Your browser does not seem to support JavaScript. As a result, your viewing experience will be diminished, and you may not be able to execute some actions.

Please download a browser that supports JavaScript, or enable it if it's disabled (i.e. NoScript).

docker command substitution fails on gitlab

Avante

I am trying to run the following command as part of a deployment in Gitlab.

TIMESTAMP=$(date +%s) docker stack deploy --with-registry-auth --compose-file $(`printf "docker-compose.%s.unimark.yaml" "$SRV_DEPLOY_ENV"`) unimark`

I am getting the following error. I am not sure what is going wrong here.

/bin/sh: eval: line 332: docker-compose.demo.unimark.yaml: not found
"docker stack deploy" requires exactly 1 argument.
See 'docker stack deploy --help'.
Usage:  docker stack deploy [OPTIONS] STACK
Deploy a new stack or update an existing stack

I also tried

DOCKER_COMPOSE_DEPLOY_FILE=`printf "docker-compose.%s.unimark.yaml" "$SRV_DEPLOY_ENV"`
TIMESTAMP=$(date +%s) docker stack deploy --with-registry-auth --compose-file $($DOCKER_COMPOSE_DEPLOY_FILE) unimark`

the same error saying docker-compose file cannot be found. I checked and the file is there in the same directory. Not sure if it has to do with some bash vs sh issue.

emmalee last edited by
I think this is a problem with https://wiki.bash-hackers.org/syntax/expansion/cmdsubst .
```
$(`printf "docker-compose.%s.unimark.yaml" "$SRV_DEPLOY_ENV"`)
```
or
```
DOCKER_COMPOSE_DEPLOY_FILE=`printf "docker-compose.%s.unimark.yaml" 
"$SRV_DEPLOY_ENV"`
$($DOCKER_COMPOSE_DEPLOY_FILE)
```
To bash is interpreted the same: please execute the command that is the result of this nested command.

Removing the backtick in the first instance or removing the parenthesis in the second one should do the trick.
Reply Quote 0
1 Reply Last reply

2
Posts

0
Views

Suggested Topics

Searching the parent teg inside the file via the subcontract of the bash.
Software Programming • xml bash sed grep • • Alberto

2

0
Votes

2
Posts

0
Views

First, processing xml by text means is pain.Secondly, in the example given, it is indeed not an appropriate xml document: XML allows only one root element, i.e. it will be correct to record it somehow:<?xml version="1.0" encoding="windows-1251"?> <operation_list> <operation id="73583876586">  </operation> <operation id="73584313194">  <payment_info> <payment_item type="points" amount="4000.0"/> </payment_info> </operation> </operation_list> This can be done, for example sedHmm:sed -i "$(echo -e '1a<operation_list>\n$a</operation_list>')" foo.xml It can then be processed by specialized xml-utilits, for example xpath:xpath -e '//operation[*/payment_item]' foo.xml xmllint It is also applicable in this regard, but worse so that it will not be able to override some other minor mistakes, such as the fact that the space of the name is commons not defined. Pro xmlstarlet I can't say anything because I didn't use the other... I can also advise you to process the xml'i to go to something bigger than bash's from a series of perlo-pho-piton.
How to create network connection into docker stack?
Continuous Integration and Delivery (CI, CD) • docker docker compose • • jeanid

2

0
Votes

2
Posts

1
Views

S

First of all, thanks for the drawing so I understand what you are trying. The next step is, when you are working with Docker Swarm all your stacks/services can hit the external networks like Redis, SQL and S3 storage so that is nothing you need to take care of. When you want traffic inside your cluster you need a proxy in the front, I personally are using NGINX as proxy layer and then you need to create a upstream with a stack of IP's to your Docker Swarm Manager nodes, never sending it to your workers. Docker Swarm working the way you are sending traffic to a single port number eg. 9000 and this port 9000 is binding to your stack/services on port 80 or what you are needed. Every single replicate will now running on port 9000 for externel traffic from the managers and into your cluster. Besure you are deploying your stacks only for worker nodes except if its controller software you needed, else you can get a unstable cluster based on my own expires. If your Redis and SQL running in the cluster (i hope not) but if you want it, you can setup a network for thoes stacks and the add the network internel into your orther stacks, but i will recommend to keep Redis, SQL and somthing like that on the own servers So the following up on my description here is you need the following. HTTP / HTTPS Proxy to route traffic into a custom port eg. 9000 for your Docker Swarm Managers Expose a port eg. 9000 to your service port eg. 80 Setup connection inside the service to use the external Redis and SQL Thats it, hope i have explain it good enough else you can just ask
A

Reuse of docker swarm containers for batch jobs
Continuous Integration and Delivery (CI, CD) • docker • • Amritpal

2

0
Votes

2
Posts

1
Views

Correct me if I am wrong, but that is one of the reasons why docker orchestration tools exists like docker-swarm to be able to deploy multiple docker containers by using one command line. Create a service with 5 replica tasks (–replicas) Use the --replicas flag to set the number of replica tasks for a replicated service. The following command creates a redis service with 5 replica tasks: $ docker service create --name redis --replicas=5 redis:3.0.6 4cdgfyky7ozwh3htjfw0d12qv If for example 1000 identical containers that use a different environment variable have to be deployed, multiple docker service create could be added to a script, instead of copy-paste multiple times in one docker-compose file.
How do I make read only mount in Docker container writable?
Continuous Integration and Delivery (CI, CD) • docker testing • • jeanid

2

0
Votes

2
Posts

1
Views

Solution to this problem is to create an overlay filesytem over a read-only mount, but if you try to do it directly, overlay will refuse to put upper and work directories on another overlay filesystem. The trick is to create a tmpfs for the upper and work directories like this: Create a script called run-in-c.sh #!/bin/bash NAME=$1 shift HOSTNAME=dock${NAME} CONTAINER=dc-${USER}-${NAME} REPOSITORY=${HOME}/repository BASEIMAGE=hub.docker.io/my-org/my-base-container OVERLAY=/mnt/overlay LOWERDIR=/mnt/lower UPPERDIR=${OVERLAY}/upper WORKDIR=${OVERLAY}/work TARGET=/mnt/repository # PRIVILEGED="--privileged" PRIVILEGED="--cap-add SYS_ADMIN" docker container create --name $CONTAINER $PRIVILEGED --hostname $HOSTNAME --volume ${CO}:${LOWERDIR}:ro $BASEIMAGE docker container start $CONTAINER docker container exec $CONTAINER mkdir -p $OVERLAY docker container exec $CONTAINER mount -t tmpfs tmpfs $OVERLAY docker container exec $CONTAINER mkdir -p $WORKDIR $UPPERDIR $TARGET docker container exec $CONTAINER mount -t overlay overlay -o lowerdir=${LOWERDIR},upperdir=${UPPERDIR},workdir=${WORKDIR} $TARGET docker container exec -it --workdir $TARGET $CONTAINER $* docker container stop $CONTAINER docker container rm $CONTAINER Then you can run commands in the container as: run-in-c.sh test01 'cd dir && command args' or simply get interactive shell with: run-in-c.sh naming-stuff-is-too-hard bash
O

Little makefile
Software Programming • linux bash cmake makefile • • Oba22

2

0
Votes

2
Posts

0
Views

B

I think the simplest and most primitive option.LIBS_PATH = -L/usr/local/lib -L/usr/lib LIBS = -lopencv_imgproc -lopencv_highgui -lmpi -lopa -lmpl -lrt -lcr -lpthread -lboost_filesystem -lboost_system -lopencv_core INCLUDE_PATH = -I/usr/local/include/opencv -I/usr/lib/mpich2/include/ FLAGS = -g -O2 main: http://main.cu nvcc $(INCLUDE_PATH) $(FLAGS) -o $@ $^ $(LIBS_PATH) $(LIBS)
A

Docker build from gitlab pipeline
Continuous Integration and Delivery (CI, CD) • docker gitlab gitlab ci runner • • authera

2

0
Votes

2
Posts

0
Views

E

I think that you forgot '.'(dot) docker build -f $DOCKERFILE_BUILD . (In my case) Even with this command, I got the error ...
How can I call a function in Bash and pass parameters?
Software Programming • functions bash shell sc languageript • • Analeea

2

0
Votes

2
Posts

0
Views

A

In Bash there is no return to use as we know it in other languages. As the idea that subdues is that https://es.stackoverflow.com/a/194550/83 What we do is Tell him to tell him What's out. Hence in the functions we return things with an "echo" or "printf" or whatever returns to stdout.So, to call dimeNombre and collect your result, you must execute the command and save it in a variable:resultado=$(dimeNombre) echo "dimeNombre ha devuelto $resultado" Another example:We define the function dime_nombre:function dime_nombre { echo "23" } We call it:$ dime_nombre 23 We call it and save it in a variable:$ res=$(dime_nombre) $ echo "$res" 23
How to automatically update Docker containers in development?
Continuous Integration and Delivery (CI, CD) • docker docker compose dockerfile • • Bogopo

2

0
Votes

2
Posts

1
Views

T

An approach I use in both prod and dev is to run a webhook server ( this one is excellent https://github.com/adnanh/webhook ) which is subscribed to listen to the github.com git push events which are published by github ... then when someone does a push to github.com the webhook launches a rebuild script to issue git pull then recomple the code and issue docker build xxx and docker push yyy and docker-compose -f my-file-docker-compose.yaml up ... this all happens on auto pilot ... where I have a running webhook server on a vps box for a given git branch to rebuild its toy domain this took time to craft however its a life saver
K

Upload busybox to router ftp
Software Programming • linux ubuntu security bash assembly • • kalyn

2

0
Votes

2
Posts

0
Views

B

Assuming the system is OpenWrt, can be performed following a series of steps.To log in from the console is done with the following command:ssh root@192.168.1.1 It can be simplified without mentioning root:ssh 192.168.1.1 In addition, you have to choose the ip the router, it's not always 1.1, also, depending on the configuration, can be 2.1or someone else.After this, you can install busybox using the command opkg:opkg install busybox You have to keep in mind that the latest version Busybox, lost some interesting features regarding its previous version, for example, that sleep can't use milliseconds:busybox sleep 0.1 sleep: invalid number '0.1' An alternative way to get Busybox from the inside is to install sshfs:opkg install sshfs If the installation by the dependencies fails, the parameter can be used --force-depends, this is one of the ways to solve it:opkg install sshfs --force-depends Also, it may not be installed due to lack of space.Units sshfs, they can be like these:ldd /usr/bin/sshfs # sshfs-3.7.2-x86_64-1 linux-vdso.so.1 (0x00007ffd51d1b000) libfuse3.so.3 => /usr/lib64/libfuse3.so.3 (0x00007f54cb386000) libpthread.so.0 => /lib64/libpthread.so.0 (0x00007f54cb365000) libglib-2.0.so.0 => /usr/lib64/libglib-2.0.so.0 (0x00007f54cb231000) libc.so.6 => /lib64/libc.so.6 (0x00007f54cb051000) libdl.so.2 => /lib64/libdl.so.2 (0x00007f54cb04c000) /lib64/ld-linux-x86-64.so.2 (0x00007f54cb3c7000) libpcre.so.1 => /lib64/libpcre.so.1 (0x00007f54cafd4000) To install files when the router does not have programs that can download from the internet, as is wget, you can convert the bytes of the files to hexadecimal values, using the command xxd, being out of SSH:xxd -p /usr/bin/sshfs | tr -d '\n' > ./sshfs.txt Also, this operation can be reversed, making those hexadecimal values to bytes:xxd -r -p ./sshfs.txt /usr/bin/sshfs This can serve to save the file from a terminal that allows to paste plain text... For large files it may take long, because inserting long text strings into the console can bring problems with the rendering.So, to paste the text into the window terminal, like for example lxterminal being inside SSHIt's done like this:echo 7f454c460201010000... > /usr/bin/sshfs Note: The three puntits are not real, this means they follow him thousands of hexadecl characters.Finally, give the execution permits to the executable program:chmod +x /usr/bin/sshfs Then you have to do these same steps with every unit that is missing, fortunately, this program does not have many missing units, the only one is the library libfuse3.so.3.First convert to hexadecimal:xxd -p /usr/lib64/libfuse3.so.3 | tr -d '\n' > ./libfuse3.so.3.txt Having then saved the text, as previously done, copy the values from an external text editor and paste them into the terminal inside SSH:echo 7f454c460201010000... > ./usr/lib64/libfuse3.so.3 Once this was done, the installation of SSHFS... This serves to access the folders on the computer.For this, the router is accessed again, but with the parameter -R:ssh 192.168.1.1 -R 10000:localhost:22 Occasionally, the 1.1 can be another, like 2.1depending on how it is configured.Then, the SSHFS is used to mount the disk folder, to the local folder:mkdir ./local sshfs -p 10000 root@127.0.0.1:~/disco ./local In the folder disco is the Busybox before entering the router.Note: The username is not necessarily always rootTo see the list of users, you can do the following.> cat /etc/shadow root::0:0:99999:7::: daemon::0:0:99999:7::: ftp::0:0:99999:7::: network::0:0:99999:7::: nobody:*:0:0:99999:7::: ntp:x:0:0:99999:7::: dnsmasq:x:0:0:99999:7::: logd:x:0:0:99999:7::: ubus:x:0:0:99999:7::: With this, being inside SSH, you can already copy Busybox accessing disk files:cp ./local/busybox /usr/bin/busybox The path of copying is to personal choice, can be /bin or someone else that's in it $PATH.Documentation OpenWrt: https://openwrt.org/docs/guide-quick-start/sshadministration https://openwrt.org/docs/guide-user/additional-software/managing_packages https://openwrt.org/faq/cannot_satisfy_dependencies
C

How/where are programs installed in Docker containers?
Continuous Integration and Delivery (CI, CD) • docker • • courtlanda

2

0
Votes

2
Posts

1
Views

A

Hi and welcome to DevOps SE and Docker! Now the concept of Docker is to create isolated virtual environments, actually it's just a process or more but wrapped in its own environment. So at first hand you could take any Docker image and the scripts inside would be there where the creators of the image placed them. If you decide to create your own Docker images, and I believe you will sooner or later, then it is up to you how layout the system. Additionally, you could link - proper term is here mount - your system's folders with those of the container but still the execution will take place inside the container. For example to install the RStudio package in an Anaconda3 environment, I have tried the following. $ docker run -it continuumio/anaconda3 bash (base) root@7162c3acc9e3:/# conda install -y -c r rstudio (base) root@7162c3acc9e3:/# which rstudio (base) root@7162c3acc9e3:/# /opt/conda/bin/rstudio As you can see, if installed as root user which is default, the path is /opt/conda/bin/rstudio. Most packages not using special system capabilities would considerably not "know" whether they are in a Docker environment or not, so in many cases you could consider a Docker container to be just a (fluid) environment you have the root access too. Additional note on the terms: image is a blueprint for a container defined by a Dockerfile. "Installing" something in an image means you add instructions to its Dockerfile. Own images can be derived from others by the statment FROM. container is basically process isolation in its own OS environment. If you install something in the container during its uptime, this change will be gone with the container.
P

Process Order
Software Programming • bash • • Pearlaqua

2

0
Votes

2
Posts

0
Views

O

Linux flock(1) with process substitution can be executed in series.subst.sh#!/bin/bash diff <(ps -e) <(ps -e) Process trace $ strace -tt -e execve -f ./subst.sh 2>&1 | grep -E 'execve("/bin/ps"|exited with 0' [pid 28373] 11:46:32.822097 execve("/bin/ps", ["ps", "-e"], [/* 64 vars /]) = 0 [pid 28375] 11:46:32.830374 execve("/bin/ps", ["ps", "-e"], [/ 64 vars */]) = 0 [pid 28373] 11:46:33.076616 +++ exited with 0 +++ [pid 28375] 11:46:33.099348 +++ exited with 0 +++ subst_with_flock.sh#!/bin/bash lock=$0 diff <(flock "$lock" ps -e) <(flock "$lock" ps -e) Process trace $ strace -tt -e execve -f ./subst_with_flock.sh 2>&1 | grep -E 'execve("/bin/ps"|exited with 0' [pid 28404] 11:47:51.611734 execve("/bin/ps", ["ps", "-e"], [/* 64 vars /]) = 0 [pid 28404] 11:47:51.791915 +++ exited with 0 +++ [pid 28405] 11:47:51.796736 execve("/bin/ps", ["ps", "-e"], [/ 64 vars */]) = 0 [pid 28405] 11:47:51.966822 +++ exited with 0 +++ However, the execution order is irregular.date.sh#!/bin/bash lock=$0 cat <(flock "$lock" date +'1 %M:%S.%N') <(flock "$lock" date +'2 %M:%S.%N') <(flock "$lock" date +'3 %M:%S.%N') <(flock "$lock" date +'4 %M:%S.%N') <(flock "$lock" date +'5 %M:%S.%N') Process trace $ strace -tt -e execve -f ./date.sh 2>&1 >trace | grep -E 'execve("/bin/date"|exited with 0' [pid 30031] 12:37:12.780454 execve("/bin/date", ["date", "+4 %M:%S.%N"], [/* 64 vars /]) = 0 [pid 30031] 12:37:12.793103 +++ exited with 0 +++ [pid 30034] 12:37:12.798596 execve("/bin/date", ["date", "+3 %M:%S.%N"], [/ 64 vars /]) = 0 [pid 30034] 12:37:12.803944 +++ exited with 0 +++ [pid 30035] 12:37:12.811373 execve("/bin/date", ["date", "+2 %M:%S.%N"], [/ 64 vars /]) = 0 [pid 30035] 12:37:12.819125 +++ exited with 0 +++ [pid 30036] 12:37:12.824015 execve("/bin/date", ["date", "+5 %M:%S.%N"], [/ 64 vars /]) = 0 [pid 30036] 12:37:12.831424 +++ exited with 0 +++ [pid 30037] 12:37:12.836361 execve("/bin/date", ["date", "+1 %M:%S.%N"], [/ 64 vars */]) = 0 [pid 30037] 12:37:12.842358 +++ exited with 0 +++
M

How do you get the row number that matches?
Software Programming • linux bash shell • • magpie

2

0
Votes

2
Posts

0
Views

C

Does cat do that or not?cat doesn't know how to do that because he's not looking for matches.All this is about grep and his possibilities. It would therefore be easier to:grep -n "string_for_searching" file.txt Or in your case:grep -n 403 file.txt
M

What are the advantages of dockerizing nginx and php in different containers?
Continuous Integration and Delivery (CI, CD) • docker dockerfile • • meriah

2

0
Votes

2
Posts

1
Views

J

PHP with nginx is usually done using php-fpm which is a separate processus. Keeping the core idea of docker of one process (see end of answer for more details on this point) per container this makes sense to have the nginx process and php-fpm process in separate containers. As the communication between nginx and php-fpm arise through fastcgi the php-fpm container can also be on a separated host and this allows using a cluster of php-fpm containers behind nginx. After the wall of comment here's a little more background, docker documentation have paragraph about the idea that a container should have only one concern. The main idea of a linux container (lxc) is to run a process in an isolated namespace at the cpu and memory level, docker add on top of this an isolation at the filesystem level. The advantage is that the compromission of a process within this namespace won't allow to read memory of other processes and as such should prevent other compromission on the host. While talking about nginx and php-fpm, they work in pair but each has it's own concern, nginx will do the HTTP part, routing, headers validation, etc. and php-fpm will do the code interpretation and return the html part to nginx. While it's usual to have both together serving a single application that's not mandatory. Depending on context it may be easier to have a container including the whole stack for an application, on a developer workstation for exemple. But ideally for production use, try to keep the fewer interaction inside the container, having separated processes in the same container with supervisord brings its share of problem in term of zombie process and log handling (exemple story here for illustration purpose only). So finally I'll quote the docker page with some emphasis: While “one process per container” is frequently a good rule of thumb, it is not a hard and fast rule. Use your best judgment to keep containers as clean and modular as possible. There's no "silver bullet rule" which apply to everything, it's always a balance between the complexity within the container and the complexity orchestrating the containers themselves.
Bash "archivo.sh" error in if when extracting the output from cat to a variable and comparing it to if
Software Programming • bash shell conditions • • Laycee

2

0
Votes

2
Posts

0
Views

A

It's simple, you just have to change. camMode= sudo cat data.txt;forcamMode=$( data.txt);Apparently the output of the console cannot be determined as a string, but when reading the document in this way if it allows.
Y

$ make build DEV=true
Software Programming • bash de • • yajahira

2

0
Votes

2
Posts

0
Views

A

git clone Afteractivitywatch go to directory make Run.$ git clone --recursive https://github.com/ActivityWatch/activitywatch.git $ ls ## activitywatch ディレクトリがあるか確認 $ cd activitywatch $ make build DEV=true "Eは is displayed"build (make) the rule is not found "inThis is written in Makefile, so go to the directory where the desired Makefile exists and thenmake The command must be executed.

docker command substitution fails on gitlab

Suggested Topics

Searching the parent teg inside the file via the subcontract of the bash. Software Programming • xml bash sed grep • • Alberto

How to create network connection into docker stack? Continuous Integration and Delivery (CI, CD) • docker docker compose • • jeanid

Reuse of docker swarm containers for batch jobs Continuous Integration and Delivery (CI, CD) • docker • • Amritpal

How do I make read only mount in Docker container writable? Continuous Integration and Delivery (CI, CD) • docker testing • • jeanid

Little makefile Software Programming • linux bash cmake makefile • • Oba22

Docker build from gitlab pipeline Continuous Integration and Delivery (CI, CD) • docker gitlab gitlab ci runner • • authera

How can I call a function in Bash and pass parameters? Software Programming • functions bash shell sc languageript • • Analeea

How to automatically update Docker containers in development? Continuous Integration and Delivery (CI, CD) • docker docker compose dockerfile • • Bogopo

Upload busybox to router ftp Software Programming • linux ubuntu security bash assembly • • kalyn

How/where are programs installed in Docker containers? Continuous Integration and Delivery (CI, CD) • docker • • courtlanda

Process Order Software Programming • bash • • Pearlaqua

How do you get the row number that matches? Software Programming • linux bash shell • • magpie

What are the advantages of dockerizing nginx and php in different containers? Continuous Integration and Delivery (CI, CD) • docker dockerfile • • meriah

Bash "archivo.sh" error in if when extracting the output from cat to a variable and comparing it to if Software Programming • bash shell conditions • • Laycee

$ make build DEV=true Software Programming • bash de • • yajahira

Searching the parent teg inside the file via the subcontract of the bash.
Software Programming • xml bash sed grep • • Alberto

How to create network connection into docker stack?
Continuous Integration and Delivery (CI, CD) • docker docker compose • • jeanid

Reuse of docker swarm containers for batch jobs
Continuous Integration and Delivery (CI, CD) • docker • • Amritpal

How do I make read only mount in Docker container writable?
Continuous Integration and Delivery (CI, CD) • docker testing • • jeanid

Little makefile
Software Programming • linux bash cmake makefile • • Oba22

Docker build from gitlab pipeline
Continuous Integration and Delivery (CI, CD) • docker gitlab gitlab ci runner • • authera

How can I call a function in Bash and pass parameters?
Software Programming • functions bash shell sc languageript • • Analeea

How to automatically update Docker containers in development?
Continuous Integration and Delivery (CI, CD) • docker docker compose dockerfile • • Bogopo

Upload busybox to router ftp
Software Programming • linux ubuntu security bash assembly • • kalyn

How/where are programs installed in Docker containers?
Continuous Integration and Delivery (CI, CD) • docker • • courtlanda

Process Order
Software Programming • bash • • Pearlaqua

How do you get the row number that matches?
Software Programming • linux bash shell • • magpie

What are the advantages of dockerizing nginx and php in different containers?
Continuous Integration and Delivery (CI, CD) • docker dockerfile • • meriah

Bash "archivo.sh" error in if when extracting the output from cat to a variable and comparing it to if
Software Programming • bash shell conditions • • Laycee

$ make build DEV=true
Software Programming • bash de • • yajahira