Tools to support development, testing and deployment of Marketing Cloud technologies
License: Apache License 2.0
In my project we are using repo script for creating our demo/test content package.
We often prepare content on local author instance and then use ./repo get -f <content_path> and then we commit the content in the repository. However repo get will checkout all the properties even those that are not need (not desirable) like jcr:created, jcr:createdBy etc.
Cleaning process before commit is tedious that is why we have updated version of repo script that removes those props when you use new -c parameter.
I could prepare PR with such change to repo script if this is something desirable. Please let me know.
Hi Folks,
I am currently using Intellij Ultimate Edition 20.2.2 on Windows 10. I am using Cygwin version 3.2.0 and I have installed zip,unzip,rsync,curl packages.
Windows users are facing a serious obstacle before making this tool work on their machine, the user is unable to delete the files and edit them.
I think the problem is with the cygwin ,due to permissions for the files being created.
I have attached the screen shot of the issue user is facing. Please find more about the issue here.
https://blog.dhampir.no/content/forcing-cygwin-to-create-sane-permissions-on-windows
The solution is to change one line in
C:\cygwin64\etc\fstab
adding noacl to the below statement.
none /cygdrive cygdrive binary,noacl,posix=0,user 0 0
Could you please do something to overcome the issue, as not everyone has enough time and patience to fix this manually.
Thanks in advance,
Vara Prasad
Hello.
Following this topic: #25
I've downloaded repoWin.ps1 and every needed script.
But when i try to download jcr content i got the error curl: (3) URL using bad/illegal format or missing URL
Here is the full output:
PS C:\Users\Kryuko\Progetti\Java\6.5\6.5\test\aem-guides-wknd\ui.content\src\main\content\jcr_root> C:\repo\repoWin.ps1 get .\content\dam\wknd\ -u "http://localhost/:4502" downloading /content/dam/wknd/* from http://localhost:4502 curl: (3) URL using bad/illegal format or missing URL repo: failed to upload package:
Of course my repoWin.ps1 is in C:\repo\
I tried even without repoWin.ps1, using directly bash from wsl and using a manual path, and i got the same error.
Thank you in advance.
Hi everyone
I just used the damsync.sh (https://github.com/Adobe-Marketing-Cloud/tools/blob/master/cq/damsync/damsync.sh) as a working reference for a correctly-structured HTTP POST request for DAM asset upload.
Problem is, files are uploaded and shown into CRX, but the DAM interface is broken!
I'm trying to setup repo tool with IntelliJ on Windows 10, but I'm getting next error:
Error running 'put': Cannot run program "C:\Program Files (x86)\tools-repo-v1.3\repo\repo" (in directory "C:\development\customers\testi\workspace\my-project"): CreateProcess error=193, %1 is not a valid Win32 application
I have install cygwin with zip, unzip, curl, rsync packages
And here is picture with my intellj setup link
Hi,
It would be nice to have the possibility to create the required local directory when geting a new jcr content that does not yet exist locally. Maybe an option like 'repo checkout <jcr_path>.
This would enable 'cherry picking' of any content without having to rely on a first checkout.
Thx in advance
Christophe
Hello, I'd like to be able to run repo using git bash (cygwin cause trouble in my computer, I prefer to not depend on him)
I've installed zip, unzip, rsync and curl using chocolately on windows and I can use all of them correctly inside git bash
When trying to do checkout, I receive this error:
download and overwrite locally? (y/n): y
The source and destination cannot both be remote.
rsync error: syntax or usage error (code 1) at main.c(1420) [Receiver=3.2.3]
(Because internal policy reason, I cannot post here the entire log, hope you could understand)
Environment:
Windows 10, cygwin64 terminal (with zip, unzip, rsync), localhost:4502 (admin:admin)
repo checkout /apps/foldername
through error
repo: does not exists: /apps/foldername
Repo also works with Netbeans if you install the "External commands" plugin. https://github.com/tristanjl/netbeans-externalcommands
Instructions:
which repo, you will need the full path more than likely, this is referenced as [REPO] where [REPO] will be something like /usr/local/bin/repo for example.Current status and diff do not work because they do not have the working directory set to the project root before the command is run. This would require extra work to support (but not impossible.)
You can also map these commands to shortcuts from Preferences > Keymap. The commands are generically listed as "Command 1", "Command 2", etc.
The issue summary might need to be re-qualified depending on investigation.
The current hypothesis I have is that there are troubles syncing (possibly in both ways) special JCR paths like /oak:index that are escaped by VLT. It seems to be related to #5
+ VERSION=1.5-beta
+ server=http://localhost:4502
+ credentials=admin:admin
+ force=false
+ quiet=false
+ packmgr=/crx/packmgr/service/.json
+ packageGroup=tmp/repo
++ basename /Users/kitarek/bin/repo
+ readonly PROGNAME=repo
+ PROGNAME=repo
+ trap 'cleanup 130' SIGINT SIGTERM SIGHUP SIGQUIT
+ '[' 1 -eq 0 ']'
+ [[ --version == \-\h ]]
+ [[ --version == \-\-\h\e\l\p ]]
+ [[ --version == \h\e\l\p ]]
+ [[ --version == \-\v\e\r\s\i\o\n ]]
+ [[ --version == \-\-\v\e\r\s\i\o\n ]]
+ echo 'repo version 1.5-beta'
repo version 1.5-beta
+ exit
set -x line to repo tool to see debug logs for bashmkdir repo-oak-indexcd repo-oak-index/repo checkout '/oak:index'repo checkout '/apps' works correctly so in general the problem is not related to local environment.The output of 3. is:
+ server=http://localhost:4502
+ credentials=admin:admin
+ force=false
+ quiet=false
+ packmgr=/crx/packmgr/service/.json
+ packageGroup=tmp/repo
++ basename /Users/kitarek/bin/repo
+ readonly PROGNAME=repo
+ PROGNAME=repo
+ trap 'cleanup 130' SIGINT SIGTERM SIGHUP SIGQUIT
+ '[' 2 -eq 0 ']'
+ [[ checkout == \-\h ]]
+ [[ checkout == \-\-\h\e\l\p ]]
+ [[ checkout == \h\e\l\p ]]
+ [[ checkout == \-\v\e\r\s\i\o\n ]]
+ [[ checkout == \-\-\v\e\r\s\i\o\n ]]
+ '[' -t 1 ']'
+ isatty=true
+ action=checkout
+ shift
+ '[' checkout == st ']'
+ [[ checkout == \c\h\e\c\k\o\u\t ]]
+ [[ 1 -eq 0 ]]
+ path=/Users/kitarek/repo-oak-index
+ '[' 1 -gt 0 ']'
+ [[ /oak:index == --* ]]
+ [[ /oak:index == -* ]]
+ path=/oak:index
+ shift
+ '[' 0 -gt 0 ']'
+ '[' checkout == checkout ']'
+ filter=/oak:index
+ [[ /Users/kitarek/repo-oak-index == */jcr_root* ]]
+ '[' -e jcr_root ']'
+ mkdir jcr_root
+ rootpath=/Users/kitarek/repo-oak-index/jcr_root
+ echo 'checking out into new /Users/kitarek/repo-oak-index/jcr_root'
checking out into new /Users/kitarek/repo-oak-index/jcr_root
+ echo
+ path=/Users/kitarek/repo-oak-index/jcr_root/oak:index
+ mkdir -p /Users/kitarek/repo-oak-index/jcr_root/oak:index
+ action=get
+ [[ /oak:index == '' ]]
+ [[ /oak:index == \/ ]]
+ fromVlt=false
++ find_up /Users/kitarek/repo-oak-index .repo
+++ abspath /Users/kitarek/repo-oak-index
+++ '[' -d /Users/kitarek/repo-oak-index ']'
++++ cd /Users/kitarek/repo-oak-index
++++ pwd
+++ echo /Users/kitarek/repo-oak-index
++ dir=/Users/kitarek/repo-oak-index
++ '[' -n /Users/kitarek/repo-oak-index ']'
++ '[' -e /Users/kitarek/repo-oak-index/.repo ']'
++ dir=/Users/kitarek
++ '[' -n /Users/kitarek ']'
++ '[' -e /Users/kitarek/.repo ']'
++ dir=/Users
++ '[' -n /Users ']'
++ '[' -e /Users/.repo ']'
++ dir=
++ '[' -n '' ']'
+ repoCfg=
+ '[' -f '' ']'
+ '[' -f /Users/kitarek/repo-oak-index/jcr_root/.vlt ']'
+ server=http://localhost:4502
+ credentials=admin:admin
+ force=false
+ quiet=false
+ false
+ verbose=true
+ inverseDiff=false
+ '[' get == localdiff ']'
+ '[' get == serverdiff ']'
+ false
+ pathDirname=/Users/kitarek/repo-oak-index/jcr_root
+ filterDirname=
+ pathBasename=oak:index
+ filterBasename=oak:index
+ '[' -d /Users/kitarek/repo-oak-index/jcr_root/oak:index ']'
+ humanFilter='/oak:index/*'
+ '[' get == put ']'
+ '[' get == get ']'
+ print 'downloading /oak:index/* from http://localhost:4502'
+ true
+ echo 'downloading /oak:index/* from http://localhost:4502'
downloading /oak:index/* from http://localhost:4502
+ packageName=-oak:index
+ packageName=repo-oakindex
++ date +%s
+ packageVersion=1519992982
++ mktemp -d -t repo.XXX
+ tmpDir=/var/folders/lg/v9sb730x7hx5x9nlnmsc8cx00000gn/T/repo.XXX.4xhFPNrs
+ excludes=/var/folders/lg/v9sb730x7hx5x9nlnmsc8cx00000gn/T/repo.XXX.4xhFPNrs/.excludes
+ write_excludes /var/folders/lg/v9sb730x7hx5x9nlnmsc8cx00000gn/T/repo.XXX.4xhFPNrs/.excludes
+ cat
+ cat /Users/kitarek/repo-oak-index/jcr_root/.vltignore
+ cat /Users/kitarek/repo-oak-index/jcr_root/.repoignore
++ find /Users/kitarek/repo-oak-index/jcr_root/oak:index -name .vltignore
+ create_pkg_meta_inf /var/folders/lg/v9sb730x7hx5x9nlnmsc8cx00000gn/T/repo.XXX.4xhFPNrs /oak:index tmp/repo repo-oakindex 1519992982
+ local base=/var/folders/lg/v9sb730x7hx5x9nlnmsc8cx00000gn/T/repo.XXX.4xhFPNrs
++ filesystem_to_jcr /oak:index
++ local filter=/oak:index
++ filter=/oak:index
++ filter=/oak:index
++ filter=/oak:index
++ filter=/oak:index
++ filter=/oak:index
++ filter=/oak:index
++ filter=/oak:index
++ filter=/oak:index
++ filter=/oak:index
++ filter=/oak:index
++ filter=/oak:index
+++ urldecode /oak:index
+++ printf %b /oak:index
++ filter=/oak:index
++ echo /oak:index
+ local filter=/oak:index
+ local pkgGroup=tmp/repo
+ local pkgName=repo-oakindex
+ local pkgVersion=1519992982
+ mkdir -p /var/folders/lg/v9sb730x7hx5x9nlnmsc8cx00000gn/T/repo.XXX.4xhFPNrs/META-INF/vault
+ mkdir -p /var/folders/lg/v9sb730x7hx5x9nlnmsc8cx00000gn/T/repo.XXX.4xhFPNrs/jcr_root
+ cat
++ to_xml /oak:index
++ local name=/oak:index
++ name=/oak:index
++ name=/oak:index
++ name=/oak:index
++ name=/oak:index
++ name=/oak:index
++ echo /oak:index
+ cat
++ to_xml repo-oakindex
++ local name=repo-oakindex
++ name=repo-oakindex
++ name=repo-oakindex
++ name=repo-oakindex
++ name=repo-oakindex
++ name=repo-oakindex
++ echo repo-oakindex
++ to_xml 1519992982
++ local name=1519992982
++ name=1519992982
++ name=1519992982
++ name=1519992982
++ name=1519992982
++ name=1519992982
++ echo 1519992982
++ to_xml tmp/repo
++ local name=tmp/repo
++ name=tmp/repo
++ name=tmp/repo
++ name=tmp/repo
++ name=tmp/repo
++ name=tmp/repo
++ echo tmp/repo
+ pkg=tmp/repo/repo-oakindex-1519992982.zip
+ '[' get == put ']'
+ [[ get == \g\e\t ]]
+ build_zip /var/folders/lg/v9sb730x7hx5x9nlnmsc8cx00000gn/T/repo.XXX.4xhFPNrs
+ pushd /var/folders/lg/v9sb730x7hx5x9nlnmsc8cx00000gn/T/repo.XXX.4xhFPNrs
+ zip -q -r pkg.zip .
+ popd
+ zipfile=/var/folders/lg/v9sb730x7hx5x9nlnmsc8cx00000gn/T/repo.XXX.4xhFPNrs/pkg.zip
+ upload_pkg /var/folders/lg/v9sb730x7hx5x9nlnmsc8cx00000gn/T/repo.XXX.4xhFPNrs/pkg.zip
+ pkg_mgr_http upload '-F package=@/var/folders/lg/v9sb730x7hx5x9nlnmsc8cx00000gn/T/repo.XXX.4xhFPNrs/pkg.zip -F force=true http://localhost:4502/crx/packmgr/service/.json?cmd=upload'
++ curl_http '-F package=@/var/folders/lg/v9sb730x7hx5x9nlnmsc8cx00000gn/T/repo.XXX.4xhFPNrs/pkg.zip -F force=true http://localhost:4502/crx/packmgr/service/.json?cmd=upload'
++ curl -u admin:admin -f -s -S -F package=@/var/folders/lg/v9sb730x7hx5x9nlnmsc8cx00000gn/T/repo.XXX.4xhFPNrs/pkg.zip -F force=true 'http://localhost:4502/crx/packmgr/service/.json?cmd=upload'
+ out='{"success":true,"msg":"Package uploaded","path":"/etc/packages/tmp/repo/repo-oakindex-1519992982.zip"}'
+ [[ {"success":true,"msg":"Package uploaded","path":"/etc/packages/tmp/repo/repo-oakindex-1519992982.zip"} != *\"success\":true* ]]
+ build_pkg tmp/repo/repo-oakindex-1519992982.zip
+ pkg_mgr_http build '-X POST http://localhost:4502/crx/packmgr/service/.json/etc/packages/tmp/repo/repo-oakindex-1519992982.zip?cmd=build'
++ curl_http '-X POST http://localhost:4502/crx/packmgr/service/.json/etc/packages/tmp/repo/repo-oakindex-1519992982.zip?cmd=build'
++ curl -u admin:admin -f -s -S -X POST 'http://localhost:4502/crx/packmgr/service/.json/etc/packages/tmp/repo/repo-oakindex-1519992982.zip?cmd=build'
+ out='{"success":true,"msg":"Package built"}'
+ [[ {"success":true,"msg":"Package built"} != *\"success\":true* ]]
+ rm -rf /var/folders/lg/v9sb730x7hx5x9nlnmsc8cx00000gn/T/repo.XXX.4xhFPNrs/META-INF /var/folders/lg/v9sb730x7hx5x9nlnmsc8cx00000gn/T/repo.XXX.4xhFPNrs/jcr_root /var/folders/lg/v9sb730x7hx5x9nlnmsc8cx00000gn/T/repo.XXX.4xhFPNrs/pkg.zip
+ download_pkg tmp/repo/repo-oakindex-1519992982.zip /var/folders/lg/v9sb730x7hx5x9nlnmsc8cx00000gn/T/repo.XXX.4xhFPNrs/pkg.zip
+ curl_http '-o /var/folders/lg/v9sb730x7hx5x9nlnmsc8cx00000gn/T/repo.XXX.4xhFPNrs/pkg.zip http://localhost:4502/etc/packages/tmp/repo/repo-oakindex-1519992982.zip'
+ curl -u admin:admin -f -s -S -o /var/folders/lg/v9sb730x7hx5x9nlnmsc8cx00000gn/T/repo.XXX.4xhFPNrs/pkg.zip http://localhost:4502/etc/packages/tmp/repo/repo-oakindex-1519992982.zip
+ '[' 0 -ne 0 ']'
+ delete_pkg tmp/repo/repo-oakindex-1519992982.zip
+ pkg_mgr_http build '-X POST http://localhost:4502/crx/packmgr/service/.json/etc/packages/tmp/repo/repo-oakindex-1519992982.zip?cmd=delete'
++ curl_http '-X POST http://localhost:4502/crx/packmgr/service/.json/etc/packages/tmp/repo/repo-oakindex-1519992982.zip?cmd=delete'
++ curl -u admin:admin -f -s -S -X POST 'http://localhost:4502/crx/packmgr/service/.json/etc/packages/tmp/repo/repo-oakindex-1519992982.zip?cmd=delete'
+ out='{"success":true,"msg":"Package deleted"}'
+ [[ {"success":true,"msg":"Package deleted"} != *\"success\":true* ]]
+ pushd /var/folders/lg/v9sb730x7hx5x9nlnmsc8cx00000gn/T/repo.XXX.4xhFPNrs
+ unzip -q pkg.zip
+ popd
+ [[ get == \d\i\f\f ]]
+ [[ get == \s\t\a\t\u\s ]]
+ '[' get == get ']'
+ true
+ unzip -l /var/folders/lg/v9sb730x7hx5x9nlnmsc8cx00000gn/T/repo.XXX.4xhFPNrs/pkg.zip
+ grep ' jcr_root/oak:index'
+ false
+ prompt 'download and overwrite locally?'
+ read -p 'download and overwrite locally? (y/n): ' -n 1 -r
download and overwrite locally? (y/n): y+ echo
+ [[ ! y =~ ^[Yy]$ ]]
+ rsync -avq --delete --exclude-from=/var/folders/lg/v9sb730x7hx5x9nlnmsc8cx00000gn/T/repo.XXX.4xhFPNrs/.excludes /var/folders/lg/v9sb730x7hx5x9nlnmsc8cx00000gn/T/repo.XXX.4xhFPNrs/jcr_root//oak:index /Users/kitarek/repo-oak-index/jcr_root
rsync: link_stat "/var/folders/lg/v9sb730x7hx5x9nlnmsc8cx00000gn/T/repo.XXX.4xhFPNrs/jcr_root//oak:index" failed: No such file or directory (2)
rsync error: some files could not be transferred (code 23) at /BuildRoot/Library/Caches/com.apple.xbs/Sources/rsync/rsync-52/rsync/main.c(996) [sender=2.6.9]
+ true
+ git rev-parse --git-dir
+ true
+ [[ -n '' ]]
+ [[ -n '' ]]
+ cleanup
+ '[' -d /var/folders/lg/v9sb730x7hx5x9nlnmsc8cx00000gn/T/repo.XXX.4xhFPNrs ']'
+ rm -rf /var/folders/lg/v9sb730x7hx5x9nlnmsc8cx00000gn/T/repo.XXX.4xhFPNrs
+ exit
> find . -type f
> find . -type d
.
./jcr_root
./jcr_root/oak:index
rsync version 2.6.9 protocol version 29
Copyright (C) 1996-2006 by Andrew Tridgell, Wayne Davison, and others.
<http://rsync.samba.org/>
Capabilities: 64-bit files, socketpairs, hard links, symlinks, batchfiles,
inplace, IPv6, 64-bit system inums, 64-bit internal inums
rsync comes with ABSOLUTELY NO WARRANTY. This is free software, and you
are welcome to redistribute it under certain conditions. See the GNU
General Public Licence for details.
curl 7.54.0 (x86_64-apple-darwin17.0) libcurl/7.54.0 LibreSSL/2.0.20 zlib/1.2.11 nghttp2/1.24.0
Protocols: dict file ftp ftps gopher http https imap imaps ldap ldaps pop3 pop3s rtsp smb smbs smtp smtps telnet tftp
Features: AsynchDNS IPv6 Largefile GSS-API Kerberos SPNEGO NTLM NTLM_WB SSL libz HTTP2 UnixSockets HTTPS-proxy
When I run a task like "repo put -f ${file}" I get the error:
I think this problem is related with ${file} variable that gets the path to the file in a Windows like slash style.
When I manually change it to a unix like slash style it works.
It's been quiet a while that i have started getting this repo tool error. I have tried all the ways but didn't workout on my mac. Could you please look into this and let me know if something is not right on my end. I have followed all the steps as documented.
I've tried to use repo tool with cq:dialog file but it is not working.
repo get - didn't download this file
repo diff - shows that whole file is new
repo status - shows that there is no such directory
repo put - shows that upload succeed but nothing changes in aem
However when I ran repo get on folder above it downloaded whole catalog with _cq_dialog inside.
tested with aem 6.1 and repo 1.2.
Hi,
having a grunt task with all options as grunt options would be great.
right now i use grunt-shell to execute it, but it's more fragile
I have followed the instructions on https://github.com/Adobe-Marketing-Cloud/tools/tree/master/repo for installing aem repo.
but on following all the instructions I am facing this error on running repo(put).
is it the issue of not having the repo path? but how to do it? I installed the aem repo by using homebrew commands:
brew tap adobe-marketing-cloud/brews
brew install adobe-marketing-cloud/brews/repo
please help
OS : Mac OS Bigsur, Apple silicon
I'm trying to use repo with intellij but the path is wrong.
This is what I have so far:
The output for one of the tasks is:
repo: not inside a vault checkout with a jcr_root base directory: /home/phoenix/C:\MyProject\packages\my-application\src\main\content\jcr_root\apps\myapp\components\authoring\hero\clientlibs\js.txt
I don't understand why is adding /home/phoenix/ to the path.
Hello I am trying to set repo tool for intellij in windows
I've downloaded the repo file and installed cygwin and placed at C:\cygwin64 folder.
When i am running command getting below error.
C:\cygwin64\bin\bash.exe -l C:/Users/myfol/Installer/tools-repo-1.4/tools-repo-1.4/repo/repo st C:\Users\myfol\workspace\my-site\ui.apps\src\main\content\jcr_root\apps\my-sitel\components\button
C:/Users/myfol/Installer/tools-repo-1.4/tools-repo-1.4/repo/repo: line 381: zip: command not found
curl: (26) couldn't open file "/tmp/repo.VR1/pkg.zip"
repo: failed to upload package:
Process finished with exit code 5
Here is the configuration in Intellij
Program : C:\cygwin64\bin\bash.exe
Argument : -l C:/Users/myfol/Installer/tools-repo-1.4/tools-repo-1.4/repo/repo st "$FilePath$"
Hello,
I've installed Cygwin in my windows, can anyone let me know how to install Repo manually. I've already configured ae
m project in vs code. I'm new to this process so guide me with your thoughts
I'm running IntelliJ IDEA 2020.1.2 (Community Edition), Build #IC-201.7846.76 on Windows 10.
Following these instructions and this tutorial, I've installed Cygwin v3.1.6 and package zip v3.0-12. I setup repo in External Tools in IntelliJ as recommended in the docs. So, for example, I have a "Repo (status)" setting with Program path: 'C:\cygwin64\bin\bash', Arguments: '-l repo st
curl: (26) couldn't open file "/tmp/repo.iSl/pkg.zip"
repo: failed to upload package:
Process finished with exit code 5
Hello, I'm trying to setup this repo tool in IntelliJ without any luck.
I've downloaded the repo file and is placed at C:\RepoTool\ folder.
Also installed cygwin and placed at C:\cygwin64 folder.
I've included the folder C:\cygwin64 into the PATH environment variable.
Configured the different tools like the tutorial said.
But when I try to run the tool it throws
C:\cygwin64\bin\bash.exe -l repo get -f C:\AEM\Projects\wknd-sites-guide\ui.apps\src\main\content\jcr_root\apps\wknd\components
/usr/bin/bash: repo: No such file or directory
Process finished with exit code 127
Why is throwing that error?
React
A declarative, efficient, and flexible JavaScript library for building user interfaces.
🖖 Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.
Typescript
TypeScript is a superset of JavaScript that compiles to clean JavaScript output.
An Open Source Machine Learning Framework for Everyone
Django
The Web framework for perfectionists with deadlines.
Laravel
A PHP framework for web artisans
Bring data to life with SVG, Canvas and HTML. 📊📈🎉
JavaScript (JS) is a lightweight interpreted programming language with first-class functions.
Some thing interesting about web. New door for the world.
A server is a program made to process requests and deliver data to clients.
Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.
Some thing interesting about visualization, use data art
Some thing interesting about game, make everyone happy.
Facebook
We are working to build community through open source technology. NB: members must have two-factor auth.
Microsoft
Open source projects and samples from Microsoft.
Google
Google ❤️ Open Source for everyone.
Alibaba
Alibaba Open Source for everyone
D3
Data-Driven Documents codes.
Tencent
China tencent open source team.