Howdy @jps3, I propose dropping the requirement on the .pkg installer for the munki recipe since it is unnecessary (Munki can install drag-drop installers) and implies an additional requirement on the autopkg administrator to run an autopkgserver when once isn't strictly required.

I'm happy to do the work if you'd accept the PR. Let me know!

This is a pro-active issue notice. I see the errors and am checking on it.

The SketchUpPro.download.recipe is not working as intended. Setting the RELEASE_YEAR variable only effectively works (currently) if set to "2017." The current version ("2018") does not have the year in the download URL or filename, thus negating the intention of the recent changes to the recipe.

I will work out a more useful schema to handle this as soon as possible.

The current version of Kitematic (v0.17.0) is causing the CodeSignatureVerifier step to have an issue. It appears to be due to one of the bundled frameworks, "Elektron Framework.framework" for which codesign returns an error "bundle format is ambigious (could be app or framework)".

I have tried switching the download recipe from verifying requirements vs expected_authority_names as a test, but the error remains the same.

Not sure of any way to work around this, other than using -k DISABLE_CODE_SIGNATURE_VERIFICATION=1 which is not ideal.

Anyone have any experience with this kind of issue?

I keep getting the following error. however there is what looks like a valid .dmg in the cache. Some help would be greatly appreciated.

Error in local.munki.WacomIntuosProDriver: Processor: MunkiImporter: Error: creating pkginfo for /Users/bs_autopkg/Library/AutoPkg/Cache/local.munki.WacomIntuosProDriver/downloads/wacom.dmg failed: Could not find a supported installer item in /Users/bs_autopkg/Library/AutoPkg/Cache/local.munki.WacomIntuosProDriver/downloads/wacom.dmg!

The URL has changed & the file is no longer a .dmg so need to specify this.

Example of changes I made to our recipes below:

		<dict>
			<key>Processor</key>
			<string>URLTextSearcher</string>
			<key>Arguments</key>
			<dict>
				<key>url</key>
				<string>https://www.sketchup.com/download/all</string>
				<key>result_output_var_name</key>
				<string>url</string>
				<key>re_pattern</key>
				<string>https://www.sketchup.com/sketchup/2017/en/sketchupmake-2017-[\S]+\-en-dmg</string>			
				<key>re_flags</key>
				<array>
					<string>IGNORECASE</string>
				</array>
			</dict>
		</dict>
		<dict>
			<key>Arguments</key>
			<dict>
				<key>filename</key>
				<string>%NAME%.dmg</string>
			</dict>
			<key>Processor</key>
			<string>URLDownloader</string>
		</dict>

WacomIntuosProDriver.download fails with "Could not retrieve URL: http://us.wacom.com/en/support/drivers"

Changing the URLTextSearcher url to "http://www.wacom.com/en-us/support/product-support/drivers" fixes this issue.

Since the recipe has a lengthy installs array and no blocking_applications array, Munki uses the applications in the installs array as a virtual blocking_applications array.

This means that the user is prompted to quit any of the following apps:
Wacom Desktop Center.app
Wacom Display Settings.app
Wacom Tablet Utility.app
WacomTabletDriver.app

The last one is problematic as it is a faceless background app that auto-relaunches: there's no reasonable way for a normal user to quit this.

I'd propose adding:

<key>blocking_applications</key>
<array>
    <string>Wacom Desktop Center.app</string>
    <string>Wacom Display Settings.app</string>
    <string>Wacom Tablet Utility.app</string>
</array>

to the pkginfo.

We're seeing the following error:
The following recipes failed: arduino.munki.recipe Error in local.munki.Arduino: Processor: URLTextSearcher: Error: No match found on URL: https://arduino.cc/en/Main/Software

#82 should fix it

Some friendly advice on maintaining Munki recipes:

Normally for Munki recipes, it's preferable to put all of your default pkginfo keys in the Input dict for a recipe rather than directly in the Arguments dict for MunkiImporter. This allows people to override your recipe with their own modifications to pkginfo. Currently, if someone were to override one of your Munki recipes and add some additional keys to pkginfo (an alternate catalogs, or a category/developer), these overrides get ignored because the recipe uses the argument provided in the Process steps instead.

See the Adium.munki recipe:

https://github.com/autopkg/recipes/blob/master/Adium/Adium.munki.recipe#L41-L51

Here we can leave the pkginfo argument out altogether, because MunkiImporter will take this key's data as a starting place if it exists.

We're using your Brackets.munki recipe.

I noticed the following blocking_applications were added to the Brackets.munki recipe:
https://github.com/autopkg/jps3-recipes/blame/master/Adobe/Brackets.munki.recipe#L27-L31

The Munki wiki says (second bullet is the important part):
https://github.com/munki/munki/wiki/Blocking-Applications#details

Munki will skip any unattended_installs or unattended_uninstalls if:

• There is a blocking_applications key in the pkginfo, and any application listed is running, or
• There is no blocking_applications key in the pkginfo, and any application in the installs list (if it exists) is running.

I think blocking_applications of "Brackets" and "Brackets.app" aren't necessary since the recipe results in a copy_from_dmg Munki Installer Item, which includes Brackets in the "installs" array. I'd fork and PR, but I'm not sure if you've had a different experience with the "automatic" blocking_applications coming from the "installs" array.

I'm getting the following errors on the Camtasia Recipe from Autopkg:
Processor: CodeSignatureVerifier: Error: Code signature verification failed. Note that all verifications can be disabled by setting the variable DISABLE_CODE_SIGNATURE_VERIFICATION to a non-empty value.

WacomIntuosProDriver.munki does not set the display name correctly.

Changing

<key>displayname</key>

to

<key>display_name</key>

fixes the issue, though.

Hey,

The latest version of the Wacom drivers are causing issues in Munki because there's a hyphen in the version number. I changed the version number in the pkginfo (removed the hyphen) and then renamed the plist to contain the same version number - finally, I re-added it to my manifest and then it began working. Just thought I would give you a heads up.

Best,

D

BetterZip is now at v5, since it was updated the current recipe returns this error:

Error [70] Error running recipes
 can't concat str to bytes
Failed.

The download URL has changed to

http://us.download.nvidia.com/Mac/cuda_396/cudadriver_396.148_macos.dmg

URL contains this DMG but the regex doesn't match on this. Not much of a REGEX expert so just flagging this.

Brackets.munki.recipe depends on Brackets.download.recipe from Novaksam and this recipe is now missing

Hello @jps3. The download of SketchUpPro fails and says it cannot find a match on the site.

Thanks!

This is a pro-active issue notice. I see the errors and am checking on it.

If I run the new recipe with https, I get a fail:

$ autopkg run -v Pashua.pkg.recipe Processing Pashua.pkg.recipe... URLDownloader Couldn't download https://www.bluem.net/files/Pashua.dmg (HTTP Error 403: Forbidden) Failed.

If I manually download it using curl it works fine:

$ curl -O https://www.bluem.net/files/Pashua.dmg % Total % Received % Xferd Average Speed Time Time Time Current Dload Upload Total Spent Left Speed 100 3592k 100 3592k 0 0 5145k 0 --:--:-- --:--:-- --:--:-- 5139k

If I revert the download url to http, and run again using autopkg it also works:

$ autopkg run -v Pashua.pkg.recipe Processing Pashua.pkg.recipe... URLDownloader URLDownloader: Storing new Last-Modified header: Wed, 23 Dec 2015 08:21:58 GMT URLDownloader: Downloaded /Volumes/DATA/autopkg/Cache/com.github.jps3.pkg.Pashua/downloads/Pashua.dmg EndOfCheckPhase ...

Running the latest version of autopkg:

$ autopkg version 0.5.2

It appears that GitHub Pages sites stopped redirecting *github.com to *github.io yesterday (April 15), which broke the URL used by the OpenSCAD download recipe.
https://github.blog/changelog/2021-01-29-github-pages-will-stop-redirecting-pages-sites-from-github-com-after-april-15-2021/

Looking at the notes in the download recipe, it seems there were previously issues with the SSL cert for https://openscad.org/appcast.xml, but that appears to have been fixed now. The recipe can likely be switched to using the direct URL rather than indirectly via the GitHub Pages site.

I've opened another issue with the developer to update the Sparkle XML file.

I get the following error when running SketchUpPro.munki.recipe:

$ autopkg run SketchUpPro.munki
Processing SketchUpPro.munki...
Error processing path '/private/tmp/dmg.wwXjhm/SketchUp 2014' with glob. 
Failed.

The following recipes failed:
    SketchUpPro.munki
        Error in local.munki.SketchUpPro: Processor: Copier: Error: Error processing path '/private/tmp/dmg.wwXjhm/SketchUp 2014' with glob.

I'm using autopkg 0.4.1 on Mac OS X 10.9.5 :

$ autopkg version
0.4.1
$ sw_vers -productVersion 
10.9.5

On run, WacomIntuosProDriver.munki fails on determining the LSMinimumSystemVersion by reading the Info.plist file. This key is no longer present, replaced with this key:

<key>LSMinimumSystemVersionByArchitecture</key> <dict> <key>x86_64</key> <string>10.8</string> </dict>

Looks like the URL from the vender is failing in a web browser too (https://arduino.cc/en/Main/Software). I think it might need to be changed to https://www.arduino.cc/en/software but I'll dig further and see if I can submit a PR.

Full output:

% autopkg run -vvv "Arduino.download.recipe"
Processing Arduino.download.recipe...
WARNING: Arduino.download.recipe is missing trust info and FAIL_RECIPES_WITHOUT_TRUST_INFO is not set. Proceeding...
{'AUTOPKG_VERSION': '2.1',
 'DOWNLOAD_PAGE': 'https://arduino.cc/en/Main/Software',
 'GIT_PATH': '/Applications/Xcode.app/Contents/Developer/usr/bin/git',
 'MUNKI_REPO': '/Users/darren/munki_repo',
 'NAME': 'Arduino',
 'PARENT_RECIPES': [],
 'RECIPE_CACHE_DIR': '/Users/darren/Library/AutoPkg/Cache/com.github.jps3.download.Arduino',
 'RECIPE_DIR': '/Users/darren/Library/AutoPkg/RecipeRepos/com.github.autopkg.jps3-recipes/Arduino',
 'RECIPE_OVERRIDE_DIRS': ['~/Library/AutoPkg/RecipeOverrides'],
 'RECIPE_PATH': '/Users/darren/Library/AutoPkg/RecipeRepos/com.github.autopkg.jps3-recipes/Arduino/Arduino.download.recipe',
 'RECIPE_REPOS': {'[Removed]}},
 'RECIPE_SEARCH_DIRS': [[Removed]],
 'verbose': 3}
URLTextSearcher
{'Input': {'re_pattern': '(?P<url>(https:)?\\/\\/(?:[^\\/]*)arduino\\.cc\\/(?:download_handler\\.php\\?f=\\/)(?P<filename>/?[^"\']+-macosx\\.zip))',
           'url': 'https://arduino.cc/en/Main/Software'}}
URLTextSearcher: No value supplied for result_output_var_name, setting default value of: match
Traceback (most recent call last):
  File "/Library/AutoPkg/autopkglib/URLGetter.py", line 191, in execute_curl
    errors=errors,
  File "/Library/AutoPkg/Python3/Python.framework/Versions/Current/lib/python3.7/subprocess.py", line 512, in run
    output=stdout, stderr=stderr)
subprocess.CalledProcessError: Command '['/usr/bin/curl', '--compressed', '--location', 'https://arduino.cc/en/Main/Software']' returned non-zero exit status 7.

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "/Library/AutoPkg/autopkglib/__init__.py", line 676, in process
    self.env = processor.process()
  File "/Library/AutoPkg/autopkglib/__init__.py", line 483, in process
    self.main()
  File "/Library/AutoPkg/autopkglib/URLTextSearcher.py", line 121, in main
    content = self.download_with_curl(curl_cmd)
  File "/Library/AutoPkg/autopkglib/URLGetter.py", line 199, in download_with_curl
    proc_stdout, proc_stderr, retcode = self.execute_curl(curl_cmd, text)
  File "/Library/AutoPkg/autopkglib/URLGetter.py", line 194, in execute_curl
    raise ProcessorError(e)
autopkglib.ProcessorError: Command '['/usr/bin/curl', '--compressed', '--location', 'https://arduino.cc/en/Main/Software']' returned non-zero exit status 7.
  File "/Library/AutoPkg/autopkglib/__init__.py", line 676, in process
    self.env = processor.process()
Command '['/usr/bin/curl', '--compressed', '--location', 'https://arduino.cc/en/Main/Software']' returned non-zero exit status 7.
Failed.
Receipt written to /Users/darren/Library/AutoPkg/Cache/com.github.jps3.download.Arduino/receipts/Arduino.download-receipt-20201104-150957.plist

The following recipes failed:
    Arduino.download.recipe
        Error in com.github.jps3.download.Arduino: Processor: URLTextSearcher: Error: Command '['/usr/bin/curl', '--compressed', '--location', 'https://arduino.cc/en/Main/Software']' returned non-zero exit status 7.

Nothing downloaded, packaged or imported.

Could you please update the recipes?

Thanks!

We're seeing the following error in the Arduino recipe:

The following recipes failed:
    Arduino.munki.recipe
        Error in local.munki.Arduino: Processor: DmgCreator: Error: creation of /Users/Shared/AutoPkg/Cache/local.munki.Arduino/arduino-1.8.6.dmg failed: hdiutil: create failed - No space left on device

A quick look at this makes me suspect that the issue stems from the dmg_megabytes variable being set to 500MB but the Arduino app itself is around 530MB.

https://github.com/autopkg/jps3-recipes/blob/master/WacomIntuosProDriver/WacomIntuosProDriver.munki.recipe#L42

Might "Wacom Table Utility" supposed to be "Wacom Tablet Utility"?

Error in com.github.jps3.download.OverSight: Processor: URLTextSearcher: Error: No match found on URL: https://objective-see.com/products/OverSight.html

Can you please update the OverSight recipe?

...
<key>Process</key>
		<array>
			<dict>
				<key>Processor</key>
				<string>com.github.jps3.shared/JSONParser</string>
				<key>Arguments</key>
				<dict>
					<key>product</key>
					<string>OverSight</string>
				</dict>
			</dict>
			<dict>
				<key>Processor</key>
				<string>URLDownloader</string>
			</dict>
			<dict>
				<key>Processor</key>
				<string>EndOfCheckPhase</string>
			</dict>
			<dict>
				<key>Processor</key>
				<string>Unarchiver</string>
				<key>Arguments</key>
				<dict>
					<key>purge_destination</key>
					<true/>
					<key>destination_path</key>
					<string>%RECIPE_CACHE_DIR%/%NAME%</string>
				</dict>
			</dict>
			<dict>
			<key>Arguments</key>
			<dict>
				<key>input_path</key>
				<string>%RECIPE_CACHE_DIR%/%NAME%/%NAME%_Installer.app/Contents/Resources/%NAME%.app</string>
				<key>requirement</key>
				<string>anchor apple generic and identifier "com.objective-see.OverSight" and (certificate leaf[field.1.2.840.113635.100.6.1.9] /* exists */ or certificate 1[field.1.2.840.113635.100.6.2.6] /* exists */ and certificate leaf[field.1.2.840.113635.100.6.1.13] /* exists */ and certificate leaf[subject.OU] = VBG97UB4TA)</string>
			</dict>
			<key>Processor</key>
			<string>CodeSignatureVerifier</string>
		</dict>
	</array>

We are using the WacomIntuosProDriver.munki.recipe.

Wacom Intuos Pro Driver 6.3.15-1 was released on 10/8. The 6.3.15-1 pkg appears to improper permissions with the "LaunchAgents" and "LaunchDaemons" directories (which have POSIX 644 permissions in the pkg). While this doesn't affect the first run of WacomIntuosProDriver.munki.recipe (which obtains the 6.3.15-1 pkg and PkgPayloadUnpacker's it), subsequent WacomIntuosProDriver.munki.recipe runs die with the following:

PkgPayloadUnpacker
{'Input': {'destination_path': u'/Users/admin/Library/AutoPkg/Cache/local.munki.WacomIntuosProDriver/faux_root',
           'pkg_payload_path': u'/Users/admin/Library/AutoPkg/Cache/local.munki.WacomIntuosProDriver/pkgtmp/content.pkg/Payload',
           'purge_destination': True}}
Can't remove /Users/admin/Library/AutoPkg/Cache/local.munki.WacomIntuosProDriver/faux_root/Library: Permission denied
Failed.
Receipt written to /Users/admin/Library/AutoPkg/Cache/local.munki.WacomIntuosProDriver/receipts/WacomIntuosProDriver.munki-receipt-20151012-091157.plist

The following recipes failed:
    WacomIntuosProDriver.munki.recipe
        Error in local.munki.WacomIntuosProDriver: Processor: PkgPayloadUnpacker: Error: Can't remove /Users/admin/Library/AutoPkg/Cache/local.munki.WacomIntuosProDriver/faux_root/Library: Permission denied

chmod 755'ing the LaunchAgents and LaunchDaemons directories does allow the .munki recipe to succeed.

Looks like the Camtasia code signature has changed to the following:

identifier "com.techsmith.camtasia2018" and anchor apple generic and certificate 1[field.1.2.840.113635.100.6.2.6] /* exists / and certificate leaf[field.1.2.840.113635.100.6.1.13] / exists */ and certificate leaf[subject.OU] = "7TQL462TU8"

I am using AutoPkg with the com.github.jps3.munki.SketchUpPro receipe. I made a local override for the locale (DE) but AutoPkg downloads and logs it again on every run. Sometimes, there is a version number, sometimes not. But it's logged with

*New software available for testing:*

- SketchUpPro-de: 18.0.16976

*The following new items were downloaded:*

/Users/admin/Library/AutoPkg/Cache/local.munki.SketchUpPro/downloads/SketchUpPro-de.dmg

I don't know why this happens. Every other software in my receipe list works without problems.

Camtasia.download.recipe

Camtasia 2021 (i.e. as currently stated in affected recipe):

identifier "com.techsmith.camtasia2021" and anchor apple generic and certificate 1[field.1.2.840.113  635.100.6.2.6] /* exists */ and certificate leaf[field.1.2.840.113635.100.6.1.13] /* exists */ and certificate leaf[subject.OU] = "7TQL462TU8"

Camtasia 2022 (i.e. what that would need to be changed to):

identifier "com.techsmith.camtasia2022" and anchor apple generic and certificate 1[field.1.2.840.113635.100.6.2.6] /* exists */ and certificate leaf[field.1.2.840.113635.100.6.1.13] /* exists */ and certificate leaf[subject.OU] = "7TQL462TU8"

This feels … sloppy. Unsure how to better “break out” the concept of a reasonably generic “Camtasia” download recipe, but perhaps that’s not possible with regard to their code signing. 🤔

Any ideas are welcome.

The current version of Camtasia, as downloaded from developer's web site is no longer signed. Previous versions were. Additionally the app bundles Info.plist file still specifies and HTTP URL, and not HTTPS.

I have attempted to contact the developer, but have not received any reply to date.

Unsure of what to do here, it seems like a Bad Idea™ to remove the codesign'ing check just to get around an autopkg warning/error. And developer must change this or their app won't work on many systems.

The HTTPS certificate used by bluem.net is no longer valid.

The developer has been contacted and advised of the situation. Additionally, I asked him to consider code signing Pashua.app as well.

(Waiting to hear back)

Hi,

I'm not sure if I'm posting this in the correct area, but I seem to be having an issue. A quick little background. I have recently taken over the care and feeding of the Munki server, and I am trying to get up to speed on it. Munki is sending out these errors:

$ autopkg run SketchUpPro.munki
Processing SketchUpPro.munki...
Error processing path '/private/tmp/dmg.mB0EdF/SketchUp 2016/LayOut.app' with glob.
Failed.

The following recipes failed:
SketchUpPro.munki
Error in com.github.jps3.munki.SketchUpPro: Processor: CodeSignatureVerifier: Error: Error processing path '/private/tmp/dmg.mB0EdF/SketchUp 2016/LayOut.app' with glob.

Nothing downloaded, packaged or imported.

I did run the updater to be sure:

misod:tmp admin$ autopkg repo-update all
Attempting git pull for /Users/admin/Library/AutoPkg/RecipeRepos/com.github.autopkg.thenikola-recipes...
Already up-to-date.

Attempting git pull for /Users/admin/Library/AutoPkg/RecipeRepos/com.github.autopkg.gerardkok-recipes...
Already up-to-date.

Attempting git pull for /Users/admin/Library/AutoPkg/RecipeRepos/com.github.autopkg.sheagcraig-recipes...
Already up-to-date.

Attempting git pull for /Users/admin/Library/AutoPkg/RecipeRepos/com.github.autopkg.jps3-recipes...
Already up-to-date.

I am using
autopkg version
0.6.1
on 10.11.6

Thanks

This error has appeared with Fritzing fairly recently.

I noticed today when running the recipe to update the software that Wacom doesn't version their .pkg correctly and it pulls the pkg receipt into munki as version 0. This makes munki think the software is already installed and won't offer to install the latest version.

Could the recipe be edited to use MunkiInstallsItemsCreator so it will check installed bundle versions instead of receipt version?

It appears the application bundles below are all versioned with their name in the CFBundleShortVersionString. However the CFBundleVersion are consistent at 6.3.13f3
Using CFBundleVersion as the comparison would be consistent for all bundles that are installed that I can see.

Paths to the bundles that could be used in the installs array in the recipe:
/Applications/Wacom Tablet.localized/Wacom Tablet Utility.app
/Applications/Wacom Tablet.localized/Wacom Desktop Center.app
/Library/Application Support/Tablet/WacomTabletDriver.app
/Library/PreferencePanes/WacomTablet.prefpane

I started looking at the code to possibly do a PR but I've not created a recipe like that before. I noticed you have a few recipes (Sketchup, TotalTerminal, SuspiciousPackageQLP) that do use the key so maybe you'd be more familiar with the syntax and process.

Looks like with v3 it changed to a xip download.

http://www.mothersruin.com/software/SuspiciousPackage/get.html

Download here:

http://www.mothersruin.com/software/downloads/SuspiciousPackage.xip

(old URL http://www.mothersruin.com/software/downloads/SuspiciousPackage.pkg is giving a 404)

Run output from today:

The following recipes failed:
    WacomIntuosProDriver.munki
        Error in local.munki.WacomIntuosProDriver: Processor: PlistReader: Error: Key 'LSMinimumSystemVersion' could not be found in the plist /Users/gneagle/Library/AutoPkg/Cache/local.munki.WacomIntuosProDriver/faux_root/Applications/Wacom Tablet.localized/Wacom Desktop Center.app/Contents/Info.plist!

Looking at that plist:

    <key>LSMinimumSystemVersionByArchitecture</key>
    <dict>
        <key>x86_64</key>
        <string>10.8</string>
    </dict>

They are now using LSMinimumSystemVersionByArchitecture instead of LSMinimumSystemVersion.

Can you please update the recipes for Path Finder?

PF uses Sparkle, the url for PF8 is https://get.cocoatech.com/releasecast.xml

Thanks!

Just an FYI to anyone who may notice the current code signature verification error. I am working on that. Also, I am updating the recipes as at some point Wacom has updated how they create the packages, and are no longer using the older style "non-flat" package with the odd issues that presented in how they were creating them.