Here are Python scripts and sample configuration files that can be used to automate the creation of Excalibur Imagery Projects.

For more information about Excalibur and Imagery Projects see the Resources section.

• Sample JSON files that define an Imagery Project
• Sample JSON files that define overall configuration definitions for running the scripts
• Python scripts that create an Imagery Project in a portal

1. Fork and then clone this repository to your machine. Or download it as a zip file and extract the contents to your machine.
2. Make sure you have all the requirements.
3. Copy and edit the configuration files.
4. Run the script to create the project.

Detailed instructions are in the Creating a project section.

The scripts require Python 3 to be installed on your machine. The scripts were developed using Python version 3.8.6. Python 3 is already installed on your machine if you are running ArcGIS Pro. To see if Python is installed, open a terminal and run the command python. If installed, you will see the version of Python displayed and be at a command prompt for entering Python commands.

If Python is not installed on your machine, you can download the version for your OS from the Python download site. It is recommended to add the path to the Python executable to the Paths on your machine. Once installed, open a terminal and run the command python and make sure it runs without errors.

Connections to the portal and content creation are handled via the ArcGIS API for Python. You can get information about it at the API site. Detailed instructions for installing the API are here.

Excalibur is a Portal application that is supported on ArcGIS Enterprise version 10.7 and higher. To run the scripts, you must be a user on an ArcGIS Enterprise instance and you must have permissions to create new items.

• logging.conf: This is the configuration file for the logger. You do not need to update it.
• paths-sample.json: This holds the path to the directory where the project configuration files are stored and also the url to your portal. You will need to make a copy of it and name it paths.json

This is where the logs are written. The current log file is named excalibur.log. Logs are set to rotate when a log file reaches 500k and 2 backups are kept.

This is where the JSON files defining a project are stored. Samples are provided. You will need to make new JSON files and follow the samples to define your own projects

Contains the two Python scripts that write the project to the portal and the script that connects to the portal using the supplied credentials.

• Make a copy of config/paths-sample.json and name it paths.json.
• Update the SHARING_URL property to point to your portal. Make sure the url ends in sharing/rest.

NOTE: In config/paths-sample.json there is a property named 'VERIFY_SSL'. This is used to turn on/off SSL verification for http requests made by the 'requests' library. If running the script in a development environment, it might be necessary to set the flag to false

• Copy one of the JSON files in the projects directory and name it anything.
• Update the JSON to describe your project. See the Project definition schema section for details about the JSON schema.

• Open a terminal and go to the directory where you cloned the repository or extracted the zip file contents, and then go to the scripts directory.
• From the scripts directory, run python runCreateProject.py -h. This shows the arguments. They are
  • The name of the project JSON file. This must be the first argument
  • Optional arguments:
    • -s or --sharingurl: The url to the portal's REST endpoint. If the argument is not specified, the url in the SHARING_URL property of config/paths.json is used.
    • -u or --user: Your portal username. If the argument is not specified you get prompted for it.
    • -p or --password: Your portal user's password. If the argument is not specified you get prompted for it.
    • -o or --orgshare: True/False flag for sharing the project item with the organization. Default is False (do not share it).
• If the script runs successfully, you will see a console log in the terminal that has the item id of the Excalibur Imagery Project's portal item.

The properties for an imagery project. The focusImageLayer and observationLayers property are objects and their schema is described below.

Supported service types at versions of Excalibur

• ArcGIS Image Service - as of v1.0
• WMS Service - as of v2.1
• WMTS Service - as of v2.1

The properties for the focusImageLayer object.

• Observation Layer supported since v1.0
• enrichmentDefinition supported since v2.3

The properties for the objects in the observationLayers array.

{
  "title": "A simple imagery project",
  "summary": "A simple project with just a focus image layer",
  "description": "",
  "instructions": "Look for damage",
  "focusImageLayer": {
    "serviceType": "arcgis",
    "serviceUrl": "https://server/service-name/ImageServer",
    "rasterIds": [],
    "layerNames": []
  }
}

{
  "title": "A simple imagery project",
  "summary": "A simple project with just a focus image layer",
  "description": "",
  "instructions": "Look for damage",
  "focusImageLayer": {
    "serviceType": "arcgis",
    "serviceUrl": "https://server/service-name/ImageServer",
    "rasterIds": [1, 2, 3],
    "layerNames": []
  }
}

{
  "title": "A simple imagery project",
  "summary": "A simple project with a WMS layer",
  "description": "",
  "instructions": "Look for damage",
  "focusImageLayer": {
    "serviceType": "wms",
    "serviceUrl": "https://server/service-name",
    "rasterIds": [],
    "layerNames": []
  }
}

{
  "title": "A simple imagery project",
  "summary": "A simple project with a WMS layer",
  "description": "",
  "instructions": "Look for damage",
  "focusImageLayer": {
    "serviceType": "wms",
    "serviceUrl": "https://server/service-name",
    "rasterIds": []
    "layerNames": ["damage0102", "damage0104"]
  }
}

NOTE: WMTS service layers are cached and ONLY ONE can be displayed as the focus image layer in a project. So the layerNames property can only have one layer name.

{
  "title": "A simple imagery project",
  "summary": "A simple project with a WMTS layer",
  "description": "",
  "instructions": "Look for weather",
  "focusImageLayer": {
    "serviceType": "wmts",
    "serviceUrl": "https://server/service-name",
    "rasterIds": []
    "layerNames": ["radar-base-reflectivity"]
  }
}

{
  "title": "Imagery project with observations",
  "summary": "A project with an observation layer",
  "description": "",
  "instructions": "Add a point on top of anything of interest and enter comments",
  "focusImageLayer": {
    "serviceType": "arcgis",
    "serviceUrl": "https://server/service-name/ImageServer",
    "rasterIds": [1, 2, 3],
    "layerNames": []
  },
  "observationLayers": [
    {
      "itemId": "123456789abcdefg"
    }
  ]
}

This also shows the webmapId property

{
  "title": "Imagery project with observations",
  "summary": "A project with an observation layer",
  "description": "",
  "instructions": "Add a point on top of anything of interest and enter comments",
  "focusImageLayer": {
    "serviceType": "arcgis",
    "serviceUrl": "https://server/service-name/ImageServer",
    "rasterIds": [1, 2, 3],
    "layerNames": []
  },
  "observationLayers": [
    {
      "itemId": "123456789abcdefg"
    },
    {
      "itemId": "hijklmnop9876543",
      layerId: 2
    }
  ],
  "webmapId": "12345678"
}

{
  "title": "Imagery project with observations getting data from another layer",
  "summary": "A project with an observation layer that gets its 'parcelid' field calculated from the parcel boundary polygon layer's 'id' field",
  "description": "",
  "instructions": "Add a point on top of anything of interest and enter comments",
  "webmapId": "12345678",
  "focusImageLayer": {
    "serviceType": "arcgis",
    "serviceUrl": "https://server/service-name/ImageServer",
    "rasterIds": [
      1,
      2,
      3
    ],
    "layerNames": []
  },
  "observationLayers": [
    {
      "itemId": "ead6deb3d93848c4a7fd58025cc2cdaa",
      "enrichmentDefinition": {
        "description": "Building Parcel Info",
        "layers": [
          {
            "sourceUrl": "https://path/to/parcel/boundaries/FeatureServer",
            "fields": [
              {
                "source": "id",
                "destination": "parcelid"
              }
            ]
          }
        ]
      }
    }
  ]
}

• Getting started with Excalibur
• Overview of Excalibur Imagery Projects

Find a bug or want to request a new feature? Please let us know by submitting an issue.

Esri welcomes contributions from anyone and everyone. Please see our guidelines for contributing.

Copyright 2020 Esri

Licensed under the Apache License, Version 2.0 (the "License"); you may not use this file except in compliance with the License. You may obtain a copy of the License at

http://www.apache.org/licenses/LICENSE-2.0

Unless required by applicable law or agreed to in writing, software distributed under the License is distributed on an "AS IS" BASIS, WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied. See the License for the specific language governing permissions and limitations under the License.

A copy of the license is available in the repository's License.txt file.