Git Product home page Git Product logo

Comments (2)

github-actions avatar github-actions commented on June 2, 2024
❌ test_table_migration_job_refreshes_migration_status[regular-migrate-tables]: AssertionError: No migration status found for TableType.MANAGED hive_metastore.migrate_fk30c.ucx_tmxgt (12m14.601s)
AssertionError: No migration status found for TableType.MANAGED hive_metastore.migrate_fk30c.ucx_tmxgt
assert 0 == 1
 +  where 0 = len([])
07:03 DEBUG [databricks.labs.ucx.mixins.fixtures] added make_dbfs_data_copy fixture: dbfs:/mnt/TEST_MOUNT_NAME/a/b/SPom
07:03 INFO [databricks.labs.ucx.mixins.fixtures] Schema hive_metastore.migrate_fk30c: https://DATABRICKS_HOST/explore/data/hive_metastore/migrate_fk30c
07:03 DEBUG [databricks.labs.ucx.mixins.fixtures] added schema fixture: SchemaInfo(browse_only=None, catalog_name='hive_metastore', catalog_type=None, comment=None, created_at=None, created_by=None, effective_predictive_optimization_flag=None, enable_predictive_optimization=None, full_name='hive_metastore.migrate_fk30c', metastore_id=None, name='migrate_fk30c', owner=None, properties=None, schema_id=None, storage_location=None, storage_root=None, updated_at=None, updated_by=None)
07:03 INFO [databricks.labs.ucx.mixins.fixtures] Table hive_metastore.migrate_fk30c.ucx_tmxgt: https://DATABRICKS_HOST/explore/data/hive_metastore/migrate_fk30c/ucx_tmxgt
07:03 DEBUG [databricks.labs.ucx.mixins.fixtures] added table fixture: TableInfo(access_point=None, browse_only=None, catalog_name='hive_metastore', columns=None, comment=None, created_at=None, created_by=None, data_access_configuration_id=None, data_source_format=<DataSourceFormat.DELTA: 'DELTA'>, deleted_at=None, delta_runtime_properties_kvpairs=None, effective_predictive_optimization_flag=None, enable_predictive_optimization=None, encryption_details=None, full_name='hive_metastore.migrate_fk30c.ucx_tmxgt', metastore_id=None, name='ucx_tmxgt', owner=None, pipeline_id=None, properties=None, row_filter=None, schema_name='migrate_fk30c', sql_path=None, storage_credential_name=None, storage_location='dbfs:/user/hive/warehouse/migrate_fk30c/ucx_tmxgt', table_constraints=None, table_id=None, table_type=<TableType.MANAGED: 'MANAGED'>, updated_at=None, updated_by=None, view_definition=None, view_dependencies=None)
07:03 INFO [databricks.labs.ucx.mixins.fixtures] Table hive_metastore.migrate_fk30c.ucx_tnffd: https://DATABRICKS_HOST/explore/data/hive_metastore/migrate_fk30c/ucx_tnffd
07:03 DEBUG [databricks.labs.ucx.mixins.fixtures] added table fixture: TableInfo(access_point=None, browse_only=None, catalog_name='hive_metastore', columns=None, comment=None, created_at=None, created_by=None, data_access_configuration_id=None, data_source_format=<DataSourceFormat.CSV: 'CSV'>, deleted_at=None, delta_runtime_properties_kvpairs=None, effective_predictive_optimization_flag=None, enable_predictive_optimization=None, encryption_details=None, full_name='hive_metastore.migrate_fk30c.ucx_tnffd', metastore_id=None, name='ucx_tnffd', owner=None, pipeline_id=None, properties=None, row_filter=None, schema_name='migrate_fk30c', sql_path=None, storage_credential_name=None, storage_location='dbfs:/mnt/TEST_MOUNT_NAME/a/b/SPom', table_constraints=None, table_id=None, table_type=<TableType.EXTERNAL: 'EXTERNAL'>, updated_at=None, updated_by=None, view_definition=None, view_dependencies=None)
07:03 INFO [databricks.labs.ucx.mixins.fixtures] Table hive_metastore.migrate_fk30c.ucx_tft89: https://DATABRICKS_HOST/explore/data/hive_metastore/migrate_fk30c/ucx_tft89
07:03 DEBUG [databricks.labs.ucx.mixins.fixtures] added table fixture: TableInfo(access_point=None, browse_only=None, catalog_name='hive_metastore', columns=None, comment=None, created_at=None, created_by=None, data_access_configuration_id=None, data_source_format=None, deleted_at=None, delta_runtime_properties_kvpairs=None, effective_predictive_optimization_flag=None, enable_predictive_optimization=None, encryption_details=None, full_name='hive_metastore.migrate_fk30c.ucx_tft89', metastore_id=None, name='ucx_tft89', owner=None, pipeline_id=None, properties=None, row_filter=None, schema_name='migrate_fk30c', sql_path=None, storage_credential_name=None, storage_location=None, table_constraints=None, table_id=None, table_type=<TableType.VIEW: 'VIEW'>, updated_at=None, updated_by=None, view_definition='SELECT * FROM hive_metastore.migrate_fk30c.ucx_tmxgt', view_dependencies=None)
07:03 INFO [databricks.labs.ucx.mixins.fixtures] Table hive_metastore.migrate_fk30c.ucx_telik: https://DATABRICKS_HOST/explore/data/hive_metastore/migrate_fk30c/ucx_telik
07:03 DEBUG [databricks.labs.ucx.mixins.fixtures] added table fixture: TableInfo(access_point=None, browse_only=None, catalog_name='hive_metastore', columns=None, comment=None, created_at=None, created_by=None, data_access_configuration_id=None, data_source_format=None, deleted_at=None, delta_runtime_properties_kvpairs=None, effective_predictive_optimization_flag=None, enable_predictive_optimization=None, encryption_details=None, full_name='hive_metastore.migrate_fk30c.ucx_telik', metastore_id=None, name='ucx_telik', owner=None, pipeline_id=None, properties=None, row_filter=None, schema_name='migrate_fk30c', sql_path=None, storage_credential_name=None, storage_location=None, table_constraints=None, table_id=None, table_type=<TableType.VIEW: 'VIEW'>, updated_at=None, updated_by=None, view_definition='SELECT * FROM hive_metastore.migrate_fk30c.ucx_tft89', view_dependencies=None)
07:03 DEBUG [databricks.labs.ucx.mixins.fixtures] added catalog fixture: CatalogInfo(browse_only=False, catalog_type=<CatalogType.MANAGED_CATALOG: 'MANAGED_CATALOG'>, comment='', connection_name=None, created_at=1714892613105, created_by='0a330eb5-dd51-4d97-b6e4-c474356b1d5d', effective_predictive_optimization_flag=None, enable_predictive_optimization=None, full_name='ucx_crwug', isolation_mode=<IsolationMode.OPEN: 'OPEN'>, metastore_id='8952c1e3-b265-4adf-98c3-6f755e2e1453', name='ucx_crwug', options=None, owner='0a330eb5-dd51-4d97-b6e4-c474356b1d5d', properties=None, provider_name=None, provisioning_info=None, securable_kind=<CatalogInfoSecurableKind.CATALOG_STANDARD: 'CATALOG_STANDARD'>, securable_type='CATALOG', share_name=None, storage_location=None, storage_root=None, updated_at=1714892613105, updated_by='0a330eb5-dd51-4d97-b6e4-c474356b1d5d')
07:03 INFO [databricks.labs.ucx.mixins.fixtures] Schema ucx_crwug.migrate_fk30c: https://DATABRICKS_HOST/explore/data/ucx_crwug/migrate_fk30c
07:03 DEBUG [databricks.labs.ucx.mixins.fixtures] added schema fixture: SchemaInfo(browse_only=None, catalog_name='ucx_crwug', catalog_type=None, comment=None, created_at=None, created_by=None, effective_predictive_optimization_flag=None, enable_predictive_optimization=None, full_name='ucx_crwug.migrate_fk30c', metastore_id=None, name='migrate_fk30c', owner=None, properties=None, schema_id=None, storage_location=None, storage_root=None, updated_at=None, updated_by=None)
07:03 INFO [databricks.labs.ucx.mixins.fixtures] Schema hive_metastore.ucx_sr06s: https://DATABRICKS_HOST/explore/data/hive_metastore/ucx_sr06s
07:03 DEBUG [databricks.labs.ucx.mixins.fixtures] added schema fixture: SchemaInfo(browse_only=None, catalog_name='hive_metastore', catalog_type=None, comment=None, created_at=None, created_by=None, effective_predictive_optimization_flag=None, enable_predictive_optimization=None, full_name='hive_metastore.ucx_sr06s', metastore_id=None, name='ucx_sr06s', owner=None, properties=None, schema_id=None, storage_location=None, storage_root=None, updated_at=None, updated_by=None)
[gw6] linux -- Python 3.10.14 /home/runner/work/ucx/ucx/.venv/bin/python
07:03 DEBUG [databricks.labs.ucx.mixins.fixtures] added make_dbfs_data_copy fixture: dbfs:/mnt/TEST_MOUNT_NAME/a/b/SPom
07:03 INFO [databricks.labs.ucx.mixins.fixtures] Schema hive_metastore.migrate_fk30c: https://DATABRICKS_HOST/explore/data/hive_metastore/migrate_fk30c
07:03 DEBUG [databricks.labs.ucx.mixins.fixtures] added schema fixture: SchemaInfo(browse_only=None, catalog_name='hive_metastore', catalog_type=None, comment=None, created_at=None, created_by=None, effective_predictive_optimization_flag=None, enable_predictive_optimization=None, full_name='hive_metastore.migrate_fk30c', metastore_id=None, name='migrate_fk30c', owner=None, properties=None, schema_id=None, storage_location=None, storage_root=None, updated_at=None, updated_by=None)
07:03 INFO [databricks.labs.ucx.mixins.fixtures] Table hive_metastore.migrate_fk30c.ucx_tmxgt: https://DATABRICKS_HOST/explore/data/hive_metastore/migrate_fk30c/ucx_tmxgt
07:03 DEBUG [databricks.labs.ucx.mixins.fixtures] added table fixture: TableInfo(access_point=None, browse_only=None, catalog_name='hive_metastore', columns=None, comment=None, created_at=None, created_by=None, data_access_configuration_id=None, data_source_format=<DataSourceFormat.DELTA: 'DELTA'>, deleted_at=None, delta_runtime_properties_kvpairs=None, effective_predictive_optimization_flag=None, enable_predictive_optimization=None, encryption_details=None, full_name='hive_metastore.migrate_fk30c.ucx_tmxgt', metastore_id=None, name='ucx_tmxgt', owner=None, pipeline_id=None, properties=None, row_filter=None, schema_name='migrate_fk30c', sql_path=None, storage_credential_name=None, storage_location='dbfs:/user/hive/warehouse/migrate_fk30c/ucx_tmxgt', table_constraints=None, table_id=None, table_type=<TableType.MANAGED: 'MANAGED'>, updated_at=None, updated_by=None, view_definition=None, view_dependencies=None)
07:03 INFO [databricks.labs.ucx.mixins.fixtures] Table hive_metastore.migrate_fk30c.ucx_tnffd: https://DATABRICKS_HOST/explore/data/hive_metastore/migrate_fk30c/ucx_tnffd
07:03 DEBUG [databricks.labs.ucx.mixins.fixtures] added table fixture: TableInfo(access_point=None, browse_only=None, catalog_name='hive_metastore', columns=None, comment=None, created_at=None, created_by=None, data_access_configuration_id=None, data_source_format=<DataSourceFormat.CSV: 'CSV'>, deleted_at=None, delta_runtime_properties_kvpairs=None, effective_predictive_optimization_flag=None, enable_predictive_optimization=None, encryption_details=None, full_name='hive_metastore.migrate_fk30c.ucx_tnffd', metastore_id=None, name='ucx_tnffd', owner=None, pipeline_id=None, properties=None, row_filter=None, schema_name='migrate_fk30c', sql_path=None, storage_credential_name=None, storage_location='dbfs:/mnt/TEST_MOUNT_NAME/a/b/SPom', table_constraints=None, table_id=None, table_type=<TableType.EXTERNAL: 'EXTERNAL'>, updated_at=None, updated_by=None, view_definition=None, view_dependencies=None)
07:03 INFO [databricks.labs.ucx.mixins.fixtures] Table hive_metastore.migrate_fk30c.ucx_tft89: https://DATABRICKS_HOST/explore/data/hive_metastore/migrate_fk30c/ucx_tft89
07:03 DEBUG [databricks.labs.ucx.mixins.fixtures] added table fixture: TableInfo(access_point=None, browse_only=None, catalog_name='hive_metastore', columns=None, comment=None, created_at=None, created_by=None, data_access_configuration_id=None, data_source_format=None, deleted_at=None, delta_runtime_properties_kvpairs=None, effective_predictive_optimization_flag=None, enable_predictive_optimization=None, encryption_details=None, full_name='hive_metastore.migrate_fk30c.ucx_tft89', metastore_id=None, name='ucx_tft89', owner=None, pipeline_id=None, properties=None, row_filter=None, schema_name='migrate_fk30c', sql_path=None, storage_credential_name=None, storage_location=None, table_constraints=None, table_id=None, table_type=<TableType.VIEW: 'VIEW'>, updated_at=None, updated_by=None, view_definition='SELECT * FROM hive_metastore.migrate_fk30c.ucx_tmxgt', view_dependencies=None)
07:03 INFO [databricks.labs.ucx.mixins.fixtures] Table hive_metastore.migrate_fk30c.ucx_telik: https://DATABRICKS_HOST/explore/data/hive_metastore/migrate_fk30c/ucx_telik
07:03 DEBUG [databricks.labs.ucx.mixins.fixtures] added table fixture: TableInfo(access_point=None, browse_only=None, catalog_name='hive_metastore', columns=None, comment=None, created_at=None, created_by=None, data_access_configuration_id=None, data_source_format=None, deleted_at=None, delta_runtime_properties_kvpairs=None, effective_predictive_optimization_flag=None, enable_predictive_optimization=None, encryption_details=None, full_name='hive_metastore.migrate_fk30c.ucx_telik', metastore_id=None, name='ucx_telik', owner=None, pipeline_id=None, properties=None, row_filter=None, schema_name='migrate_fk30c', sql_path=None, storage_credential_name=None, storage_location=None, table_constraints=None, table_id=None, table_type=<TableType.VIEW: 'VIEW'>, updated_at=None, updated_by=None, view_definition='SELECT * FROM hive_metastore.migrate_fk30c.ucx_tft89', view_dependencies=None)
07:03 DEBUG [databricks.labs.ucx.mixins.fixtures] added catalog fixture: CatalogInfo(browse_only=False, catalog_type=<CatalogType.MANAGED_CATALOG: 'MANAGED_CATALOG'>, comment='', connection_name=None, created_at=1714892613105, created_by='0a330eb5-dd51-4d97-b6e4-c474356b1d5d', effective_predictive_optimization_flag=None, enable_predictive_optimization=None, full_name='ucx_crwug', isolation_mode=<IsolationMode.OPEN: 'OPEN'>, metastore_id='8952c1e3-b265-4adf-98c3-6f755e2e1453', name='ucx_crwug', options=None, owner='0a330eb5-dd51-4d97-b6e4-c474356b1d5d', properties=None, provider_name=None, provisioning_info=None, securable_kind=<CatalogInfoSecurableKind.CATALOG_STANDARD: 'CATALOG_STANDARD'>, securable_type='CATALOG', share_name=None, storage_location=None, storage_root=None, updated_at=1714892613105, updated_by='0a330eb5-dd51-4d97-b6e4-c474356b1d5d')
07:03 INFO [databricks.labs.ucx.mixins.fixtures] Schema ucx_crwug.migrate_fk30c: https://DATABRICKS_HOST/explore/data/ucx_crwug/migrate_fk30c
07:03 DEBUG [databricks.labs.ucx.mixins.fixtures] added schema fixture: SchemaInfo(browse_only=None, catalog_name='ucx_crwug', catalog_type=None, comment=None, created_at=None, created_by=None, effective_predictive_optimization_flag=None, enable_predictive_optimization=None, full_name='ucx_crwug.migrate_fk30c', metastore_id=None, name='migrate_fk30c', owner=None, properties=None, schema_id=None, storage_location=None, storage_root=None, updated_at=None, updated_by=None)
07:03 INFO [databricks.labs.ucx.mixins.fixtures] Schema hive_metastore.ucx_sr06s: https://DATABRICKS_HOST/explore/data/hive_metastore/ucx_sr06s
07:03 DEBUG [databricks.labs.ucx.mixins.fixtures] added schema fixture: SchemaInfo(browse_only=None, catalog_name='hive_metastore', catalog_type=None, comment=None, created_at=None, created_by=None, effective_predictive_optimization_flag=None, enable_predictive_optimization=None, full_name='hive_metastore.ucx_sr06s', metastore_id=None, name='ucx_sr06s', owner=None, properties=None, schema_id=None, storage_location=None, storage_root=None, updated_at=None, updated_by=None)
07:03 DEBUG [databricks.labs.ucx.install] Cannot find previous installation: Path (/Users/0a330eb5-dd51-4d97-b6e4-c474356b1d5d/.z8Bt/config.yml) doesn't exist.
07:03 INFO [databricks.labs.ucx.install] Please answer a couple of questions to configure Unity Catalog migration
07:03 INFO [databricks.labs.ucx.installer.hms_lineage] HMS Lineage feature creates one system table named system.hms_to_uc_migration.table_access and helps in your migration process from HMS to UC by allowing you to programmatically query HMS lineage data.
07:03 INFO [databricks.labs.ucx.install] Fetching installations...
07:03 WARNING [databricks.labs.ucx.install] Existing installation at /Users/0a330eb5-dd51-4d97-b6e4-c474356b1d5d/.z8Bt is corrupted. Skipping...
07:03 INFO [databricks.labs.ucx.installer.policy] Creating UCX cluster policy.
07:03 DEBUG [tests.integration.conftest] Waiting for clusters to start...
07:12 DEBUG [tests.integration.conftest] Waiting for clusters to start...
07:12 INFO [databricks.labs.ucx.install] Installing UCX v0.22.1+3220240505071207
07:12 INFO [databricks.labs.ucx.install] Creating ucx schemas...
07:12 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=remove-workspace-local-backup-groups
07:12 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=migrate-groups-experimental
07:12 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=assessment
07:12 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=migrate-tables
07:12 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=migrate-groups
07:12 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=migrate-external-hiveserde-tables-in-place-experimental
07:12 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=migrate-tables-in-mounts-experimental
07:12 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=validate-groups-permissions
07:12 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=failing
07:12 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=migrate-external-tables-ctas
07:12 INFO [databricks.labs.ucx.install] Installation completed successfully! Please refer to the https://DATABRICKS_HOST/#workspace/Users/0a330eb5-dd51-4d97-b6e4-c474356b1d5d/.z8Bt/README for the next steps.
07:12 DEBUG [databricks.labs.ucx.installer.workflows] starting migrate-tables job: https://DATABRICKS_HOST#job/532561735305135
07:03 DEBUG [databricks.labs.ucx.mixins.fixtures] added make_dbfs_data_copy fixture: dbfs:/mnt/TEST_MOUNT_NAME/a/b/SPom
07:03 INFO [databricks.labs.ucx.mixins.fixtures] Schema hive_metastore.migrate_fk30c: https://DATABRICKS_HOST/explore/data/hive_metastore/migrate_fk30c
07:03 DEBUG [databricks.labs.ucx.mixins.fixtures] added schema fixture: SchemaInfo(browse_only=None, catalog_name='hive_metastore', catalog_type=None, comment=None, created_at=None, created_by=None, effective_predictive_optimization_flag=None, enable_predictive_optimization=None, full_name='hive_metastore.migrate_fk30c', metastore_id=None, name='migrate_fk30c', owner=None, properties=None, schema_id=None, storage_location=None, storage_root=None, updated_at=None, updated_by=None)
07:03 INFO [databricks.labs.ucx.mixins.fixtures] Table hive_metastore.migrate_fk30c.ucx_tmxgt: https://DATABRICKS_HOST/explore/data/hive_metastore/migrate_fk30c/ucx_tmxgt
07:03 DEBUG [databricks.labs.ucx.mixins.fixtures] added table fixture: TableInfo(access_point=None, browse_only=None, catalog_name='hive_metastore', columns=None, comment=None, created_at=None, created_by=None, data_access_configuration_id=None, data_source_format=<DataSourceFormat.DELTA: 'DELTA'>, deleted_at=None, delta_runtime_properties_kvpairs=None, effective_predictive_optimization_flag=None, enable_predictive_optimization=None, encryption_details=None, full_name='hive_metastore.migrate_fk30c.ucx_tmxgt', metastore_id=None, name='ucx_tmxgt', owner=None, pipeline_id=None, properties=None, row_filter=None, schema_name='migrate_fk30c', sql_path=None, storage_credential_name=None, storage_location='dbfs:/user/hive/warehouse/migrate_fk30c/ucx_tmxgt', table_constraints=None, table_id=None, table_type=<TableType.MANAGED: 'MANAGED'>, updated_at=None, updated_by=None, view_definition=None, view_dependencies=None)
07:03 INFO [databricks.labs.ucx.mixins.fixtures] Table hive_metastore.migrate_fk30c.ucx_tnffd: https://DATABRICKS_HOST/explore/data/hive_metastore/migrate_fk30c/ucx_tnffd
07:03 DEBUG [databricks.labs.ucx.mixins.fixtures] added table fixture: TableInfo(access_point=None, browse_only=None, catalog_name='hive_metastore', columns=None, comment=None, created_at=None, created_by=None, data_access_configuration_id=None, data_source_format=<DataSourceFormat.CSV: 'CSV'>, deleted_at=None, delta_runtime_properties_kvpairs=None, effective_predictive_optimization_flag=None, enable_predictive_optimization=None, encryption_details=None, full_name='hive_metastore.migrate_fk30c.ucx_tnffd', metastore_id=None, name='ucx_tnffd', owner=None, pipeline_id=None, properties=None, row_filter=None, schema_name='migrate_fk30c', sql_path=None, storage_credential_name=None, storage_location='dbfs:/mnt/TEST_MOUNT_NAME/a/b/SPom', table_constraints=None, table_id=None, table_type=<TableType.EXTERNAL: 'EXTERNAL'>, updated_at=None, updated_by=None, view_definition=None, view_dependencies=None)
07:03 INFO [databricks.labs.ucx.mixins.fixtures] Table hive_metastore.migrate_fk30c.ucx_tft89: https://DATABRICKS_HOST/explore/data/hive_metastore/migrate_fk30c/ucx_tft89
07:03 DEBUG [databricks.labs.ucx.mixins.fixtures] added table fixture: TableInfo(access_point=None, browse_only=None, catalog_name='hive_metastore', columns=None, comment=None, created_at=None, created_by=None, data_access_configuration_id=None, data_source_format=None, deleted_at=None, delta_runtime_properties_kvpairs=None, effective_predictive_optimization_flag=None, enable_predictive_optimization=None, encryption_details=None, full_name='hive_metastore.migrate_fk30c.ucx_tft89', metastore_id=None, name='ucx_tft89', owner=None, pipeline_id=None, properties=None, row_filter=None, schema_name='migrate_fk30c', sql_path=None, storage_credential_name=None, storage_location=None, table_constraints=None, table_id=None, table_type=<TableType.VIEW: 'VIEW'>, updated_at=None, updated_by=None, view_definition='SELECT * FROM hive_metastore.migrate_fk30c.ucx_tmxgt', view_dependencies=None)
07:03 INFO [databricks.labs.ucx.mixins.fixtures] Table hive_metastore.migrate_fk30c.ucx_telik: https://DATABRICKS_HOST/explore/data/hive_metastore/migrate_fk30c/ucx_telik
07:03 DEBUG [databricks.labs.ucx.mixins.fixtures] added table fixture: TableInfo(access_point=None, browse_only=None, catalog_name='hive_metastore', columns=None, comment=None, created_at=None, created_by=None, data_access_configuration_id=None, data_source_format=None, deleted_at=None, delta_runtime_properties_kvpairs=None, effective_predictive_optimization_flag=None, enable_predictive_optimization=None, encryption_details=None, full_name='hive_metastore.migrate_fk30c.ucx_telik', metastore_id=None, name='ucx_telik', owner=None, pipeline_id=None, properties=None, row_filter=None, schema_name='migrate_fk30c', sql_path=None, storage_credential_name=None, storage_location=None, table_constraints=None, table_id=None, table_type=<TableType.VIEW: 'VIEW'>, updated_at=None, updated_by=None, view_definition='SELECT * FROM hive_metastore.migrate_fk30c.ucx_tft89', view_dependencies=None)
07:03 DEBUG [databricks.labs.ucx.mixins.fixtures] added catalog fixture: CatalogInfo(browse_only=False, catalog_type=<CatalogType.MANAGED_CATALOG: 'MANAGED_CATALOG'>, comment='', connection_name=None, created_at=1714892613105, created_by='0a330eb5-dd51-4d97-b6e4-c474356b1d5d', effective_predictive_optimization_flag=None, enable_predictive_optimization=None, full_name='ucx_crwug', isolation_mode=<IsolationMode.OPEN: 'OPEN'>, metastore_id='8952c1e3-b265-4adf-98c3-6f755e2e1453', name='ucx_crwug', options=None, owner='0a330eb5-dd51-4d97-b6e4-c474356b1d5d', properties=None, provider_name=None, provisioning_info=None, securable_kind=<CatalogInfoSecurableKind.CATALOG_STANDARD: 'CATALOG_STANDARD'>, securable_type='CATALOG', share_name=None, storage_location=None, storage_root=None, updated_at=1714892613105, updated_by='0a330eb5-dd51-4d97-b6e4-c474356b1d5d')
07:03 INFO [databricks.labs.ucx.mixins.fixtures] Schema ucx_crwug.migrate_fk30c: https://DATABRICKS_HOST/explore/data/ucx_crwug/migrate_fk30c
07:03 DEBUG [databricks.labs.ucx.mixins.fixtures] added schema fixture: SchemaInfo(browse_only=None, catalog_name='ucx_crwug', catalog_type=None, comment=None, created_at=None, created_by=None, effective_predictive_optimization_flag=None, enable_predictive_optimization=None, full_name='ucx_crwug.migrate_fk30c', metastore_id=None, name='migrate_fk30c', owner=None, properties=None, schema_id=None, storage_location=None, storage_root=None, updated_at=None, updated_by=None)
07:03 INFO [databricks.labs.ucx.mixins.fixtures] Schema hive_metastore.ucx_sr06s: https://DATABRICKS_HOST/explore/data/hive_metastore/ucx_sr06s
07:03 DEBUG [databricks.labs.ucx.mixins.fixtures] added schema fixture: SchemaInfo(browse_only=None, catalog_name='hive_metastore', catalog_type=None, comment=None, created_at=None, created_by=None, effective_predictive_optimization_flag=None, enable_predictive_optimization=None, full_name='hive_metastore.ucx_sr06s', metastore_id=None, name='ucx_sr06s', owner=None, properties=None, schema_id=None, storage_location=None, storage_root=None, updated_at=None, updated_by=None)
07:03 DEBUG [databricks.labs.ucx.install] Cannot find previous installation: Path (/Users/0a330eb5-dd51-4d97-b6e4-c474356b1d5d/.z8Bt/config.yml) doesn't exist.
07:03 INFO [databricks.labs.ucx.install] Please answer a couple of questions to configure Unity Catalog migration
07:03 INFO [databricks.labs.ucx.installer.hms_lineage] HMS Lineage feature creates one system table named system.hms_to_uc_migration.table_access and helps in your migration process from HMS to UC by allowing you to programmatically query HMS lineage data.
07:03 INFO [databricks.labs.ucx.install] Fetching installations...
07:03 WARNING [databricks.labs.ucx.install] Existing installation at /Users/0a330eb5-dd51-4d97-b6e4-c474356b1d5d/.z8Bt is corrupted. Skipping...
07:03 INFO [databricks.labs.ucx.installer.policy] Creating UCX cluster policy.
07:03 DEBUG [tests.integration.conftest] Waiting for clusters to start...
07:12 DEBUG [tests.integration.conftest] Waiting for clusters to start...
07:12 INFO [databricks.labs.ucx.install] Installing UCX v0.22.1+3220240505071207
07:12 INFO [databricks.labs.ucx.install] Creating ucx schemas...
07:12 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=remove-workspace-local-backup-groups
07:12 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=migrate-groups-experimental
07:12 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=assessment
07:12 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=migrate-tables
07:12 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=migrate-groups
07:12 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=migrate-external-hiveserde-tables-in-place-experimental
07:12 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=migrate-tables-in-mounts-experimental
07:12 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=validate-groups-permissions
07:12 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=failing
07:12 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=migrate-external-tables-ctas
07:12 INFO [databricks.labs.ucx.install] Installation completed successfully! Please refer to the https://DATABRICKS_HOST/#workspace/Users/0a330eb5-dd51-4d97-b6e4-c474356b1d5d/.z8Bt/README for the next steps.
07:12 DEBUG [databricks.labs.ucx.installer.workflows] starting migrate-tables job: https://DATABRICKS_HOST#job/532561735305135
07:15 DEBUG [databricks.labs.ucx.mixins.fixtures] clearing 0 make_storage_dir fixtures
07:15 DEBUG [databricks.labs.ucx.mixins.fixtures] clearing 1 make_dbfs_data_copy fixtures
07:15 DEBUG [databricks.labs.ucx.mixins.fixtures] removing make_dbfs_data_copy fixture: dbfs:/mnt/TEST_MOUNT_NAME/a/b/SPom
07:15 DEBUG [databricks.labs.ucx.mixins.fixtures] clearing 0 cluster fixtures
07:15 DEBUG [databricks.labs.ucx.mixins.fixtures] clearing 1 catalog fixtures
07:15 DEBUG [databricks.labs.ucx.mixins.fixtures] removing catalog fixture: CatalogInfo(browse_only=False, catalog_type=<CatalogType.MANAGED_CATALOG: 'MANAGED_CATALOG'>, comment='', connection_name=None, created_at=1714892613105, created_by='0a330eb5-dd51-4d97-b6e4-c474356b1d5d', effective_predictive_optimization_flag=None, enable_predictive_optimization=None, full_name='ucx_crwug', isolation_mode=<IsolationMode.OPEN: 'OPEN'>, metastore_id='8952c1e3-b265-4adf-98c3-6f755e2e1453', name='ucx_crwug', options=None, owner='0a330eb5-dd51-4d97-b6e4-c474356b1d5d', properties=None, provider_name=None, provisioning_info=None, securable_kind=<CatalogInfoSecurableKind.CATALOG_STANDARD: 'CATALOG_STANDARD'>, securable_type='CATALOG', share_name=None, storage_location=None, storage_root=None, updated_at=1714892613105, updated_by='0a330eb5-dd51-4d97-b6e4-c474356b1d5d')
07:15 DEBUG [databricks.labs.ucx.mixins.fixtures] ignoring error while catalog CatalogInfo(browse_only=False, catalog_type=<CatalogType.MANAGED_CATALOG: 'MANAGED_CATALOG'>, comment='', connection_name=None, created_at=1714892613105, created_by='0a330eb5-dd51-4d97-b6e4-c474356b1d5d', effective_predictive_optimization_flag=None, enable_predictive_optimization=None, full_name='ucx_crwug', isolation_mode=<IsolationMode.OPEN: 'OPEN'>, metastore_id='8952c1e3-b265-4adf-98c3-6f755e2e1453', name='ucx_crwug', options=None, owner='0a330eb5-dd51-4d97-b6e4-c474356b1d5d', properties=None, provider_name=None, provisioning_info=None, securable_kind=<CatalogInfoSecurableKind.CATALOG_STANDARD: 'CATALOG_STANDARD'>, securable_type='CATALOG', share_name=None, storage_location=None, storage_root=None, updated_at=1714892613105, updated_by='0a330eb5-dd51-4d97-b6e4-c474356b1d5d') teardown: Catalog 'ucx_crwug' does not exist.
07:15 INFO [databricks.labs.ucx.install] Deleting UCX v0.22.1+3220240505071525 from https://DATABRICKS_HOST
07:15 INFO [databricks.labs.ucx.install] Deleting inventory database ucx_sr06s
07:15 INFO [databricks.labs.ucx.install] Deleting jobs
07:15 INFO [databricks.labs.ucx.install] Deleting remove-workspace-local-backup-groups job_id=989401604572746.
07:15 INFO [databricks.labs.ucx.install] Deleting migrate-groups-experimental job_id=652186497149582.
07:15 INFO [databricks.labs.ucx.install] Deleting assessment job_id=981593181288816.
07:15 INFO [databricks.labs.ucx.install] Deleting migrate-tables job_id=532561735305135.
07:15 INFO [databricks.labs.ucx.install] Deleting migrate-groups job_id=655535536889399.
07:15 INFO [databricks.labs.ucx.install] Deleting migrate-external-hiveserde-tables-in-place-experimental job_id=1119442836594203.
07:15 INFO [databricks.labs.ucx.install] Deleting migrate-tables-in-mounts-experimental job_id=577734172341417.
07:15 INFO [databricks.labs.ucx.install] Deleting validate-groups-permissions job_id=827240442227832.
07:15 INFO [databricks.labs.ucx.install] Deleting failing job_id=846842259806105.
07:15 INFO [databricks.labs.ucx.install] Deleting migrate-external-tables-ctas job_id=530791421189113.
07:15 INFO [databricks.labs.ucx.install] Deleting cluster policy
07:15 ERROR [databricks.labs.ucx.install] UCX Policy already deleted
07:15 INFO [databricks.labs.ucx.install] Deleting secret scope
07:15 INFO [databricks.labs.ucx.install] UnInstalling UCX complete
07:15 DEBUG [databricks.labs.ucx.mixins.fixtures] clearing 0 workspace user fixtures
07:15 DEBUG [databricks.labs.ucx.mixins.fixtures] clearing 0 account group fixtures
07:15 DEBUG [databricks.labs.ucx.mixins.fixtures] clearing 0 workspace group fixtures
07:15 DEBUG [databricks.labs.ucx.mixins.fixtures] clearing 0 table fixtures
07:15 DEBUG [databricks.labs.ucx.mixins.fixtures] clearing 4 table fixtures
07:15 DEBUG [databricks.labs.ucx.mixins.fixtures] removing table fixture: TableInfo(access_point=None, browse_only=None, catalog_name='hive_metastore', columns=None, comment=None, created_at=None, created_by=None, data_access_configuration_id=None, data_source_format=<DataSourceFormat.DELTA: 'DELTA'>, deleted_at=None, delta_runtime_properties_kvpairs=None, effective_predictive_optimization_flag=None, enable_predictive_optimization=None, encryption_details=None, full_name='hive_metastore.migrate_fk30c.ucx_tmxgt', metastore_id=None, name='ucx_tmxgt', owner=None, pipeline_id=None, properties=None, row_filter=None, schema_name='migrate_fk30c', sql_path=None, storage_credential_name=None, storage_location='dbfs:/user/hive/warehouse/migrate_fk30c/ucx_tmxgt', table_constraints=None, table_id=None, table_type=<TableType.MANAGED: 'MANAGED'>, updated_at=None, updated_by=None, view_definition=None, view_dependencies=None)
07:15 DEBUG [databricks.labs.ucx.mixins.fixtures] removing table fixture: TableInfo(access_point=None, browse_only=None, catalog_name='hive_metastore', columns=None, comment=None, created_at=None, created_by=None, data_access_configuration_id=None, data_source_format=<DataSourceFormat.CSV: 'CSV'>, deleted_at=None, delta_runtime_properties_kvpairs=None, effective_predictive_optimization_flag=None, enable_predictive_optimization=None, encryption_details=None, full_name='hive_metastore.migrate_fk30c.ucx_tnffd', metastore_id=None, name='ucx_tnffd', owner=None, pipeline_id=None, properties=None, row_filter=None, schema_name='migrate_fk30c', sql_path=None, storage_credential_name=None, storage_location='dbfs:/mnt/TEST_MOUNT_NAME/a/b/SPom', table_constraints=None, table_id=None, table_type=<TableType.EXTERNAL: 'EXTERNAL'>, updated_at=None, updated_by=None, view_definition=None, view_dependencies=None)
07:15 DEBUG [databricks.labs.ucx.mixins.fixtures] removing table fixture: TableInfo(access_point=None, browse_only=None, catalog_name='hive_metastore', columns=None, comment=None, created_at=None, created_by=None, data_access_configuration_id=None, data_source_format=None, deleted_at=None, delta_runtime_properties_kvpairs=None, effective_predictive_optimization_flag=None, enable_predictive_optimization=None, encryption_details=None, full_name='hive_metastore.migrate_fk30c.ucx_tft89', metastore_id=None, name='ucx_tft89', owner=None, pipeline_id=None, properties=None, row_filter=None, schema_name='migrate_fk30c', sql_path=None, storage_credential_name=None, storage_location=None, table_constraints=None, table_id=None, table_type=<TableType.VIEW: 'VIEW'>, updated_at=None, updated_by=None, view_definition='SELECT * FROM hive_metastore.migrate_fk30c.ucx_tmxgt', view_dependencies=None)
07:15 DEBUG [databricks.labs.ucx.mixins.fixtures] removing table fixture: TableInfo(access_point=None, browse_only=None, catalog_name='hive_metastore', columns=None, comment=None, created_at=None, created_by=None, data_access_configuration_id=None, data_source_format=None, deleted_at=None, delta_runtime_properties_kvpairs=None, effective_predictive_optimization_flag=None, enable_predictive_optimization=None, encryption_details=None, full_name='hive_metastore.migrate_fk30c.ucx_telik', metastore_id=None, name='ucx_telik', owner=None, pipeline_id=None, properties=None, row_filter=None, schema_name='migrate_fk30c', sql_path=None, storage_credential_name=None, storage_location=None, table_constraints=None, table_id=None, table_type=<TableType.VIEW: 'VIEW'>, updated_at=None, updated_by=None, view_definition='SELECT * FROM hive_metastore.migrate_fk30c.ucx_tft89', view_dependencies=None)
07:15 DEBUG [databricks.labs.ucx.mixins.fixtures] clearing 3 schema fixtures
07:15 DEBUG [databricks.labs.ucx.mixins.fixtures] removing schema fixture: SchemaInfo(browse_only=None, catalog_name='hive_metastore', catalog_type=None, comment=None, created_at=None, created_by=None, effective_predictive_optimization_flag=None, enable_predictive_optimization=None, full_name='hive_metastore.migrate_fk30c', metastore_id=None, name='migrate_fk30c', owner=None, properties=None, schema_id=None, storage_location=None, storage_root=None, updated_at=None, updated_by=None)
07:15 DEBUG [databricks.labs.ucx.mixins.fixtures] removing schema fixture: SchemaInfo(browse_only=None, catalog_name='ucx_crwug', catalog_type=None, comment=None, created_at=None, created_by=None, effective_predictive_optimization_flag=None, enable_predictive_optimization=None, full_name='ucx_crwug.migrate_fk30c', metastore_id=None, name='migrate_fk30c', owner=None, properties=None, schema_id=None, storage_location=None, storage_root=None, updated_at=None, updated_by=None)
07:15 DEBUG [databricks.labs.ucx.mixins.fixtures] removing schema fixture: SchemaInfo(browse_only=None, catalog_name='hive_metastore', catalog_type=None, comment=None, created_at=None, created_by=None, effective_predictive_optimization_flag=None, enable_predictive_optimization=None, full_name='hive_metastore.ucx_sr06s', metastore_id=None, name='ucx_sr06s', owner=None, properties=None, schema_id=None, storage_location=None, storage_root=None, updated_at=None, updated_by=None)
[gw6] linux -- Python 3.10.14 /home/runner/work/ucx/ucx/.venv/bin/python

Running from nightly #51

from ucx.

github-actions avatar github-actions commented on June 2, 2024
❌ test_table_migration_job_refreshes_migration_status[regular-migrate-tables]: AssertionError: No migration status found for TableType.MANAGED hive_metastore.migrate_glmme.ucx_tayjb (17m26.524s)
AssertionError: No migration status found for TableType.MANAGED hive_metastore.migrate_glmme.ucx_tayjb
assert 0 == 1
 +  where 0 = len([])
07:04 DEBUG [databricks.labs.ucx.mixins.fixtures] added make_dbfs_data_copy fixture: dbfs:/mnt/TEST_MOUNT_NAME/a/b/lowI
07:04 INFO [databricks.labs.ucx.mixins.fixtures] Schema hive_metastore.migrate_glmme: https://DATABRICKS_HOST/explore/data/hive_metastore/migrate_glmme
07:04 DEBUG [databricks.labs.ucx.mixins.fixtures] added schema fixture: SchemaInfo(browse_only=None, catalog_name='hive_metastore', catalog_type=None, comment=None, created_at=None, created_by=None, effective_predictive_optimization_flag=None, enable_predictive_optimization=None, full_name='hive_metastore.migrate_glmme', metastore_id=None, name='migrate_glmme', owner=None, properties=None, schema_id=None, storage_location=None, storage_root=None, updated_at=None, updated_by=None)
07:04 INFO [databricks.labs.ucx.mixins.fixtures] Table hive_metastore.migrate_glmme.ucx_tayjb: https://DATABRICKS_HOST/explore/data/hive_metastore/migrate_glmme/ucx_tayjb
07:04 DEBUG [databricks.labs.ucx.mixins.fixtures] added table fixture: TableInfo(access_point=None, browse_only=None, catalog_name='hive_metastore', columns=None, comment=None, created_at=None, created_by=None, data_access_configuration_id=None, data_source_format=<DataSourceFormat.DELTA: 'DELTA'>, deleted_at=None, delta_runtime_properties_kvpairs=None, effective_predictive_optimization_flag=None, enable_predictive_optimization=None, encryption_details=None, full_name='hive_metastore.migrate_glmme.ucx_tayjb', metastore_id=None, name='ucx_tayjb', owner=None, pipeline_id=None, properties=None, row_filter=None, schema_name='migrate_glmme', sql_path=None, storage_credential_name=None, storage_location='dbfs:/user/hive/warehouse/migrate_glmme/ucx_tayjb', table_constraints=None, table_id=None, table_type=<TableType.MANAGED: 'MANAGED'>, updated_at=None, updated_by=None, view_definition=None, view_dependencies=None)
07:04 INFO [databricks.labs.ucx.mixins.fixtures] Table hive_metastore.migrate_glmme.ucx_ttprq: https://DATABRICKS_HOST/explore/data/hive_metastore/migrate_glmme/ucx_ttprq
07:04 DEBUG [databricks.labs.ucx.mixins.fixtures] added table fixture: TableInfo(access_point=None, browse_only=None, catalog_name='hive_metastore', columns=None, comment=None, created_at=None, created_by=None, data_access_configuration_id=None, data_source_format=<DataSourceFormat.CSV: 'CSV'>, deleted_at=None, delta_runtime_properties_kvpairs=None, effective_predictive_optimization_flag=None, enable_predictive_optimization=None, encryption_details=None, full_name='hive_metastore.migrate_glmme.ucx_ttprq', metastore_id=None, name='ucx_ttprq', owner=None, pipeline_id=None, properties=None, row_filter=None, schema_name='migrate_glmme', sql_path=None, storage_credential_name=None, storage_location='dbfs:/mnt/TEST_MOUNT_NAME/a/b/lowI', table_constraints=None, table_id=None, table_type=<TableType.EXTERNAL: 'EXTERNAL'>, updated_at=None, updated_by=None, view_definition=None, view_dependencies=None)
07:04 INFO [databricks.labs.ucx.mixins.fixtures] Table hive_metastore.migrate_glmme.ucx_tixgj: https://DATABRICKS_HOST/explore/data/hive_metastore/migrate_glmme/ucx_tixgj
07:04 DEBUG [databricks.labs.ucx.mixins.fixtures] added table fixture: TableInfo(access_point=None, browse_only=None, catalog_name='hive_metastore', columns=None, comment=None, created_at=None, created_by=None, data_access_configuration_id=None, data_source_format=None, deleted_at=None, delta_runtime_properties_kvpairs=None, effective_predictive_optimization_flag=None, enable_predictive_optimization=None, encryption_details=None, full_name='hive_metastore.migrate_glmme.ucx_tixgj', metastore_id=None, name='ucx_tixgj', owner=None, pipeline_id=None, properties=None, row_filter=None, schema_name='migrate_glmme', sql_path=None, storage_credential_name=None, storage_location=None, table_constraints=None, table_id=None, table_type=<TableType.VIEW: 'VIEW'>, updated_at=None, updated_by=None, view_definition='SELECT * FROM hive_metastore.migrate_glmme.ucx_tayjb', view_dependencies=None)
07:04 INFO [databricks.labs.ucx.mixins.fixtures] Table hive_metastore.migrate_glmme.ucx_tm6cz: https://DATABRICKS_HOST/explore/data/hive_metastore/migrate_glmme/ucx_tm6cz
07:04 DEBUG [databricks.labs.ucx.mixins.fixtures] added table fixture: TableInfo(access_point=None, browse_only=None, catalog_name='hive_metastore', columns=None, comment=None, created_at=None, created_by=None, data_access_configuration_id=None, data_source_format=None, deleted_at=None, delta_runtime_properties_kvpairs=None, effective_predictive_optimization_flag=None, enable_predictive_optimization=None, encryption_details=None, full_name='hive_metastore.migrate_glmme.ucx_tm6cz', metastore_id=None, name='ucx_tm6cz', owner=None, pipeline_id=None, properties=None, row_filter=None, schema_name='migrate_glmme', sql_path=None, storage_credential_name=None, storage_location=None, table_constraints=None, table_id=None, table_type=<TableType.VIEW: 'VIEW'>, updated_at=None, updated_by=None, view_definition='SELECT * FROM hive_metastore.migrate_glmme.ucx_tixgj', view_dependencies=None)
07:04 DEBUG [databricks.labs.ucx.mixins.fixtures] added catalog fixture: CatalogInfo(browse_only=False, catalog_type=<CatalogType.MANAGED_CATALOG: 'MANAGED_CATALOG'>, comment='', connection_name=None, created_at=1714979054012, created_by='0a330eb5-dd51-4d97-b6e4-c474356b1d5d', effective_predictive_optimization_flag=None, enable_predictive_optimization=None, full_name='ucx_ckubs', isolation_mode=<IsolationMode.OPEN: 'OPEN'>, metastore_id='8952c1e3-b265-4adf-98c3-6f755e2e1453', name='ucx_ckubs', options=None, owner='0a330eb5-dd51-4d97-b6e4-c474356b1d5d', properties=None, provider_name=None, provisioning_info=None, securable_kind=<CatalogInfoSecurableKind.CATALOG_STANDARD: 'CATALOG_STANDARD'>, securable_type='CATALOG', share_name=None, storage_location=None, storage_root=None, updated_at=1714979054012, updated_by='0a330eb5-dd51-4d97-b6e4-c474356b1d5d')
07:04 INFO [databricks.labs.ucx.mixins.fixtures] Schema ucx_ckubs.migrate_glmme: https://DATABRICKS_HOST/explore/data/ucx_ckubs/migrate_glmme
07:04 DEBUG [databricks.labs.ucx.mixins.fixtures] added schema fixture: SchemaInfo(browse_only=None, catalog_name='ucx_ckubs', catalog_type=None, comment=None, created_at=None, created_by=None, effective_predictive_optimization_flag=None, enable_predictive_optimization=None, full_name='ucx_ckubs.migrate_glmme', metastore_id=None, name='migrate_glmme', owner=None, properties=None, schema_id=None, storage_location=None, storage_root=None, updated_at=None, updated_by=None)
07:04 INFO [databricks.labs.ucx.mixins.fixtures] Schema hive_metastore.ucx_sfoka: https://DATABRICKS_HOST/explore/data/hive_metastore/ucx_sfoka
07:04 DEBUG [databricks.labs.ucx.mixins.fixtures] added schema fixture: SchemaInfo(browse_only=None, catalog_name='hive_metastore', catalog_type=None, comment=None, created_at=None, created_by=None, effective_predictive_optimization_flag=None, enable_predictive_optimization=None, full_name='hive_metastore.ucx_sfoka', metastore_id=None, name='ucx_sfoka', owner=None, properties=None, schema_id=None, storage_location=None, storage_root=None, updated_at=None, updated_by=None)
[gw7] linux -- Python 3.10.14 /home/runner/work/ucx/ucx/.venv/bin/python
07:04 DEBUG [databricks.labs.ucx.mixins.fixtures] added make_dbfs_data_copy fixture: dbfs:/mnt/TEST_MOUNT_NAME/a/b/lowI
07:04 INFO [databricks.labs.ucx.mixins.fixtures] Schema hive_metastore.migrate_glmme: https://DATABRICKS_HOST/explore/data/hive_metastore/migrate_glmme
07:04 DEBUG [databricks.labs.ucx.mixins.fixtures] added schema fixture: SchemaInfo(browse_only=None, catalog_name='hive_metastore', catalog_type=None, comment=None, created_at=None, created_by=None, effective_predictive_optimization_flag=None, enable_predictive_optimization=None, full_name='hive_metastore.migrate_glmme', metastore_id=None, name='migrate_glmme', owner=None, properties=None, schema_id=None, storage_location=None, storage_root=None, updated_at=None, updated_by=None)
07:04 INFO [databricks.labs.ucx.mixins.fixtures] Table hive_metastore.migrate_glmme.ucx_tayjb: https://DATABRICKS_HOST/explore/data/hive_metastore/migrate_glmme/ucx_tayjb
07:04 DEBUG [databricks.labs.ucx.mixins.fixtures] added table fixture: TableInfo(access_point=None, browse_only=None, catalog_name='hive_metastore', columns=None, comment=None, created_at=None, created_by=None, data_access_configuration_id=None, data_source_format=<DataSourceFormat.DELTA: 'DELTA'>, deleted_at=None, delta_runtime_properties_kvpairs=None, effective_predictive_optimization_flag=None, enable_predictive_optimization=None, encryption_details=None, full_name='hive_metastore.migrate_glmme.ucx_tayjb', metastore_id=None, name='ucx_tayjb', owner=None, pipeline_id=None, properties=None, row_filter=None, schema_name='migrate_glmme', sql_path=None, storage_credential_name=None, storage_location='dbfs:/user/hive/warehouse/migrate_glmme/ucx_tayjb', table_constraints=None, table_id=None, table_type=<TableType.MANAGED: 'MANAGED'>, updated_at=None, updated_by=None, view_definition=None, view_dependencies=None)
07:04 INFO [databricks.labs.ucx.mixins.fixtures] Table hive_metastore.migrate_glmme.ucx_ttprq: https://DATABRICKS_HOST/explore/data/hive_metastore/migrate_glmme/ucx_ttprq
07:04 DEBUG [databricks.labs.ucx.mixins.fixtures] added table fixture: TableInfo(access_point=None, browse_only=None, catalog_name='hive_metastore', columns=None, comment=None, created_at=None, created_by=None, data_access_configuration_id=None, data_source_format=<DataSourceFormat.CSV: 'CSV'>, deleted_at=None, delta_runtime_properties_kvpairs=None, effective_predictive_optimization_flag=None, enable_predictive_optimization=None, encryption_details=None, full_name='hive_metastore.migrate_glmme.ucx_ttprq', metastore_id=None, name='ucx_ttprq', owner=None, pipeline_id=None, properties=None, row_filter=None, schema_name='migrate_glmme', sql_path=None, storage_credential_name=None, storage_location='dbfs:/mnt/TEST_MOUNT_NAME/a/b/lowI', table_constraints=None, table_id=None, table_type=<TableType.EXTERNAL: 'EXTERNAL'>, updated_at=None, updated_by=None, view_definition=None, view_dependencies=None)
07:04 INFO [databricks.labs.ucx.mixins.fixtures] Table hive_metastore.migrate_glmme.ucx_tixgj: https://DATABRICKS_HOST/explore/data/hive_metastore/migrate_glmme/ucx_tixgj
07:04 DEBUG [databricks.labs.ucx.mixins.fixtures] added table fixture: TableInfo(access_point=None, browse_only=None, catalog_name='hive_metastore', columns=None, comment=None, created_at=None, created_by=None, data_access_configuration_id=None, data_source_format=None, deleted_at=None, delta_runtime_properties_kvpairs=None, effective_predictive_optimization_flag=None, enable_predictive_optimization=None, encryption_details=None, full_name='hive_metastore.migrate_glmme.ucx_tixgj', metastore_id=None, name='ucx_tixgj', owner=None, pipeline_id=None, properties=None, row_filter=None, schema_name='migrate_glmme', sql_path=None, storage_credential_name=None, storage_location=None, table_constraints=None, table_id=None, table_type=<TableType.VIEW: 'VIEW'>, updated_at=None, updated_by=None, view_definition='SELECT * FROM hive_metastore.migrate_glmme.ucx_tayjb', view_dependencies=None)
07:04 INFO [databricks.labs.ucx.mixins.fixtures] Table hive_metastore.migrate_glmme.ucx_tm6cz: https://DATABRICKS_HOST/explore/data/hive_metastore/migrate_glmme/ucx_tm6cz
07:04 DEBUG [databricks.labs.ucx.mixins.fixtures] added table fixture: TableInfo(access_point=None, browse_only=None, catalog_name='hive_metastore', columns=None, comment=None, created_at=None, created_by=None, data_access_configuration_id=None, data_source_format=None, deleted_at=None, delta_runtime_properties_kvpairs=None, effective_predictive_optimization_flag=None, enable_predictive_optimization=None, encryption_details=None, full_name='hive_metastore.migrate_glmme.ucx_tm6cz', metastore_id=None, name='ucx_tm6cz', owner=None, pipeline_id=None, properties=None, row_filter=None, schema_name='migrate_glmme', sql_path=None, storage_credential_name=None, storage_location=None, table_constraints=None, table_id=None, table_type=<TableType.VIEW: 'VIEW'>, updated_at=None, updated_by=None, view_definition='SELECT * FROM hive_metastore.migrate_glmme.ucx_tixgj', view_dependencies=None)
07:04 DEBUG [databricks.labs.ucx.mixins.fixtures] added catalog fixture: CatalogInfo(browse_only=False, catalog_type=<CatalogType.MANAGED_CATALOG: 'MANAGED_CATALOG'>, comment='', connection_name=None, created_at=1714979054012, created_by='0a330eb5-dd51-4d97-b6e4-c474356b1d5d', effective_predictive_optimization_flag=None, enable_predictive_optimization=None, full_name='ucx_ckubs', isolation_mode=<IsolationMode.OPEN: 'OPEN'>, metastore_id='8952c1e3-b265-4adf-98c3-6f755e2e1453', name='ucx_ckubs', options=None, owner='0a330eb5-dd51-4d97-b6e4-c474356b1d5d', properties=None, provider_name=None, provisioning_info=None, securable_kind=<CatalogInfoSecurableKind.CATALOG_STANDARD: 'CATALOG_STANDARD'>, securable_type='CATALOG', share_name=None, storage_location=None, storage_root=None, updated_at=1714979054012, updated_by='0a330eb5-dd51-4d97-b6e4-c474356b1d5d')
07:04 INFO [databricks.labs.ucx.mixins.fixtures] Schema ucx_ckubs.migrate_glmme: https://DATABRICKS_HOST/explore/data/ucx_ckubs/migrate_glmme
07:04 DEBUG [databricks.labs.ucx.mixins.fixtures] added schema fixture: SchemaInfo(browse_only=None, catalog_name='ucx_ckubs', catalog_type=None, comment=None, created_at=None, created_by=None, effective_predictive_optimization_flag=None, enable_predictive_optimization=None, full_name='ucx_ckubs.migrate_glmme', metastore_id=None, name='migrate_glmme', owner=None, properties=None, schema_id=None, storage_location=None, storage_root=None, updated_at=None, updated_by=None)
07:04 INFO [databricks.labs.ucx.mixins.fixtures] Schema hive_metastore.ucx_sfoka: https://DATABRICKS_HOST/explore/data/hive_metastore/ucx_sfoka
07:04 DEBUG [databricks.labs.ucx.mixins.fixtures] added schema fixture: SchemaInfo(browse_only=None, catalog_name='hive_metastore', catalog_type=None, comment=None, created_at=None, created_by=None, effective_predictive_optimization_flag=None, enable_predictive_optimization=None, full_name='hive_metastore.ucx_sfoka', metastore_id=None, name='ucx_sfoka', owner=None, properties=None, schema_id=None, storage_location=None, storage_root=None, updated_at=None, updated_by=None)
07:04 DEBUG [databricks.labs.ucx.install] Cannot find previous installation: Path (/Users/0a330eb5-dd51-4d97-b6e4-c474356b1d5d/.WG59/config.yml) doesn't exist.
07:04 INFO [databricks.labs.ucx.install] Please answer a couple of questions to configure Unity Catalog migration
07:04 INFO [databricks.labs.ucx.installer.hms_lineage] HMS Lineage feature creates one system table named system.hms_to_uc_migration.table_access and helps in your migration process from HMS to UC by allowing you to programmatically query HMS lineage data.
07:04 INFO [databricks.labs.ucx.install] Fetching installations...
07:04 WARNING [databricks.labs.ucx.install] Existing installation at /Users/0a330eb5-dd51-4d97-b6e4-c474356b1d5d/.WG59 is corrupted. Skipping...
07:04 INFO [databricks.labs.ucx.installer.policy] Creating UCX cluster policy.
07:04 DEBUG [tests.integration.conftest] Waiting for clusters to start...
07:12 DEBUG [tests.integration.conftest] Waiting for clusters to start...
07:12 INFO [databricks.labs.ucx.install] Installing UCX v0.22.1+3220240506071235
07:12 INFO [databricks.labs.ucx.install] Creating ucx schemas...
07:13 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=failing
07:13 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=migrate-external-hiveserde-tables-in-place-experimental
07:13 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=migrate-tables-in-mounts-experimental
07:13 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=assessment
07:13 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=migrate-tables
07:13 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=migrate-external-tables-ctas
07:13 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=migrate-groups
07:13 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=remove-workspace-local-backup-groups
07:13 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=validate-groups-permissions
07:13 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=migrate-groups-experimental
07:13 INFO [databricks.labs.ucx.install] Installation completed successfully! Please refer to the https://DATABRICKS_HOST/#workspace/Users/0a330eb5-dd51-4d97-b6e4-c474356b1d5d/.WG59/README for the next steps.
07:13 DEBUG [databricks.labs.ucx.installer.workflows] starting migrate-tables job: https://DATABRICKS_HOST#job/482415789776984
07:04 DEBUG [databricks.labs.ucx.mixins.fixtures] added make_dbfs_data_copy fixture: dbfs:/mnt/TEST_MOUNT_NAME/a/b/lowI
07:04 INFO [databricks.labs.ucx.mixins.fixtures] Schema hive_metastore.migrate_glmme: https://DATABRICKS_HOST/explore/data/hive_metastore/migrate_glmme
07:04 DEBUG [databricks.labs.ucx.mixins.fixtures] added schema fixture: SchemaInfo(browse_only=None, catalog_name='hive_metastore', catalog_type=None, comment=None, created_at=None, created_by=None, effective_predictive_optimization_flag=None, enable_predictive_optimization=None, full_name='hive_metastore.migrate_glmme', metastore_id=None, name='migrate_glmme', owner=None, properties=None, schema_id=None, storage_location=None, storage_root=None, updated_at=None, updated_by=None)
07:04 INFO [databricks.labs.ucx.mixins.fixtures] Table hive_metastore.migrate_glmme.ucx_tayjb: https://DATABRICKS_HOST/explore/data/hive_metastore/migrate_glmme/ucx_tayjb
07:04 DEBUG [databricks.labs.ucx.mixins.fixtures] added table fixture: TableInfo(access_point=None, browse_only=None, catalog_name='hive_metastore', columns=None, comment=None, created_at=None, created_by=None, data_access_configuration_id=None, data_source_format=<DataSourceFormat.DELTA: 'DELTA'>, deleted_at=None, delta_runtime_properties_kvpairs=None, effective_predictive_optimization_flag=None, enable_predictive_optimization=None, encryption_details=None, full_name='hive_metastore.migrate_glmme.ucx_tayjb', metastore_id=None, name='ucx_tayjb', owner=None, pipeline_id=None, properties=None, row_filter=None, schema_name='migrate_glmme', sql_path=None, storage_credential_name=None, storage_location='dbfs:/user/hive/warehouse/migrate_glmme/ucx_tayjb', table_constraints=None, table_id=None, table_type=<TableType.MANAGED: 'MANAGED'>, updated_at=None, updated_by=None, view_definition=None, view_dependencies=None)
07:04 INFO [databricks.labs.ucx.mixins.fixtures] Table hive_metastore.migrate_glmme.ucx_ttprq: https://DATABRICKS_HOST/explore/data/hive_metastore/migrate_glmme/ucx_ttprq
07:04 DEBUG [databricks.labs.ucx.mixins.fixtures] added table fixture: TableInfo(access_point=None, browse_only=None, catalog_name='hive_metastore', columns=None, comment=None, created_at=None, created_by=None, data_access_configuration_id=None, data_source_format=<DataSourceFormat.CSV: 'CSV'>, deleted_at=None, delta_runtime_properties_kvpairs=None, effective_predictive_optimization_flag=None, enable_predictive_optimization=None, encryption_details=None, full_name='hive_metastore.migrate_glmme.ucx_ttprq', metastore_id=None, name='ucx_ttprq', owner=None, pipeline_id=None, properties=None, row_filter=None, schema_name='migrate_glmme', sql_path=None, storage_credential_name=None, storage_location='dbfs:/mnt/TEST_MOUNT_NAME/a/b/lowI', table_constraints=None, table_id=None, table_type=<TableType.EXTERNAL: 'EXTERNAL'>, updated_at=None, updated_by=None, view_definition=None, view_dependencies=None)
07:04 INFO [databricks.labs.ucx.mixins.fixtures] Table hive_metastore.migrate_glmme.ucx_tixgj: https://DATABRICKS_HOST/explore/data/hive_metastore/migrate_glmme/ucx_tixgj
07:04 DEBUG [databricks.labs.ucx.mixins.fixtures] added table fixture: TableInfo(access_point=None, browse_only=None, catalog_name='hive_metastore', columns=None, comment=None, created_at=None, created_by=None, data_access_configuration_id=None, data_source_format=None, deleted_at=None, delta_runtime_properties_kvpairs=None, effective_predictive_optimization_flag=None, enable_predictive_optimization=None, encryption_details=None, full_name='hive_metastore.migrate_glmme.ucx_tixgj', metastore_id=None, name='ucx_tixgj', owner=None, pipeline_id=None, properties=None, row_filter=None, schema_name='migrate_glmme', sql_path=None, storage_credential_name=None, storage_location=None, table_constraints=None, table_id=None, table_type=<TableType.VIEW: 'VIEW'>, updated_at=None, updated_by=None, view_definition='SELECT * FROM hive_metastore.migrate_glmme.ucx_tayjb', view_dependencies=None)
07:04 INFO [databricks.labs.ucx.mixins.fixtures] Table hive_metastore.migrate_glmme.ucx_tm6cz: https://DATABRICKS_HOST/explore/data/hive_metastore/migrate_glmme/ucx_tm6cz
07:04 DEBUG [databricks.labs.ucx.mixins.fixtures] added table fixture: TableInfo(access_point=None, browse_only=None, catalog_name='hive_metastore', columns=None, comment=None, created_at=None, created_by=None, data_access_configuration_id=None, data_source_format=None, deleted_at=None, delta_runtime_properties_kvpairs=None, effective_predictive_optimization_flag=None, enable_predictive_optimization=None, encryption_details=None, full_name='hive_metastore.migrate_glmme.ucx_tm6cz', metastore_id=None, name='ucx_tm6cz', owner=None, pipeline_id=None, properties=None, row_filter=None, schema_name='migrate_glmme', sql_path=None, storage_credential_name=None, storage_location=None, table_constraints=None, table_id=None, table_type=<TableType.VIEW: 'VIEW'>, updated_at=None, updated_by=None, view_definition='SELECT * FROM hive_metastore.migrate_glmme.ucx_tixgj', view_dependencies=None)
07:04 DEBUG [databricks.labs.ucx.mixins.fixtures] added catalog fixture: CatalogInfo(browse_only=False, catalog_type=<CatalogType.MANAGED_CATALOG: 'MANAGED_CATALOG'>, comment='', connection_name=None, created_at=1714979054012, created_by='0a330eb5-dd51-4d97-b6e4-c474356b1d5d', effective_predictive_optimization_flag=None, enable_predictive_optimization=None, full_name='ucx_ckubs', isolation_mode=<IsolationMode.OPEN: 'OPEN'>, metastore_id='8952c1e3-b265-4adf-98c3-6f755e2e1453', name='ucx_ckubs', options=None, owner='0a330eb5-dd51-4d97-b6e4-c474356b1d5d', properties=None, provider_name=None, provisioning_info=None, securable_kind=<CatalogInfoSecurableKind.CATALOG_STANDARD: 'CATALOG_STANDARD'>, securable_type='CATALOG', share_name=None, storage_location=None, storage_root=None, updated_at=1714979054012, updated_by='0a330eb5-dd51-4d97-b6e4-c474356b1d5d')
07:04 INFO [databricks.labs.ucx.mixins.fixtures] Schema ucx_ckubs.migrate_glmme: https://DATABRICKS_HOST/explore/data/ucx_ckubs/migrate_glmme
07:04 DEBUG [databricks.labs.ucx.mixins.fixtures] added schema fixture: SchemaInfo(browse_only=None, catalog_name='ucx_ckubs', catalog_type=None, comment=None, created_at=None, created_by=None, effective_predictive_optimization_flag=None, enable_predictive_optimization=None, full_name='ucx_ckubs.migrate_glmme', metastore_id=None, name='migrate_glmme', owner=None, properties=None, schema_id=None, storage_location=None, storage_root=None, updated_at=None, updated_by=None)
07:04 INFO [databricks.labs.ucx.mixins.fixtures] Schema hive_metastore.ucx_sfoka: https://DATABRICKS_HOST/explore/data/hive_metastore/ucx_sfoka
07:04 DEBUG [databricks.labs.ucx.mixins.fixtures] added schema fixture: SchemaInfo(browse_only=None, catalog_name='hive_metastore', catalog_type=None, comment=None, created_at=None, created_by=None, effective_predictive_optimization_flag=None, enable_predictive_optimization=None, full_name='hive_metastore.ucx_sfoka', metastore_id=None, name='ucx_sfoka', owner=None, properties=None, schema_id=None, storage_location=None, storage_root=None, updated_at=None, updated_by=None)
07:04 DEBUG [databricks.labs.ucx.install] Cannot find previous installation: Path (/Users/0a330eb5-dd51-4d97-b6e4-c474356b1d5d/.WG59/config.yml) doesn't exist.
07:04 INFO [databricks.labs.ucx.install] Please answer a couple of questions to configure Unity Catalog migration
07:04 INFO [databricks.labs.ucx.installer.hms_lineage] HMS Lineage feature creates one system table named system.hms_to_uc_migration.table_access and helps in your migration process from HMS to UC by allowing you to programmatically query HMS lineage data.
07:04 INFO [databricks.labs.ucx.install] Fetching installations...
07:04 WARNING [databricks.labs.ucx.install] Existing installation at /Users/0a330eb5-dd51-4d97-b6e4-c474356b1d5d/.WG59 is corrupted. Skipping...
07:04 INFO [databricks.labs.ucx.installer.policy] Creating UCX cluster policy.
07:04 DEBUG [tests.integration.conftest] Waiting for clusters to start...
07:12 DEBUG [tests.integration.conftest] Waiting for clusters to start...
07:12 INFO [databricks.labs.ucx.install] Installing UCX v0.22.1+3220240506071235
07:12 INFO [databricks.labs.ucx.install] Creating ucx schemas...
07:13 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=failing
07:13 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=migrate-external-hiveserde-tables-in-place-experimental
07:13 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=migrate-tables-in-mounts-experimental
07:13 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=assessment
07:13 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=migrate-tables
07:13 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=migrate-external-tables-ctas
07:13 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=migrate-groups
07:13 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=remove-workspace-local-backup-groups
07:13 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=validate-groups-permissions
07:13 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=migrate-groups-experimental
07:13 INFO [databricks.labs.ucx.install] Installation completed successfully! Please refer to the https://DATABRICKS_HOST/#workspace/Users/0a330eb5-dd51-4d97-b6e4-c474356b1d5d/.WG59/README for the next steps.
07:13 DEBUG [databricks.labs.ucx.installer.workflows] starting migrate-tables job: https://DATABRICKS_HOST#job/482415789776984
07:21 DEBUG [databricks.labs.ucx.mixins.fixtures] clearing 0 make_storage_dir fixtures
07:21 DEBUG [databricks.labs.ucx.mixins.fixtures] clearing 1 make_dbfs_data_copy fixtures
07:21 DEBUG [databricks.labs.ucx.mixins.fixtures] removing make_dbfs_data_copy fixture: dbfs:/mnt/TEST_MOUNT_NAME/a/b/lowI
07:21 DEBUG [databricks.labs.ucx.mixins.fixtures] clearing 0 cluster fixtures
07:21 DEBUG [databricks.labs.ucx.mixins.fixtures] clearing 1 catalog fixtures
07:21 DEBUG [databricks.labs.ucx.mixins.fixtures] removing catalog fixture: CatalogInfo(browse_only=False, catalog_type=<CatalogType.MANAGED_CATALOG: 'MANAGED_CATALOG'>, comment='', connection_name=None, created_at=1714979054012, created_by='0a330eb5-dd51-4d97-b6e4-c474356b1d5d', effective_predictive_optimization_flag=None, enable_predictive_optimization=None, full_name='ucx_ckubs', isolation_mode=<IsolationMode.OPEN: 'OPEN'>, metastore_id='8952c1e3-b265-4adf-98c3-6f755e2e1453', name='ucx_ckubs', options=None, owner='0a330eb5-dd51-4d97-b6e4-c474356b1d5d', properties=None, provider_name=None, provisioning_info=None, securable_kind=<CatalogInfoSecurableKind.CATALOG_STANDARD: 'CATALOG_STANDARD'>, securable_type='CATALOG', share_name=None, storage_location=None, storage_root=None, updated_at=1714979054012, updated_by='0a330eb5-dd51-4d97-b6e4-c474356b1d5d')
07:21 DEBUG [databricks.labs.ucx.mixins.fixtures] ignoring error while catalog CatalogInfo(browse_only=False, catalog_type=<CatalogType.MANAGED_CATALOG: 'MANAGED_CATALOG'>, comment='', connection_name=None, created_at=1714979054012, created_by='0a330eb5-dd51-4d97-b6e4-c474356b1d5d', effective_predictive_optimization_flag=None, enable_predictive_optimization=None, full_name='ucx_ckubs', isolation_mode=<IsolationMode.OPEN: 'OPEN'>, metastore_id='8952c1e3-b265-4adf-98c3-6f755e2e1453', name='ucx_ckubs', options=None, owner='0a330eb5-dd51-4d97-b6e4-c474356b1d5d', properties=None, provider_name=None, provisioning_info=None, securable_kind=<CatalogInfoSecurableKind.CATALOG_STANDARD: 'CATALOG_STANDARD'>, securable_type='CATALOG', share_name=None, storage_location=None, storage_root=None, updated_at=1714979054012, updated_by='0a330eb5-dd51-4d97-b6e4-c474356b1d5d') teardown: Catalog 'ucx_ckubs' does not exist.
07:21 INFO [databricks.labs.ucx.install] Deleting UCX v0.22.1+3220240506072112 from https://DATABRICKS_HOST
07:21 INFO [databricks.labs.ucx.install] Deleting inventory database ucx_sfoka
07:21 INFO [databricks.labs.ucx.install] Deleting jobs
07:21 INFO [databricks.labs.ucx.install] Deleting failing job_id=2375574480009.
07:21 INFO [databricks.labs.ucx.install] Deleting migrate-external-hiveserde-tables-in-place-experimental job_id=846374555583111.
07:21 INFO [databricks.labs.ucx.install] Deleting migrate-tables-in-mounts-experimental job_id=475133728557186.
07:21 INFO [databricks.labs.ucx.install] Deleting assessment job_id=65000535558734.
07:21 INFO [databricks.labs.ucx.install] Deleting migrate-tables job_id=482415789776984.
07:21 INFO [databricks.labs.ucx.install] Deleting migrate-external-tables-ctas job_id=459741884477712.
07:21 INFO [databricks.labs.ucx.install] Deleting migrate-groups job_id=552187433608344.
07:21 INFO [databricks.labs.ucx.install] Deleting remove-workspace-local-backup-groups job_id=1015674183634422.
07:21 INFO [databricks.labs.ucx.install] Deleting validate-groups-permissions job_id=621844289817233.
07:21 INFO [databricks.labs.ucx.install] Deleting migrate-groups-experimental job_id=1022107944807762.
07:21 INFO [databricks.labs.ucx.install] Deleting cluster policy
07:21 ERROR [databricks.labs.ucx.install] UCX Policy already deleted
07:21 INFO [databricks.labs.ucx.install] Deleting secret scope
07:21 INFO [databricks.labs.ucx.install] UnInstalling UCX complete
07:21 DEBUG [databricks.labs.ucx.mixins.fixtures] clearing 0 workspace user fixtures
07:21 DEBUG [databricks.labs.ucx.mixins.fixtures] clearing 0 account group fixtures
07:21 DEBUG [databricks.labs.ucx.mixins.fixtures] clearing 0 workspace group fixtures
07:21 DEBUG [databricks.labs.ucx.mixins.fixtures] clearing 0 table fixtures
07:21 DEBUG [databricks.labs.ucx.mixins.fixtures] clearing 4 table fixtures
07:21 DEBUG [databricks.labs.ucx.mixins.fixtures] removing table fixture: TableInfo(access_point=None, browse_only=None, catalog_name='hive_metastore', columns=None, comment=None, created_at=None, created_by=None, data_access_configuration_id=None, data_source_format=<DataSourceFormat.DELTA: 'DELTA'>, deleted_at=None, delta_runtime_properties_kvpairs=None, effective_predictive_optimization_flag=None, enable_predictive_optimization=None, encryption_details=None, full_name='hive_metastore.migrate_glmme.ucx_tayjb', metastore_id=None, name='ucx_tayjb', owner=None, pipeline_id=None, properties=None, row_filter=None, schema_name='migrate_glmme', sql_path=None, storage_credential_name=None, storage_location='dbfs:/user/hive/warehouse/migrate_glmme/ucx_tayjb', table_constraints=None, table_id=None, table_type=<TableType.MANAGED: 'MANAGED'>, updated_at=None, updated_by=None, view_definition=None, view_dependencies=None)
07:21 DEBUG [databricks.labs.ucx.mixins.fixtures] removing table fixture: TableInfo(access_point=None, browse_only=None, catalog_name='hive_metastore', columns=None, comment=None, created_at=None, created_by=None, data_access_configuration_id=None, data_source_format=<DataSourceFormat.CSV: 'CSV'>, deleted_at=None, delta_runtime_properties_kvpairs=None, effective_predictive_optimization_flag=None, enable_predictive_optimization=None, encryption_details=None, full_name='hive_metastore.migrate_glmme.ucx_ttprq', metastore_id=None, name='ucx_ttprq', owner=None, pipeline_id=None, properties=None, row_filter=None, schema_name='migrate_glmme', sql_path=None, storage_credential_name=None, storage_location='dbfs:/mnt/TEST_MOUNT_NAME/a/b/lowI', table_constraints=None, table_id=None, table_type=<TableType.EXTERNAL: 'EXTERNAL'>, updated_at=None, updated_by=None, view_definition=None, view_dependencies=None)
07:21 DEBUG [databricks.labs.ucx.mixins.fixtures] removing table fixture: TableInfo(access_point=None, browse_only=None, catalog_name='hive_metastore', columns=None, comment=None, created_at=None, created_by=None, data_access_configuration_id=None, data_source_format=None, deleted_at=None, delta_runtime_properties_kvpairs=None, effective_predictive_optimization_flag=None, enable_predictive_optimization=None, encryption_details=None, full_name='hive_metastore.migrate_glmme.ucx_tixgj', metastore_id=None, name='ucx_tixgj', owner=None, pipeline_id=None, properties=None, row_filter=None, schema_name='migrate_glmme', sql_path=None, storage_credential_name=None, storage_location=None, table_constraints=None, table_id=None, table_type=<TableType.VIEW: 'VIEW'>, updated_at=None, updated_by=None, view_definition='SELECT * FROM hive_metastore.migrate_glmme.ucx_tayjb', view_dependencies=None)
07:21 DEBUG [databricks.labs.ucx.mixins.fixtures] removing table fixture: TableInfo(access_point=None, browse_only=None, catalog_name='hive_metastore', columns=None, comment=None, created_at=None, created_by=None, data_access_configuration_id=None, data_source_format=None, deleted_at=None, delta_runtime_properties_kvpairs=None, effective_predictive_optimization_flag=None, enable_predictive_optimization=None, encryption_details=None, full_name='hive_metastore.migrate_glmme.ucx_tm6cz', metastore_id=None, name='ucx_tm6cz', owner=None, pipeline_id=None, properties=None, row_filter=None, schema_name='migrate_glmme', sql_path=None, storage_credential_name=None, storage_location=None, table_constraints=None, table_id=None, table_type=<TableType.VIEW: 'VIEW'>, updated_at=None, updated_by=None, view_definition='SELECT * FROM hive_metastore.migrate_glmme.ucx_tixgj', view_dependencies=None)
07:21 DEBUG [databricks.labs.ucx.mixins.fixtures] clearing 3 schema fixtures
07:21 DEBUG [databricks.labs.ucx.mixins.fixtures] removing schema fixture: SchemaInfo(browse_only=None, catalog_name='hive_metastore', catalog_type=None, comment=None, created_at=None, created_by=None, effective_predictive_optimization_flag=None, enable_predictive_optimization=None, full_name='hive_metastore.migrate_glmme', metastore_id=None, name='migrate_glmme', owner=None, properties=None, schema_id=None, storage_location=None, storage_root=None, updated_at=None, updated_by=None)
07:21 DEBUG [databricks.labs.ucx.mixins.fixtures] removing schema fixture: SchemaInfo(browse_only=None, catalog_name='ucx_ckubs', catalog_type=None, comment=None, created_at=None, created_by=None, effective_predictive_optimization_flag=None, enable_predictive_optimization=None, full_name='ucx_ckubs.migrate_glmme', metastore_id=None, name='migrate_glmme', owner=None, properties=None, schema_id=None, storage_location=None, storage_root=None, updated_at=None, updated_by=None)
07:21 DEBUG [databricks.labs.ucx.mixins.fixtures] removing schema fixture: SchemaInfo(browse_only=None, catalog_name='hive_metastore', catalog_type=None, comment=None, created_at=None, created_by=None, effective_predictive_optimization_flag=None, enable_predictive_optimization=None, full_name='hive_metastore.ucx_sfoka', metastore_id=None, name='ucx_sfoka', owner=None, properties=None, schema_id=None, storage_location=None, storage_root=None, updated_at=None, updated_by=None)
[gw7] linux -- Python 3.10.14 /home/runner/work/ucx/ucx/.venv/bin/python

Running from nightly #52

from ucx.

Related Issues (20)

Recommend Projects

  • React photo React

    A declarative, efficient, and flexible JavaScript library for building user interfaces.

  • Vue.js photo Vue.js

    🖖 Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.

  • Typescript photo Typescript

    TypeScript is a superset of JavaScript that compiles to clean JavaScript output.

  • TensorFlow photo TensorFlow

    An Open Source Machine Learning Framework for Everyone

  • Django photo Django

    The Web framework for perfectionists with deadlines.

  • D3 photo D3

    Bring data to life with SVG, Canvas and HTML. 📊📈🎉

Recommend Topics

  • javascript

    JavaScript (JS) is a lightweight interpreted programming language with first-class functions.

  • web

    Some thing interesting about web. New door for the world.

  • server

    A server is a program made to process requests and deliver data to clients.

  • Machine learning

    Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.

  • Game

    Some thing interesting about game, make everyone happy.

Recommend Org

  • Facebook photo Facebook

    We are working to build community through open source technology. NB: members must have two-factor auth.

  • Microsoft photo Microsoft

    Open source projects and samples from Microsoft.

  • Google photo Google

    Google ❤️ Open Source for everyone.

  • D3 photo D3

    Data-Driven Documents codes.