datastrato / gravitino-playground Goto Github PK

Now, Iceberg use the same location as Hive. This may be misleading for newcomers. We change it to a new path

I'd like to add more sales data but loading via SQL through Trino is slow. Is there a better way to load more data?

Currently, Gravitino playground support Jupyter notebook, We can add a new notebook to explain how to use Trino to federation query mysql, postgres and hive, like this, http://github.com/datastrato/gravitino-playground?tab=readme-ov-file#example

I think we can use these Trino python library

1. https://github.com/CybercentreCanada/jupyterlab-sql-editor/blob/main/example/Trino.ipynb
2. https://github.com/trinodb/trino-python-client

Preferably, we can design a federated query scenario.

Update the Trino connector playground to using simple catalog name
refer to datastrato/gravitino#2947

I'm using Windows 10 with Podman 4.8.3. When I use "podman compose up", it looks all good when downloading the docker images, start them. But finally it reports such error:

playground-gravitino | Start to download the jar package of JDBC
playground-gravitino | --2024-01-07 03:35:07-- https://repo1.maven.org/maven2/mysql/mysql-connector-java/8.0.27/mysql-connector-java-8.0.27.jar
playground-gravitino | Resolving repo1.maven.org (repo1.maven.org)... 198.18.0.34
playground-gravitino | Connecting to repo1.maven.org (repo1.maven.org)|198.18.0.34|:443... connected.
playground-gravitino | HTTP request sent, awaiting response... 200 OK
playground-gravitino | Length: 2475087 (2.4M) [application/java-archive]
playground-gravitino | Saving to: ‘/root/gravitino/catalogs/jdbc-mysql/libs/mysql-connector-java-8.0.27.jar\r’
playground-gravitino |
playground-gravitino | 0K .......... .......... .......... .......... .......... 2% 309K 8s
playground-gravitino | 50K .......... .......... .......... .......... .......... 4% 847K 5s
playground-gravitino | 100K .......... .......... .......... .......... .......... 6% 441K 5s
playground-gravitino | 150K .......... .......... .......... .......... .......... 8% 5.22M 4s
playground-gravitino | 200K .......... .......... .......... .......... .......... 10% 1.97M 3s
playground-gravitino | 250K .......... .......... .......... .......... .......... 12% 727K 3s
playground-gravitino | 300K .......... .......... .......... .......... .......... 14% 2.29M 3s
playground-gravitino | 350K .......... .......... .......... .......... .......... 16% 3.09M 2s
playground-gravitino | 400K .......... .......... .......... .......... .......... 18% 2.01M 2s
playground-gravitino | 450K .......... .......... .......... .......... .......... 20% 2.82M 2s
playground-gravitino | 500K .......... .......... .......... .......... .......... 22% 3.28M 2s
playground-gravitino | 550K .......... .......... .......... .......... .......... 24% 3.70M 2s
playground-gravitino | 600K .......... .......... .......... .......... .......... 26% 1018K 2s
playground-gravitino | 650K .......... .......... .......... .......... .......... 28% 3.76M 1s
playground-gravitino | 700K .......... .......... .......... .......... .......... 31% 3.44M 1s
playground-gravitino | 750K .......... .......... .......... .......... .......... 33% 2.84M 1s
playground-gravitino | 800K .......... .......... .......... .......... .......... 35% 5.45M 1s
playground-gravitino | 850K .......... .......... .......... .......... .......... 37% 6.66M 1s
playground-gravitino | 900K .......... .......... .......... .......... .......... 39% 2.73M 1s
playground-gravitino | 950K .......... .......... .......... .......... .......... 41% 5.13M 1s
playground-gravitino | 1000K .......... .......... .......... .......... .......... 43% 3.35M 1s
playground-gravitino | 1050K .......... .......... .......... .......... .......... 45% 2.96M 1s
playground-gravitino | 1100K .......... .......... .......... .......... .......... 47% 3.93M 1s
playground-gravitino | 1150K .......... .......... .......... .......... .......... 49% 4.39M 1s
playground-gravitino | 1200K .......... .......... .......... .......... .......... 51% 11.4M 1s
playground-gravitino | 1250K .......... .......... .......... .......... .......... 53% 4.61M 1s
playground-gravitino | 1300K .......... .......... .......... .......... .......... 55% 2.45M 1s
playground-gravitino | 1350K .......... .......... .......... .......... .......... 57% 5.44M 1s
playground-gravitino | 1400K .......... .......... .......... .......... .......... 59% 4.19M 1s
playground-gravitino | 1450K .......... .......... .......... .......... .......... 62% 2.50M 0s
playground-gravitino | 1500K .......... .......... .......... .......... .......... 64% 2.73M 0s
playground-gravitino | 1550K .......... .......... .......... .......... .......... 66% 3.40M 0s
playground-gravitino | 1600K .......... .......... .......... .......... .......... 68% 6.11M 0s
playground-gravitino | 1650K .......... .......... .......... .......... .......... 70% 1.47M 0s
playground-gravitino | 1700K .......... .......... .......... .......... .......... 72% 1.15M 0s
playground-gravitino | 1750K .......... .......... .......... .......... .......... 74% 2.20M 0s
playground-gravitino | 1800K .......... .......... .......... .......... .......... 76% 8.90M 0s
playground-gravitino | 1850K .......... .......... .......... .......... .......... 78% 1.81M 0s
playground-gravitino | 1900K .......... .......... .......... .......... .......... 80% 5.51M 0s
playground-gravitino | 1950K .......... .......... .......... .......... .......... 82% 3.06M 0s
playground-gravitino | 2000K .......... .......... .......... .......... .......... 84% 1.33M 0s
playground-gravitino | 2050K .......... .......... .......... .......... .......... 86% 3.46M 0s
playground-gravitino | 2100K .......... .......... .......... .......... .......... 88% 2.42M 0s
playground-gravitino | 2150K .......... .......... .......... .......... .......... 91% 2.85M 0s
playground-gravitino | 2200K .......... .......... .......... .......... .......... 93% 5.04M 0s
playground-gravitino | 2250K .......... .......... .......... .......... .......... 95% 4.02M 0s
playground-gravitino | 2300K .......... .......... .......... .......... .......... 97% 3.57M 0s
playground-gravitino | 2350K .......... .......... .......... .......... .......... 99% 11.3M 0s
playground-gravitino | 2400K .......... ....... 100% 42.1M=1.1s
playground-gravitino |
playground-gravitino | 2024-01-07 03:35:09 (2.08 MB/s) - ‘/root/gravitino/catalogs/jdbc-mysql/libs/mysql-connector-java-8.0.27.jar\r’ saved [2475087/2475087]
playground-gravitino |
playground-gravitino | --2024-01-07 03:35:09-- https://jdbc.postgresql.org/download/postgresql-42.7.0.jar
playground-gravitino | Resolving jdbc.postgresql.org (jdbc.postgresql.org)... 198.18.0.35
playground-gravitino | Connecting to jdbc.postgresql.org (jdbc.postgresql.org)|198.18.0.35|:443... connected.
playground-gravitino | HTTP request sent, awaiting response... 200 OK
playground-gravitino | Length: 1077325 (1.0M) [application/java-archive]
playground-gravitino | Saving to: ‘/root/gravitino/catalogs/jdbc-postgresql/libs/postgresql-42.7.0.jar\r’
playground-gravitino |
playground-gravitino | 0K .......... .......... .......... .......... .......... 4% 221K 5s
playground-gravitino | 50K .......... .......... .......... .......... .......... 9% 331K 4s
playground-gravitino | 100K .......... .......... .......... .......... .......... 14% 1.65M 2s
playground-gravitino | 150K .......... .......... .......... .......... .......... 19% 349K 2s
playground-gravitino | 200K .......... .......... .......... .......... .......... 23% 2.87M 2s
playground-gravitino | 250K .......... .......... .......... .......... .......... 28% 2.86M 1s
playground-gravitino | 300K .......... .......... .......... .......... .......... 33% 2.15M 1s
playground-gravitino | 350K .......... .......... .......... .......... .......... 38% 387K 1s
playground-gravitino | 400K .......... .......... .......... .......... .......... 42% 12.0M 1s
playground-gravitino | 500K .......... .......... .......... .......... .......... 52% 1.47M 1s
playground-gravitino | 550K .......... .......... .......... .......... .......... 57% 2.29M 1s
playground-gravitino | 600K .......... .......... .......... .......... .......... 61% 8.21M 1s
playground-gravitino | 650K .......... .......... .......... .......... .......... 66% 2.99M 0s
playground-gravitino | 700K .......... .......... .......... .......... .......... 71% 2.10M 0s
playground-gravitino | 750K .......... .......... .......... .......... .......... 76% 808K 0s
playground-gravitino | 800K .......... .......... .......... .......... .......... 80% 2.51M 0s
playground-gravitino | 850K .......... .......... .......... .......... .......... 85% 7.96M 0s
playground-gravitino | 900K .......... .......... .......... .......... .......... 90% 1.26M 0s
playground-gravitino | 950K .......... .......... .......... .......... .......... 95% 1.24M 0s
playground-gravitino | 1000K .......... .......... .......... .......... .......... 99% 3.71M 0s
playground-gravitino | 1050K .. 100% 3958G=1.1s
playground-gravitino |
playground-gravitino | 2024-01-07 03:35:12 (992 KB/s) - ‘/root/gravitino/catalogs/jdbc-postgresql/libs/postgresql-42.7.0.jar\r’ saved [1077325/1077325]
playground-gravitino |
playground-gravitino | cp: cannot stat '/root/gravitino/catalogs/jdbc-postgresql/libs/postgresql-42.7.0.jar': No such file or directory
playground-gravitino | cp: cannot stat '/root/gravitino/catalogs/jdbc-mysql/libs/mysql-connector-java-8.0.27.jar': No such file or directory
playground-gravitino | Finish downloading
playground-gravitino | Start the Gravitino Server
playground-gravitino |
playground-gravitino | Usage: bin/gravitino.sh [--config ]
playground-gravitino | {start|stop|restart|status}
Gracefully stopping... (press Ctrl+C again to force)
dependency failed to start: container playground-gravitino is unhealthy
Error: executing C:\Users\pan\AppData\Local\Microsoft\WindowsApps\docker-compose.exe up: exit status 1

Then I use "podman exec -it playground-gravitino bash" to login into the container to see what happens. I can see the file is there, but when use "ls -l ", it said the file not exists:

root@f9bb5eb28902:~/gravitino# ls /root/gravitino/catalogs/jdbc-postgresql/libs/postgresql-42.7.0.jar
ls: cannot access '/root/gravitino/catalogs/jdbc-postgresql/libs/postgresql-42.7.0.jar': No such file or directory

root@f9bb5eb28902:~/gravitino# ls -la /root/gravitino/catalogs/jdbc-postgresql/libs/ |grep post
-rw-r--r-- 1 root root 20119 Dec 12 15:09 gravitino-catalog-jdbc-postgresql-0.3.0.jar
-rw-r--r-- 1 root root 1077325 Nov 20 18:10 postgresql-42.7.0.jar

This is very interesting. Then I tried to use "TAB" to let the bash auto-completion, I can see the file name has a "^M" as the ending:
root@f9bb5eb28902:/gravitino# whoami
root
root@f9bb5eb28902:/gravitino# ls /root/gravitino/catalogs/jdbc-postgresql/libs/postgresql-42.7.0.jar^M

Gravitino 0.5.0 starts to support messaging (kafka) catalog. The playground should add kafka container for user to evaluate it quickly.

In the Hive service started by docker compose, a total of 4 ports are started: 3307 9000 9083 50070, but only 3 are stated in the README.

# docker-compose.yaml
services:
  hive:
    image: datastrato/hive:2.7.3-no-yarn
    ports:
      - "3307:3306"
      - "9000:9000"
      - "9083:9083"
      - "50070:50070"
    container_name: playground
...

After datastrato/gravitino#1177 is released, We should remove the workround

1. Failed to launch playground. because I have a stoped docker container with the name "mysql" which conflict with playground container name, rename to "playground-mysql" "playground-postgresql"? And I noticed playground export some famous ports like 3306 , maybe conflict with the port in local host.
2. I don't know when the playground is ready to use, maybe we could provide a more meaningful message when it's ready or add some documents.
3. Add document about when playground is ready, which metalake, schema, tables are pre-created.
4. Add document about how to explore existing metalake, schema, tables.

The playground will fail to start if MySQL or PostgreSQL is running locally. The error message says the port is in use, but it would be more friendly to say that it is likely that MySQL/PostgreSQL is running locally and needs to be shutdown before running the playground.

I'm using Windows 10 with Podman 4.8.3. When I use "podman compose up", the trino container exits firstly due to #12 . After I manually solve #12, and start the trino container, I see the "init.sh" wasn't successfully executed. Only the first command got success, which created the "metalake_demo" entity. Other entities like Hive catalog and Postgresql catalog were not created.

From the logs I see such error:

/tmp/trino/init.sh: line 5: $'\r': command not found % Total % Received % Xferd Average Speed Time Time Time Current Dload Upload Total Spent Left Speed 100 273 100 213 100 60 610 172 --:--:-- --:--:-- --:- /tmp/trino/init.sh: line 82: syntax error: unexpected end of file

Copy how-to-use-the playground.md to README.md

Gravitino can provide Iceberg REST service. I would provide a new demo in the playground.
The company wants to migrate some tables from Hive to Iceberg. These tables would be written by Spark through REST catalog. We would use Trino to read the data from both Iceberg and Hive. Usually, we need to join them.

As reported here:
datastrato/gravitino#1419 (comment)

It may be that the health check intervals need to be increased.

Currently, Gravitino have own Python client, we need have a Python notebook environment to execute and use it.
So, I think add Jupyter into playground.

Hive container of the playground fails to start. Removed all containers and images and could reproduce the issue.

Here is the full log:
./launch-playground.sh
[+] Running 6/6
✔ Network gravitino-playground_default Created 0.3s
✔ Container playground-hive Cr... 2.5s
✔ Container playground-mysql C... 2.1s
✔ Container playground-postgresql Created 2.5s
✔ Container playground-gravitino Created 1.1s
✔ Container playground-trino C... 0.6s
Attaching to playground-gravitino, playground-hive, playground-mysql, playground-postgresql, playground-trino
playground-mysql | 2024-01-08 02:16:08+00:00 [Note] [Entrypoint]: Entrypoint script for MySQL Server 8.0.35-1.el8 started.
playground-hive | * Starting OpenBSD Secure Shell server sshd
playground-hive | ...done.
playground-hive | # localhost:22 SSH-2.0-OpenSSH_7.2p2 Ubuntu-4ubuntu2.10
playground-hive | # localhost:22 SSH-2.0-OpenSSH_7.2p2 Ubuntu-4ubuntu2.10
playground-hive | # localhost:22 SSH-2.0-OpenSSH_7.2p2 Ubuntu-4ubuntu2.10
playground-hive | # 0.0.0.0:22 SSH-2.0-OpenSSH_7.2p2 Ubuntu-4ubuntu2.10
playground-hive | # 0.0.0.0:22 SSH-2.0-OpenSSH_7.2p2 Ubuntu-4ubuntu2.10
playground-hive | # 0.0.0.0:22 SSH-2.0-OpenSSH_7.2p2 Ubuntu-4ubuntu2.10
playground-hive | OpenJDK 64-Bit Server VM warning: ignoring option MaxPermSize=128m; support was removed in 8.0
playground-hive | OpenJDK 64-Bit Server VM warning: ignoring option MaxPermSize=128m; support was removed in 8.0
playground-postgresql | The files belonging to this database system will be owned by user "postgres".
playground-postgresql | This user must also own the server process.
playground-postgresql |
playground-postgresql |
playground-postgresql | The database cluster will be initialized with locale "en_US.utf8".
playground-postgresql | The default database encoding has accordingly been set to "UTF8".
playground-postgresql | The default text search configuration will be set to "english".
playground-postgresql |
playground-postgresql | Data page checksums are disabled.
playground-postgresql |
playground-postgresql | fixing permissions on existing directory /var/lib/postgresql/data ... ok
playground-postgresql |
playground-postgresql | creating subdirectories ...
playground-postgresql | ok
playground-postgresql | selecting dynamic shared memory implementation ... posix
playground-postgresql | selecting default max_connections ...
playground-postgresql | 100
playground-postgresql | selecting default shared_buffers ...
playground-postgresql | 128MB
playground-postgresql | selecting default time zone ...
playground-postgresql | Etc/UTC
playground-postgresql | creating configuration files ... ok
playground-postgresql | running bootstrap script ...
playground-postgresql | ok
playground-postgresql | performing post-bootstrap initialization ...
playground-hive | 24/01/08 02:16:13 WARN util.NativeCodeLoader: Unable to load native-hadoop library for your platform... using builtin-java classes where applicable
playground-mysql | 2024-01-08 02:16:14+00:00 [Note] [Entrypoint]: Switching to dedicated user 'mysql'
playground-mysql | 2024-01-08 02:16:14+00:00 [Note] [Entrypoint]: Entrypoint script for MySQL Server 8.0.35-1.el8 started.
playground-hive | Starting namenodes on [0.0.0.0]
playground-mysql | 2024-01-08 02:16:18+00:00 [Note] [Entrypoint]: Initializing database files
playground-mysql | 2024-01-08T02:16:19.216299Z 0 [Warning] [MY-011068] [Server] The syntax '--skip-host-cache' is deprecated and will be removed in a future release. Please use SET GLOBAL host_cache_size=0 instead.
playground-mysql | 2024-01-08T02:16:19.216478Z 0 [Warning] [MY-010918] [Server] 'default_authentication_plugin' is deprecated and will be removed in a future release. Please use authentication_policy instead.
playground-mysql | 2024-01-08T02:16:19.216520Z 0 [System] [MY-013169] [Server] /usr/sbin/mysqld (mysqld 8.0.35) initializing of server in progress as process 80
playground-mysql | 2024-01-08T02:16:19.955807Z 1 [System] [MY-013576] [InnoDB] InnoDB initialization has started.
playground-postgresql | ok
playground-postgresql | syncing data to disk ...
playground-hive | 0.0.0.0: starting namenode, logging to /usr/local/hadoop/logs/hadoop-root-namenode-2630b55e0102.out
playground-hive | 0.0.0.0: OpenJDK 64-Bit Server VM warning: ignoring option MaxPermSize=128m; support was removed in 8.0
playground-hive | 0.0.0.0: OpenJDK 64-Bit Server VM warning: ignoring option MaxPermSize=128m; support was removed in 8.0
playground-hive | 0.0.0.0: OpenJDK 64-Bit Server VM warning: ignoring option MaxPermSize=128m; support was removed in 8.0
playground-hive | localhost: starting datanode, logging to /usr/local/hadoop/logs/hadoop-root-datanode-2630b55e0102.out
playground-hive | localhost: OpenJDK 64-Bit Server VM warning: ignoring option MaxPermSize=128m; support was removed in 8.0
playground-hive | localhost: OpenJDK 64-Bit Server VM warning: ignoring option MaxPermSize=128m; support was removed in 8.0
playground-hive | localhost: OpenJDK 64-Bit Server VM warning: ignoring option MaxPermSize=128m; support was removed in 8.0
playground-postgresql | initdb: warning: enabling "trust" authentication for local connections
playground-postgresql | You can change this by editing pg_hba.conf or using the option -A, or
playground-postgresql | --auth-local and --auth-host, the next time you run initdb.
playground-postgresql | ok
playground-postgresql |
playground-postgresql |
playground-postgresql | Success. You can now start the database server using:
playground-postgresql |
playground-postgresql | pg_ctl -D /var/lib/postgresql/data -l logfile start
playground-postgresql |
playground-postgresql |
playground-postgresql | waiting for server to start....
playground-postgresql | 2024-01-08 02:16:30.441 UTC [49] LOG: starting PostgreSQL 13.13 (Debian 13.13-1.pgdg120+1) on aarch64-unknown-linux-gnu, compiled by gcc (Debian 12.2.0-14) 12.2.0, 64-bit
playground-postgresql | 2024-01-08 02:16:30.477 UTC [49] LOG: listening on Unix socket "/var/run/postgresql/.s.PGSQL.5432"
playground-postgresql | 2024-01-08 02:16:30.506 UTC [50] LOG: database system was shut down at 2024-01-08 02:16:20 UTC
playground-postgresql | 2024-01-08 02:16:30.517 UTC [49] LOG: database system is ready to accept connections
playground-postgresql | done
playground-postgresql | server started
playground-postgresql |
playground-postgresql | /usr/local/bin/docker-entrypoint.sh: running /docker-entrypoint-initdb.d/init.sql
playground-postgresql |
playground-postgresql | CREATE DATABASE
playground-postgresql | You are now connected to database "db" as user "postgres".
playground-postgresql | CREATE SCHEMA
playground-postgresql | CREATE TABLE
playground-postgresql | CREATE TABLE
playground-postgresql | CREATE TABLE
playground-postgresql | CREATE TABLE
playground-postgresql | COMMENT
playground-postgresql | CREATE TABLE
playground-postgresql | COMMENT
playground-postgresql | CREATE TABLE
playground-postgresql | COMMENT
playground-postgresql | CREATE TABLE
playground-postgresql | COMMENT
playground-postgresql | INSERT 0 4
playground-postgresql | INSERT 0 1
playground-postgresql | INSERT 0 1
playground-postgresql | INSERT 0 1
playground-postgresql | INSERT 0 1
playground-postgresql | INSERT 0 1
playground-postgresql | INSERT 0 1
playground-postgresql | INSERT 0 1
playground-postgresql | INSERT 0 1
playground-postgresql | INSERT 0 1
playground-postgresql | INSERT 0 1
playground-postgresql | INSERT 0 1
playground-postgresql | INSERT 0 1
playground-postgresql | INSERT 0 4
playground-postgresql | INSERT 0 12
playground-postgresql | INSERT 0 1
playground-postgresql | INSERT 0 1
playground-postgresql | INSERT 0 1
playground-postgresql | INSERT 0 1
playground-postgresql | INSERT 0 1
playground-postgresql | INSERT 0 1
playground-postgresql | INSERT 0 1
playground-postgresql | INSERT 0 1
playground-postgresql | INSERT 0 1
playground-postgresql | INSERT 0 1
playground-postgresql | INSERT 0 1
playground-postgresql | INSERT 0 1
playground-postgresql | INSERT 0 1
playground-postgresql | INSERT 0 3
playground-postgresql | INSERT 0 12
playground-postgresql | INSERT 0 1
playground-postgresql | INSERT 0 1
playground-postgresql | INSERT 0 1
playground-postgresql | INSERT 0 1
playground-postgresql | INSERT 0 1
playground-postgresql | INSERT 0 1
playground-postgresql | INSERT 0 1
playground-postgresql | INSERT 0 1
playground-postgresql | INSERT 0 1
playground-postgresql | INSERT 0 1
playground-postgresql | INSERT 0 1
playground-postgresql | INSERT 0 1
playground-postgresql | INSERT 0 8
playground-postgresql | INSERT 0 17
playground-postgresql | INSERT 0 1
playground-postgresql | INSERT 0 1
playground-postgresql | INSERT 0 1
playground-postgresql | INSERT 0 1
playground-postgresql | INSERT 0 1
playground-postgresql | INSERT 0 1
playground-postgresql | INSERT 0 1
playground-postgresql | INSERT 0 1
playground-postgresql | INSERT 0 1
playground-postgresql | INSERT 0 6
playground-postgresql | INSERT 0 4
playground-postgresql | INSERT 0 1
playground-postgresql | INSERT 0 1
playground-postgresql | INSERT 0 1
playground-mysql | 2024-01-08T02:16:43.284568Z 1 [System] [MY-013577] [InnoDB] InnoDB initialization has ended.
playground-postgresql | INSERT 0 1
playground-postgresql | INSERT 0 1
playground-postgresql | INSERT 0 1
playground-postgresql | INSERT 0 1
playground-postgresql | INSERT 0 1
playground-postgresql | INSERT 0 4
playground-postgresql | INSERT 0 4
playground-postgresql | INSERT 0 1
playground-postgresql | INSERT 0 1
playground-postgresql | INSERT 0 1
playground-postgresql | INSERT 0 1
playground-postgresql | INSERT 0 4
playground-postgresql | INSERT 0 1
playground-postgresql | INSERT 0 1
playground-postgresql | INSERT 0 1
playground-postgresql | INSERT 0 1
playground-postgresql | INSERT 0 2
playground-postgresql | INSERT 0 9
playground-postgresql | INSERT 0 1
playground-postgresql | INSERT 0 1
playground-postgresql | INSERT 0 1
playground-postgresql | INSERT 0 1
playground-postgresql | INSERT 0 1
playground-postgresql | INSERT 0 1
playground-postgresql | INSERT 0 1
playground-postgresql | INSERT 0 1
playground-postgresql | INSERT 0 1
playground-postgresql | INSERT 0 1
playground-postgresql | INSERT 0 1
playground-postgresql | INSERT 0 1
playground-postgresql | INSERT 0 1
playground-postgresql | INSERT 0 1
playground-postgresql | INSERT 0 1
playground-postgresql | INSERT 0 1
playground-postgresql | INSERT 0 1
playground-postgresql | INSERT 0 1
playground-postgresql | INSERT 0 1
playground-postgresql | INSERT 0 1
playground-postgresql | INSERT 0 1
playground-postgresql | INSERT 0 1
playground-postgresql | INSERT 0 1
playground-postgresql | INSERT 0 1
playground-postgresql | INSERT 0 1
playground-postgresql | INSERT 0 4
playground-postgresql | INSERT 0 1
playground-postgresql | INSERT 0 1
playground-postgresql | INSERT 0 1
playground-postgresql | INSERT 0 1
playground-postgresql | INSERT 0 3
playground-postgresql | INSERT 0 1
playground-postgresql | INSERT 0 1
playground-postgresql | INSERT 0 1
playground-postgresql | INSERT 0 1
playground-postgresql | INSERT 0 1
playground-postgresql | INSERT 0 3
playground-postgresql | INSERT 0 1
playground-postgresql | INSERT 0 1
playground-postgresql | INSERT 0 1
playground-postgresql | INSERT 0 1
playground-postgresql | INSERT 0 4
playground-postgresql | INSERT 0 1
playground-postgresql | INSERT 0 1
playground-postgresql | INSERT 0 1
playground-postgresql | INSERT 0 1
playground-postgresql | INSERT 0 1
playground-postgresql | INSERT 0 2
playground-postgresql | INSERT 0 1
playground-postgresql | INSERT 0 1
playground-postgresql | INSERT 0 1
playground-postgresql | INSERT 0 1
playground-postgresql | INSERT 0 5
playground-postgresql | INSERT 0 7
playground-postgresql | INSERT 0 1
playground-postgresql | INSERT 0 1
playground-postgresql | INSERT 0 1
playground-postgresql | INSERT 0 1
playground-postgresql | INSERT 0 1
playground-postgresql | INSERT 0 1
playground-postgresql | INSERT 0 1
playground-postgresql | INSERT 0 1
playground-postgresql | INSERT 0 1
playground-postgresql | INSERT 0 4
playground-postgresql | INSERT 0 2
playground-postgresql | INSERT 0 1
playground-postgresql | INSERT 0 1
playground-postgresql | INSERT 0 1
playground-postgresql | INSERT 0 1
playground-postgresql | INSERT 0 4
playground-postgresql | INSERT 0 8
playground-postgresql | INSERT 0 1
playground-postgresql | INSERT 0 1
playground-postgresql | INSERT 0 1
playground-postgresql | INSERT 0 1
playground-postgresql | INSERT 0 2
playground-postgresql | INSERT 0 23
playground-postgresql | INSERT 0 1
playground-postgresql | INSERT 0 1
playground-postgresql | INSERT 0 1
playground-postgresql | INSERT 0 1
playground-postgresql | INSERT 0 6
playground-postgresql | INSERT 0 19
playground-postgresql | INSERT 0 1
playground-postgresql | INSERT 0 1
playground-postgresql | INSERT 0 1
playground-postgresql | INSERT 0 1
playground-postgresql | INSERT 0 4
playground-postgresql | INSERT 0 1
playground-postgresql | INSERT 0 1
playground-postgresql | INSERT 0 1
playground-postgresql | INSERT 0 1
playground-postgresql | INSERT 0 6
playground-postgresql | INSERT 0 1
playground-postgresql | INSERT 0 1
playground-postgresql | INSERT 0 1
playground-postgresql | INSERT 0 1
playground-postgresql | INSERT 0 2
playground-postgresql | INSERT 0 12
playground-postgresql | INSERT 0 1
playground-postgresql | INSERT 0 1
playground-postgresql | INSERT 0 1
playground-postgresql | INSERT 0 1
playground-postgresql | INSERT 0 4
playground-postgresql | INSERT 0 1
playground-postgresql | INSERT 0 1
playground-postgresql | INSERT 0 1
playground-postgresql | INSERT 0 3
playground-postgresql | INSERT 0 19
playground-postgresql | INSERT 0 1
playground-postgresql | INSERT 0 1
playground-postgresql | INSERT 0 1
playground-postgresql | INSERT 0 1
playground-postgresql | INSERT 0 1
playground-postgresql | INSERT 0 1
playground-postgresql | INSERT 0 1
playground-postgresql | INSERT 0 1
playground-postgresql | INSERT 0 1
playground-hive | Starting secondary namenodes [0.0.0.0]
playground-postgresql | INSERT 0 1
playground-postgresql | INSERT 0 1
playground-postgresql | INSERT 0 1
playground-postgresql | INSERT 0 1
playground-postgresql | INSERT 0 9
playground-postgresql | INSERT 0 2
playground-postgresql | INSERT 0 1
playground-postgresql | INSERT 0 1
playground-postgresql | INSERT 0 1
playground-postgresql | INSERT 0 1
playground-postgresql | INSERT 0 5
playground-postgresql | INSERT 0 1
playground-postgresql | INSERT 0 1
playground-postgresql | INSERT 0 1
playground-postgresql | INSERT 0 1
playground-postgresql | INSERT 0 1
playground-postgresql | INSERT 0 1
playground-postgresql | INSERT 0 1
playground-postgresql | INSERT 0 1
playground-postgresql | INSERT 0 1
playground-postgresql | INSERT 0 13
playground-postgresql | INSERT 0 1
playground-postgresql | INSERT 0 1
playground-postgresql | INSERT 0 1
playground-postgresql | INSERT 0 1
playground-postgresql | INSERT 0 1
playground-postgresql | INSERT 0 10
playground-postgresql | INSERT 0 1
playground-postgresql | INSERT 0 1
playground-postgresql | INSERT 0 1
playground-postgresql | INSERT 0 1
playground-postgresql | INSERT 0 1
playground-postgresql | INSERT 0 1
playground-postgresql | INSERT 0 1
playground-postgresql | INSERT 0 1
playground-postgresql | INSERT 0 2
playground-postgresql | INSERT 0 17
playground-postgresql | INSERT 0 1
playground-postgresql | INSERT 0 1
playground-postgresql | INSERT 0 1
playground-postgresql | INSERT 0 1
playground-postgresql | INSERT 0 1
playground-postgresql | INSERT 0 1
playground-postgresql | INSERT 0 1
playground-postgresql | INSERT 0 1
playground-postgresql | INSERT 0 1
playground-postgresql | INSERT 0 1
playground-postgresql | INSERT 0 1
playground-postgresql | INSERT 0 1
playground-postgresql | INSERT 0 1
playground-postgresql | INSERT 0 1
playground-postgresql | INSERT 0 1
playground-postgresql | INSERT 0 1
playground-postgresql | INSERT 0 1
playground-postgresql | INSERT 0 1
playground-postgresql | INSERT 0 1
playground-postgresql | INSERT 0 1
playground-postgresql | INSERT 0 1
playground-postgresql | INSERT 0 1
playground-postgresql | INSERT 0 1
playground-postgresql | INSERT 0 2
playground-postgresql | INSERT 0 1
playground-postgresql | INSERT 0 1
playground-postgresql | INSERT 0 1
playground-postgresql | INSERT 0 1
playground-postgresql | INSERT 0 1
playground-postgresql | INSERT 0 1
playground-postgresql | INSERT 0 1
playground-postgresql | INSERT 0 1
playground-postgresql | INSERT 0 1
playground-postgresql | INSERT 0 1
playground-postgresql | INSERT 0 1
playground-postgresql | INSERT 0 1
playground-hive | 0.0.0.0: starting secondarynamenode, logging to /usr/local/hadoop/logs/hadoop-root-secondarynamenode-2630b55e0102.out
playground-hive | 0.0.0.0: OpenJDK 64-Bit Server VM warning: ignoring option MaxPermSize=128m; support was removed in 8.0
playground-hive | 0.0.0.0: OpenJDK 64-Bit Server VM warning: ignoring option MaxPermSize=128m; support was removed in 8.0
playground-hive | 0.0.0.0: OpenJDK 64-Bit Server VM warning: ignoring option MaxPermSize=128m; support was removed in 8.0
playground-postgresql | INSERT 0 1
playground-postgresql | INSERT 0 6
playground-postgresql | INSERT 0 14
playground-postgresql | INSERT 0 1
playground-postgresql | INSERT 0 1
playground-postgresql | INSERT 0 1
playground-postgresql | INSERT 0 1
playground-postgresql | INSERT 0 1
playground-postgresql | INSERT 0 1
playground-postgresql | INSERT 0 1
playground-postgresql | INSERT 0 1
playground-postgresql | INSERT 0 3
playground-postgresql | INSERT 0 1
playground-postgresql | INSERT 0 1
playground-postgresql | INSERT 0 1
playground-postgresql | INSERT 0 1
playground-postgresql | INSERT 0 1
playground-postgresql | INSERT 0 1
playground-postgresql | INSERT 0 1
playground-postgresql | INSERT 0 1
playground-postgresql | INSERT 0 1
playground-postgresql | INSERT 0 6
playground-postgresql | INSERT 0 5
playground-postgresql | INSERT 0 1
playground-postgresql | INSERT 0 1
playground-postgresql | INSERT 0 1
playground-postgresql | INSERT 0 1
playground-postgresql | INSERT 0 2
playground-postgresql | INSERT 0 1
playground-postgresql | INSERT 0 1
playground-postgresql | INSERT 0 1
playground-postgresql | INSERT 0 1
playground-postgresql | INSERT 0 2
playground-postgresql | INSERT 0 8
playground-postgresql | INSERT 0 1
playground-postgresql | INSERT 0 1
playground-postgresql | INSERT 0 1
playground-postgresql | INSERT 0 1
playground-postgresql | INSERT 0 1
playground-postgresql | INSERT 0 17
playground-postgresql | INSERT 0 1
playground-postgresql | INSERT 0 1
playground-postgresql | INSERT 0 1
playground-postgresql | INSERT 0 1
playground-postgresql | INSERT 0 3
playground-postgresql | INSERT 0 7
playground-postgresql | INSERT 0 1
playground-postgresql | INSERT 0 1
playground-postgresql | INSERT 0 1
playground-postgresql | INSERT 0 1
playground-postgresql | INSERT 0 2
playground-postgresql | INSERT 0 1
playground-postgresql | INSERT 0 1
playground-postgresql | INSERT 0 1
playground-postgresql | INSERT 0 1
playground-postgresql | INSERT 0 6
playground-postgresql | INSERT 0 26
playground-postgresql | INSERT 0 1
playground-postgresql | INSERT 0 1
playground-postgresql | INSERT 0 1
playground-postgresql | INSERT 0 1
playground-postgresql | INSERT 0 1
playground-postgresql | INSERT 0 7
playground-postgresql | INSERT 0 1
playground-postgresql | INSERT 0 1
playground-postgresql | INSERT 0 1
playground-postgresql | INSERT 0 1
playground-postgresql | INSERT 0 10
playground-postgresql | INSERT 0 1
playground-postgresql | INSERT 0 1
playground-postgresql | INSERT 0 1
playground-postgresql | INSERT 0 1
playground-postgresql | INSERT 0 2
playground-postgresql | INSERT 0 10
playground-postgresql | INSERT 0 1
playground-postgresql | INSERT 0 1
playground-postgresql | INSERT 0 1
playground-postgresql | INSERT 0 1
playground-postgresql | INSERT 0 1
playground-postgresql | INSERT 0 1
playground-postgresql | INSERT 0 1
playground-postgresql | INSERT 0 1
playground-postgresql | INSERT 0 16
playground-postgresql | INSERT 0 1
playground-postgresql | INSERT 0 1
playground-postgresql | INSERT 0 1
playground-postgresql | INSERT 0 1
playground-postgresql | INSERT 0 2
playground-postgresql | INSERT 0 1
playground-postgresql | INSERT 0 1
playground-postgresql | INSERT 0 1
playground-postgresql | INSERT 0 1
playground-postgresql | INSERT 0 2
playground-postgresql | INSERT 0 10
playground-postgresql | INSERT 0 1
playground-postgresql | INSERT 0 1
playground-postgresql | INSERT 0 1
playground-postgresql | INSERT 0 1
playground-postgresql | INSERT 0 4
playground-postgresql | INSERT 0 1
playground-postgresql | INSERT 0 1
playground-postgresql | INSERT 0 1
playground-postgresql | INSERT 0 1
playground-postgresql | INSERT 0 1
playground-postgresql | INSERT 0 1
playground-postgresql | INSERT 0 1
playground-postgresql | INSERT 0 1
playground-postgresql | INSERT 0 1
playground-postgresql | INSERT 0 5
playground-postgresql | INSERT 0 1
playground-postgresql | INSERT 0 1
playground-postgresql | INSERT 0 1
playground-postgresql | INSERT 0 1
playground-postgresql | INSERT 0 1
playground-postgresql | INSERT 0 1
playground-postgresql | INSERT 0 1
playground-postgresql | INSERT 0 1
playground-postgresql | INSERT 0 6
playground-postgresql | INSERT 0 11
playground-postgresql | INSERT 0 1
playground-postgresql | INSERT 0 1
playground-postgresql | INSERT 0 1
playground-postgresql | INSERT 0 1
playground-postgresql | INSERT 0 1
playground-postgresql | INSERT 0 1
playground-postgresql | INSERT 0 1
playground-postgresql | INSERT 0 1
playground-postgresql | INSERT 0 1
playground-postgresql | INSERT 0 1
playground-postgresql | INSERT 0 1
playground-postgresql | INSERT 0 1
playground-postgresql | INSERT 0 1
playground-postgresql | INSERT 0 1
playground-postgresql | INSERT 0 1
playground-postgresql | INSERT 0 1
playground-postgresql | INSERT 0 1
playground-postgresql | INSERT 0 21
playground-postgresql | INSERT 0 1
playground-postgresql | INSERT 0 1
playground-postgresql | INSERT 0 1
playground-postgresql | INSERT 0 1
playground-postgresql | INSERT 0 5
playground-postgresql | INSERT 0 10
playground-postgresql | INSERT 0 1
playground-postgresql | INSERT 0 1
playground-postgresql | INSERT 0 1
playground-postgresql | INSERT 0 1
playground-postgresql | INSERT 0 1
playground-postgresql | INSERT 0 19
playground-postgresql | INSERT 0 1
playground-postgresql | INSERT 0 1
playground-postgresql | INSERT 0 1
playground-postgresql | INSERT 0 1
playground-postgresql | INSERT 0 2
playground-postgresql | INSERT 0 4
playground-postgresql | INSERT 0 1
playground-postgresql | INSERT 0 1
playground-postgresql | INSERT 0 1
playground-postgresql | INSERT 0 1
playground-postgresql | INSERT 0 1
playground-postgresql | INSERT 0 1
playground-postgresql | INSERT 0 1
playground-postgresql | INSERT 0 1
playground-postgresql | INSERT 0 7
playground-postgresql | INSERT 0 19
playground-postgresql | INSERT 0 1
playground-postgresql | INSERT 0 1
playground-postgresql | INSERT 0 1
playground-postgresql | INSERT 0 1
playground-postgresql | INSERT 0 4
playground-postgresql | INSERT 0 1
playground-postgresql | INSERT 0 1
playground-postgresql | INSERT 0 1
playground-postgresql | INSERT 0 1
playground-postgresql | INSERT 0 10
playground-postgresql | INSERT 0 1
playground-postgresql | INSERT 0 1
playground-postgresql | INSERT 0 1
playground-postgresql | INSERT 0 1
playground-postgresql | INSERT 0 5
playground-postgresql | INSERT 0 21
playground-postgresql | INSERT 0 1
playground-postgresql | INSERT 0 1
playground-postgresql | INSERT 0 1
playground-postgresql | INSERT 0 1
playground-postgresql | INSERT 0 8
playground-postgresql | INSERT 0 1
playground-postgresql | INSERT 0 1
playground-postgresql | INSERT 0 1
playground-postgresql | INSERT 0 1
playground-postgresql | INSERT 0 3
playground-postgresql | INSERT 0 1
playground-postgresql | INSERT 0 1
playground-postgresql | INSERT 0 1
playground-postgresql | INSERT 0 1
playground-postgresql | INSERT 0 8
playground-postgresql | INSERT 0 7
playground-postgresql | INSERT 0 1
playground-postgresql | INSERT 0 1
playground-postgresql | INSERT 0 1
playground-postgresql | INSERT 0 1
playground-postgresql | INSERT 0 5
playground-postgresql | INSERT 0 1
playground-postgresql | INSERT 0 1
playground-postgresql | INSERT 0 1
playground-postgresql | INSERT 0 1
playground-postgresql | INSERT 0 10
playground-postgresql | INSERT 0 3
playground-postgresql | INSERT 0 1
playground-postgresql | INSERT 0 1
playground-postgresql | INSERT 0 1
playground-postgresql | INSERT 0 1
playground-postgresql | INSERT 0 2
playground-postgresql | INSERT 0 1
playground-postgresql | INSERT 0 1
playground-postgresql | INSERT 0 1
playground-postgresql | INSERT 0 1
playground-hive | OpenJDK 64-Bit Server VM warning: ignoring option MaxPermSize=128m; support was removed in 8.0
playground-hive | OpenJDK 64-Bit Server VM warning: ignoring option MaxPermSize=128m; support was removed in 8.0
playground-postgresql | INSERT 0 1
playground-postgresql | INSERT 0 1
playground-postgresql | INSERT 0 1
playground-postgresql | INSERT 0 1
playground-postgresql | INSERT 0 19
playground-postgresql | INSERT 0 1
playground-postgresql | INSERT 0 1
playground-postgresql | INSERT 0 1
playground-postgresql | INSERT 0 1
playground-postgresql | INSERT 0 7
playground-postgresql | INSERT 0 18
playground-postgresql | INSERT 0 1
playground-postgresql | INSERT 0 1
playground-postgresql | INSERT 0 1
playground-postgresql | INSERT 0 1
playground-postgresql | INSERT 0 9
playground-postgresql | INSERT 0 3
playground-postgresql | INSERT 0 1
playground-postgresql | INSERT 0 1
playground-postgresql | INSERT 0 1
playground-postgresql | INSERT 0 1
playground-postgresql | INSERT 0 1
playground-postgresql | INSERT 0 1
playground-postgresql | INSERT 0 1
playground-postgresql | INSERT 0 1
playground-postgresql | INSERT 0 4
playground-postgresql | INSERT 0 13
playground-postgresql | INSERT 0 1
playground-postgresql | INSERT 0 1
playground-postgresql | INSERT 0 1
playground-postgresql | INSERT 0 1
playground-postgresql | INSERT 0 1
playground-postgresql | INSERT 0 1
playground-postgresql | INSERT 0 1
playground-postgresql | INSERT 0 1
playground-postgresql | INSERT 0 1
playground-postgresql | INSERT 0 6
playground-postgresql |
playground-postgresql |
playground-postgresql |
playground-postgresql | waiting for server to shut down...2024-01-08 02:17:31.169 UTC [49] LOG: received fast shutdown request
playground-postgresql | .
playground-postgresql | 2024-01-08 02:17:31.612 UTC [49] LOG: aborting any active transactions
playground-postgresql | 2024-01-08 02:17:31.619 UTC [49] LOG: background worker "logical replication launcher" (PID 56) exited with exit code 1
playground-postgresql | 2024-01-08 02:17:31.619 UTC [51] LOG: shutting down
playground-postgresql | .
playground-postgresql | .
playground-postgresql | 2024-01-08 02:17:33.811 UTC [49] LOG: database system is shut down
playground-postgresql | done
playground-postgresql | server stopped
playground-postgresql |
playground-postgresql | PostgreSQL init process complete; ready for start up.
playground-postgresql |
playground-postgresql |
playground-hive | 24/01/08 02:17:58 WARN util.NativeCodeLoader: Unable to load native-hadoop library for your platform... using builtin-java classes where applicable
playground-hive | OpenJDK 64-Bit Server VM warning: ignoring option MaxPermSize=128m; support was removed in 8.0
playground-hive | 24/01/08 02:18:05 WARN util.NativeCodeLoader: Unable to load native-hadoop library for your platform... using builtin-java classes where applicable
playground-postgresql | 2024-01-08 02:18:06.919 UTC [1] LOG: starting PostgreSQL 13.13 (Debian 13.13-1.pgdg120+1) on aarch64-unknown-linux-gnu, compiled by gcc (Debian 12.2.0-14) 12.2.0, 64-bit
playground-postgresql | 2024-01-08 02:18:06.920 UTC [1] LOG: listening on IPv4 address "0.0.0.0", port 5432
playground-postgresql | 2024-01-08 02:18:06.920 UTC [1] LOG: listening on IPv6 address "::", port 5432
playground-postgresql | 2024-01-08 02:18:07.169 UTC [1] LOG: listening on Unix socket "/var/run/postgresql/.s.PGSQL.5432"
playground-postgresql | 2024-01-08 02:18:07.511 UTC [66] LOG: database system was shut down at 2024-01-08 02:17:33 UTC
playground-postgresql | 2024-01-08 02:18:07.616 UTC [1] LOG: database system is ready to accept connections
playground-hive | OpenJDK 64-Bit Server VM warning: ignoring option MaxPermSize=128m; support was removed in 8.0
playground-hive | 24/01/08 02:18:42 WARN util.NativeCodeLoader: Unable to load native-hadoop library for your platform... using builtin-java classes where applicable
playground-mysql | 2024-01-08T02:18:44.273103Z 6 [Warning] [MY-010453] [Server] root@localhost is created with an empty password ! Please consider switching off the --initialize-insecure option.
playground-hive | OpenJDK 64-Bit Server VM warning: ignoring option MaxPermSize=128m; support was removed in 8.0
playground-hive | 24/01/08 02:18:46 WARN util.NativeCodeLoader: Unable to load native-hadoop library for your platform... using builtin-java classes where applicable
playground-mysql | 2024-01-08T02:18:49.786910Z 6 [Warning] [MY-013360] [Server] Plugin mysql_native_password reported: ''mysql_native_password' is deprecated and will be removed in a future release. Please use caching_sha2_password instead'
playground-hive | OpenJDK 64-Bit Server VM warning: ignoring option MaxPermSize=128m; support was removed in 8.0
playground-hive | 24/01/08 02:18:58 WARN util.NativeCodeLoader: Unable to load native-hadoop library for your platform... using builtin-java classes where applicable
playground-hive | OpenJDK 64-Bit Server VM warning: ignoring option MaxPermSize=128m; support was removed in 8.0
playground-hive | 24/01/08 02:19:05 WARN util.NativeCodeLoader: Unable to load native-hadoop library for your platform... using builtin-java classes where applicable
playground-hive | OpenJDK 64-Bit Server VM warning: ignoring option MaxPermSize=128m; support was removed in 8.0
playground-hive | 24/01/08 02:19:10 WARN util.NativeCodeLoader: Unable to load native-hadoop library for your platform... using builtin-java classes where applicable
playground-mysql | 2024-01-08 02:19:24+00:00 [Note] [Entrypoint]: Database files initialized
playground-mysql | 2024-01-08 02:19:24+00:00 [Note] [Entrypoint]: Starting temporary server
playground-mysql | 2024-01-08T02:19:25.473818Z 0 [Warning] [MY-011068] [Server] The syntax '--skip-host-cache' is deprecated and will be removed in a future release. Please use SET GLOBAL host_cache_size=0 instead.
playground-mysql | 2024-01-08T02:19:25.475128Z 0 [Warning] [MY-010918] [Server] 'default_authentication_plugin' is deprecated and will be removed in a future release. Please use authentication_policy instead.
playground-mysql | 2024-01-08T02:19:25.475151Z 0 [System] [MY-010116] [Server] /usr/sbin/mysqld (mysqld 8.0.35) starting as process 124
playground-mysql | 2024-01-08T02:19:25.491784Z 1 [System] [MY-013576] [InnoDB] InnoDB initialization has started.
playground-mysql | 2024-01-08T02:19:26.488007Z 1 [System] [MY-013577] [InnoDB] InnoDB initialization has ended.
playground-mysql | 2024-01-08T02:19:29.783609Z 0 [Warning] [MY-010068] [Server] CA certificate ca.pem is self signed.
playground-mysql | 2024-01-08T02:19:29.783648Z 0 [System] [MY-013602] [Server] Channel mysql_main configured to support TLS. Encrypted connections are now supported for this channel.
playground-mysql | 2024-01-08T02:19:30.125622Z 0 [Warning] [MY-011810] [Server] Insecure configuration for --pid-file: Location '/var/run/mysqld' in the path is accessible to all OS users. Consider choosing a different directory.
playground-hive | OpenJDK 64-Bit Server VM warning: ignoring option MaxPermSize=128m; support was removed in 8.0
playground-mysql | 2024-01-08T02:19:30.534677Z 0 [System] [MY-011323] [Server] X Plugin ready for connections. Socket: /var/run/mysqld/mysqlx.sock
playground-mysql | 2024-01-08T02:19:30.534770Z 0 [System] [MY-010931] [Server] /usr/sbin/mysqld: ready for connections. Version: '8.0.35' socket: '/var/run/mysqld/mysqld.sock' port: 0 MySQL Community Server - GPL.
playground-mysql | 2024-01-08 02:19:30+00:00 [Note] [Entrypoint]: Temporary server started.
playground-mysql | '/var/lib/mysql/mysql.sock' -> '/var/run/mysqld/mysqld.sock'
playground-mysql | 2024-01-08T02:19:30.939942Z 8 [Warning] [MY-013360] [Server] Plugin mysql_native_password reported: ''mysql_native_password' is deprecated and will be removed in a future release. Please use caching_sha2_password instead'
playground-hive | 24/01/08 02:19:38 WARN util.NativeCodeLoader: Unable to load native-hadoop library for your platform... using builtin-java classes where applicable
playground-mysql | Warning: Unable to load '/usr/share/zoneinfo/iso3166.tab' as time zone. Skipping it.
playground-mysql | Warning: Unable to load '/usr/share/zoneinfo/leap-seconds.list' as time zone. Skipping it.
playground-mysql | Warning: Unable to load '/usr/share/zoneinfo/leapseconds' as time zone. Skipping it.
playground-mysql | Warning: Unable to load '/usr/share/zoneinfo/tzdata.zi' as time zone. Skipping it.
playground-mysql | Warning: Unable to load '/usr/share/zoneinfo/zone.tab' as time zone. Skipping it.
playground-mysql | Warning: Unable to load '/usr/share/zoneinfo/zone1970.tab' as time zone. Skipping it.
playground-mysql | 2024-01-08T02:19:46.393048Z 9 [Warning] [MY-013360] [Server] Plugin mysql_native_password reported: ''mysql_native_password' is deprecated and will be removed in a future release. Please use caching_sha2_password instead'
playground-mysql | 2024-01-08T02:19:46.394441Z 9 [Warning] [MY-013360] [Server] Plugin mysql_native_password reported: ''mysql_native_password' is deprecated and will be removed in a future release. Please use caching_sha2_password instead'
playground-mysql | 2024-01-08T02:19:46.719257Z 9 [Warning] [MY-013360] [Server] Plugin mysql_native_password reported: ''mysql_native_password' is deprecated and will be removed in a future release. Please use caching_sha2_password instead'
playground-mysql | 2024-01-08 02:19:47+00:00 [Note] [Entrypoint]: Creating database db
playground-mysql | 2024-01-08T02:19:47.528244Z 10 [Warning] [MY-013360] [Server] Plugin mysql_native_password reported: ''mysql_native_password' is deprecated and will be removed in a future release. Please use caching_sha2_password instead'
playground-mysql | 2024-01-08 02:19:48+00:00 [Note] [Entrypoint]: Creating user mysql
playground-mysql | 2024-01-08T02:19:48.749733Z 11 [Warning] [MY-013360] [Server] Plugin mysql_native_password reported: ''mysql_native_password' is deprecated and will be removed in a future release. Please use caching_sha2_password instead'
playground-mysql | 2024-01-08T02:19:48.751197Z 11 [Warning] [MY-013360] [Server] Plugin mysql_native_password reported: ''mysql_native_password' is deprecated and will be removed in a future release. Please use caching_sha2_password instead'
playground-mysql | 2024-01-08 02:19:49+00:00 [Note] [Entrypoint]: Giving user mysql access to schema db
playground-mysql | 2024-01-08T02:19:49.527239Z 12 [Warning] [MY-013360] [Server] Plugin mysql_native_password reported: ''mysql_native_password' is deprecated and will be removed in a future release. Please use caching_sha2_password instead'
playground-mysql |
playground-mysql |
playground-mysql | 2024-01-08 02:19:49+00:00 [Note] [Entrypoint]: /usr/local/bin/docker-entrypoint.sh: running /docker-entrypoint-initdb.d/init.sql
playground-mysql | 2024-01-08T02:19:49.680261Z 13 [Warning] [MY-013360] [Server] Plugin mysql_native_password reported: ''mysql_native_password' is deprecated and will be removed in a future release. Please use caching_sha2_password instead'
playground-mysql |
playground-mysql |
playground-mysql |
playground-mysql | 2024-01-08 02:19:49+00:00 [Note] [Entrypoint]: Stopping temporary server
playground-mysql | 2024-01-08T02:19:49.942035Z 14 [Warning] [MY-013360] [Server] Plugin mysql_native_password reported: ''mysql_native_password' is deprecated and will be removed in a future release. Please use caching_sha2_password instead'
playground-mysql | 2024-01-08T02:19:49.943991Z 14 [System] [MY-013172] [Server] Received SHUTDOWN from user root. Shutting down mysqld (Version: 8.0.35).
playground-hive | OpenJDK 64-Bit Server VM warning: ignoring option MaxPermSize=128m; support was removed in 8.0
playground-mysql | 2024-01-08T02:20:16.222529Z 0 [System] [MY-010910] [Server] /usr/sbin/mysqld: Shutdown complete (mysqld 8.0.35) MySQL Community Server - GPL.
playground-mysql | 2024-01-08 02:20:17+00:00 [Note] [Entrypoint]: Temporary server stopped
playground-mysql |
playground-mysql |
playground-mysql | 2024-01-08 02:20:17+00:00 [Note] [Entrypoint]: MySQL init process done. Ready for start up.
playground-mysql |
playground-mysql |
playground-mysql | 2024-01-08T02:20:17.497059Z 0 [Warning] [MY-011068] [Server] The syntax '--skip-host-cache' is deprecated and will be removed in a future release. Please use SET GLOBAL host_cache_size=0 instead.
playground-mysql | 2024-01-08T02:20:17.498403Z 0 [Warning] [MY-010918] [Server] 'default_authentication_plugin' is deprecated and will be removed in a future release. Please use authentication_policy instead.
playground-mysql | 2024-01-08T02:20:17.498424Z 0 [System] [MY-010116] [Server] /usr/sbin/mysqld (mysqld 8.0.35) starting as process 1
playground-mysql | 2024-01-08T02:20:17.505551Z 1 [System] [MY-013576] [InnoDB] InnoDB initialization has started.
playground-hive | 24/01/08 02:20:18 WARN util.NativeCodeLoader: Unable to load native-hadoop library for your platform... using builtin-java classes where applicable
playground-mysql | 2024-01-08T02:20:19.735242Z 1 [System] [MY-013577] [InnoDB] InnoDB initialization has ended.
playground-mysql | 2024-01-08T02:20:42.393231Z 0 [Warning] [MY-010068] [Server] CA certificate ca.pem is self signed.
playground-mysql | 2024-01-08T02:20:42.393302Z 0 [System] [MY-013602] [Server] Channel mysql_main configured to support TLS. Encrypted connections are now supported for this channel.
playground-mysql | 2024-01-08T02:20:42.409744Z 0 [Warning] [MY-011810] [Server] Insecure configuration for --pid-file: Location '/var/run/mysqld' in the path is accessible to all OS users. Consider choosing a different directory.
playground-mysql | 2024-01-08T02:20:47.137229Z 0 [System] [MY-010931] [Server] /usr/sbin/mysqld: ready for connections. Version: '8.0.35' socket: '/var/run/mysqld/mysqld.sock' port: 3306 MySQL Community Server - GPL.
playground-mysql | 2024-01-08T02:20:47.137349Z 0 [System] [MY-011323] [Server] X Plugin ready for connections. Bind-address: '::' port: 33060, socket: /var/run/mysqld/mysqlx.sock
playground-hive | OpenJDK 64-Bit Server VM warning: ignoring option MaxPermSize=128m; support was removed in 8.0
playground-hive | 24/01/08 02:20:49 WARN util.NativeCodeLoader: Unable to load native-hadoop library for your platform... using builtin-java classes where applicable
playground-hive | chmod: /user/hive/tmp': No such file or directory playground-hive | usermod: no changes playground-hive | * Starting MySQL database server mysqld playground-hive | ...done. playground-hive | mysql: [Warning] Using a password on the command line interface can be insecure. playground-hive | OpenJDK 64-Bit Server VM warning: ignoring option MaxPermSize=128m; support was removed in 8.0 playground-hive | SLF4J: Class path contains multiple SLF4J bindings. playground-hive | SLF4J: Found binding in [jar:file:/usr/local/hive/lib/log4j-slf4j-impl-2.6.2.jar!/org/slf4j/impl/StaticLoggerBinder.class] playground-hive | SLF4J: Found binding in [jar:file:/usr/local/hadoop/share/hadoop/common/lib/slf4j-log4j12-1.7.10.jar!/org/slf4j/impl/StaticLoggerBinder.class] playground-hive | SLF4J: See http://www.slf4j.org/codes.html#multiple_bindings for an explanation. playground-hive | SLF4J: Actual binding is of type [org.apache.logging.slf4j.Log4jLoggerFactory] playground-hive | Metastore connection URL: jdbc:mysql://localhost/metastore_db?createDatabaseIfNotExist=true&useSSL=false playground-hive | Metastore Connection Driver : com.mysql.jdbc.Driver playground-hive | Metastore connection User: hive playground-hive | Loading class com.mysql.jdbc.Driver'. This is deprecated. The new driver class is `com.mysql.cj.jdbc.Driver'. The driver is automatically registered via the SPI and manual loading of the driver class is generally unnecessary.
playground-hive | Starting metastore schema initialization to 2.3.0
playground-hive | Initialization script hive-schema-2.3.0.mysql.sql
dependency failed to start: container playground-hive is unhealthy
[+] Running 6/6
✔ Container playground-postgresql Removed 10.6s
✔ Container playground-trino R... 0.5s
✔ Container playground-mysql R... 11.5s
✔ Container playground-gravitino Removed 1.0s
✔ Container playground-hive Re... 14.0s
✔ Network gravitino-playground_default Removed 0.1s
justin@Justins-MBP gravitino-playground %

After Gravitino 0.4.0 is released, we would update the Docker image version.

I was trying to run the playground, and I encounter this error:

ERROR: The Compose file './docker-compose.yaml' is invalid because:
services.trino.depends_on contains an invalid type, it should be an array
services.gravitino.depends_on contains an invalid type, it should be an array
ERROR: The Compose file './docker-compose.yaml' is invalid because:
services.trino.depends_on contains an invalid type, it should be an array
services.gravitino.depends_on contains an invalid type, it should be an array

And I found this issue: docker/compose#4305 says that the depends_on is not supported on v3 anymore.
Can anyone help me this?

Find out the minimum OS requirements for the playground and suggested configuration for it to start correctly. Also, suggest a configuration for the number of cores and HD size for Docker Hub (if used).