Versions Compared

Old Version 3

changes.mady.by.user Unknown User (tarmstrong)

Saved on

compared with

New Version 4

changes.mady.by.user Unknown User (tarmstrong)

Saved on

Key

  • This line was added.
  • This line was removed.
  • Formatting was changed.

...

Code Block
start-impala-cluster.py --kill
start-impala-cluster.py --docker_network=impala-cluster-network
impala-shell.sh

Note that querying any existing tables is likely to fail because "localhost" is baked into a lot of metadata. You will need to load, or re-load data before running end-to-end tests.

You can see the running docker containers with "docker ps"

Code Block
$ docker ps
CONTAINER ID        IMAGE                COMMAND                  CREATED             STATUS              PORTS                                                                          NAMES
af295db2f818        impalad_coord_exec   "/opt/impala/bin/dae…"   2 minutes ago       Up 2 minutes        0.0.0.0:21002->21000/tcp, 0.0.0.0:21052->21050/tcp, 0.0.0.0:25002->25000/tcp   impala-test-cluster-impala-cluster-network-impalad_coord_exec-2
57011eda4ded        impalad_coord_exec   "/opt/impala/bin/dae…"   2 minutes ago       Up 2 minutes        0.0.0.0:21001->21000/tcp, 0.0.0.0:21051->21050/tcp, 0.0.0.0:25001->25000/tcp   impala-test-cluster-impala-cluster-network-impalad_coord_exec-1
7a3caac8ccc0        impalad_coord_exec   "/opt/impala/bin/dae…"   2 minutes ago       Up 2 minutes        0.0.0.0:21000->21000/tcp, 0.0.0.0:21050->21050/tcp, 0.0.0.0:25000->25000/tcp   impala-test-cluster-impala-cluster-network-impalad_coord_exec-0
e54887a3bc2c        catalogd             "/opt/impala/bin/dae…"   2 minutes ago       Up 2 minutes        0.0.0.0:25020->25020/tcp                                                       impala-test-cluster-impala-cluster-network-catalogd
57cd35033b15        statestored          "/opt/impala/bin/dae…"   2 minutes ago       Up 2 minutes        0.0.0.0:25010->25010/tcp                                                       impala-test-cluster-impala-cluster-network-statestored

Running Tests

Automated end-to-end tests are run with this job: https://jenkins.impala.io/job/ubuntu-16.04-dockerised-tests/. https://github.com/apache/impala/blob/master/bin/jenkins/dockerized-impala-bootstrap-and-test.sh bootstraps ubuntu16.04 from scratch and runs the tests.

...

  • The Impala debug pages are mostly exposed on the same ports as the regular minicluster, i.e. localhost:25000, localhost:25001, localhost:25002, localhost:25010, localhost:25020. This is achieved by mapping from the default webserver ports inside the container to the desired ports outside the container. I.e. all of the Impala daemons are exposing their webserver on port 25000 inside the container.
  • If you want to look at logs or other state in a running container, you can use "docker exec" to run a bash process inside a container (using the name or ID from "docker ps"). Inside the container is a very stripped down Ubuntu environment, so it may be missing many commands you're accustomed to!
Code Block
docker exec -it impala-test-cluster-impala-cluster-network-catalogd /bin/bash
cat /tmp/catalogd.INFO

...