/poc-testing-validation-objectmapper

Primary LanguageJava

POC Testing Validation and Object Mapper

Spring boot application for testing the crud application with kafka events of crud.

Pre-Reqs:

Start the docker containers:

docker-compose up

Create the Topic:

docker ps 
CONTAINER ID        IMAGE                    COMMAND                  CREATED             STATUS              PORTS                                                NAMES
0d1693a6767c        wurstmeister/kafka       "start-kafka.sh"         About an hour ago   Up 32 seconds       0.0.0.0:32768->9092/tcp                              testing-validation-objectmapper_kafka_1
6f62cf5d0625        wurstmeister/zookeeper   "/bin/sh -c '/usr/sb…"   About an hour ago   Up 32 seconds       22/tcp, 2888/tcp, 3888/tcp, 0.0.0.0:2181->2181/tcp   testing-validation-objectmapper_zookeeper_1

docker exec -it 0d16 sh
kafka-topics --create --zookeeper zookeeper:2181 --replication-factor 1 --partitions 1 --topic topic-test
kafka-topics --list --zookeeper zookeeper:2181

Send and Consume Message (AD HOC):

kafka-console-producer --broker-list localhost:9092 --topic test
kafka-console-consumer --bootstrap-server localhost:9092 --topic test --from-beginning

Registering schema:

cd web/src/main/resources
python3 register_schema.py http://localhost:8081 persons-avro persons.avsc

Testing

  1. Start the containers: 
    docker-compose up -d
  2. Start the Consumer application
  3. Start Web application
  4. Use postman collection (TestingValidationObjectMapper.postman_collection) to send post
  5. Consumer application must show the received messages: 
    2020-10-18 17:41:39.603  INFO 69348 --- [ntainer#0-0-C-1] o.a.k.c.c.internals.ConsumerCoordinator  : [Consumer clientId=consumer-testGroup-1, groupId=testGroup] Setting offset for partition test-0 to the committed offset FetchPosition{offset=55, offsetEpoch=Optional.empty, currentLeader=LeaderAndEpoch{leader=Optional[localhost:9092 (id: 1 rack: null)], epoch=0}}
2020-10-18 17:41:39.603  INFO 69348 --- [ntainer#0-0-C-1] o.s.k.l.KafkaMessageListenerContainer    : testGroup: partitions assigned: [test-0]
2020-10-18 17:41:39.606  INFO 69348 --- [ntainer#0-0-C-1] c.o.k.c.config.KafkaMessageListener      : Received Message: {"tenantId": "1234", "fullName": "Marcelo"}
2020-10-18 17:41:48.005  INFO 69348 --- [ntainer#0-0-C-1] c.o.k.c.config.KafkaMessageListener      : Received Message: {"tenantId": "1234", "fullName": "Marcelo"}
2020-10-18 17:41:55.680  INFO 69348 --- [ntainer#0-0-C-1] c.o.k.c.config.KafkaMessageListener      : Received Message: {"tenantId": "1234", "fullName": "Marcelo"}
2020-10-18 17:41:56.872  INFO 69348 --- [ntainer#0-0-C-1] c.o.k.c.config.KafkaMessageListener      : Received Message: {"tenantId": "1234", "fullName": "Marcelo"}

Application urls:

Zookeeper: localhost:2181

Broker: localhost:9092

Cluster: http://localhost:9021/clusters

Schema registry: localhost:8081

List of registries versions: http://localhost:8081/subjects/persons-avro-value/versions/

Application: localhost:8080

Useful Links:

Docker images

Schema registry

Python script for schema registry