Return to the Main GitHub Org. Site
For all iDaaS design patterns it should be assumed that you will either install as part of this effort, or have the following:
- IDE (Possibly). There are several great choices out there several resources we work use wither VS Code with numerous plugins or some edition Community or otherwise of JetBrains IntelliJ.
- Java JDK: Java is what everything is developed in. The current supported JDK release(s) are 1.8 and 11. We strongly recommend 11 as all the build actions and activities we do are based on this JDK release. OpenJDK Download Site.
- Maven: Some understanding of building, deploying Java artifacts and the commands associated. If using Maven commands then
Maven would need to be intalled and runing for the environment you are using. More details about Maven can be
found here
- An existing Kafka (or some flavor of it) up and running. We have implemented iDaaS with numerous Kafka implementations.
Please see the following files we have included to try and help:
Kafka Non Windows
Kafka Windows
No matter the platform chosen it is important to know that the Kafka out of the box implementation might require some changes depending upon your implementation needs. Here are a few we have made to ensure:
In /config/consumer.properties file we will be enhancing the property of auto.offset.reset to earliest. This is intended to enable any new system entering the group to read ALL the messages from the start.
auto.offset.reset=earliest - Something to view Kafka topics with as you are developing and a potential interface for production when and if needed.
Depending on your Kafka implementation can make this a non-issue; however, we wanted to make you aware of this need
as being able to see data in every component natively is key for validating and implementing any solution. There are
several open or inexpensive options to chose from and within the community we have used all of them below with success.
- Open Source and Web based: Provectus
- Open Source and Web based: Kafdrop
- Open Source and Web based: Kowl
- Desktop Based and Paid Product after trial: Offset Explorer
- An internet connection with active internet connectivity, this is to ensure that if any Maven commands are
run and any libraries need to be pulled down they can.