Improving Performance

  • Typical areas to improve performance shared by Michael Vorburger:

    • 1. Find slow SQL queries
      2. Add indices to the DB
      3. Tune some low level DB set up params (think cache sizes in the DB itself and such)
      4. Change Java code to rewrite SQL queries
      5. Change DB DDL code to improve DB schema, typically to normalize things to avoid JOINs
      6. Find Java code CPU hotspots, and fix
      7. Find Java code memory leaks or GC trashers

  • Suggestions from Nayan from mailing list. 

    • without code change
      1. Use SSD/High IOPS storage for Database
      2. If you are on AWS, go for Aurora instead of MySQL
      3. Look at database usage for this batch job and see if there is opportunity index some columns for better performance

    • with code change
      1. Process the data parallel either on with multi threading on single node or we can go for multiple nodes
      2. Query optimisation
      3. Data fetch and commit batch size
      there are many other opportunities to improve the same

High Volume/Load Environments across the Ecosystem:

Existing Work to Date

  • No labels