Versions Compared

Old Version 5

changes.mady.by.user Unknown User (rxin)

Saved on

compared with

New Version 6

changes.mady.by.user Unknown User (rxin)

Saved on

Key

  • This line was added.
  • This line was removed.
  • Formatting was changed.

Here are instructions on profiling Spark applications using YourKit Java Profiler(http://www.yourkit.com/java/profiler/index.jsp).

On Spark EC2 images

1. After logging into the master node, download the YourKit Java Profiler for Linux from the YourKit downloads page (at the time of writing, the latest version is yjp-12.0.5-linux.tar.bz2; you will need to substitute different paths if using a newer version). This file is pretty big (~100 MB) and YourKit downloads site is somewhat slow, so you may consider mirroring this file or including it on a custom AMI.

...