TornadoVM

TornadoVM is a plug-in to OpenJDK and other JDK distributions (e.g., GraalVM, Red Hat Mandrel, Amazon Corretto, Microsoft OpenJDK, Azul Zulu) that allows developers to automatically run Java programs on heterogeneous hardware. TornadoVM targets devices compatible with OpenCL, PTX and Level-Zero, which include multi-core CPUs, dedicated GPUs (Intel, NVIDIA, AMD), integrated GPUs (Intel HD Graphics and ARM Mali), and FPGAs (Intel and Xilinx).

TornadoVM has three backends: OpenCL, NVIDIA CUDA PTX, and SPIR-V. Developers can choose which backends to install and run.

TornadoVM does not replace existing VMs, but it rather complements them with the capability of offloading Java code to OpenCL, PTX and SPIR-V, handling memory management between Java and hardware accelerators, and running/coordinating the compute-kernels.

Contents

• Introduction to TornadoVM
  • Main Features
• Installation & Configuration
  • Pre-requisites
  • Supported Platforms
  • Installation
    • A) Automatic Installation
    • B) Manual Installation
      • Linux
      • Windows
      • ARM Mali GPUs and Linux
      • Compilation with Maven
    • Installation for GraalVM for JDK 21.0.1 on Linux and macOS
      • 1. Download GraalVM JDK 21.0.1
      • 1. Download TornadoVM
      • 3. Install CMAKE (if cmake < 3.6)
        • For Linux:
        • For macOS:
      • 4. Compile TornadoVM with GraalVM
    • TornadoVM for JDK 21 on Linux and macOS
      • 1. Download a JDK 21 distribution
        • 1.1 Manage JDKs manually
        • 1.2 Manage JDKs with SDKMAN
      • 2. Download TornadoVM
      • 3. Install CMAKE (if cmake < 3.6)
        • For Linux:
        • For macOS:
      • 4. Compile TornadoVM for JDK 21
      • Running with JDK 21
    • TornadoVM for Windows 10/11 using GraalVM
      • A) Windows installation with MSys2 toolchain
      • 1. Install prerequisites
        • Maven
        • MSys2
      • 2. Download TornadoVM
      • 3. Download GraalVM for JDK 21 Community 21.0.1
      • 4. Install the NVIDIA drivers and CUDA Toolkit
      • 5. Configure the TornadoVM build: setting ENV variables
      • 6. Compile TornadoVM
      • 7. Check the installation
      • B) Windows installation with native toolchain
      • 1. Install prerequisites
      • 2. Setup environment
      • 3. Download, compile and install TornadoVM
      • 4. Check the installation
    • TornadoVM on ARM Mali GPUs
      • 1. Installation
      • 2. Testing on ARM MALI GPUs
    • Known issues on Linux
    • Known issues on Windows
    • IDE Code Formatter
      • Using Eclipse and Netbeans
      • Using IntelliJ
    • TornadoVM Maven Projects
    • Versions available
• Running Examples and Benchmarks
  • Running TornadoVM Programs
  • Benchmarking
    • Running all benchmarks with default values
    • Running a specific benchmark
  • Unittests
• Core Programming
  • 1. Data Representation
  • 2. Expressing Parallelism within Java Methods
    • Loop Parallel API
    • Kernel API
      • Kernel Context
      • KernelContext Features
    • Example
    • Running Multiple Tasks with the Kernel Context
  • 3. Selecting the methods to be accelerated using a Task-Graph API
    • A. Defining copies from the host (main CPU) to the device (accelerator).
      • B. Code definition
      • C. Copy out from the device (accelerator) to the host (main CPU).
  • 4. Execution Plans
    • What can we do with an execution plan?
    • How can we optimize an execution plan?
    • Obtain the result and the profiler
  • Parallel Reductions
    • Creating reduction tasks
    • Map/Reduce
    • Reduction with dependencies
  • Dynamic Reconfiguration
  • Batch Computing Processing
    • Current Limitations of Batch Processing
• Migrating from v0.15.2 to v1.0
  • 1. Off-heap types API
  • 2. Example: Migrating TornadoVM applications from <= 0.15.2 to 1.0
• Polyglot Programming
  • 1. Prerequisites
    • A) Configuration of the JAVA_HOME Variable
    • B) GraalVM Polyglot Dependencies
  • 2. Using the GraalVM Polyglot Dependencies from Maven Central
    • A) Build TornadoVM with the GraalVM Polyglot Dependencies from Maven Central
    • B) Run the Examples
  • 3. Using the GraalVM Polyglot Dependencies as Standalone Toolkits
    • A) Build GraalVM Polyglot Dependencies from Source
    • B) Interoperate between a Polyglot Programming Language and TornadoVM through Graal’s Polyglot API
    • C) Run the Examples
• TornadoVM Profiler
  • 1. Enable the Profiler from the Command Line
  • 1. Enabling/Disabling the Profiler using the TornadoExecutionPlan
  • Explanation of all values
    • Print timers at the end of the execution
    • Save profiler into a file
    • Parsing Json files
  • Code feature extraction for the OpenCL/PTX generated code
    • Save features into a file
    • Send log over a socket.
• Benchmarking TornadoVM
  • Benchmarks
  • How to run
    • Example
  • Using JMH
• FPGA Programming in TornadoVM
  • Pre-requisites
  • Step 1: Update/Create the FPGA’s configuration file
    • Example of a configuration file for Intel FPGAs (Emulation mode) with the Intel oneAPI Base Tool Kit:
    • Example of a configuration file for an Intel Nallatech-A385 FPGA (Intel Arria 10 GT1150):
    • Example of a configuration file for a Xilinx KCU1500 FPGA:
    • Example of a configuration file for a Xilinx Alveo U50 FPGA:
    • Example of a configuration file for an AWS xilinx_aws-vu9p-f1-04261818_dynamic_5_0 FPGA:
  • Step 2: Select one of the three FPGA Execution Modes
    • 1. Full JIT Mode
    • 2. Ahead of Time Execution Mode
    • 3. Emulation Mode
      • A) Emulation of an Intel platform:
      • B) Emulation of a Xilinx platform (using Vitis):
• Docker Containers
  • Nvidia GPUs
    • Prerequisites
    • How to run?
    • Using TornadoVM with GraalVM for NVIDIA GPUs
    • Some options
  • Intel Integrated Graphics
    • Prerequisites
    • How to run?
    • Using TornadoVM with GraalVM for Intel Integrated Graphics
• Cloud Deployments
  • 1. Running on AWS for CPUs and GPUs
  • 2. Running on AWS EC2 F1 Xilinx FPGAs
    • Pre-requisites:
    • 1. Install TornadoVM as a CentOS user. The Xilinx FPGA is not exposed to simple users.
    • 2. Follow these steps to get access to the Xilinx FPGA.
    • 3. Update the the FPGA Conguration file
    • 4. Run a program that offloads a task on the FPGA.
    • 5. You can monitor the status of your Amazon FPGA Image.
    • 6. Now that the AFI is available, you can execute the program and run the OpenCL kernel on the AWS FPGA.
• SPIR-V Devices
  • Install Intel oneAPI Level Zero Compute Runtime
  • Install TornadoVM for SPIR-V
  • Running examples with the SPIR-V backend
    • Running DFT from the unit-test suite
      • Disassemble the SPIR-V binary:
• CUDA Devices
  • Prerequisites
    • Driver Installation
  • TornadoVM Installation
  • Addressing Possible issues
  • Testing the CUDA Backend of TornadoVM
• Multi-Device Execution
  • Prerequisites
    • Ensuring that multiple devices are available
  • Sequential Execution on Multiple Devices
  • Concurrent Execution on Multiple Devices
  • How to debug
  • Not Supported
• TornadoVM Flags
  • List of TornadoVM Flags:
    • Optimizations
    • Level Zero
• IDE Integration
  • IntelliJ
    • Required Plugins:
    • Run and Debug TornadoVM with Intellij
    • Build/Run Configuration
    • Debug/Run Configuration
    • CheckStyle-IDEA Configuration
• Developer Guidelines
  • IntelliJ Configurations
    • 1. Enable Eclipse Code Formatter for IntelliJ
    • 2. Enable IntelliJ Code Formatter
    • 3. Checkstyle-IDEA Plugin
    • 4. EditorConfig
    • 1. Save Actions
  • Pre-commit hooks
    • Install pre-commit hooks
• Frequently Asked Questions
  • 1. What can TornadoVM do?
  • 2. Can I use TornadoVM in a commercial application?
  • 3. How can I use it?
    • List of compatible JDKs
      • Windows
      • ARM Mali GPUs and Linux
    • Usage
  • 4. Which programming languages does TornadoVM support?
  • 5. Is TornadoVM a Domain Specific Language (DSL)?
  • 6. Does it support the whole Java Language?
  • 7. Can TornadoVM degrade the performance of my application?
  • 8. Dynamic Reconfiguration? What is this?
  • 9. Does TornadoVM support only OpenCL devices?
  • 10. Why is it called a VM?
  • 11. How does it interact with OpenJDK?
  • 12. How do I know which parts of my application are suitable for acceleration?
  • 13. How can I contribute to TornadoVM?
  • 14. Does TornadoVM support calls to standard Java libraries?
  • 15. Do I need a GPU to run TornadoVM?
• Unsupported Java features
  • 1. No Recursion
  • 2. No Object Support (*)
  • 3. No Dynamic Memory Allocation (*)
  • 4. No Support for Traps/Exceptions (*)
  • 5. No Support for static TaskGraphs and Tasks
    • Note
• Resources
  • Videos
  • Presentations
  • Podcast
  • Articles
  • Demos & Artefacts
• Publications
  • Full list of publications
• TornadoVM Changelog
  • TornadoVM 1.0.3
    • Improvements
    • Compatibility
    • Bug Fixes
  • TornadoVM 1.0.2
    • Improvements
    • Compatibility
    • Bug Fixes
  • TornadoVM 1.0.1
    • Improvements
    • Compatibility/Integration
    • Bug Fixes
  • TornadoVM 1.0
    • Improvements
    • Compatibility/Integration
    • Bug fixes:
  • TornadoVM 0.15.2
    • Improvements
    • Compatibility/Integration
    • Bug fixes:
  • TornadoVM 0.15.1
    • Improvements
    • Compatibility/Integration
    • Bug fixes:
  • TornadoVM 0.15
    • Improvements
    • Bug fixes:
  • TornadoVM 0.14.1
    • Improvements
    • Compatibility/Integration
    • Bug Fixes
  • TornadoVM 0.14
    • New Features
    • Compatibility/Integration
    • Improvements/Bug Fixes
  • TornadoVM 0.13
  • TornadoVM 0.12
  • TornadoVM 0.11
  • TornadoVM 0.10
  • TornadoVM 0.9
  • TornadoVM 0.8
  • TornadoVM 0.7
  • TornadoVM 0.6
  • TornadoVM 0.5
  • TornadoVM 0.4
  • TornadoVM 0.3
  • TornadoVM 0.2
  • Tornado 0.1.0