Tuesday, July 16, 2024

How Spark executer handles threads

 How spark executer handles threads:

Spark executor handles threads by determining the number of tasks that can be run in parallel based on the number of cores, scheduling tasks to available threads, ensuring thread safety, handling task failures, and managing resources

1. Number of cores

2. Scheduling

3. Thread Safety

4. Fault Tolerance

5. Resource Management

No comments: