Package: starburst 0.3.11

Introduction | Which API should I use? | Which backend? EC2 (default) vs Fargate | How it works (the mental model) | Installation | One-Time Setup | Your first job | Migrating existing future / furrr code | Real-world examples | Working with Data | Data Already in S3 | Uploading Local Data | Large Data Optimization | Cost Management | Estimate Costs | Set Cost Limits | Cost estimates | Quota Management (Fargate backend) | Check Your Quota | Request Quota Increase | Wave-Based Execution | Troubleshooting | View Worker Logs | Check Cluster Status | Common Issues | Best Practices | 1. Use for Right-Sized Workloads | 2. Batch Small Tasks | 3. Use S3 for Large Data | 4. Set Reasonable Limits | 5. Clean Up | Advanced: Custom Configuration | CPU and Memory | Timeout | Region | Next Steps | Getting Help

Detached Sessions | Why Use Detached Sessions? | Basic Usage | Creating a Session | Checking Status | Collecting Results | Detach and Reattach | Session Management | List All Sessions | Extend Timeout | Cleanup | Choosing and tuning the backend | Advanced Usage | Error Handling | Partial Collection | How It Works | Architecture | Task Lifecycle | Best Practices | When to Use Detached Sessions | Resource Management | Cost Optimization | Comparison: Ephemeral vs Detached | Troubleshooting | Session Not Found | No Results After Long Wait | Workers Terminating Too Soon | Examples | Genomics Pipeline | Monte Carlo Simulation | See Also

Overview | The Problem | Setup | Generate Sample Data | Bootstrap Function | Local Execution | Cloud Execution with staRburst | Results Analysis | Visualization | Performance Comparison | Advanced: Multi-Metric Bootstrap | When to Use This Pattern | Running the Full Example | Next Steps

Overview | The Problem | Setup | API Call Function | Mock API for Demo | Generate Sample Data | Local Execution | Cloud Execution with staRburst | Results Processing | Performance | Rate Limiting Considerations | Error Handling Best Practices | When to Use This Pattern | Running the Full Example | Next Steps

Overview | The Problem | Setup | Generate Sample Data | Feature Engineering Function | Local Execution | Cloud Execution with staRburst | Results Analysis | Performance Comparison | Advanced: Adding ML-Ready Features | When to Use This Pattern | Running the Full Example | Next Steps

Overview | The Problem | Setup | Generate Sample Data | Spatial Analysis Function | Local Execution | Cloud Execution with staRburst | Results Analysis | Performance Comparison | Advanced: Delivery Zone Optimization | When to Use This Pattern | Running the Full Example | Next Steps

Overview | The Problem | Setup | Generate Sample Data | Define Parameter Grid | Model Training Function | Local Execution | Cloud Execution with staRburst | Results Analysis | Performance | Advanced: Random Search | Advanced: Bayesian Optimization | When to Use This Pattern | Running the Full Example | Next Steps

Overview | The Problem | Setup | Generate Sample Portfolio | Risk Scenario Generation | Portfolio Valuation Function | Local Execution | Cloud Execution with staRburst | Risk Metrics Analysis | Performance | Advanced: Incremental Risk Analysis | When to Use This Pattern | Running the Full Example | Next Steps

Overview | The Problem | Setup | Report Template | Generate Sample Data | Report Generation Function | Local Execution | Cloud Execution with staRburst | Results Processing | Performance | Advanced: Custom Report Distribution | When to Use This Pattern | Running the Full Example | Next Steps

The Honest Truth | Real Performance Data | ✅ When it pays off — heavy per-task work | ❌ When it doesn't — light per-task work | The lesson | Per-Task Overhead | Batching | Choosing Instance Types | The Startup Cost Problem | Run once (cold) — modest win | Run 10 times (parameter sweep) — much better | Daily recurring job — excellent | Decision Framework | Common Patterns | Pattern: One-shot analysis — use local | Pattern: Parameter sweep — use cloud | Pattern: Daily production job — keep warm pool | Pattern: Hybrid — develop local, scale on cloud | Cost Estimation | Common Pitfalls | Use Case Quick Reference | AWS Authentication

Overview | The Problem | Setup | Simulation Function | Local Execution | Cloud Execution with staRburst | Results Analysis | Performance | When to Use This Pattern | Running the Full Example | Next Steps

Lever 1 — Task length: is each task worth shipping? | Lever 2 — Task count: batch, or fall off a cliff | Lever 3 — Fan-out width: more workers is not always better | Lever 4 — Cost vs. time: what are you optimizing? | Pro tip — shard your S3 writes across prefixes | Putting it together: a diagnosis checklist

Accessing Logs | CloudWatch Logs Structure | Viewing Logs in R | Viewing Logs in AWS Console | Common Issues | Issue 1: Tasks Stuck in "Pending" | Issue 2: Workers Crash Immediately | Issue 3: "Access Denied" Errors | Issue 4: High Costs / Runaway Workers | Issue 5: Session Cleanup Not Working | Issue 6: Results Not Appearing | Issue 7: Detached Session Reattach Fails | Issue 8: Package Installation Failures | Advanced Diagnostics | Checking ECS Task Status | Monitoring S3 Storage | Estimating Costs | Getting Help | See Also

1. Credential Management | ❌ DON'T: Hard-code Credentials | ✅ DO: Use IAM Roles (Recommended) | ✅ DO: Use Named Profiles (Local Development) | ✅ DO: Use Temporary Credentials (STS) | 2. S3 Bucket Security | Minimum Required Permissions | Enable Server-Side Encryption | Enable Versioning | Block Public Access | Use Bucket Policies | 3. Network Isolation | Use Private Subnets (For Sensitive Workloads) | Configure Security Groups | Enable VPC Endpoints (Recommended) | 4. Cost Controls | Set Budget Alerts | Use Worker Limits | Monitor Active Sessions | Use Absolute Timeouts | Cost Estimation | 5. Audit Logging | Enable CloudTrail | Enable CloudWatch Logs | Enable S3 Access Logging | Review Security Events | 6. Data Protection | Minimize Data Uploaded to S3 | Delete Results After Collection | Consider Client-Side Encryption | 7. Container Image Security | Use Minimal Base Images | Scan Images for Vulnerabilities | Use Image Lifecycle Policies | 8. Compliance Considerations | HIPAA Compliance | GDPR Compliance | SOC 2 Compliance | 9. Incident Response | If Credentials Are Compromised | If Data Breach Suspected | 10. Security Checklist | Additional Resources | See Also