Batch Processing

This function block facilitates batch processing of input data, optimizing memory consumption during the workflow. It allows you to handle multiple inputs as a single batch, improving efficiency when processing large datasets.

📥 Inputs

Input 1 This input can accept various types of data for batch processing.

Input 2 This input can also accept various types of data and will be included in the batch.

📤 Outputs

Batch This output consolidates the incoming inputs into a batch, ready for further processing.

🕹️ Controls

This block does not have specific controls for user input but processes any connected inputs to produce a batch output.

🎨 Features

Memory Optimization Designed to reduce memory usage by processing inputs in batch format, beneficial for handling larger datasets.

Flexible Input Types Supports various input types and aggregates them into a single output batch.

📝 Usage Instructions

1. Connect Inputs: Connect the desired inputs to Input 1 and Input 2. Additional input types can also be connected.

2. Evaluate the Block: Run the function block to produce a batch output containing all input data.

3. Utilize Output: Use the batch output in subsequent blocks for streamlined processing.

📊 Evaluation

This function block processes incoming data through the connected inputs and returns a batch of that data.

💡 Tips and Tricks

Compressing Data

To minimize memory consumption even further when creating batches, consider using Data to JSON to compress data formats before inputting them into this block.

Efficient Data Handling

To ensure efficient handling of large datasets, utilize block connections that can process batches efficiently, such as using Batch Concatenation to merge or split batches as required.

Using Batch Processing Wisely

When dealing with multiple data inputs, ensure that you align input types correctly in subsequent processes to avoid data type conflicts.

🛠️ Troubleshooting

Batch Output Issues

If the output batch does not contain data as expected, check if your inputs are properly connected and verify that they are providing valid data types.

Exceptions During Processing

In case of exceptions during batch processing, check the logs for any specific errors. Retrieving logs can help identify which socket may have caused the issue.