event_routing_backends.management.commands.helpers package#
Submodules#
event_routing_backends.management.commands.helpers.event_log_parser module#
Support for reading tracking event logs.
Taken entirely from edx-analytics-pipeline.
- event_routing_backends.management.commands.helpers.event_log_parser.parse_json_event(line)#
Parse a tracking log input line as JSON to create a dict representation.
Arguments: * line: the eventlog text
event_routing_backends.management.commands.helpers.queued_sender module#
Class to handle batching and sending bulk transformed statements.
- class event_routing_backends.management.commands.helpers.queued_sender.QueuedSender(destination, destination_container, destination_prefix, transformer_type, max_queue_size=10000, sleep_between_batches_secs=1.0, dry_run=False)#
Bases:
object
Handles queuing and sending events to the destination.
- finalize()#
Send a last batch of events via the LRS, or store a complete set of events to a libcloud destination.
- is_known_event(event)#
Check whether any processor cares about this event.
- queue(event)#
Add an event to the queue, try to send if we’ve reached our batch size.
- send()#
Send to the LRS if we’re configured for that, otherwise a no-op.
Events are converted to the output xAPI / Caliper format in the router.
- store()#
Store to a libcloud destination if we’re configured for that.
Events are converted to the output xAPI / Caliper format here before being saved.
- transform_and_queue(line)#
Queue the JSON representation of this log line, if valid and known to any processor.