Add batching transports and reorganize package - #4
Merged
Conversation
Introduce BatchingTransport and 17 new transports (SQL: SQLite/Postgres/MySQL; NoSQL: MongoDB/DynamoDB/Redis; Queues: Kafka/RabbitMQ/SQS/PubSub; Cloud: CloudWatch/CloudLogging/AppInsights/Datadog/Elasticsearch/NewRelic). Restructure transport and plugin modules into logquill.transports and logquill.plugins subpackages, update package exports and versioned __init__, add extensive tests for batching and each transport, and add optional-dependency extras in pyproject.toml. Update README and CHANGELOG. Implementation notes: AppInsights/Datadog/Elasticsearch/NewRelic use stdlib urllib; NewRelic gzips payloads and honors 429 Retry-After (pauses and drops batches); SQS chunks are dispatched sequentially; SQLite needs no extra.
Replace PEP 585 dict[...] annotations with typing.Dict in New Relic transport for Python 3.8 compatibility. Adds Dict to imports and updates the NewRelicSender alias and function signature accordingly in logquill/transports/cloud/new_relic_transport.py.
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
1 participant
Add this suggestion to a batch that can be applied as a single commit.This suggestion is invalid because no changes were made to the code.Suggestions cannot be applied while the pull request is closed.Suggestions cannot be applied while viewing a subset of changes.Only one suggestion per line can be applied in a batch.Add this suggestion to a batch that can be applied as a single commit.Applying suggestions on deleted lines is not supported.You must change the existing code in this line in order to create a valid suggestion.Outdated suggestions cannot be applied.This suggestion has been applied or marked resolved.Suggestions cannot be applied from pending reviews.Suggestions cannot be applied on multi-line comments.Suggestions cannot be applied while the pull request is queued to merge.Suggestion cannot be applied right now. Please check back later.
Introduce BatchingTransport and 17 new transports (SQL: SQLite/Postgres/MySQL; NoSQL: MongoDB/DynamoDB/Redis; Queues: Kafka/RabbitMQ/SQS/PubSub; Cloud: CloudWatch/CloudLogging/AppInsights/Datadog/Elasticsearch/NewRelic). Restructure transport and plugin modules into logquill.transports and logquill.plugins subpackages, update package exports and versioned init, add extensive tests for batching and each transport, and add optional-dependency extras in pyproject.toml. Update README and CHANGELOG. Implementation notes: AppInsights/Datadog/Elasticsearch/NewRelic use stdlib urllib; NewRelic gzips payloads and honors 429 Retry-After (pauses and drops batches); SQS chunks are dispatched sequentially; SQLite needs no extra.
Summary
Checklist
ruff check .passesmypy logquillpasses (--stricton the public API)pytestpasses, and new surface area has test coverageREADME.mdwith a runnable exampleCHANGELOG.mdhas an entry underUnreleasedrecord shape, transport/plugin contracts, config shape) shared with
logquill-js, a matching tracking issue/PR is opened thereScope