2022-11-06 13:04:16 +00:00
|
|
|
# logmower-shipper
|
|
|
|
|
|
|
|
|
|
Watches log directory for logs, and ships them to mongo.
|
|
|
|
|
|
|
|
|
|
- Running: `go run .`
|
|
|
|
|
- Building: `go build .`
|
|
|
|
|
|
|
|
|
|
## Files
|
2022-11-09 18:24:57 +00:00
|
|
|
0. `pkg/globals` defines globals. This is used for Prometheus namespace, and for forwarding static global CLI configuration with less clutter.
|
|
|
|
|
1. `main.go` serves `/metrics` and runs `watcher.go`.
|
|
|
|
|
2. `pkg/watcher` main routine; initializes (including `mongo.go`) and watches for new log files.
|
|
|
|
|
- `pkg/mongo` provides statically safe and central tools to interact with the database.
|
|
|
|
|
- `pkg/util` provides additional utility functions.
|
|
|
|
|
3. `pkg/file` handles file lifecycle; watches files and tails them, streaming lines to `pkg/lines`.
|
|
|
|
|
4. `pkg/lines` processes lines and streams them to `pkg/sender`.
|
|
|
|
|
5. `pkg/sender` batches lines and ships them to mongo.
|
