|
|
|
@ -28,9 +28,9 @@ Watches log directory for logs, and ships them to mongo. |
|
|
|
|
│ Retry any downstream error with backoff ) file ( ┌──────────┬────────┐ |
|
|
|
|
┌─▼─────────────────────────────────────────┴──────┤ │ Submit ) sender ( |
|
|
|
|
│┌┴─► mongo: get offset create channels ┌─────► │ to mongo └────────┤ |
|
|
|
|
││ │ + chan processors │ │ ├────▲────┬─────────┘ |
|
|
|
|
│└──┐───┘ ┌─────────────┘ └───┼─────► ) batcher ( |
|
|
|
|
└───▼──────────▼──────────────────────────┐ │ │ ├────▲────┤ |
|
|
|
|
││ │ + chan processors │ │ ├────▲────┐ │ |
|
|
|
|
│└──┐───┘ ┌─────────────┘ └───┤ │ ) batcher ( │ |
|
|
|
|
└───▼──────────▼──────────────────────────┐ │ │ ├────▲────┼─────────┘ |
|
|
|
|
┌───┴────┐ ┌───────┬────────────────────┐ │ └─────► │ queue │ |
|
|
|
|
) tailer ( ) lines ( combine │ └────────┘ └────▲────┘ |
|
|
|
|
└───▼────┘ ├───────┘ partial lines │ │ |
|
|
|
|