Skip to content

Past RIB dumps are loaded when they shouldn't be #10

Description

@TimEvens

At times a RIB dump from weeks ago is processed when it shouldn't be.

openbmp-mrt2bmp_route-views.isc.routeviews.org.log:2018-04-10 17:14:26,927 | INFO     | router_processor | Using working dir /home/ubuntu/mrt/rv/router_data/route-views.isc.routeviews.org
openbmp-mrt2bmp_route-views.isc.routeviews.org.log:2018-04-10 17:14:26,928 | INFO     | router_processor | There is an abnormality between timestamps of two files in route-views.isc.routeviews.org .
openbmp-mrt2bmp_route-views.isc.routeviews.org.log:2018-04-10 17:14:26,928 | INFO     | router_processor | There is an abnormality between timestamps of two files in route-views.isc.routeviews.org .
openbmp-mrt2bmp_route-views.isc.routeviews.org.log:2018-04-10 17:14:26,935 | INFO     | router_processor | -- 2018.01/RIBS/rib.20180131.2200.bz2 is started
openbmp-mrt2bmp_route-views.isc.routeviews.org.log:2018-04-10 17:14:26,942 | INFO     | router_processor | -- 2018.01/RIBS/rib.20180131.2200.bz2 is ended
openbmp-mrt2bmp_route-views.isc.routeviews.org.log:2018-04-10 17:14:56,972 | INFO     | router_processor | Using working dir /home/ubuntu/mrt/rv/router_data/route-views.isc.routeviews.org
openbmp-mrt2bmp_route-views.isc.routeviews.org.log:2018-04-10 17:14:56,973 | INFO     | router_processor | There is an abnormality between timestamps of two files in route-views.isc.routeviews.org .
openbmp-mrt2bmp_route-views.isc.routeviews.org.log:2018-04-10 17:14:56,979 | INFO     | router_processor | -- 2018.02/RIBS/rib.20180203.1000.bz2 is started
openbmp-mrt2bmp_route-views.isc.routeviews.org.log:2018-04-10 17:14:56,987 | INFO     | router_processor | -- 2018.02/RIBS/rib.20180203.1000.bz2 is ended

Expected Behavior

  • RIB dump is only processed when (a) program is started, (b) when there is an updates gap.
  • There is a knob to allow update gaps, which should trigger the RIB dump from only be read to get peer info
  • When reading a RIB dump, only the RIB dump minus expected hours should be loaded. Currently the max is RIPE with 8 hour RIB DUMPs.
  • If a RIB dump is needed to be loaded and one doesn't exist within the allowed time window, then the program should log that it can't find one and continue to check on interval (e.g. interval of 5 minutes)

Metadata

Metadata

Assignees

No one assigned

    Labels

    Type

    No type

    Projects

    No projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions