feat: supporting week surveys (like emg 2023) - #481
Open
sebhoerl wants to merge 9 commits into
Open
Conversation
Contributor
Author
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Add this suggestion to a batch that can be applied as a single commit.This suggestion is invalid because no changes were made to the code.Suggestions cannot be applied while the pull request is closed.Suggestions cannot be applied while viewing a subset of changes.Only one suggestion per line can be applied in a batch.Add this suggestion to a batch that can be applied as a single commit.Applying suggestions on deleted lines is not supported.You must change the existing code in this line in order to create a valid suggestion.Outdated suggestions cannot be applied.This suggestion has been applied or marked resolved.Suggestions cannot be applied from pending reviews.Suggestions cannot be applied on multi-line comments.Suggestions cannot be applied while the pull request is queued to merge.Suggestion cannot be applied right now. Please check back later.

This PR adds support for week-based surveys from MobiSurvStd. While this is currently only the EMG 2023 for Île-de-France, the implementation is generic and intended to be future-proof.
Generating week-long activity sequences
By default, a week-long survey will create week-long activity chains. The survey data is structured such that
time=0corresponds to midnight on Monday, Tuesday starts at24 * 3600, etc.Generating daily activity sequences
There are two ways of making use of a week survey to generate daily activity sequences:
random_seed. This approach reduces the amount of available observations, but is straight-forward.Configuration
The pipeline will detect automatically if a week survey has been selected. In that case, the
mobisurvstd.weeklyattribute is examined:Additional modifications
In order to support EMG2023, one can now choose which distances to use (so far MobiSurvStd only provided
euclidean_distance, but the EMG only hasrouted_distance:While one can choose manually (for surveys that may provide both information), the
autooption will check what information is available and preferroutedovereuclideanif both are present.Caveats
When using
splitorsample, the basis is still the whole EMG2023 survey, which means any day of the week from Monday to Sunday. You should make use of #474 to restrict the considered days from Monday to Friday if necessary.TODO: