Reproducible Analytical Pipelines

Is RAP relevant to me?

Would it be a nightmare to have to go back and rerun your process from the beginning if you found a mistake?
Do you have to make a lot of manual edits to code before each run?
Is there a lot of repetition in your code?
Would a new person find it difficult to understand the process?

An overall approach to analysis
Automated statistical and analytical processes that are:
- Reproducible
- Auditable
- Efficient
- High quality

In order to achieve the full benefits, at a minimum a RAP must:

RAP Self-Assessment Tool developed internally for analysts in the Scottish Government.
Specific criteria for RAP categorised into 4 ‘levels’: Aspiring, Fundamental, Intermediate and Advanced.
Description and links to further resources for each criteria.
Complete form and download report to track progress and inform next steps.

Create a process map of your existing process (and maybe a process map for your aspirational process)
RAP isn’t about replicating / shoehorning an existing process into new software. Step back - look at what you have to start with, what you’d like to end up with and the most logical way of getting from one to the other. It’s easy to assume processes are complex and convoluted for unavoidable reasons, but often they’re just a result of years of different analysts adding new layers on top of old ones until it doesn’t make sense anymore!
You don’t need to overhaul the entire project all at once. Can you isolate a section from your process map? Test a RAP approach on this section, make improvements and learn lessons for next phase.
Learn from others around you. There may be others in your division who can help you or are willing to be a critical friend. My team (Data Innovation team) can also provide support.