Organizing and cleaning up data
Working Method
- Work in groups of three (or pairs).
- Agree whether one person completes the assignment on a laptop or whether everyone works on their own laptop
- If everyone works on their own laptop, make sure to discuss progress with each other
- Ask for help when needed — we are happy to support you!
Exercise
Before you start: Make sure you download the data download and extract the files.
Please note that the information about the data below is fictional and intended for this exercise. If you want to learn more about the data being used, click here.
You are working on a research project about wood ducks and have sent students into the field to collect data. They have used your template and filled in information about the nests they studied. This raw data entry is your starting point. Your task is to turn it into a shareable project.
- Create a single folder in which the entire project will be stored. Give it a simple name (without spaces).
- Design a project structure. Which folders do you need and how will you structure them?
- Place the data files in one of the folders. Rename them so it is clear what they contain.
- Create one overarching dataset that combines all data from the raw files. Consider:
- Is the data in a “tidy” format so that future processing will run smoothly?
- Do all values match? Is it clear what they are?
- Is the file format interoperable?
- Where do you want to store this file in your folder structure?
- Write README file(s) for your project:
- Start with a README for the entire project.
- Do you think a README for the data is necessary? Why (not)? If so: create one!
References and links