Introduction to methods for digital humanities

Together with its sister course, this course acts as an introductory signposting course to our digital humanities. While the sister course, Introduction to digital humanities, lays out the landscape of all the different digital humanities and charts our place there, this course is aimed at mapping the landscape within that definition. The course thus provides students with the knowledge they need to choose their own focus within computational humanities, also manifesting in the ability to choose from the optional courses in the DH module.

After this course the student understands the multiple ways in which methods benefit work within the digital humanities. She herself is able to use simple tools to work with data. In addition, she has attained knowledge of the fundamental concepts of programming, through which she can start to expand her capabilities, should she so choose. She also learns how open, reproducible research and publishing is done in practice. Further, the student gains a general literacy on advanced computer science methods applicable to digital humanities, and when to apply them. Finally, she learns to apply all of the above in practice in a small concrete digital humanities project.

Prerequisites: absolutely none

• Introduction: three approaches to methods for digital humanists (pdf, gd)
  • Easy, ready-made tools for visualization and exploration
  • Fundamentals of programming for data processing
  • Data analysis method literacy
  • Assignments to be completed before proceeding to the next part:
    • Answer the course background questionnaire
    • Look over the final projects from last year as well as the datasets listed. Select the project and dataset that interest you the most. Post a short message on the #meth4dh channel on the course Slack on why you chose those two.
• Different types of data, data quality, available open datasets (pdf, gd)
  • Reading assignment for the next part: 
    • What is Visualization Really for? sections 2.1-2.4 for a categorization of different uses for visualization
    • Perception deception & Common visualization mistakes for learning to not trust visualizations blind
• Easy tools for processing and exploring data (pdf, gd)
  • Assignments to be completed before proceeding to the next part:
    • the Python intro -part of the fundamental concepts of programming for humanists
    • the OpenRefine tutorial
    • Experiment with at least one of the following tools described in the slides. Post a message on Slack about your experience with the tool you chose.
      • RAW
      • Palladio
      • Voyant
      • Carto
      • Tableau
      • Korp / corpus.byu.edu
• Data processing: fundamental concepts of programming for humanists (pdf, gd)
  • Assignments to be completed before proceeding to the next part:
    • the waiwa assignment, including the OpenRefine subpart of the fundamental concepts of programming for humanists
    • the figure out assignment
    • the regex tutorial and the regex assignment (create regexes to match first names, last names, years, birth places etc)
• Data analysis: fundamental concepts of statistics (pdf, gd)
  • Reading assignment: The civilizing process in London’s Old Bailey
    • Try to answer the questions given under the "Reading material" heading
  • Check out the Explained Visually site
  • Exploring bootstrapping
• Data analysis method literacy (pdf, gd)
  • Reading assignment: Testing the Robustness of Local Network Metrics in Research on Archeological Local Transport Networks
• Data analysis method literacy 2 (pdf, gd)
  • Assignments:
    • PCA explained visually
    • How to Use t-SNE Effectively
    • Visualizing K-means clustering (2)
    • Read on some small, actual work:
      • The presentation of the DHH15 key concepts of socialism group
      • The presentation of the DHH15 Finnair Blue Wings multimodality group
      • If you understand Finnish, the election questionnaire analysis and visualization
  • Open, reproducible research and publishing in practice (pdf, gd)
  • Digital humanities project

To pass the course, you are required to demonstrate some grasp of actual digital humanities work. Therefore, you are tasked with taking some dataset, and processing it in some way to yield an interesting analysis. 

Potential datasets/APIs are for example:

• Korp API
• Finnish national gallery API / dump
• Schoenberg database
• Cushman collection metadata
• WW2 covert support networks
• Europeana APIs
• DPLA APIs
• The European Library API
• Sydney Powerhouse Museum
• EEBO-TCP Phase I
• ECCO-TCP
• We also have a set of automatic transcriptions from 35,000 Finnish language TV and radio programs courtesy of the Finnish public broadcaster YLE available by asking

Tools for processing and analysis are for example:

• Preprocessing: R, Python, pandas, tm, OpenRefine, OpenCV, TensorFlow™ Image Recognition, tuneR, pyAudio Analysis, ...
• Topic modeling: Mallet, topicmodels, LDAvis, gensim, ...
• Dimensionality reduction/clustering: stats, lsa, BayesLCA, pvclust, Weka, ...
• Social network analysis: igraph, sna, statnet, sonia, …
• Simulation: NetLogo, ...
• Neural networks: som, TensorFlow™, ...
• Association rule learning: arules, Weka,
• Anomaly detection: AnomalyDetection, ...
• Visualization: Palladio, nodegoat, matplotlib, ggplot2, iPlots, plot.ly, ...

To return the assignment, you will need to upload your data, code and results into a GitHub repository, link that repository with Zenodo and give us the Zenodo DOI for your work. Include a description of what you've done, following as best as possible the guidelines for open, reproducible research:

1. which data did you use
2. what did you do to it (and how can I reproduce it)
3. what do the end results show
4. how would you continue the work (towards academic meaning)

Further info: your work doesn't need to be a full-blown pipeline from raw data to interesting results. It can be just some steps towards that. However, if you don't have end results, you need to very explicitly describe what your next steps would be to get those (i.e. a plan for future research). 

To further aid you in your work, here are some previous submissions for inspiration (for most of them, you should actually click the GitHub link on the right to start to make sense of them): 

• themes in Hungarian folk love songs - DOI: 10.5281/zenodo.44570
• extracting and visualizing biographical information from an old bank matricle - DOI: 10.5281/zenodo.225890
• analysis of a survey on user involvement in software development - DOI: 10.5281/zenodo.237727
• polite vs casual address form use by Finnish language learners in different situations - DOI: 10.5281/zenodo.218844
• discovering patterns in chalcolithic and early bronze age burials in northeast England- DOI: 10.5281/zenodo.215932
• themes discussed in Helsingin Sanomat in 1905 - DOI: 10.5281/zenodo.44572
• differences in use between the words maahanmuuttaja and pakolainen in Finnish newspapers 1970- to present - DOI: 10.5281/zenodo.44544
• differences in how frequently Finnish and Swedish newspapers talk about the Romani people - DOI: 10.5281/zenodo.44590
• contrasting Beck's lyrics to blues lyrics - DOI: 10.5281/zenodo.215292
• extracting and analysing recipe information in an old cookbook - DOI: 10.5281/zenodo.216232
• a thematic analysis of the discussion around Guggenheim on the Suomi24 forum - DOI: 10.5281/zenodo.217719
• differences in language between texts dealing with altered states of mind and normal fiction - DOI: 10.5281/zenodo.230676
• preliminary analysis comparing different Finnish cabinet strategies against each other - DOI: 10.5281/zenodo.216604
• preliminary analysis of patterns in the holdings of the Finnish National Gallery - DOI: 10.5281/zenodo.218735

During the course, you will be given material to read before proceeding to the next part. Typically, these will be academic papers that make use of digital humanities methods. When reading such papers, we ask that you focus on at least:

• Research questions - What are the humanities research questions? Does the project also target computer science research questions? If so, what? What is the relationship between the CS an humanities research questions?
• Data - How has the data used been gathered? What are the data sources used? How has the data been processed? Is the data available for others to use?
• Methods - What methods does the project apply? How do the methods support answering the research questions?
• Partners - What is the make-up of the project? Which disciplines are represented by the participants?

Provisional core reading list:

• Protestant Letter Networks in the Reign of Mary I: A Quantitative Approach
• On visualization:
  • What is Visualization Really for? sections 2.1-2.4 for a categorization of different uses for visualization
  • Perception deception & Common visualization mistakes for learning to not trust visualizations blind
  • Flowchart on selecting a good visualization based on what you want to show 
• Social networks and intraspeaker variation during periods of language change, Utterance selection model of language change
  • As a guide to reading the first paper, look to answer the general questions described above For the second paper, contrast its style with the first. Also note that you can experiment yourself with the model described in the first paper here.
• The civilizing process in London’s Old Bailey
• Testing the Robustness of Local Network Metrics in Research on Archeological Local Transport Networks
• Understanding Artificial Anasazi

Here I'll gather some relevant links to further resources. I think these are good, but they're also somewhat of a random selection.

• Further courses
  • Elective theory and practice courses available as part of the Helsinki DH module
  • Elective method courses as part of the Helsinki DH module
  • Online courses at dariahTeach
• The programming humanist:
  • The historian’s macroscope, a good general purpose book
  • Computational and Inferential Thinking - The Foundations of Data Science, an excellent introduction to statistical  analysis with interactive Python notebooks
  • Python Programming for the Humanities, the best introduction to programming for humanists that I could find
  • The programming historian, lessons and tutorials for doing various DH things
  • Eloquent Javascript, a nicely built general, interactive introduction to programming
• On data:
  • Big? Smart? Clean? Messy? Data in the Humanities (simple introduction to different kinds of data in the digital humanities)
• On visualizations:
  • What is Visualization Really for? (different uses for visualization: gaining new insight vs communicating said insight to others)
  • Perception deception (how visualizations lie if you are not careful)
  • Fundamentals of Data Visualization (a good introductory book on choosing suitable visualizations for highlighting different aspects in data, and avoiding pitfalls in tuning them)
• On statistics:
  • Computational and Inferential Thinking - The Foundations of Data Science, an excellent introduction to statistical  analysis with interactive Python notebooks
  • Statistics for the Humanities (chapters 1-5 essential)
  • Data Science online module for the Social Statistics MOOC at the University of Helsinki
  • Explained Visually
  • How to use t-SNE Effectively
• On open science:
  • Open Science: One Term, Five Schools of Thought
• Environments for reproducible research:
  • RStudio
  • Jupyter notebook
    • IPython notebook
    • R kernel for Jupyter
  • Conda