Stat 370 Project Idea - Revision history

Carver at 21:35, 28 January 2017

2017-01-28T21:35:08Z

Carver at 21:34, 28 January 2017

2017-01-28T21:34:20Z

Carver at 21:32, 28 January 2017

2017-01-28T21:32:37Z

Carver at 21:30, 28 January 2017

2017-01-28T21:30:23Z

Carver: Created page with "* Choose a data rich field. A few ideas: weather, social media, baseball, climate (although access to government data on this subject seems uncertain, at the moment). * Write..."

2017-01-28T21:29:02Z

Created page with "* Choose a data rich field. A few ideas: weather, social media, baseball, climate (although access to government data on this subject seems uncertain, at the moment). * Write..."

New page

* Choose a data rich field. A few ideas: weather, social media, baseball, climate (although access to government data on this subject seems uncertain, at the moment).
* Write code to access the data via the web automatically (thus, your program will update the data, as new data arrive).
* Write code to analyze and display the data in interesting ways.
* Tie everything together into a dynamic document.
* Do something more (ideas below) ...

The reason to "do something more" is that I am planning to do most of the above in class. Specifically,

* We will spend parts of a few class periods devoted to brainstorming and discussing ideas of where to get data for this type of project.
* In class or at home we, will investigate what needs to be done to access the data.
* I imagine that for some data sets, even accessing the data in a form useful for the dynamic document you envision will be a project in and of itself. This could be considered (part of) the "do something more."
* Part of at least one class period will be devoted to learning how to access data via the web, and discussing what others have come up with. There is some flexibility here in terms of how much we cover.
* We will go over analyzing, and displaying data and dynamic documents.

Some other ideas for "do something more".

* Web Scraping (getting data from websites with an R-Program, e.g. How many job postings on the Indeed job board have the word "RStudio" or "R" in them?
* Displaying your dynamics document on the web, and updating automatically every day. (This is probably easy.)
* Interactive Dynamic Documents (on the website select parameters like bin width for histogram, etc.)
* Displaying geographic data with maps, etc.
* Text mining and sentiment analysis (there are R packages for this). E.g. what percentage of tweets with the word "Trump" display a fearful emotion?
* More?

← Older revision		Revision as of 21:30, 28 January 2017
Line 1:		Line 1:
		+	You are not required to follow this suggestion. Some students are already doing something else, and that is fine. Synergies with other projects, outside of this class, are encouraged.
		+
	* Choose a data rich field. A few ideas: weather, social media, baseball, climate (although access to government data on this subject seems uncertain, at the moment).		* Choose a data rich field. A few ideas: weather, social media, baseball, climate (although access to government data on this subject seems uncertain, at the moment).
	* Write code to access the data via the web automatically (thus, your program will update the data, as new data arrive).		* Write code to access the data via the web automatically (thus, your program will update the data, as new data arrive).

@@ Line 1: / Line 1: @@
 You are not required to follow this suggestion.  Some students are already doing something else, and that is fine.  Synergies with other projects, outside of this class, are encouraged.
-* Choose a data rich field.  A few ideas: weather, social media, baseball, climate (although access to government data on this subject seems uncertain, at the moment).
+* Choose a data rich field.  A few ideas: weather, social media, baseball, climate (although access to government data on climate seems uncertain, at the moment).
 * Write code to access the data via the web automatically (thus, your program will update the data, as new data arrive).
 * Write code to analyze and display the data in interesting ways.

@@ Line 17: / Line 17: @@
 Some other ideas for "do something more".
-* Web Scraping (getting data from websites with an R-Program, e.g. How many job postings on the Indeed job board have the word "RStudio" or "R" in them?
+* Web Scraping (getting data from websites with an R-Program, e.g. How many job postings on the Indeed job board have the word "RStudio" or "R" in them?)
 * Displaying your dynamics document on the web, and updating automatically every day.  (This is probably easy.)
 * Interactive Dynamic Documents (on the website select parameters like bin width for histogram, etc.)

@@ Line 10: / Line 10: @@
 * We will spend parts of a few class periods devoted to brainstorming and discussing ideas of where to get data for this type of project.
-* In class or at home we, will investigate what needs to be done to access the data.
+* In class, or at home, we will investigate what needs to be done to access the data.
 * I imagine that for some data sets, even accessing the data in a form useful for the dynamic document you envision will be a project in and of itself.  This could be considered (part of) the "do something more."
 * Part of at least one class period will be devoted to learning how to access data via the web, and discussing what others have come up with.  There is some flexibility here in terms of how much we cover.