We might want to add a little section at the start of the notebook to explain the difference between DataFrame and Series objects.

Minor issue, but the 10 minutes to pandas link in the resources section of the Readme is broken.

Instead of the current link:
https://pandas.pydata.org/pandas-docs/stable/getting_started/10min.html
it should be:
https://pandas.pydata.org/pandas-docs/stable/user_guide/10min.html

A minor error, but in introduction-to-pandas.ipynb file, the header:

Challenge 7: Another way to get the month

Should actually read:

Challenge 7: Another way to get the year

as the challenge requires to get the year component of the Dataframe column and not the month.

Understand what it is that we’re looking at in the data is another useful skill - that i think most social science / stem grad students have, but for people who are new to data analysis, we can include more of that type of practice

Another thing that could be useful is using filtering functions along with groupby

unemployment_rate is a bit of a weird name (as it’s not actual unemployment rates but a DF with null proportions for unemployment rates

Part 7 says Exporting A DataFrame to csv
it looks at the file using the "!" but that is only viable in mac, not windows
!head -5 data/unemployment_missing.csv
to do: add windows version of terminal "!"

Possible things to consider for intermediate/advanced pandas class:

• reading/writing to formats other than csv
• reading data in by chunks
• multi-indexing and its methods
• sparse matrices and their methods
• ways to speed up mathy things (lots of %timeit)
• parallelized methods for pandas

We can both also look up other pandas materials and think of other things we might like to add.

@pattyf, @deniederhut, @davclark, @jackspaceBerkeley, @jonstiles, @sbenthall

The notebook for the intro to pandas workshop is almost ready to go, I think. I'd appreciate some feedback when you have time.

One specific thing I need help with is determining when we're dealing with methods, attributes, or properties.

Thanks!

The challenge 12 solution seems too complex. We can just do .dropna on our newly created ps column?

Click the "Launch" button under "Jupyter Notebooks" and navigate through your file system to the Python-Data-Visualization folder you downloaded above.

Should read Python-Data-Wrangling instead of Data Visualization

Using .round() in Manipulating Columns needs to be explained. If we don’t use it, we will not get to a full integer and then calling int() will truncate. Compare ((unemployment['year_month'] - unemployment['year']) * 100).astype(int) and ((unemployment['year_month'] - unemployment['year']) * 100).round(0).astype(int) - the first starts at 0, second starts at 1

Part 7 has a line of code:
!head -5 ../data/unemployment_missing.csv

Head is a Unix/Linux specific function and folks who were using Windows locally cannot run this line.

Add examples and descriptions for how to plot with pandas (e.g., pandas.DataFrame.plot).

unemployment_rate_missing = unemployment[unemployment['unemployment_rate'].isnull()] -> no need for double subset

1. unemployment_rate is a bit of a weird name (as it’s not actual unemployment rates but a DF with null proportions for unemployment rates
2. unemployment_rate_missing = unemployment[unemployment['unemployment_rate'].isnull()] -> no need for double subset
3. Using round() in Manipulating Columns needs to be explained. If we don’t use it, we will not get to a full integer and then calling int() will truncate. Compare ((unemployment['year_month'] - unemployment['year']) * 100).astype(int) and ((unemployment['year_month'] - unemployment['year']) * 100).round(0).astype(int) - first starts at 0, second starts at 1
4. The challenge 12 solution seems too complex. We can just do .dropna on our newly created ps column?

Name should be changed from "Introduction to Pandas" to "Python Data Wrangling and Manipulation With Pandas"

Some of the participants asked if there could be more time spent on groupby(), as they need it for their research. I feel it's important to spend at least 20' on this section and challenge. Not sure if I have an immediate idea for how to do this -- another challenge after #10, giving more examples of groupby() functionalities or scenarios, introducing it earlier (e.g. before merging).

Remove some values from the main CSV file

• replace missing values with .fillna()
  • show method parameter
• keep rows with no missing values with .dropna()

challenge 7 says: Another way to get the month
month should be "year" since that's what is being extracted

One thing that seems to be missing is how to join two tables (or more) using pandas
https://youtu.be/lXPogGKR-AU