Correct submission throwing "Incorrect submission" -- block data June 23 about pythonwhat HOT 10 CLOSED

Problem is that test_object() uses np.all() in this case. If you test this code:

import numpy as np
file = 'titanic.csv'
data1 = np.genfromtxt( file , delimiter = ',', names = True , dtype = None )
data2 = np.genfromtxt( file , delimiter = ',', names = True , dtype = None )
np.all(data1==data2)

You'll notice that it results in False, even though the arrays seem exactly the same. This means test_object() will test false when it compares data from the solution environment with data in the student environment. The reason is because you have numpy.float64 characters in the column with index 4. This sometimes is nan, which is an object of the type numpy.float64. Apparently numpy doesn't count nan == nan as True.

@filipsch we'll need a workaround for this. Maybe use numpy.testing.assert_equal.

from pythonwhat.

@filipsch Referencing this for pythonwhat implementation: http://stackoverflow.com/questions/10710328/comparing-numpy-arrays-containing-nan

from pythonwhat.

holy wacky races! spooky NumPy. The issue also occurs w/ dataframes FYI:

https://campus.datacamp.com/courses/1167/2627?ex=15

from pythonwhat.

it also occurs with pickle.load when there are no NaNs. I can raise another issue if necessary. see screenshot

https://campus.datacamp.com/courses/1167/2628?ex=3

from pythonwhat.

same issue with pd.ExcelFile()

https://campus.datacamp.com/courses/1167/2628?ex=4

in this case NOT dataframe but type(xl) = pandas.io.excel.ExcelFile

from pythonwhat.

Hi guys, this issue will block beta testing, which is slated for next Thursday 06/23. I'll need this to work before emailing potential beta testers, which I need to 4 days before beta testing starts (Sunday 06/19).

from pythonwhat.

i checked out commit for this issue: will it work in the dataframe and excel cases?

see here:

https://campus.datacamp.com/courses/1167/2627?ex=15

and here:

https://campus.datacamp.com/courses/1167/2628?ex=4

from pythonwhat.

Correct, this will do.

Note that this time I created specific equality tests for these kind of objects. If it's only used in just a few exercises and you can avoid it by using do_eval = False and test_function(), then do that. It's not manageable to create equality tests for all kinds of objects.

from pythonwhat.

thanks!working in all cases except one:

https://campus.datacamp.com/courses/1167/2627?ex=13

thoughts?

from pythonwhat.

Use a workaround here (with test_object(..., do_eval = False) and test_function(...)). Use this wiki section as a reference.

Btw, problem is that:

np.testing.assert_equal(np.genfromtxt(file , delimiter = ",", names = True , dtype = None), np.genfromtxt(file , delimiter = ",", names = True , dtype = None))

throws an AssertionError. Which means that even np's testing framework doesn't see those numpy arrays as equal.

from pythonwhat.