If dynamodb table contained boolean column, those rows are not returned. about spark-dynamodb HOT 5 OPEN

Hi @nadirvardar, thanks for reporting this. Can you clarify how I can reproduce? I'm happy to take a look and publish a new version.

from spark-dynamodb.

Hi @traviscrawford,

We have a dynamodb table, lets call it test.
We added a primary key, appId.
We started adding a new records with;
appId=1, nameString="facebook", stat(Boolean)=false
appId=1, nameString="youtube"
when we load the table in spark shell with your library(spark 2.0.2, your jar version is 6), it shows only;
appId=2, name(String)="youtube"

not the appId=1 row.

I can try again tomorrow and give a better test results.

Thank you,

from spark-dynamodb.

@traviscrawford I've confirmed that boolean columns are not returned in the resulting DataFrame. I also noticed that rows with Document types are skipped.

from spark-dynamodb.

+1 @traviscrawford

from spark-dynamodb.

Hi.
Probably, #40 solves the issue

from spark-dynamodb.