Monday, March 23, 2015

Using re:dash and BigQuery to plot New York City IDNYC Waiting Time

See http://demo.redash.io/queries/199#248

This uses https://github.com/EverythingMe/redash and https://bigquery.cloud.google.com to plot the number of days you will wait to get an IDNYC identification card.

You can turn off and on particular locations to see the chart for each location.

The data comes directly from the IDNYC calendar program.

It is interesting to note the days when the "days to wait" falls sharply.  We wonder what is going on there?

Another excellent feature of re:dash is it has an automatic update feature.  This data and chart should update each day.

Many thanks to @arikfr (Author re:dash) and @fhoffa (Google BigQuery Dev Rel)



Monday, March 9, 2015

U S Attorney/THE GOVERNMENT’S MEMORANDUM IN OPPOSITION TO THE SHELDON SILVER’S MOTION TO DISMISS

Please everyone read or listen to this memorandum: http://bit.ly/shelly-the-crook2

After 20 years or more of alleged crimes, our former speaker feels that the US Attorney is treating him too roughly apparently. What do you think?

Please read this: http://bit.ly/shelly-the-crook2

Monday, March 2, 2015

FOIL New York State court receipts




Many thanks to the New York State Comptrollers office http://www.osc.state.ny.us/ for this FOIL data.  We asked for all the court receipts and found out that only a small part of court receipts are handled by the department that was nice enough to respond.  In fact, New York City court receipts seems to not be accounted for at all.

The data seems to cover 2014 and part of 2013 but there is no way to know if it is complete or even accurate. :(

There are cases where the surcharges are higher than the civil fine for example, for DIS TRFC DEVICE the civil fine sum is $54K and the surcharge sum is $80K

Does anyone know how to FOIL the New York City courts receipts records?  Please contact us at +Ralph Yozzo or 

The raw data that was provided by the New York State Comptroller is here: https://raw.githubusercontent.com/civic-data/courtreceipts/master/2015-011%20JCF%20data.csv

The transformed data is here: https://raw.githubusercontent.com/civic-data/courtreceipts/master/2015-011%20JCF%20data-output.csv

A open source project  that processes this data is available here: https://github.com/civic-data/courtreceipts

Using Meetup API and BigQuery and redash.io to visualize data

Here's update to show RSVP history for most of the Google Developer Groups (GDG)'s in meetup.com. If any GDG is missing, please let us know.

http://demo.redash.io/queries/168/source#214



Here's a little project that can possibly be used to get data from meetup api into CSV format for google sheets, etc and also BigQuery.


See https://github.com/GDG-NewYork/meetup-api-python


If you have your own list of meetup groups that you'd like to track then compile a list of all the meetup urls (what the API calls "group_urlname") and modify the https://github.com/GDG-NewYork/meetup-api-python/blob/master/runall.sh file


If you have a BigQuery account, you could easily load all the RSVP history for all groups into BigQuery or any database.

See http://demo.redash.io/queries/156#199 (requires a Google account I believe)

Here's a sample that can be produced in seconds:

The RSVP history over time for past and future events in select GDGs (Google Developer Groups)