Monday, March 23, 2015

Using re:dash and BigQuery to plot New York City IDNYC Waiting Time

See http://demo.redash.io/queries/199#248

This uses https://github.com/EverythingMe/redash and https://bigquery.cloud.google.com to plot the number of days you will wait to get an IDNYC identification card.

You can turn off and on particular locations to see the chart for each location.

The data comes directly from the IDNYC calendar program.

It is interesting to note the days when the "days to wait" falls sharply.  We wonder what is going on there?

Another excellent feature of re:dash is it has an automatic update feature.  This data and chart should update each day.

Many thanks to @arikfr (Author re:dash) and @fhoffa (Google BigQuery Dev Rel)



Monday, March 9, 2015

U S Attorney/THE GOVERNMENT’S MEMORANDUM IN OPPOSITION TO THE SHELDON SILVER’S MOTION TO DISMISS

Please everyone read or listen to this memorandum: http://bit.ly/shelly-the-crook2

After 20 years or more of alleged crimes, our former speaker feels that the US Attorney is treating him too roughly apparently. What do you think?

Please read this: http://bit.ly/shelly-the-crook2

Monday, March 2, 2015

FOIL New York State court receipts




Many thanks to the New York State Comptrollers office http://www.osc.state.ny.us/ for this FOIL data.  We asked for all the court receipts and found out that only a small part of court receipts are handled by the department that was nice enough to respond.  In fact, New York City court receipts seems to not be accounted for at all.

The data seems to cover 2014 and part of 2013 but there is no way to know if it is complete or even accurate. :(

There are cases where the surcharges are higher than the civil fine for example, for DIS TRFC DEVICE the civil fine sum is $54K and the surcharge sum is $80K

Does anyone know how to FOIL the New York City courts receipts records?  Please contact us at +Ralph Yozzo or 

The raw data that was provided by the New York State Comptroller is here: https://raw.githubusercontent.com/civic-data/courtreceipts/master/2015-011%20JCF%20data.csv

The transformed data is here: https://raw.githubusercontent.com/civic-data/courtreceipts/master/2015-011%20JCF%20data-output.csv

A open source project  that processes this data is available here: https://github.com/civic-data/courtreceipts

Using Meetup API and BigQuery and redash.io to visualize data

Here's update to show RSVP history for most of the Google Developer Groups (GDG)'s in meetup.com. If any GDG is missing, please let us know.

http://demo.redash.io/queries/168/source#214



Here's a little project that can possibly be used to get data from meetup api into CSV format for google sheets, etc and also BigQuery.


See https://github.com/GDG-NewYork/meetup-api-python


If you have your own list of meetup groups that you'd like to track then compile a list of all the meetup urls (what the API calls "group_urlname") and modify the https://github.com/GDG-NewYork/meetup-api-python/blob/master/runall.sh file


If you have a BigQuery account, you could easily load all the RSVP history for all groups into BigQuery or any database.

See http://demo.redash.io/queries/156#199 (requires a Google account I believe)

Here's a sample that can be produced in seconds:

The RSVP history over time for past and future events in select GDGs (Google Developer Groups) 




Tuesday, January 27, 2015

Sheldon Silver's Financial Disclosure

See http://jcope.ny.gov/elected%20officials/2013/assembly/ASSEMBLYMEMBER-SILVER%20S_2013.pdf

See also http://bit.ly/shelly-the-crook in case the jcope website removes Shelly's disclosure, we have backed it up.

This is the money from the lawyers 
Shelly's signature that affirms the truth of his statements 
3/4 of a million from Lawyers

Why don't we require real dollar amounts instead of this vague system of coded numbers???

A modest proposal for Participatory Budgeting for New York State


  • Do you notice that there is no transparency and video of the recent New York State Assembly meetings?  
  • Are these meetings not public business?  
  • Is the New York State Assembly subject to the Open Meetings Law?
Look at http://www.justice.gov/usao/nys/pressreleases/January15/SheldonSilverChargesPR.php and compare U.S. Attorney Preet Bharara statements to New York State Governor Andrew Cuomo statements.

U.S. Attorney Preet Bharara said: “Over his decades in office, Speaker Silver has amassed titanic political power. But, as alleged, during that same time, Silver also amassed a tremendous personal fortune – through the abuse of that political power. All told, we allege that Silver corruptly collected some $4 million in bribes and kickbacks disguised as ‘referral fees.’ Those disguised bribes and kickbacks account for approximately two-thirds of all of Silver’s outside income since 2002.
“As today’s charges make clear, the show-me-the-money culture of Albany has been perpetuated and promoted at the very top of the political food chain. And as the charges also show, the greedy art of secret self-reward was practiced with particular cleverness and cynicism by the Speaker himself. Among other things, we allege that Sheldon Silver, Speaker of the New York State Assembly, was on retainer to a mammoth real estate developer at the very same time that the chamber he dominates was considering and passing legislation vitally affecting the bottom line of that developer; at the very same time that he was hearing out lobbyists paid by that developer and at the very same time that he was deliberately keeping secret from the public any information about this lucrative side-deal, in violation of the law.
“Politicians are supposed to be on the people’s payroll, not on secret retainer to wealthy special interests they do favors for. These charges go to the very core of what ails Albany – a lack of transparency, lack of accountability, and lack of principle joined with an overabundance of greed, cronyism, and self-dealing.”

This is our New York State Governor Cuomo speaking:
“To the extent I have to interact with the Assembly, committees, management by committee, I’ve never been a fan of, and I’ve never seen it work well,” the governor continued. “So, I’d like to see what the actual configuration is that they’ve come up with, when they come up with it. And then I’ll have an opinion.”
Do the 20 Million people of New York State want more transparency in the budget process?  Do the people prefer to PARTICIPATE in their budget?  All good questions.  It really depends on the people and their focus.  If we continue to ignore the political budget process (instead focusing on sports, etc (insert any well promoted past time here)) we will get many more Sheldon Silver et al like characters.
“…I’m focused on the functionality of government, and I want to know what the mechanism is that will replace the speaker…the quote, unquote committee. I don’t know what that means. I can’t negotiate with a committee, so I have to see what they actually come up with. From my own selfish point of view, I don’t understand how you negotiate with a commitee, how I negotiate with a committee.” 
We need committees and real time updates and complete transparency into the budget process.

WHY DO WE FOCUS SO MUCH ON ELECTIONS???

AND NOT ON THE BUDGETS???

To Quote U.S. Attorney Preet Bharara:

“When did 20 million New Yorkers agree to be ruled by a triumvirate in Roman times?” Bharara asked at a breakfast held by the New York Law School on Friday morning.

Let's look at the Population of New York State:

New York State Population is growing?

Growing??? Look again!


People are deciding with their feet.

Buffalo is shrinking:





But actually Upstate New York is shrinking and New York City is growing but so is the percent of the population in poverty

See http://www.nyc.gov/html/ceo/html/poverty/lookup.shtml  New York City's own poverty monitor:

A very sad state of affairs.  Please everyone share your opinion and require transparency of your representatives!  Ask yourself this question:   Imagine that you are the "representative" and "sheldon silver" etc were your constituent.  Do you believe that "sheldon silver" would not demand transparency from you???

Saturday, January 24, 2015

Williamsburg Bridge Greenway connector?

See Williamsburg Bridge Greenway connector: http://youtu.be/WwGmo8m4wiI

Here's your task.  You want to commute to work from Southeast Williamsburgh to Manhattan.  You have many decisions.  

Your goals are:
  • Beautiful path
  • Fresh air
  • Smooth roads
  • Safe roads
  • Minimize interaction with motor vehicles
  • Minimize commute time
To minimize commute time, you may pick Broadway in Williamsburg since it is a direct route.


Direct Route to Williamsburg Bridge from Southeast


Safer Route to Williamsburg Bridge from Southeast

You would be better off taking the Blue Lines until...

Welcome to BQE Williamsburg Bridge Disaster
You reach the BQE disaster!

Yes this is what it looks like

Could we not have a Brooklyn Side Willyb bike path approach like the Manhattan Bridge here???
Compare to Queens side of Queensboro bridge
Compare to Brooklyn side of Manhattan bridge

Here's what the BQE above looks like

But we cyclists and pedestrians and local street drivers receive!

A mess!

Dangerous crossings

Parks that have no safe entrance


Cyclists are literally directed to go on the sidewalk at this point it appears.

The overall grade for the Williamsburg Bridge cyclist/pedestrian access on the northeast side of the Williamsburg bridge is Zero.   This is not to be confused with VisionZero http://en.wikipedia.org/wiki/Vision_Zero which is a worthy goal that New York City borrowed from Sweden.