December, 17 2014, 01:00pm EDT
FCC and Sunlight Foundation Undercounted Pro-Net Neutrality Comments and Should Immediately Correct the Record
WASHINGTON
Several media outlets have run headlines based on a study that the Sunlight Foundation published yesterday that is based on faulty data, which drastically underrepresents the number of pro-net neutrality comments the FCC received during its second comment period.
Based on an initial look at the data by Fight for the Future's technologists, it appears that there are two major issues:
The FCC failed to register a significant number of pro-net neutrality comments that were sent. We've thus far identified at least 150,798 comments that were missing from the FCC's data dump, and ongoing analysis of their data suggests that this number is in fact much higher. This alone is enough to completely unseat the conclusion that anti-net neutrality commenters "dominated" the second comment period.
The Sunlight Foundation's analysis used a flawed data set that misleadingly represented the full set of comments; it ignored almost half of the total of the release of the FCC data (by their own admission), close to 800,000 comments, because of difficulty processing those comments. The data Sunlight used cannot be assumed to be "reasonably representative" of all the comments. There were several methods by which comments could be submitted to the FCC, and because this led to inconsistencies in the FCC's release of the data, it's an error for Sunlight to infer that the excluded comments maintained the same distribution of pro- vs. anti-net neutrality submissions as the data Sunlight did consider. In addition, the Sunlight Foundation also significantly undercounted comments from at least one group, Battle for the Net, by over 100,000 comments. The result is that the Sunlight Foundation's finding that anti-net neutrality groups "dominated" the second round comment period is completely unfounded.
Fight for the Future co-founder Tiffiniy Cheng said, "Millions of people have spoken out in support of net neutrality, and their voices matter. Getting these numbers right is important. The FCC and the Sunlight Foundation need to act immediately to correct the record, and media outlets that have ran stores based on the faulty data should publish prominent corrections."
"Sunlight applied a flawed sampling methodology to a flawed set of data, and drew conclusions that are impossible to make with any 'reasonably representative' certainty," said Jeff Lyon, Fight for the Future's Chief Technical Officer, "Sunlight's approach is like trying to draw conclusions about the average income in Massachusetts by only surveying people in Boston." Lyon provided the following explanation of the serious errors he was able to identify in Sunlight's analysis:
There are two major problems with the data the FCC released and the resulting study:
The Sunlight Foundation based its study on the data released by the FCC in this October 22 blog post by Gigi Sohn. However, the FCC failed to register hundreds of thousands of pro-net neutrality comments from Battle for the Net.
Sunlight's methodology was flawed. Sunlight was unable to parse all of the data released by the FCC. According to the FCC, there were 2.4 million comments in the data, but Sunlight was only able to read 1.6 million comments. Sunlight's study is based on a subset of the data that misses close to half of all the comments in FCC"s data dump; this data set is not reasonably representative of the big picture but in fact was comprised mainly of one set of comments. Furthermore, Sunlight significantly underreported the number of comments from Battle for the Net that the FCC actually recorded.
In actuality, there were at least 998,498 comments sent from Battle for the Net, but between the FCC not recording them and Sunlight applying a flawed methodology to analyze what little data there actually was, the end result was completely distorted.
The FCC failed to register our comments:
In the FCC's release of the data, Ms. Sohn reports that the FCC received 725,169 comments through ECFS and CSV uploads during the second comment period from July 19th to September 15th.
However, just between September 12th and September 15th, Battle for the Net sent 527,953 comments through CSV uploads alone.We also submitted 470,596 more comments via ECFS and email. Battle for the Net's numbers alone are far higher than the numbers reported by Ms. Sohn.
Given that numerous other individuals and organizations were submitting net neutrality comments during the same period, at best the FCC is severely underreporting the number of comments sent out from pro-net neutrality activists.
To verify this, we downloaded and analyzed the data dump of all comments received by the FCC during the second commenting period, and compared our data to the FCC's. Please note that we have thus far only analyzed the 527,953 comments sent via CSV, and we are still processing reports on the data submitted by ECFS and email.
Total number of comments we submitted via CSV: 527,953
Almost all of these submissions used an open letter by Senator Angus King with each participant signing on. To do a sanity test, we checked our CSV data for two of the phrases from the letter:
Number of occurrences of phrase: 'These principles of fairness and openness' in our CSV comments: 525,189 (this number may be lower than actual due to aggressive deduplication)
Number of occurrences of phrase: 'We are writing to urge you to implement' in our CSV comments: 525,189 (this number may be lower than actual due to aggressive deduplication)
Next, we scanned the data from the dump of FCC's ECFS comments from the second commenting period.
Number of occurrences of phrase: 'These principles of fairness and openness' in FCC's data dump of ECFS comments: 374,421
Number of occurrences of phrase: 'We are writing to urge you to implement' in FCC's data dump of ECFS comments: 374,391
We identified 525,189 CSV comments, and found that at most the FCC only recorded 374,421. From this basic analysis alone, it is clear that, at best, the FCC missed a huge number of the comments we submitted via CSV. But we also sent over 470,596 more comments via email and through FCC's ECFS site, (before it broke from all the load we put it under). Initial results are indicating that a large number of these comments submitted through email and ECFS were also not recorded by the FCC, but we are still generating reports to more precisely quantify those numbers.
We are running a more thorough analysis of the data to identify all the individuals whose comments were not recorded by the FCC, but crunching through all of this data will take several hours.
Sunlight's methodology was not "reasonably representative".
Sunlight was unable to parse all of the data released by the FCC. According to the FCC, there were 2.4 million comments in the data, but Sunlight was only able to read 1.6 million comments. They chose to base their conclusions on a subset of the data that may not be representative of the big picture. According to Sunlight's own admission:
Clearly, 1.67 million documents is far short of 2.5 million (the number reported in the commission's blog post). We spent enough time with these files that we're reasonably sure that the FCC's comment counts are incorrect and that our analysis is reasonably representative of what's there, but the fact that it's impossible for us to know for sure is problematic
Sunlight also significantly under-reported the number of comments that came from Battle for the Net commenters, estimating this at 271,608. When we pointed out how easily we identified at least 367,460 of our own comments in the data, they acknowledged their error. However, this margin alone could have been enough to tip their conclusions in favor of net neutrality activists.
Furthermore, the FCC confirmed that people who signed petitions would be counted as individual commenters. Many net-neutrality activist organizations attached their petition signatures as PDFs attached to single ECFS filings. Sunlight was unable to parse these PDFs and chose to simply exclude them from their sample pool, ignoring perhaps hundreds of thousands of pro-net neutrality comments. On the other hand, Sunlight was able to easily read all of American Commitment's comments, further distorting their results in favor of anti-net neutrality commenters.
Sunlight applied a flawed sampling methodology to a flawed set of data, and drew conclusions that are impossible to make with any "reasonably representative" certainty.
Fight for the Future is a group of artists, engineers, activists, and technologists who have been behind the largest online protests in human history, channeling Internet outrage into political power to win public interest victories previously thought to be impossible. We fight for a future where technology liberates -- not oppresses -- us.
(508) 368-3026LATEST NEWS
'Blood on Their Hands': 79 US Senators Approve Billions More in Military Aid for Israel
Sen. Bernie Sanders, one of just three Senate Democratic caucus members to oppose the bill, said that "U.S. taxpayers should not be providing billions more to the extremist Netanyahu government."
Apr 24, 2024
With the support of nearly 80% of the chamber's lawmakers, the U.S. Senate on Tuesday approved a sprawling foreign aid package that includes $17 billion in unconditional military assistance for the Israeli government as it ramps up its catastrophic assault on the Gaza Strip.
The final vote on the $95 billion package, which also included military aid for Ukraine and Taiwan, was 79-18, with just three members of the Senate Democratic caucus—Sens. Bernie Sanders (I-Vt.), Peter Welch (D-Vt.), and Jeff Merkley (D-Ore.)—and 15 Republicans opposing the bill.
Sanders called Tuesday "a dark day for democracy," condemning the upper chamber's refusal to even allow a vote on his proposed amendment to cut offensive military aid to Israel from the legislation.
"I voted no tonight on the foreign aid package for one simple reason: U.S. taxpayers should not be providing billions more to the extremist Netanyahu government to continue its devastating war against the Palestinian people," Sanders said in a statement following the vote. "Thirty-four thousand Palestinians have already been killed and 77,000 have been wounded—70% of whom are women and children."
"The housing in Gaza is destroyed; the infrastructure in Gaza is destroyed; the healthcare system in Gaza is destroyed; the educational system in Gaza is destroyed," Sanders added. "Enough is enough. No more money for Netanyahu's war machine."
The bill, which passed the House over the weekend, now heads to the desk of President Joe Biden, who is expected to sign it in the coming days.
The 79 senators who voted to pass Biden's foreign aid bill/expand Israel's genocide in Gaza: pic.twitter.com/bVQisvOndd
— Stephen Semler (@stephensemler) April 24, 2024
Overwhelming congressional and White House support for arms and military support stands in stark contrast to U.S. public opinion, which has increasingly turned against Israel's assault on Gaza in recent months as the grisly death toll and humanitarian emergency have worsened and evidence of Israeli war crimes has mounted.
As Tuesday's vote took place, thousands of Jewish New Yorkers and allies rallied outside of Senate Majority Leader Chuck Schumer's (D-N.Y.) home to voice outrage over U.S. lawmakers' growing complicity in Israel's military assault.
"We're here as thousands of Jewish New Yorkers, calling on Senator Schumer to halt weapons funding to Israel as it massacres and starves Palestinians in Gaza," said Eva Borgwardt, national spokesperson for IfNotNow, one of the groups that organized the mass demonstration on the second night of Passover.
A Gallup survey released last month found that 55% of U.S. voters—including 75% of Democrats, 60% of Independents, and 30% of Republicans—disapprove of Israel's military assault on Gaza. A separate poll commissioned by the Center for Economic and Policy Research showed that a majority of American voters support halting U.S. weapons shipments to Israel.
Since October, the Biden administration has quietly approved more than 100 arms sales to Israel, flouting U.S. laws that prohibit weapons deliveries to countries that are violating human rights or blocking American humanitarian aid.
"As I have said countless times, sending Prime Minister Benjamin Netanyahu's government the munitions it is using to destroy Gaza is wrong and inconsistent with our foreign policy goals," Welch said Tuesday after voting against the aid package. "It is unthinkable that an ally of the U.S. would conduct its military campaign with planes, tanks, bombs, and artillery supplied by the U.S., while impeding access for aid trucks to destitute civilians under its occupation."
"Urgent calls for peace are loudly echoing across the country but seem to fall on deaf ears on Capitol Hill."
Days before the Senate vote, mass graves were discovered at two Gaza hospitals that Israeli forces recently raided and destroyed. The United Nations Human Rights Office on Tuesday demanded an international probe into the mass graves, noting that bodies of Palestinians were found stripped naked with their hands tied.
"Victims had reportedly been buried deep in the ground and covered with waste," Ravina Shamdasani, a spokesperson for the U.N. High Commissioner for Human Rights, told reporters in Geneva on Tuesday.
One Gaza official toldCNN that a total of 300 bodies were found in a mass grave at the Nasser Medical Complex in Khan Younis and that "there were signs of field executions."
"The U.S. government is arming a regime creating mass graves in Gaza, indeed turning all of Gaza into a mass graveyard," Sarah Leah Whitson, executive director of Democracy for the Arab World Now, wrote on social media Tuesday.
On the heels of the Senate vote, Agence France-Pressenoted that one of its correspondents and eyewitnesses "reported heavy bombardment of several areas of northern Gaza."
"Early Wednesday, hospital and security sources in Gaza reported Israeli air strikes in Rafah, as well as the central Nuseirat refugee camp," the outlet reported.
The anti-war group CodePink said in a statement after Tuesday's vote in the U.S. Senate that "urgent calls for peace are loudly echoing across the country but seem to fall on deaf ears on Capitol Hill."
"People and the planet desperately need healthcare, housing, and climate justice, not a further descent into darkness through this massive war bill that funds death and destruction," the group added. "Every elected official who voted in favor of this bill has blood on their hands."
Keep ReadingShow Less
Defeating 'MAGA Dark Money,' Summer Lee Wins Primary in Landslide
"This is a huge testament to our collective strength and resilience as a progressive movement," said the executive director of Justice Democrats.
Apr 24, 2024
U.S. Rep. Summer Lee, a member of the progressive "Squad," won the Democratic primary for Pennsylvania's 12th Congressional District on Tuesday, fending off an opponent whose campaign was backed by a billionaire Republican megadonor and ally of Israeli Prime Minister Benjamin Netanyahu.
Lee, a vocal critic of the Netanyahu government and leading supporter of a cease-fire in Gaza, handily defeated Bhavini Patel, a borough councilmember in Edgewood, Pennsylvania whose effort to unseat the progressive incumbent was bankrolled by Jeffrey Yass, the state's richest man. Patel actively courted Republican and pro-Israel voters, characterizing Lee as "fringe."
With more than 95% of the vote counted, Lee is ahead of Patel by more than 20 percentage points.
"I am so humbled and proud to win my first primary reelection to be the congresswoman for this incredible district I've spent my life fighting for," Lee said after the race was called in her favor. "Our campaign was built on a record of delivering for our democracy, defending our most fundamental rights, and expanding our vision for what is politically possible for our region's most marginalized communities."
"Our victory is a rejection of right-wing interests and Republican billionaires using corporate super PACs to target Black and brown Democrats in our primaries—be it AIPAC or Moderate PAC or any other MAGA billionaire in Democratic clothing," Lee added. "Western PA is the blueprint for the future all of America deserves."
Opposing genocide is good politics and good policy. #CeasefireNOWÂ https://t.co/A7pnJNskWS
— Summer Lee (@SummerForPA) April 24, 2024
Through the misleadingly named Moderate PAC, Yass—a prolific tax dodger who has been floated as a possible treasury secretary pick if former President Donald Trump wins another term—spent hundreds of thousands of dollars boosting Patel and attacking Lee.
Rahna Epting, executive director of MoveOn Political Action, said that by ushering Lee to victory, residents of Pennsylvania's 12th District "soundly rejected MAGA dark money."
"MoveOn members are ready to defeat this dangerous flood of dark-money spending against progressive champions and ensure that we continue to elect working-class people to Congress," said Epting.
"Now that it's clear Summer won her primary, AIPAC's super PAC has already officially failed at their one goal for this cycle: taking out the entire Squad."
During her 2022 campaign, Lee faced and overcame huge spending by the powerful pro-Israel lobbying group AIPAC via its super PAC, the United Democracy Project. But the organization opted to stay on the sidelines this time around, even as it plans to spend $100 million to defeat progressives in this year's cycle amid growing public opposition to Israel's war on Gaza.
"They had every intention of spending in this race—but they didn't, because they realized they would likely lose," Justice Democrats executive director Alexandra Rojas wrote in an email late Tuesday. "And that is because all of us had Summer's back and supported her campaign to out-organize AIPAC in every way."
"This is a huge testament to our collective strength and resilience as a progressive movement," said Rojas. "Now that it's clear Summer won her primary, AIPAC's super PAC has already officially failed at their one goal for this cycle: taking out the entire Squad."
While AIPAC ultimately sat out the Pennsylvania race, it is devoting considerable resources to ousting other progressive lawmakers, including Reps. Jamaal Bowman (D-N.Y.) and Cori Bush (D-Mo.).
The pro-Israel lobbying group has endorsed Bush challenger Wesley Bell, calling him a "strong advocate for the U.S.-Israel relationship." As The Guardianreported last week, Bell has "raised more than $650,000 in earmarked contributions through the group Democracy Engine Inc. PAC—a donation platform that allows unpopular PACs to obscure their donations and lists AIPAC as a client on its LinkedIn page."
AIPAC is the largest donor to Bowman challenger George Latimer, who has supported Israel's war on Gaza and denied that Israel is committing genocide. The Democratic primary for New York's 16th Congressional District is on June 25.
We must be clear-eyed about what's next. @JamaalBowmanNY & @CoriBush are facing an existential threat from AIPAC, their GOP megadonors, and the politicians willing to compromise on core Democratic values to try to take a school principal & nurse out of Congress. #ProtectTheSquad
— Justice Democrats (@justicedems) April 24, 2024
Michele Weindling, political director of the youth-led Sunrise Movement, said Tuesday that following Lee's victory, "we're ramping up to take on AIPAC in Jamaal Bowman's race."
"With a candidate like George Latimer willing to sell their lies to the district, we are going to prove once again that a politician's commitment to their community beats dark money every time," said Weindling. "Whether it's in Pittsburgh or New York, Minneapolis or St. Louis, our generation is going to send billionaires packing and reelect the squad."
Keep ReadingShow Less
Critics Blast 'Reckless and Impossible' Bid to Start Operating Mountain Valley Pipeline
"The time to build more dirty and dangerous pipelines is over," said one environmental campaigner.
Apr 23, 2024
Environmental defenders on Tuesday ripped the company behind the Mountain Valley Pipeline for asking the federal government—on Earth Day—for permission to start sending methane gas through the 303-mile conduit despite a worsening climate emergency caused largely by burning fossil fuels.
Mountain Valley Pipeline LLC sent a letter Monday to Federal Energy Regulatory Commission (FERC) Acting Secretary Debbie-Anne Reese seeking final permission to begin operation on the MVP next month, even while acknowledging that much of the Virginia portion of the pipeline route remains unfinished and developers have yet to fully comply with safety requirements.
"In a manner typical of its ongoing disrespect for the environment, Mountain Valley Pipeline marked Earth Day by asking FERC for authorization to place its dangerous, unnecessary pipeline into service in late May," said Jessica Sims, the Virginia field coordinator for Appalachian Voices.
"MVP brazenly asks for this authorization while simultaneously notifying FERC that the company has completed less than two-thirds of the project to final restoration and with the mere promise that it will notify the commission when it fully complies with the requirements of a consent decree it entered into with the Pipeline and Hazardous Materials Safety Administration last fall," she continued.
"Requesting an in-service decision by May 23 leaves the company very little time to implement the safety measures required by its agreement with PHMSA," Sims added. "There is no rush, other than to satisfy MVP's capacity customers' contracts—a situation of the company's own making. We remain deeply concerned about the construction methods and the safety of communities along the route of MVP."
Russell Chisholm, co-director of the Protect Our Water, Heritage, Rights (POWHR) Coalition—which called MVP's request "reckless and impossible"—said in a statement that "we are watching our worst nightmare unfold in real-time: The reckless MVP is barreling towards completion."
"During construction, MVP has contaminated our water sources, destroyed our streams, and split the earth beneath our homes. Now they want to run methane gas through their degraded pipes and shoddy work," Chisholm added. "The MVP is a glaring human rights violation that is indicative of the widespread failures of our government to act on the climate crisis in service of the fossil fuel industry."
POWHR and activists representing frontline communities affected by the pipeline are set to take part in a May 8 demonstration outside project financier Bank of America's headquarters in Charlotte, North Carolina.
Appalachian Voices noted that MVP's request comes days before pipeline developer Equitrans Midstream is set to release its 2024 first-quarter earnings information on April 30.
MVP is set to traverse much of Virginia and West Virginia, with the Southgate extension running into North Carolina. Outgoing U.S. Sen. Joe Manchin (D-W.Va.) and other pipeline proponents fought to include expedited construction of the project in the debt ceiling deal negotiated between President Joe Biden and congressional Republicans last year.
On Monday, climate and environmental defenders also petitioned the U.S. Court of Appeals for the D.C. Circuit, challenging FERC's approval of the MVP's planned Southgate extension, contending that the project is so different from original plans that the government's previous assent is now irrelevant.
"Federal, state, and local elected officials have spoken out against this unneeded proposal to ship more methane gas into North Carolina," said Sierra Club senior field organizer Caroline Hansley. "The time to build more dirty and dangerous pipelines is over. After MVP Southgate requested a time extension for a project that it no longer plans to construct, it should be sent back to the drawing board for this newly proposed project."
David Sligh, conservation director at Wild Virginia, said: "Approving the Southgate project is irresponsible. This project will pose the same kinds of threats of damage to the environment and the people along its path as we have seen caused by the Mountain Valley Pipeline during the last six years."
"FERC has again failed to protect the public interest, instead favoring a profit-making corporation," Sligh added.
Others renewed warnings about the dangers MVP poses to wildlife.
"The endangered bats, fish, mussels, and plants in this boondoggle's path of destruction deserve to be protected from killing and habitat destruction by a project that never received proper approvals in the first place," Center for Biological Diversity attorney Perrin de Jong said. "Our organization will continue fighting this terrible idea to the bitter end."
Keep ReadingShow Less
Most Popular