December, 17 2014, 01:00pm EDT

FCC and Sunlight Foundation Undercounted Pro-Net Neutrality Comments and Should Immediately Correct the Record
WASHINGTON
Several media outlets have run headlines based on a study that the Sunlight Foundation published yesterday that is based on faulty data, which drastically underrepresents the number of pro-net neutrality comments the FCC received during its second comment period.
Based on an initial look at the data by Fight for the Future's technologists, it appears that there are two major issues:
The FCC failed to register a significant number of pro-net neutrality comments that were sent. We've thus far identified at least 150,798 comments that were missing from the FCC's data dump, and ongoing analysis of their data suggests that this number is in fact much higher. This alone is enough to completely unseat the conclusion that anti-net neutrality commenters "dominated" the second comment period.
The Sunlight Foundation's analysis used a flawed data set that misleadingly represented the full set of comments; it ignored almost half of the total of the release of the FCC data (by their own admission), close to 800,000 comments, because of difficulty processing those comments. The data Sunlight used cannot be assumed to be "reasonably representative" of all the comments. There were several methods by which comments could be submitted to the FCC, and because this led to inconsistencies in the FCC's release of the data, it's an error for Sunlight to infer that the excluded comments maintained the same distribution of pro- vs. anti-net neutrality submissions as the data Sunlight did consider. In addition, the Sunlight Foundation also significantly undercounted comments from at least one group, Battle for the Net, by over 100,000 comments. The result is that the Sunlight Foundation's finding that anti-net neutrality groups "dominated" the second round comment period is completely unfounded.
Fight for the Future co-founder Tiffiniy Cheng said, "Millions of people have spoken out in support of net neutrality, and their voices matter. Getting these numbers right is important. The FCC and the Sunlight Foundation need to act immediately to correct the record, and media outlets that have ran stores based on the faulty data should publish prominent corrections."
"Sunlight applied a flawed sampling methodology to a flawed set of data, and drew conclusions that are impossible to make with any 'reasonably representative' certainty," said Jeff Lyon, Fight for the Future's Chief Technical Officer, "Sunlight's approach is like trying to draw conclusions about the average income in Massachusetts by only surveying people in Boston." Lyon provided the following explanation of the serious errors he was able to identify in Sunlight's analysis:
There are two major problems with the data the FCC released and the resulting study:
The Sunlight Foundation based its study on the data released by the FCC in this October 22 blog post by Gigi Sohn. However, the FCC failed to register hundreds of thousands of pro-net neutrality comments from Battle for the Net.
Sunlight's methodology was flawed. Sunlight was unable to parse all of the data released by the FCC. According to the FCC, there were 2.4 million comments in the data, but Sunlight was only able to read 1.6 million comments. Sunlight's study is based on a subset of the data that misses close to half of all the comments in FCC"s data dump; this data set is not reasonably representative of the big picture but in fact was comprised mainly of one set of comments. Furthermore, Sunlight significantly underreported the number of comments from Battle for the Net that the FCC actually recorded.
In actuality, there were at least 998,498 comments sent from Battle for the Net, but between the FCC not recording them and Sunlight applying a flawed methodology to analyze what little data there actually was, the end result was completely distorted.
The FCC failed to register our comments:
In the FCC's release of the data, Ms. Sohn reports that the FCC received 725,169 comments through ECFS and CSV uploads during the second comment period from July 19th to September 15th.
However, just between September 12th and September 15th, Battle for the Net sent 527,953 comments through CSV uploads alone.We also submitted 470,596 more comments via ECFS and email. Battle for the Net's numbers alone are far higher than the numbers reported by Ms. Sohn.
Given that numerous other individuals and organizations were submitting net neutrality comments during the same period, at best the FCC is severely underreporting the number of comments sent out from pro-net neutrality activists.
To verify this, we downloaded and analyzed the data dump of all comments received by the FCC during the second commenting period, and compared our data to the FCC's. Please note that we have thus far only analyzed the 527,953 comments sent via CSV, and we are still processing reports on the data submitted by ECFS and email.
Total number of comments we submitted via CSV: 527,953
Almost all of these submissions used an open letter by Senator Angus King with each participant signing on. To do a sanity test, we checked our CSV data for two of the phrases from the letter:
Number of occurrences of phrase: 'These principles of fairness and openness' in our CSV comments: 525,189 (this number may be lower than actual due to aggressive deduplication)
Number of occurrences of phrase: 'We are writing to urge you to implement' in our CSV comments: 525,189 (this number may be lower than actual due to aggressive deduplication)
Next, we scanned the data from the dump of FCC's ECFS comments from the second commenting period.
Number of occurrences of phrase: 'These principles of fairness and openness' in FCC's data dump of ECFS comments: 374,421
Number of occurrences of phrase: 'We are writing to urge you to implement' in FCC's data dump of ECFS comments: 374,391
We identified 525,189 CSV comments, and found that at most the FCC only recorded 374,421. From this basic analysis alone, it is clear that, at best, the FCC missed a huge number of the comments we submitted via CSV. But we also sent over 470,596 more comments via email and through FCC's ECFS site, (before it broke from all the load we put it under). Initial results are indicating that a large number of these comments submitted through email and ECFS were also not recorded by the FCC, but we are still generating reports to more precisely quantify those numbers.
We are running a more thorough analysis of the data to identify all the individuals whose comments were not recorded by the FCC, but crunching through all of this data will take several hours.
Sunlight's methodology was not "reasonably representative".
Sunlight was unable to parse all of the data released by the FCC. According to the FCC, there were 2.4 million comments in the data, but Sunlight was only able to read 1.6 million comments. They chose to base their conclusions on a subset of the data that may not be representative of the big picture. According to Sunlight's own admission:
Clearly, 1.67 million documents is far short of 2.5 million (the number reported in the commission's blog post). We spent enough time with these files that we're reasonably sure that the FCC's comment counts are incorrect and that our analysis is reasonably representative of what's there, but the fact that it's impossible for us to know for sure is problematic
Sunlight also significantly under-reported the number of comments that came from Battle for the Net commenters, estimating this at 271,608. When we pointed out how easily we identified at least 367,460 of our own comments in the data, they acknowledged their error. However, this margin alone could have been enough to tip their conclusions in favor of net neutrality activists.
Furthermore, the FCC confirmed that people who signed petitions would be counted as individual commenters. Many net-neutrality activist organizations attached their petition signatures as PDFs attached to single ECFS filings. Sunlight was unable to parse these PDFs and chose to simply exclude them from their sample pool, ignoring perhaps hundreds of thousands of pro-net neutrality comments. On the other hand, Sunlight was able to easily read all of American Commitment's comments, further distorting their results in favor of anti-net neutrality commenters.
Sunlight applied a flawed sampling methodology to a flawed set of data, and drew conclusions that are impossible to make with any "reasonably representative" certainty.
Fight for the Future is a group of artists, engineers, activists, and technologists who have been behind the largest online protests in human history, channeling Internet outrage into political power to win public interest victories previously thought to be impossible. We fight for a future where technology liberates -- not oppresses -- us.
(508) 368-3026LATEST NEWS
'Spineless Capitulation to Extortion': Paramount Caves to Trump With $16 Million Settlement
Critics characterized the payment as a bribe in exchange for federal approval of Paramount's pending merger with Skydance.
Jul 02, 2025
The parent company of CBS News, Paramount Global, announced Tuesday that it has agreed to pay U.S. President Donald Trump $16 million to settle what legal experts called an entirely meritless lawsuit over the media organization's handling of a pre-election "60 Minutes" interview with Kamala Harris.
Under the reported terms of the settlement, the money will go toward Trump's legal fees and his future presidential library. Paramount said the settlement deal does not include a formal apology, but the company agreed to release written transcripts of future "60 Minutes" interviews with presidential candidates.
Critics responded with outrage to news of the settlement, which one observer characterized as "spineless capitulation to extortion." Some posted screenshots to social media showing they canceled their Paramount+ subscriptions in response.
As Paramount engaged in talks with Trump's legal team over the lawsuit in recent weeks, press freedom advocates and members of Congress implored the organization not to settle, warning that caving to the president would reward and embolden his attacks on media outlets he views as his political enemies.
"If you settle cases, you're going to send a message to your news team to not push the envelope for fear of people being sued," media attorney Edward Klaris toldThe Washington Post, "and you're going to court more cases against your company because they might think that if they sue you they're going to collect."
Paramount's controlling shareholder, Shari Redstone, supported a settlement with Trump in the hope that it would "clear the way" for federal approval of the company's merger with the entertainment company Skydance, according to The Wall Street Journal, which cited sources familiar with the internal discussions. Bloombergreported that Redstone could reap $180 million in "severance and other benefits on top of hundreds of millions from the sale of her stock" if the merger goes through.
In May, the Freedom of the Press Foundation—a Paramount shareholder—cautioned that a settlement with Trump "could amount to a bribe" to the Trump administration in exchange for approval of the merger. The advocacy group said it would sue Paramount if the company caved to the president, arguing that "a settlement of Trump's meritless lawsuit may well be a thinly veiled effort to launder bribes through the court system."
Sens. Bernie Sanders (I-Vt.), Elizabeth Warren (D-Mass.), and Ron Wyden (D-Ore.) similarly warned Paramount that a settlement with Trump could run afoul of federal anti-bribery laws.
"Paramount appears to be attempting to appease the administration in order to secure merger approval," the senators wrote in a May 19 letter to Redstone.
Keep ReadingShow Less
'We Will Not Accept This Intimidation,' Mamdani Says of Trump Threat to Arrest Him
"That Trump included praise for Eric Adams in his authoritarian threats is unsurprising, but highlights the urgency of bringing an end to this mayor's time in City Hall," said the New York City mayoral candidate.
Jul 01, 2025
Democratic New York City mayoral candidate Zohran Mamdani made clear on Tuesday that he would not be intimidated by Republican U.S. President Donald Trump's threat to arrest him.
A journalist who falsely described Mamdani—a democratic socialist—as a "communist" asked Trump about the candidate's pledge not to cooperate with U.S. Immigration and Customs Enforcement (ICE), whose agents are working to carry out the president's promised mass deportations.
"Well then, we'll have to arrest him," said Trump, a former New Yorker who has taken aim at Mamdani since his victory in last Tuesday's Democratic primary. "Look, we don't need a communist in this country."
Mamdani, who currently serves in the New York State Assembly, was born in Uganda to Indian parents and moved to NYC as a child. He was naturalized as a U.S. citizen in 2018. Throughout his campaign, the 33-year-old has faced numerous Islamophobic attacks, and after his primary win, Congressman Andy Ogles (R-Tenn.) urged the Trump administration to target him with "denaturalization proceedings," in line with a broader effort at the Department of Justice (DOJ).
Trump said Tuesday that his administration would be watching Mamdani "very carefully." The president, a well-documented liar, added that "a lot of people are saying he's here illegally—you know, we're gonna look at everything... and ideally he's gonna turn out to be much less than a communist, but right now he's a communist, that's not a socialist."
Trump also blasted Congressman Alexandria Ocasio-Cortez (D-N.Y.), a supporter of Mamdani, and praised the city's current mayor, Eric Adams, who is seeking another term as an Independent. After Trump returned to office in January, the DOJ instructed prosecutors to drop federal corruption charges against Adams, triggering widespread outrage over the attempted "illegal quid pro quo," as some critics called it.
Responding to Trump's remarks in a lengthy statement, Mamdani said Tuesday that "the president of the United States just threatened to have me arrested, stripped of my citizenship, put in a detention camp, and deported. Not because I have broken any law, but because I will refuse to let ICE terrorize our city."
"His statements don't just represent an attack on our democracy but an attempt to send a message to every New Yorker who refuses to hide in the shadows: If you speak up, they will come for you," Mamdani continued. "We will not accept this intimidation."
"That Trump included praise for Eric Adams in his authoritarian threats is unsurprising, but highlights the urgency of bringing an end to this mayor's time in City Hall," he asserted, directing attention to the GOP budget bill advanced by the U.S. Senate on Tuesday.
Mamdani said that "at this very moment, when MAGA Republicans are attempting to destroy the social safety net, kick millions of New Yorkers off of healthcare, and enrich their billionaire donors at the expense of working families, it is a scandal that Eric Adams echoes this president's division, distraction, and hatred. Voters will resoundingly reject it in November."
In addition to Mamdani and Adams, the general election candidates are Republican Curtis Sliwa, Independent Jim Walden, and disgraced former New York Gov. Andrew Cuomo, who is now running as an Independent after losing the Democratic primary. According to results released Tuesday, Mamdani got 56% of the vote compared to Cuomo's 44%.
Keep ReadingShow Less
Senators Demand Answers About 'Reckless' Trump Admin Use of AI Social Security Chatbot
Artificial intelligence systems, the four senators argue, "represent a troubling pattern that if continued, would significantly impede Americans' ability" to access their benefits.
Jul 01, 2025
Four U.S. senators—three Democrats and Vermont Independent Bernie Sanders—demanded answers Tuesday from the Trump administration about its "reckless rollout" of artificial intelligence chatbot technology into phone systems "that have blocked people from accessing their earned Social Security benefits."
"These AI programs, which the agency deployed with little consultation with Congress, advocates, or other key stakeholders, appear to have been developed in haste and represent a troubling pattern that if continued, would significantly impede Americans' ability to access their Social Security and Supplemental Security Income (SSI) benefits," the senators said in a letter to Social Security Administration (SSA) Commissioner Frank Bisignano.
While Sanders, Senate Finance Committee Ranking Member Ron Wyden (Ore.), and Sens. Elizabeth Warren (Mass.) and Kirsten Gillibrand (N.Y.) acknowledged that "AI can be a helpful tool to simplify some workloads," they contended that artificial intelligence "is not a panacea for all challenges facing SSA."
The letter continues:
SSA is entrusted with ensuring accurate and timely payment of mtore than $1 trillion in Social Security and SSI benefit payments to over 73 million seniors, individuals with disabilities, and their families each year. Considering the agency's important mission, it is critical that SSA is responsibly deploying any technology system, including AI. For example, whether incorporating newer technology like generative AI to improve customer experience and increase efficiency or leveraging predictive AI to provide disability examiners support in the disability determination process, it is critical that SSA meaningfully engage stakeholders, including its customers and employees, the advocacy community, and members of Congress, throughout the entire process to avoid harm to claimants and beneficiaries.
"The agency's hasty AI rollouts on its national 1-800 number phone system and the phone system for its 1,200 field offices, which resulted in significant impediments for Americans simply trying to access their earned benefits, demonstrate our concern," the senators wrote. "In April, SSA announced it would be deploying an anti-fraud AI algorithm to verify the identity of callers seeking to file for benefits on its national 1-800 number, arguing—without providing any evidence—that its telephone service was rife with fraud."
"However," the lawmakers noted, "the proposal was scrapped shortly after implementation after the system found it identified two claims out of over 110,000 as potentially fraudulent. Moreover, the new program slowed claim processing by 25% and led to a 'degradation of public service.'"
The senators are asking Bisignano to:
- Provide a detailed description of the new AI-based chatbot, including how it determines whether it has successfully answered a caller's questions before hanging up;
- Describe which metrics is SSA using to determine whether this AI-based chatbot is successful at improving service delivery at the national 1-800 number;
- Explain the metrics SSA used to evaluate the successes or challenges of this AI-based chatbot before rolling it out nationwide to field offices;
- Disclose which stakeholders, especially those who represent beneficiaries and employees, were consulted pre- and post-deployment of this AI-based chatbot;
- Explain whether SSA is planning to procure, develop, or implement any new AI systems this year; and
- If the answer to the above question is yes, list and provide a detailed description of these AI systems.
The AI rollout is part of Bisignano's "technology agenda" to boost productivity at SSA amid staffing and other cuts implemented by the Trump administration and its Department of Government Efficiency, or DOGE. In February, SSA announced its intent to fire 7,000 workers, or about 12% of its historically low staff.
Many SSA staffers also resigned, including nearly half of the agency's senior executives. This has adversely affected SSA beneficiaries. An analysis published last week by the Center on Budget and Policy Priorities revealed that one SSA staff member must now serve 1,480 beneficiaries—over three times as many as in 1967.
Last week, Warren sent a letter to Bisignano—who one advocacy group described as "a Wall Street CEO with a long history of slashing the companies he runs to the bone"—accusing him of misleading the public about longer beneficiary wait times resulting from the Trump administration and DOGE taking a "chainsaw to Social Security."
Keep ReadingShow Less
Most Popular