December, 17 2014, 01:00pm EDT
FCC and Sunlight Foundation Undercounted Pro-Net Neutrality Comments and Should Immediately Correct the Record
WASHINGTON
Several media outlets have run headlines based on a study that the Sunlight Foundation published yesterday that is based on faulty data, which drastically underrepresents the number of pro-net neutrality comments the FCC received during its second comment period.
Based on an initial look at the data by Fight for the Future's technologists, it appears that there are two major issues:
The FCC failed to register a significant number of pro-net neutrality comments that were sent. We've thus far identified at least 150,798 comments that were missing from the FCC's data dump, and ongoing analysis of their data suggests that this number is in fact much higher. This alone is enough to completely unseat the conclusion that anti-net neutrality commenters "dominated" the second comment period.
The Sunlight Foundation's analysis used a flawed data set that misleadingly represented the full set of comments; it ignored almost half of the total of the release of the FCC data (by their own admission), close to 800,000 comments, because of difficulty processing those comments. The data Sunlight used cannot be assumed to be "reasonably representative" of all the comments. There were several methods by which comments could be submitted to the FCC, and because this led to inconsistencies in the FCC's release of the data, it's an error for Sunlight to infer that the excluded comments maintained the same distribution of pro- vs. anti-net neutrality submissions as the data Sunlight did consider. In addition, the Sunlight Foundation also significantly undercounted comments from at least one group, Battle for the Net, by over 100,000 comments. The result is that the Sunlight Foundation's finding that anti-net neutrality groups "dominated" the second round comment period is completely unfounded.
Fight for the Future co-founder Tiffiniy Cheng said, "Millions of people have spoken out in support of net neutrality, and their voices matter. Getting these numbers right is important. The FCC and the Sunlight Foundation need to act immediately to correct the record, and media outlets that have ran stores based on the faulty data should publish prominent corrections."
"Sunlight applied a flawed sampling methodology to a flawed set of data, and drew conclusions that are impossible to make with any 'reasonably representative' certainty," said Jeff Lyon, Fight for the Future's Chief Technical Officer, "Sunlight's approach is like trying to draw conclusions about the average income in Massachusetts by only surveying people in Boston." Lyon provided the following explanation of the serious errors he was able to identify in Sunlight's analysis:
There are two major problems with the data the FCC released and the resulting study:
The Sunlight Foundation based its study on the data released by the FCC in this October 22 blog post by Gigi Sohn. However, the FCC failed to register hundreds of thousands of pro-net neutrality comments from Battle for the Net.
Sunlight's methodology was flawed. Sunlight was unable to parse all of the data released by the FCC. According to the FCC, there were 2.4 million comments in the data, but Sunlight was only able to read 1.6 million comments. Sunlight's study is based on a subset of the data that misses close to half of all the comments in FCC"s data dump; this data set is not reasonably representative of the big picture but in fact was comprised mainly of one set of comments. Furthermore, Sunlight significantly underreported the number of comments from Battle for the Net that the FCC actually recorded.
In actuality, there were at least 998,498 comments sent from Battle for the Net, but between the FCC not recording them and Sunlight applying a flawed methodology to analyze what little data there actually was, the end result was completely distorted.
The FCC failed to register our comments:
In the FCC's release of the data, Ms. Sohn reports that the FCC received 725,169 comments through ECFS and CSV uploads during the second comment period from July 19th to September 15th.
However, just between September 12th and September 15th, Battle for the Net sent 527,953 comments through CSV uploads alone.We also submitted 470,596 more comments via ECFS and email. Battle for the Net's numbers alone are far higher than the numbers reported by Ms. Sohn.
Given that numerous other individuals and organizations were submitting net neutrality comments during the same period, at best the FCC is severely underreporting the number of comments sent out from pro-net neutrality activists.
To verify this, we downloaded and analyzed the data dump of all comments received by the FCC during the second commenting period, and compared our data to the FCC's. Please note that we have thus far only analyzed the 527,953 comments sent via CSV, and we are still processing reports on the data submitted by ECFS and email.
Total number of comments we submitted via CSV: 527,953
Almost all of these submissions used an open letter by Senator Angus King with each participant signing on. To do a sanity test, we checked our CSV data for two of the phrases from the letter:
Number of occurrences of phrase: 'These principles of fairness and openness' in our CSV comments: 525,189 (this number may be lower than actual due to aggressive deduplication)
Number of occurrences of phrase: 'We are writing to urge you to implement' in our CSV comments: 525,189 (this number may be lower than actual due to aggressive deduplication)
Next, we scanned the data from the dump of FCC's ECFS comments from the second commenting period.
Number of occurrences of phrase: 'These principles of fairness and openness' in FCC's data dump of ECFS comments: 374,421
Number of occurrences of phrase: 'We are writing to urge you to implement' in FCC's data dump of ECFS comments: 374,391
We identified 525,189 CSV comments, and found that at most the FCC only recorded 374,421. From this basic analysis alone, it is clear that, at best, the FCC missed a huge number of the comments we submitted via CSV. But we also sent over 470,596 more comments via email and through FCC's ECFS site, (before it broke from all the load we put it under). Initial results are indicating that a large number of these comments submitted through email and ECFS were also not recorded by the FCC, but we are still generating reports to more precisely quantify those numbers.
We are running a more thorough analysis of the data to identify all the individuals whose comments were not recorded by the FCC, but crunching through all of this data will take several hours.
Sunlight's methodology was not "reasonably representative".
Sunlight was unable to parse all of the data released by the FCC. According to the FCC, there were 2.4 million comments in the data, but Sunlight was only able to read 1.6 million comments. They chose to base their conclusions on a subset of the data that may not be representative of the big picture. According to Sunlight's own admission:
Clearly, 1.67 million documents is far short of 2.5 million (the number reported in the commission's blog post). We spent enough time with these files that we're reasonably sure that the FCC's comment counts are incorrect and that our analysis is reasonably representative of what's there, but the fact that it's impossible for us to know for sure is problematic
Sunlight also significantly under-reported the number of comments that came from Battle for the Net commenters, estimating this at 271,608. When we pointed out how easily we identified at least 367,460 of our own comments in the data, they acknowledged their error. However, this margin alone could have been enough to tip their conclusions in favor of net neutrality activists.
Furthermore, the FCC confirmed that people who signed petitions would be counted as individual commenters. Many net-neutrality activist organizations attached their petition signatures as PDFs attached to single ECFS filings. Sunlight was unable to parse these PDFs and chose to simply exclude them from their sample pool, ignoring perhaps hundreds of thousands of pro-net neutrality comments. On the other hand, Sunlight was able to easily read all of American Commitment's comments, further distorting their results in favor of anti-net neutrality commenters.
Sunlight applied a flawed sampling methodology to a flawed set of data, and drew conclusions that are impossible to make with any "reasonably representative" certainty.
Fight for the Future is a group of artists, engineers, activists, and technologists who have been behind the largest online protests in human history, channeling Internet outrage into political power to win public interest victories previously thought to be impossible. We fight for a future where technology liberates -- not oppresses -- us.
(508) 368-3026LATEST NEWS
Roughly 900 US Troops Still in Syria as Rebels Close in on Damascus
"Whether the Pentagon wants to admit it or not," U.S. troops "are likely involved in the broader conflict unfolding there right now," warned one analyst.
Dec 07, 2024
Syrian rebel groups' rapid advance on the nation's capital city of Damascus and the possible collapse of President Bashar al-Assad's government after more than a decade of civil war has brought renewed attention to the continued presence of U.S. forces in the country, despite the absence of a clear legal authorization.
The U.S. is believed to have around 900 troops deployed to Syria, mostly in the northeast, as well as an unknown number of private contractors. Nick Turse, a contributing writer for The Intercept, observed Thursday that American forces in Syria "have, on average, come under fire multiple times each week since last October," according to internal Pentagon statistics.
"Keeping military personnel in harm's way for the sake of foreign policy credibility has become increasingly risky with the Gaza war and the flare-up of the Syrian civil war," Turse wrote.
Kelley Vlahos, senior adviser to the Quincy Institute for Responsible Statecraft, wrote Saturday morning that "whether the Pentagon wants to admit it or not," U.S. troops "are likely involved in the broader conflict unfolding there right now."
Reutersreported Tuesday that as rebels advanced toward the city of Hama, "fighters from a U.S.-backed, Kurdish-led coalition battled government forces in the northeast, both sides said, opening a new front along a vital supply route" and "compounding Assad's problems."
As the coalition of groups led by the Islamist organization Hayat Tahrir al-Sham (HTS) and factions of the Turkey-backed Syrian National Army has quickly seized control of large swaths of territory, the White House National Security Council (NSC) said in a statement last weekend that the U.S.—which has previously armed and trained Syrian rebels—"has nothing to do with this offensive."
"The United States, together with its partners and allies, urge de-escalation, protection of civilians and minority groups, and a serious and credible political process that can end this civil war once and for all with a political settlement consistent with UNSCR 2254," said NSC spokesperson Sean Savett. "We will also continue to fully defend and protect U.S. personnel and U.S. military positions, which remain essential to ensuring that ISIS can never again resurge in Syria."
On Friday, the White House said in a letter to Congress that "a small presence of United States Armed Forces remains in strategically significant locations in Syria to conduct operations, in partnership with local, vetted ground forces, to address continuing terrorist threats emanating from Syria."
President-elect Donald Trump, who during his first term opted to keep U.S. troops in Syria for the openly stated purpose of exploiting the country's oil fields, wrote in a social media post on Saturday that "the United States should have nothing to do with" the current conflict.
"This is not our fight," he wrote in all caps. "Let it play out. Do not get involved!"
Trump's post, as The Associated Pressreported, came as rebels' "stunning march across Syria gained speed... with news that they had reached the suburbs of the capital and with the government forced to deny rumors that President Bashar al-Assad had fled the country."
Hassan Abdul-Ghani, an insurgent commander, said in a Telegram post that rebels are entering the "final stage" of their offensive as they began to encircle Syria's capital. Citing unnamed local sources, Al Jazeerareported that "a state of panic has spread as army troops withdraw from their positions around Damascus."
"They also confirmed that opposition forces had advanced in the western Damascus countryside and the withdrawal of army forces from cities and towns in Eastern Ghouta," the outlet added. "There was a rush for food items in markets in the capital."
Government forces have been backed by Russian airstrikes, Hezbollah, and Iraqi militia fighters.
Reutersreported that "Iranian Foreign Minister Abbas Araqchi said in an Arabic-language interview that Tehran would consider sending troops to Syria if Damascus asked, and Russian President Vladimir Putin urged an end to 'terrorist aggression' in Syria."
In a video statement on Saturday, a Syrian military commander said that "our valiant army continues to carry out its operations against terrorist gatherings at high rates in the directions of the Hama and Homs countrysides and the northern Daraa countryside, inflicting hundreds of deaths and injuries on the terrorists."
Anti-war lawmakers in the U.S. have repeatedly questioned the role of American troops in Syria in recent years and launched efforts to force their withdrawal.
In March 2023, a bipartisan group of lawmakers in the U.S. House put forth a resolution that would have required full withdrawal of American forces from Syria within 180 days of passage in the absence of congressional action authorizing their continued presence.
The resolution was voted down by 170 Republicans and 150 Democrats.
Months later, the U.S. Senate tanked a similar effort.
Erik Sperling, executive director of the advocacy group Just Foreign Policy, told The Intercept on Thursday that the Biden administration hasn't "put the war in Syria up for debate because they know the American people don't want another war in the Middle East."
"They know there is no popular support for putting U.S. troops at risk for this," said Sperling, who warned that "many of Trump's advisers will try to drag him deeper into this regional conflict in the Middle East."
The explosion of Syria's civil war in recent days has been disastrous for civilians in the crossfire.
Human Rights Watch (HRW) said Wednesday that "the outbreak of major hostilities... raises concerns that civilians face a real risk of serious abuses at the hands of opposition armed groups and the Syrian government."
"The bloody record of atrocities by all parties to the conflict in Syria is bound to persist until leaders go beyond words and support accountability efforts," said Adam Coogle, HRW's deputy Middle East director. "Without credible justice, there will be no end in sight to the suffering Syrians have endured, no matter who controls the land."
Keep ReadingShow Less
Fury as South Korea's Conservative Party Thwarts Impeachment Vote
"Today, citizens witnessed democracy taking a step backward," said the Korean Confederation of Trade Unions.
Dec 07, 2024
A bid to impeach South Korean President Yoon Suk Yeol over his short-lived imposition of martial law failed Saturday after lawmakers from his conservative party left the National Assembly chamber and refused to take part in the vote.
Supporters of impeachment needed at least eight members of Yoon's People Power Party (PPP) to support removing the president, who apologized to the nation in a one-minute-long address Saturday morning but refused to step down after he briefly instituted martial law in a stated attempt to "eradicate shameful pro-North Korea" forces, plunging the country into a political crisis.
Yoon's gambit sparked immediate and sustained protests and was widely seen as a coup attempt.
Saturday's impeachment effort drew a massive number of people into the streets outside the National Assembly building despite below-freezing temperatures, and demonstrators voiced outrage when they learned that Yoon's allies thwarted the initial attempt to oust him. Just two PPP members returned to the National Assembly chamber to cast a ballot Saturday.
"I am so angry. I can't find the words to describe my frustration," 23-year-old Kim Hyo-lim toldThe New York Times. "I am devastated, but I feel honored to be a part of this historic moment for my country."
Another demonstrator said they intend to protest "every weekend" until Yoon is removed.
(Photo: Daniel Ceng/Anadolu via Getty Images)
Organizers said roughly a million people took part in demonstrations Saturday in support of Yoon's impeachment. Many also demanded his arrest.
The Financial Timesreported following the failed impeachment effort that Yoon—whose term expires in 2027—and PPP leaders "appeared to have reached a deal whereby the president would hand over political direction of the country to his party and agree to stand down at a time of the party's choosing, in return for support in the impeachment vote."
The Korean Confederation of Trade Unions (KCTU), which has over 1.1 million members, called PPP lawmakers who boycotted Saturday's vote "accomplices in treason."
"The People Power Party has turned its back on the people's wishes, effectively admitting their complicity," KCTU said in a statement posted to social media. "More than one million citizens gathered in front of the National Assembly. They came together because they cannot forgive a president who declared martial law and aimed weapons at his own people. Despite the cold winter weather, they took to the streets hoping desperately for the impeachment to pass."
"Today, citizens witnessed democracy taking a step backward," KCTU added. "They saw clearly who stands with those who would harm our democracy. The People Power Party must be dissolved. Those who protect Yoon must face consequences. It would be a grave mistake to think this can be resolved through compromise or constitutional amendments for an early resignation. Through the people's judgment, Yoon, his associates, and the People Power Party will face severe consequences."
Opposition lawmakers are expected to file a fresh impeachment motion next week as pressure mounts for Yoon to step down.
Additionally, as The Washington Postreported, "the national police have opened an investigation into Yoon on treason accusations by opposition parties and activists."
Keep ReadingShow Less
Top Democrat Issues Warning Over Trump Plot to 'Steal' From Federal Programs
"The Constitution provides no impoundment power to the president to unilaterally withhold funds appropriated by Congress," said Rep. Rosa DeLauro.
Dec 07, 2024
The top Democrat on the House Appropriations Committee warned Friday that President-elect Donald Trump is planning to "steal from the programs and services that affect middle-class, working, and vulnerable families" by refusing to spend money appropriated by Congress.
Rep. Rosa DeLauro (D-Conn.) said in a statement that Trump's strategy, known as "impoundment," is "uninformed and unconstitutional," adding that "the Supreme Court, the Department of Justice, and the Government Accountability Office are all in agreement—the Constitution provides no impoundment power to the president to unilaterally withhold funds appropriated by Congress."
"It is the sworn duty of the president of the United States to faithfully execute the law," DeLauro added, "and appropriations laws are no exception."
In a new fact sheet, Democrats on the House Appropriations Committee note that "the Constitution gives Congress the power of the purse, and nowhere does it give the president any unilateral power to either temporarily or permanently impound—steal, withhold, or prevent from being spent—funds appropriated by Congress."
"The Framers were right to give Congress the power of the purse," the fact sheet states. "If the president had the unilateral power to decline to spend resources as directed by Congress, then those who rely on Social Security, Medicare, Veterans Medical Care, and other federal spending programs would be subject to the whims of the executive branch. The American people would be unable to depend on promises made by Congress in appropriations laws."
Trump has explicitly vowed to use impoundment to "squeeze the bloated federal bureaucracy for massive savings," a plan endorsed by the billionaire pair tapped by the president-elect to run a new commission tasked with identifying spending and regulations to slash.
"With impoundment, we can simply choke off the money," Trump declared in a campaign ad.
"They have no authority. Does anybody get that?"
Following Elon Musk and Vivek Ramaswamy's visit to Capitol Hill on Thursday to discuss their plans for the "Department of Government Efficiency" (DOGE) with GOP lawmakers, The Washington Postreported that Republicans are "keen on expanding the president's power to impound spending—or refuse to spend money Congress authorizes."
"Musk and Ramaswamy said they were eager to test the constitutional limits of Trump's ability to unilaterally control spending decisions," the Post reported, citing two unnamed lawmakers. "Republicans largely left the more than two-hour meeting giddy."
Analysts argue Trump's plan to withhold federal spending would run afoul of the 1974 Congressional Budget and Impoundment Control Act (ICA). The law, as Propublica's Molly Redden explained, "forbids presidents from blocking spending over policy disagreements."
"A similar power grab led to his first impeachment," Redden wrote. "During his first term, Trump held up nearly $400 million in military aid to Ukraine while he pressured President Volodymyr Zelenskyy to open a corruption investigation into Joe Biden and his family. The U.S. Government Accountability Office later ruled his actions violated the Impoundment Control Act."
Democrats on the House Budget Committee recently pointed out that "although decided after the ICA passed, the Supreme Court unanimously held in Train v. City of New York that even without the ICA, the president does not have unilateral authority to impound funds."
That hasn't stopped Trump, Musk, and Ramaswamy from exploring ways to cut or block spending without congressional approval.
In a Wall Street Journalop-ed published last month, Musk and Ramaswamy wrote that "even without relying on" the view that the ICA is unconstitutional, "DOGE will help end federal overspending by taking aim at the $500 billion-plus in annual federal expenditures that are unauthorized by Congress or being used in ways that Congress never intended, from $535 million a year to the Corporation for Public Broadcasting and $1.5 billion for grants to international organizations to nearly $300 million to progressive groups like Planned Parenthood."
Housing assistance, childcare aid, student loan programs, and other spending would also be vulnerable under such an approach.
"They want [to cut] $2 trillion," DeLauro told reporters Thursday. "Think about the discretionary budget. It's $1.7 trillion. Where are they going for the money? Where are they going?"
"They have no authority," she added. "Does anybody get that?"
Keep ReadingShow Less
Most Popular