NEW YORK (CNN) -- The U.N. nuclear watchdog agency has written a scathing letter to a congressional committee saying part of its case against Iran is "outrageous and dishonest."

The report came a day before an Iranian opposition figure accused Iran of using lasers to enrich uranium in its bid to develop a nuclear weapon.

Tehran has repeatedly said that its nuclear program is solely for energy production.

The International Atomic Energy Agency wrote the leadership of the House Intelligence Committee on Wednesday, lambasting it for claiming that the Islamic republic "is currently enriching uranium to weapons grade."

Iran is far from that capability, the IAEA said. (Watch how the IAEA and the House disagree -- 2:00)

Rep. Mike Rogers, a Michigan Republican who sits on the Permanent Select Committee on Intelligence, which prepared the report, said the subcommittee's assertion is "very clear."

"It says that we don't believe that they've gotten there. But the point of that whole section is, they are trying to enrich uranium to weapons grade," he said.

The subcommittee's report also insinuates that the IAEA may be in cahoots with Tehran in covering up Iran's nuclear ambitions.

The report alleges that an IAEA inspector might have been removed at Iran's request "for not adhering to an unstated IAEA policy barring IAEA officials from telling the whole truth about the Iranian nuclear program."

The IAEA shot back that the claim was "an outrageous and dishonest suggestion," but Rogers stood by it Thursday.

"The Iranians said take him off the program, and they said OK. You can't have Iran getting to pick who is their inspectors," Rogers said.

The IAEA has been down this road before, when it entered the fray over Iraq's weapons program before the 2003 U.S. invasion. During that tussle, the Bush administration criticized the agency for being too cautious and opposed the reappointment of agency chief Mohammed El-Baradei.

"This is a very troubling instance here, this report, of U.S. policymakers in my view trying to push the intelligence community to find evidence that they believe supports their suspicions and their end policy goals," said Daryl Kimball of the nonprofit think tank, the Arms Control Association in Washington.

Rogers, however, insisted that the report was bipartisan and that the U.S. intelligence community reviewed it. U.S. intelligence officials declined to comment on the subcommittee's report or the IAEA letter.