If you believe the judge has not fairly evaluated your case, you may appeal your claim to the Appeals Council, which is set up to reevaluate decisions. If the Appeals Council denies your claim, you can then file a lawsuit against Social Security in federal court.