Underground Oil Tanks

Should I be concerned if a buried oil tank used to be on my property, but was removed?

Yes and No.   The tank may have leaked prior to removal.   If the Seller can provide you with a report documenting the tank was removed and testing was completed, then no, you should be fine.