Text Data De-duplication Cleanup

I have a text-based dataset that needs a focused round of data cleaning and formatting. The core task is to identify and remove every duplicate entry so the final file is lean, accurate, and ready for analysis... (Budget: ₹12500 - ₹37500 INR, Jobs: Data Entry, Data Processing, Excel)