The File is currently checked out or locked for editing by another user

Steps to resolve this issue

Go to Library Settings

Select Manage files which have no checked in version

It will list out files checked out and we need to select particular documents located in this folder and take ownership of those docs.

Now we can remove the library.