Remove Duplicates

[qjhart]

There are three duplicate codes in the current county_codes.csv file. These need to be removed. I think they are in as seperate country names in the wikidata search.

[qjhart]

The codes are:
FK,NC,NL,YUCS

diff  <(cut -d, -f 1 country_codes.csv | sort) <(cut -d, -f 1 country_codes.csv | sort -u)
84d83
< FK
177d175
< NC
183d180
< NL
266d262
< YUCS

One is exactly Equivalent:

 diff  <(cat country_codes.csv | sort) <(cat country_codes.csv | sort -u)
177d176
< NC,New Caledonia,NCL,1853,,"<?xml version=""1.0"" encoding=""UTF-8""?><svg xmlns=""http://www.w3.org/2000/svg"" width=""900"" height=""600""><rect width=""900"" height=""600"" fill=""#ED2939""/><rect width=""600"" height=""600"" fill=""#fff""/><rect width=""300"" height=""600"" fill=""#002395""/></svg>"

One other shares the same country name as well:

diff  <(cut -d, -f 1,2 country_codes.csv | sort) <(cut -d, -f 1,2 country_codes.csv | sort -u)

84d83
< FK,Falkland Islands
176d174
< NC,New Caledonia

And Two others share the same code

diff  <(cut -d, -f 1,3 country_codes.csv | sort) <(cut -d, -f 1,3 country_codes.csv | sort -u)
177d176
< NC,NCL
183d181
< NL,NLD
266d263
< YUCS,YUG