Skip to main content

Unicode/UTF-8 characters (Chinese characters, Barcodes, etc.) and CSV files

Unicode/UTF-8 characters (Chinese characters, Barcodes, etc.) and CSV files

Simple CSV files do not support Unicode/UTF-8 characters. This is a limitation of the CSV format and not something that can be changed in Cin7 Core. However, it is possible to import/export Unicode characters following these steps. This article shows the process for Windows machines. Unfortunately, Excel 2016 for Mac is the only version to support this format.

Excel 2016 for Mac only

Unicode/UTF-8 characters include:

  • Chinese characters

  • any non-Latin scripts (Hebrew, Cyrillic, Japanese, etc.)

  • symbols

  • barcodes.

 

Note: If you export a file in the correct format and save it as a simple CSV, the characters will be overwritten and CANNOT be reverted to the correct format. If the overwritten file is then imported into Cin7 Core, it will overwrite the characters in the system, and they CANNOT be recovered. This is a limitation of the CSV format that is beyond Cin7 Core's control.

We recommend keeping a backup in Excel format (.xls or .xlsx) with the correctly formatted Chinese characters (or other Unicode characters) in case files from Cin7 Core get overwritten.

If data has been corrupted, there is nothing we can do; the only thing to do is to input the characters again in Cin7 Core, or input the characters in Excel, save to CSV, and import.

Exporting CSV files with Unicode characters

You must first change the General Settings, so export files use the correct encoding.

  1. Navigate to Settings → General Settings → Organisation.

  2. Check that Export CSV File Encoding is set to Unicode.

  

Viewing and Editing CSV files with Unicode characters

Unicode files CANNOT be opened in Excel by double-clicking the file – the Unicode characters will not display correctly and be damaged. If a file opened in this way is saved, it will overwrite and corrupt the exported file.

You can check that correct details have been exported by opening the file in Notepad. To view Unicode characters in Excel, follow the steps below.

Note: MS Excel for Mac 2011 does not open CSV files with Unicode encoding.

View Unicode characters in Excel:

  1. Open Excel from your menu or Desktop. DO NOT double-click the exported file to open Excel.

  2. Navigate to Data → Get External Data → From Text. This may look a bit different depending on which version of Excel you are running.
         
         

  3. Navigate to the location of the CSV file you want to import.
         

  4. Choose the Delimited option.

  5. Set the character encoding File Origin to 65001: Unicode (UTF-8) from the drop-down list.

  6. Check My data has headers so that Excel recognises that the first row of the CSV file has column names.

  7. Click Next to display the second step of Text Import Wizard.
         

  8. Set the delimiter to Comma.

  9. Click Next to move on to the next step.
         

  10. Select all columns and set Column data format to Text.

  11. Click OK and then Finish.
         

  12. Keep the default values inside the Import Data dialogue and click OK.
         

  13. Now you can make modifications to the file and save the file as an Excel document or a CSV file.

Saving an Excel file as CSV with unicode encoding

In some cases, you will be working with a new spreadsheet, not one that was exported from Cin7 Core. You will need to save your Excel spreadsheet as a CSV file with unicode encoding in order to import it correctly into Cin7 Core without corrupting the special characters.

The steps are as given below:

  1. Open an Excel file with Microsoft Excel.

    • DO NOT double-click on a CSV file exported from Cin7 Core to open it in Excel - it will corrupt any Unicode characters.

  2. Navigate to File → Save As.

  3. Navigate to Browseto select a location to save the file.

  4. The Save As window appears as shown below.

  5. Next, enter the name of the file.

  6. Select the Save as type as CSV (Comma delimited) (*.csv)option.

  7. Click Tools drop-down box and click Web Options. A new window for web options appears.

  8. Under Encoding tab, select the option Unicode (UTF-8) from Save this document asdrop-down list.

  9. Finally, click OK,and save the file.

Importing CSV files with Unicode characters

The final step is to import the modified file back into Cin7 Core. You can import the file from the same screen that you exported from.

Note: You must only use the CSV file that you have JUST saved from the Excel file. If you open the CSV file, make changes, then save it again, this will remove all the UTF/Unicode characters. If you want to make changes, you must make them in the Excel file.

If a file with corrupted Unicode/UTF-8 characters is uploaded to Cin7 Core, it will corrupt the data in Cin7 Core, and there is nothing we can do to restore it. The only thing to do is to input the characters again in Cin7 Core, or input the characters in Excel, save to CSV, and import.

Was this article helpful?

Have more questions? Submit a request