"Data integrity lost: variable 1, variable 2..." error (Korean text)

[yaoweiwei535]

Version number of KH Coder

beta3

Your Qeuestion

A box appeared during preprocessing, and then the app crashed

[ko-ichi-h]

Please fill out the template below. Especially, attaching the input data file will be great help. This error is often caused by unintended characters being entered away from the actual data.

Version number of KH Coder:
To check the version number, go to "Help" "About" in the menu of KH Coder. Please be sure to enter it correctly, such as "3.Beta.07f", not just "3".

OS
e.g. Windows 10, Ubuntu 20.04

The error message as detailed as possible
Please do not abbreviate or translate the message. Please tell me as it is, verbatim. If you don't like to type, you can attach a screenshot.

To Reproduce
Steps to reproduce the behavior:

1. Go to '...'
2. Click on '....'
3. Scroll down to '....'

Expected behavior
A clear and concise description of what you expected to happen.

What happens if you perform the same operation with the tutorial file (Anne.xls)
Can you get the intended result with tutorial data files? Or you get the same error? Please use "Anne.xls" in "tutorial_en" folder to test it out.

Files to Reproduce the Error
If we can't reproduce the error with the tutorial file "Anne.xls", please consider attaching files that can reproduce the Error.

Language of the Text
What language of text are you trying to analyze?
e.g. English, Spanish

Type of the data file
What kind of file are you trying to analyze?
e.g. Plain text (.txt), Excel (.xlsx), Word (.docx)

Screenshots
If applicable, add screenshots to help explain your problem.

CPU
e.g. Core i7, Atom

Antivirus or Security software running on the PC
e.g. Norton 360, Avast

Additional context
Add any other context about the problem.

Contents of the console window:
Other than errors in pop-up windows, the full console/terminal output really helps. On Windows, you can find the console window by clicking KH Coder icon in the task bar. The window has white texts on a black background.

If it is long, you can save the contents in a text file, Word file, etc. and paste the file. Alternatively, you can attach a screenshot of the console window, but if possible, a copy and paste of the entire content is more likely to give us a clue.

[yaoweiwei535]

Version number of KH Coder:
3.02c official-package

OS：Windows 11

Language of the Text
What language of text are you trying to analyze?
e.g. korean

Type of the data file
What kind of file are you trying to analyze?
e.g. Excel (.xlsx)

[ko-ichi-h]

The file is not attached successfully. Would you try it again?

You may better zip the file and then attach it.

[yaoweiwei535]

[ko-ichi-h]

Can't you attach input Excel file? Not a PNG image.

[ko-ichi-h]

Alternatively, you can try cleaning up the data yourself.

A good place to start is to try the CLEAN function in Excel. Try creating a new Excel file with CLEANed text and making a new KH Coder project with that new file.
https://www.educba.com/clean-in-excel/

[ko-ichi-h]

Also, make sure that you select "text" as the "Target Column" when you create a KH Coder project.

[yaoweiwei535]

I tried the methods you suggested, but after cleaning the text, a new error appeared, as shown in the first image.
text.xlsx

Thanks!

[yaoweiwei535]

Sorry, I deleted my reply because I uploaded the wrong image.

[yaoweiwei535]

Yes, however, the first two columns did not succeed. I uploaded a file named "text."

[yaoweiwei535]

I updated the file as shown in the image, and the result is still the same.

[ko-ichi-h]

OK, I have figured out the problem.

Can you read this post?
#1160 (comment)

I will explain it in English later.

[ko-ichi-h]

For Korean text, the restrictions are strict: you can only enter 1000 characters or less per line. Therefore, you must break lines in a cell before exceeding 1000 characters.

First, I used the CLEAN function of Excel. Next, a new line was inserted in the cell for each sentence. Then the pre-processing was successfully done.

The file is attached:
test_ed.xlsx

---

The "1000 characters or less per line" restriction was taken care of in 3.02d.

[yaoweiwei535]

I can see this discussion. I apologize for disturbing you so late! I’m very sorry. To avoid the same issue in the future, I hope to try the process myself. I’m sorry I didn’t understand immediately.Could you please tell me how to perform the second step? I carefully read your reply. Thank you very much!

[ko-ichi-h]

Well, give me a day or two.

I am going to do something about this "1000 characters per line" restriction.

[yaoweiwei535]

Thank you for your valuable time!

[ko-ichi-h]

OK, in KH Coder 3.02d and later, if a line exceeds 800 characters, it will automatically break into shorter lines. A line break will occur immediately after every period.

If you are using the "KH Coder Official Package" full version like 3.02c (not free limited demo), you can enable this function by following the steps below.

1. Download this file: patch.zip
2. Double click the downloaded patch.zip and you will find a file "kh_dictio.pm"
3. Copy "kh_dictio.pm" and paste it into "kh_lib" folder of your KH Coder. Overwrite the existing file. (You will find the "kh_lib" folder in the same location as the "kh_coder.exe" file.)

Now, just use Excel's CLEAN function and you're good to go.

p.s.
KH Coder 3.02d is an upcoming version, not yet available.

[yaoweiwei535]

The issue has been resolved very well, thank you!