My thoughts about the usability of the program.

Added by Henry Y about 2 years ago

Version of MarkReader and SourceEditor used in the evaluation:
version 2.0

My background and the used of the Shared Questionnaire System:
I work in a University and we have stacks of Student Evaluation forms at the end of the course or semester.
The Student Evaluation consists of 28 single answer questions and 2 free answers.

My objective is to convert all the evalution forms into digital format, and enter it into a database which then get processed.
Ideally the free answer questions is to be converted by an OMR into electronic form (.doc) instead of a picture (jpg, tiff etc)

Problem encounterd in using and implementing the Shared Questionnaire System:
1) There are some inconsistency in the sqm file in defining the x,y coordinates

eg. The 4 black square markers
<master:master master:version="1.3" master:numPages="1" />
<master:corner master:x1="99" master:y1="29" master:x2="497" master:y2="29" master:x3="94" master:y3="810" master:x4="492" master:y4="810" />

Here the x,y coordinates seems to be defining the upper left corner of the marker

The position of the free answers circle
<svg:g id="mark1/0">
<svg:rect x="478.0" y="214.0" width="10.0" height="10.0">

Here the x,y coordinates seems to be the center of the circle

The free answer text area
<svg:g id="textarea30">
<svg:rect svg:x="24.0" svg:y="688.0" svg:width="555.0" svg:height="39.0">

Here the x,y coordinates seems to be the center of the left side of the rectangle.

Note: My suggestion will be to define the x,y coordinates of all points to be the same everywhere. Eg, it always defines the center of the object.

2)
(i) I started creating my questionnaire by using SourceEditor and typing all 28 single answers + 2 free answers
I then extract the sqm and sqs file from the pdf file that it created.

(ii) I then created my custom questionnaire using MS word, and scan the printout into tiff format at 200dpi

(iii) I used an imageviewer (IrfanView) and resize the tiff file to 21 X 29.79cm (A4 size) at 72dpi

(iv) I edited the sqm file x,y position.

(v) When I ran MarkReader it says missing pdf file. I had the .sqm .sqs and .tiff file in the folder

(vi) In the end I had to position the markers to be at the same position as in the sample file sqs-sample-sourcefolder2.zip
and I also used the .sqm and .sqs file in the sqs-sample-sourcefolder2.zip instead of the one generated by SourceEditor.

There are some differences such as svg:y="638.0 instead of y="638.0

With the original sqm file from SourceEditor, MarkReader will says no pdf file, or it will stop processing.

(vii) MarkReader now works fine, and I adjust the .sqm x,y coordinates for the single answer questions to get the exact mark area.

Questions for developer Hiroya Kubo
1) The OMR for the text area is not working. i.e in the web browswer when I navigate to question 30, there is only the picture but the text box next to it is empty.

Has the OMR been impletemented yet or it is not program to recognise english yet?

2) I tried to download the japanese manual from
http://dev.sqs2.net/wiki/sqs/SQS_Manual

but it says
403
You are not authorized to access this page.

3) To make the program practical, is it possible for the program in the web browser to edit the excel file?

For example it's normal to run MarkReader, then the results come out in the webpage. Then I will select all tiff files + all questions.
Click Error No answers, and Error Multiple answers.
I will then make appropriate changes to select the right answer.
Then I export as excel.

However, at present the exported excel file does not contain those corrected answers.

That will be all for today, but I will have to say that the mark recognition works flawlessly and perfectly.

Regards,
Henry.

PS:
1) Remove <page></page> from sqm if you are making a single page file.
2) Thanks for letting me know that using dotted circles makes the recognition a lot more accurate.


Replies (9)

RE: My thoughts about the usability of the program. - Added by Henry Y about 2 years ago

My samples

OMR_sample.zip - Sample of my custom questions including sqm and sqs file (528 KB)

RE: My thoughts about the usability of the program. - Added by Hiroya Kubo almost 2 years ago

Dear Henry,

Sorry for my late reply,

Henry Y wrote:

Version of MarkReader and SourceEditor used in the evaluation: version 2.0

My background and the used of the Shared Questionnaire System: I work in a University and we have stacks of Student Evaluation forms at the end of the course or semester. The Student Evaluation consists of 28 single answer questions and 2 free answers.

Oh, I also work in a university, and I have been leading Student Evaluations of our University for these 4 years with SQS.

My objective is to convert all the evalution forms into digital format, and enter it into a database which then get processed. Ideally the free answer questions is to be converted by an OMR into electronic form (.doc) instead of a picture (jpg, tiff etc)

OK,

Problem encounterd in using and implementing the Shared Questionnaire System: 1) There are some inconsistency in the sqm file in defining the x,y coordinates

eg. The 4 black square markers <master:master master:version="1.3" master:numPages="1" /> <master:corner master:x1="99" master:y1="29" master:x2="497" master:y2="29" master:x3="94" master:y3="810" master:x4="492" master:y4="810" />

Here the x,y coordinates seems to be defining the upper left corner of the marker

No, each of (x1,y1),(x2,y2),(x3,y3),(x4,y4) coordinates is pointed at the center of a black square marker.
I suppose you may misunderstand the meaning of the "corner".

The position of the free answers circle <svg:g id="mark1/0"> <svg:rect x="478.0" y="214.0" width="10.0" height="10.0">

Here the x,y coordinates seems to be the center of the circle

No, the x,y coordinates defines the upper left of the rectangle which is surrounding the mark area represented by the dotted ellipse.

The free answer text area <svg:g id="textarea30"> <svg:rect svg:x="24.0" svg:y="688.0" svg:width="555.0" svg:height="39.0">

Here the x,y coordinates seems to be the center of the left side of the rectangle.

No, the x,y coordinates defines the upper left of the rectangle as the free answer area.

Note: My suggestion will be to define the x,y coordinates of all points to be the same everywhere. Eg, it always defines the center of the object.

I'm confused with your suggestion, I suppose you might misplace the coordinates of 4 black square markers, from the beginning of making your .sqm file.

2) (i) I started creating my questionnaire by using SourceEditor and typing all 28 single answers + 2 free answers I then extract the sqm and sqs file from the pdf file that it created.

(ii) I then created my custom questionnaire using MS word, and scan the printout into tiff format at 200dpi

(iii) I used an imageviewer (IrfanView) and resize the tiff file to 21 X 29.79cm (A4 size) at 72dpi

(iv) I edited the sqm file x,y position.

OK,

(v) When I ran MarkReader it says missing pdf file. I had the .sqm .sqs and .tiff file in the folder

(vi) In the end I had to position the markers to be at the same position as in the sample file sqs-sample-sourcefolder2.zip and I also used the .sqm and .sqs file in the sqs-sample-sourcefolder2.zip instead of the one generated by SourceEditor.

There are some differences such as svg:y="638.0 instead of y="638.0

With the original sqm file from SourceEditor, MarkReader will says no pdf file, or it will stop processing.

(vii) MarkReader now works fine, and I adjust the .sqm x,y coordinates for the single answer questions to get the exact mark area.

I'm very sorry, some versions of SourceEditor(2010-01-??) generate missconfigured .sqm files.
Please launch older versions of SourceEditor(2009-12-??) and drag and drop your .sqs file, and then, regenerate .pdf file.
The .sqm file attached to the .pdf file will work fine.

I will fix these problem in next release. For now, I withdrew the newer version of SourceEditor(2010-01-??) and modified links to SourceEditor launchers.

Questions for developer Hiroya Kubo 1) The OMR for the text area is not working. i.e in the web browswer when I navigate to question 30, there is only the picture but the text box next to it is empty.

Has the OMR been impletemented yet or it is not program to recognise english yet?

I suppose you wanted to say O*C*R(Optical Character Recognition)?

SQS MarkReader has no OCR related feature. As far as I know, there is no opensource OCR software implemented in Java, which can recognize not-isolated offline handwriting alphabet characters.

In your web browser, the text boxes next to the free answer area images are provided for people who want to code its text manually.

2) I tried to download the japanese manual from http://dev.sqs2.net/wiki/sqs/SQS_Manual

but it says 403 You are not authorized to access this page.

Sorry, the target file was removed. I fixed it.

3) To make the program practical, is it possible for the program in the web browser to edit the excel file?

For example it's normal to run MarkReader, then the results come out in the webpage. Then I will select all tiff files + all questions. Click Error No answers, and Error Multiple answers. I will then make appropriate changes to select the right answer. Then I export as excel.

However, at present the exported excel file does not contain those corrected answers.

I suppose you may use a folder which has nested folder structures for MarkReader.
For now, MarkReader has serious bugs in handling nested folder structures.
I think you will succeed in using single depth folders for MarkReader.

Hiroya

RE: My thoughts about the usability of the program. - Added by Henry Y almost 2 years ago

Hiroya Kubo wrote:

3) To make the program practical, is it possible for the program in the web browser to edit the excel file?

For example it's normal to run MarkReader, then the results come out in the webpage. Then I will select all tiff files + all questions. Click Error No answers, and Error Multiple answers. I will then make appropriate changes to select the right answer. Then I export as excel.

However, at present the exported excel file does not contain those corrected answers.

I suppose you may use a folder which has nested folder structures for MarkReader. For now, MarkReader has serious bugs in handling nested folder structures. I think you will succeed in using single depth folders for MarkReader.

Hiroya

Dear Hiroya,
I think you have misunderstood the last question that you replied. Maybe I can clarify it a bit.

If you look at the attached picture you will have a better understanding. In the picture I have to choose the correct answer as (4) Strongly agree. But after doing that, I want to export to spreadsheets.
The problem is that when I export to spread sheet, the answer that I just manually entered is not reflected in the exported spreadsheet.

Is there any solution to this problem?

Thanks again for your previous reply.

Regards,
Henry Yuen

excel1.JPG - recognition problem in OMR (86.6 KB)

excel2.JPG - manually choosing the right answer (86.9 KB)

excel3.JPG - excel spreadsheet not adjusted to reflect correct answer (61.9 KB)

RE: My thoughts about the usability of the program. - Added by Hiroya Kubo almost 2 years ago

Dear Henry,

Sorry for my late reply again.
(For now, I don't have enough time to develop SQS... My baby girl was born in last weekend.)

Thank you for your description and attached pictures, I can reproduce your problem. This is a bug of AJAX code.
I think It will require substantial time to fix, a certain numbers of code must be fully rewritten. It is too complicated...
Please wait for a while...

RE: My thoughts about the usability of the program. - Added by Henry Y almost 2 years ago

Dear Hiroya,

First of all, congratulations for having a baby girl :) She must be three weeks old now.

If you can instruct me where to find the source code of the program, maybe I can help you fix it.

And please let me know, which software you used to develop the program (eclispe, ibm java etc..)

Regards,
Henry Yuen.

RE: My thoughts about the usability of the program. - Added by mustafa kurul almost 2 years ago

Hi Hiyora, i learned now that you had baby. Congratulations :)
I hope she will grow healthy.

RE: My thoughts about the usability of the program. - Added by Hiroya Kubo almost 2 years ago

Dear Henry,

Thank you for your congratulations!

If you can instruct me where to find the source code of the program, maybe I can help you fix it.

And please let me know, which software you used to develop the program (eclispe, ibm java etc..)

Thanks again,

Please see:
http://dev.sqs2.net/wiki/sqs/Developer_Documentation

Hiroya

RE: My thoughts about the usability of the program. - Added by Hiroya Kubo almost 2 years ago

Dear mustafa,

Thank you!

and sorry for slow down of my developing speed...

RE: My thoughts about the usability of the program. - Added by mustafa kurul almost 2 years ago

I am very happy to hear a word from you :)

(1-9/9)