Samizdat - Patches: patch #6554, guess_lang patch 0.4.1 [vs...
You are not allowed to post comments on this tracker with your current authentication level.
patch #6554: guess_lang patch 0.4.1 [vs 080703-2]
Submitter: | Boud Roukema <boud> | ||
Submitted: | Thu 26 Jun 2008 12:59:48 AM UTC | ||
Category: | None | Priority: | 5 - Normal |
Status: | Works For Me | Privacy: | Public |
Assigned to: | None | Open/Closed: | Open |
Jump to the original submission
Mon 20 Apr 2009 03:43:03 PM UTC, comment #7: |
Dmitry Borodaenko <angdraug>![]() |
Mon 20 Apr 2009 02:31:32 PM UTC, comment #6: As long as it is possible to re-use an existing library for this functionality, it doesn't make sense to implement our own incomplete solution.
|
Dmitry Borodaenko <angdraug>![]() |
Fri 22 Aug 2008 11:44:27 PM UTC, comment #5: Version 0.4.1 has a trivial change in the path for the new file for the first file to modify. This is just being uploaded to help a little with systematic treatment of the patches. |
Boud Roukema <boud>![]() |
Mon 18 Aug 2008 08:49:40 PM UTC, comment #4: Version 0.4 moves the check on the length of a string to the guessable_lang method in guess_lang.rb. The motivation is to avoid giving readers comments about a suspected language error in cases where the text is too short to expect a reasonably high accuracy.
|
Boud Roukema <boud>![]() |
Sat 16 Aug 2008 10:19:39 PM UTC, comment #3: 0.3.1 has been cleaned of debugging comments which had been left in place in 0.3. |
Boud Roukema <boud>![]() |
Sat 16 Aug 2008 01:10:41 AM UTC, comment #2: Version 0.3 has rough detection algorithms for four languages in utf-8: en, fr, ja, pl. Messages in fr and pl written in ascii (due to people having problems with non-ascii character input) should have a fair chance of being detected as well.
|
Boud Roukema <boud>![]() |
Wed 02 Jul 2008 12:24:46 AM UTC, comment #1: Patch version 0.2 is the same as 0.1, except that .to_s is used on body before using the guess_lang method. This avoids having an error in case the body is nil. In situations where a nil body is a problem, this should be flagged earlier - it should not be a problem for guess_lang.
|
Boud Roukema <boud>![]() |
Thu 26 Jun 2008 12:59:48 AM UTC, original submission:
PROBLEM: People publish messages without remembering to check what language was selected by samizdat or by them. The result is a message which is really in, e.g. english but is labelled as being in japanese, or vice versa.
|
Boud Roukema <boud>![]() |
Depends on the following items: None found
Items that depend on this one: None found
Follow 11 latest changes.
Date | Changed by | Updated Field | Previous Value | => | Replaced by |
---|---|---|---|---|---|
2008-08-22 | boud | Attached File | - | ![]() |
Added 080823_guess_lang-0.4.1.patch, #16336 |
Summary | guess_lang patch 0.4 [vs 080703-2] | ![]() |
guess_lang patch 0.4.1 [vs 080703-2] | ||
2008-08-18 | boud | Attached File | - | ![]() |
Added 080818_guess_lang-0.4.patch, #16312 |
Summary | guess_lang patch 0.3.1 [vs 080703-2] | ![]() |
guess_lang patch 0.4 [vs 080703-2] | ||
2008-08-16 | boud | Summary | guess_lang patch 0.3 [vs 080703-2] | ![]() |
guess_lang patch 0.3.1 [vs 080703-2] |
2008-08-16 | boud | Attached File | - | ![]() |
Added 080815_guess_lang-0.3.1.patch, #16302 |
2008-08-16 | boud | Attached File | - | ![]() |
Added 080815_guess_lang-0.3.patch, #16297 |
Summary | guess_lang patch 0.2 | ![]() |
guess_lang patch 0.3 [vs 080703-2] | ||
2008-07-02 | boud | Attached File | - | ![]() |
Added 080702_guess_lang-0.2.patch, #15979 |
Summary | guess_lang patch 0.1 | ![]() |
guess_lang patch 0.2 | ||
2008-06-26 | boud | Attached File | - | ![]() |
Added 080626_guess_lang-0.1.patch, #15945 |
I've just got a response back from libtextcat authors: they do plan to release a new version that would address the encoding issue later this year.