bugVarnamproject - Bugs: bug #40714, [libvarnam] Update patterns...

 
 

bug #40714: [libvarnam] Update patterns content and see if WITHOUT_ROWID is helpful

Submitted by:  Navaneeth <navaneethkn>
Submitted on:  Wed 27 Nov 2013 05:20:42 AM UTC  
 
Category: libvarnamSeverity: 3 - Normal
Item Group: BugStatus: None
Privacy: PublicAssigned to: None
Open/Closed: Open

Add a New Comment (Rich MarkupRich Markup):
   

You are not logged in

Please log in, so followups can be emailed to you.

 

Sat 22 Mar 2014 08:42:57 AM UTC, comment #2:

Learning time has decreased by a minute, and there is no change in the query plan. Results attached (time_analysis.txt)

(file #30999)

Kevin Martin Jose <lonesword>
Thu 20 Mar 2014 08:22:43 PM UTC, comment #1:

I have used sqlite_analyzer on ml.vst.learnings before and after using 'without rowid' on patterns_content. There is a significant improvement in storage size. The db used to be about 500 mb after learning the word corpus. 'without rowid' shrinked it to 294mb! See the attachments. withoutrowid.txt specifies the stats after using 'without rowid' on patterns_content.

(file #30975, file #30976)

Kevin Martin Jose <lonesword>
Wed 27 Nov 2013 05:20:42 AM UTC, original submission:

Recent version of SQLIte introduced WITHOUT_ROW_ID tables which can improve the storage size and query speed. Try this will patterns_content table and see if it leads to improved query plan.

Navaneeth <navaneethkn>
Project Administrator

 

(Note: upload size limit is set to 16384 kB, after insertion of the required escape characters.)

Attach File(s):
   
   
Comment:
   

Attached Files
file #30999:  time_analysis added by lonesword (431B - application/octet-stream)
file #30975:  withoutrowid.txt added by lonesword (20kB - text/plain)
file #30976:  withrowid.txt added by lonesword (26kB - text/plain)

 

Depends on the following items: None found

Items that depend on this one: None found

 

Carbon-Copy List
  • -unavailable- added by lonesword (Updated the item)
  • -unavailable- added by navaneethkn (Submitted the item)
  •  

    Do you think this task is very important?
    If so, you can click here to add your encouragement to it.
    This task has 0 encouragements so far.

    Only logged-in users can vote.

     

    Please enter the title of George Orwell's famous dystopian book (it's a date):

     

     

    Follow 3 latest changes.

    Date Changed By Updated Field Previous Value => Replaced By
    Sat 22 Mar 2014 08:42:56 AM UTCloneswordAttached File-=>Added time_analysis, #30999
    Thu 20 Mar 2014 08:22:43 PM UTCloneswordAttached File-=>Added withoutrowid.txt, #30975
      Attached File-=>Added withrowid.txt, #30976

    Back to the top


    Powered by Savane 3.1-cleanup