taskLinterna Mágica - Tasks: task #11216, The way web sites detection and...

 
 

You are not allowed to post comments on this tracker with your current authentification level.

task #11216: The way web sites detection and support is handled should change.

Submitted by:  Ivaylo Valkov <valkov>
Submitted on:  Wed Jun 29 12:30:14 2011  
 
Should Start On: Wed Jun 29 00:00:00 2011Should be Finished on: Tue Jul 26 00:00:00 2011
Category: Code and framework changesPriority: 7 - High
Status: DonePrivacy: Public
Assigned to: Ivaylo Valkov <valkov>Open/Closed: Closed
Planned Release: 0.0.10

Tue Jul 19 10:32:34 2011, comment #1:

Changing the end date secund time. Too much changes are still needed in branch task-11216.

Ivaylo Valkov <valkov>
Project AdministratorIn charge of this item.
Wed Jun 29 12:30:14 2011, original submission:

The main reason for this change is the site specific support. It is
spread in various files. Another reason for the change is the regular
expression that handles most of the sites, the general purpose one. It
is getting big and hard to work with.

The idea is to keep all site specific support in a single file. Some
sites already have most of the specific code in single file, but some
part of the logic is still in other files.

The task requires framework modifications. There is a basic idea in
the TODO file. Every site that requires specific extraction should have
a config template:

This was the first draft. After examining the code it is obvious,
that site specific code is executed at 20 to 30 places
(conditions/entry points). These should be used to make templates for
sites.

An object should be defined that would hold all site specific code:

A key in the object is a web site domain name. Each value is another
object with standard keys, that match the entry points mentioned
above.

An ENTRY_POINT_VALUE, should be a function with predefined arguments
and return value. These functions will be executed at the places where
the site specific code is executed now.

An ENTRY_POINT_VALUE could reference a function for another
site. Either by directly pointing the object or by a string value.
This could be used to reduce code duplication.

Only the entry points that are needed for a site will be defined.

A general purpose extraction code will be used if a site specific code
is not found.

The site specific code/templates for detecting remotely embedded objects
could be moved in the same file that will have all site specific code.

Ivaylo Valkov <valkov>
Project AdministratorIn charge of this item.

 

No files currently attached

 

Depends on the following items: None found

Items that depend on this one: None found

 

Carbon-Copy List
  • -unavailable- added by valkov (Submitted the item)
  •  

    Do you think this task is very important?
    If so, you can click here to add your encouragement to it.
    This task has 0 encouragements so far.

    Only logged-in users can vote.

     

    Please enter the title of George Orwell's famous dystopian book (it's a date):

     

     

    Follow 4 latest changes.

    Date Changed By Updated Field Previous Value => Replaced By
    Tue Jul 26 08:13:57 2011valkovStatusIn Progress=>Done
      Open/ClosedOpen=>Closed
    Tue Jul 19 10:32:34 2011valkovShould be Finished onMon Jul 18 00:00:00 2011=>Tue Jul 26 00:00:00 2011
    Wed Jul 13 09:32:19 2011valkovShould be Finished onWed Jul 13 00:00:00 2011=>Mon Jul 18 00:00:00 2011

    Back to the top


    Powered by Savane 3.1-cleanup1