bugGluster - Bugs: bug #17283, XLATOR - AdaptiveLU

 
 

bug #17283: XLATOR - AdaptiveLU

Submitter:  Anand Avati <avati>
Submitted:  Thu 03 Aug 2006 03:02:50 PM UTC
   
 
Category:  GlusterFS Severity:  5 - Blocker
Priority:  7 - High Item Group:  Missing Feature
Status:  Fixed Privacy:  Public
Assigned to:  amarts Originator Name:  *
Open/Closed:  Closed Release: 
Operating System:  GNU/Linux Reproducibility:  None
* Mandatory Fields

Add a New Comment Rich Markup
   

Tue 22 Aug 2006 10:59:46 PM UTC, comment #2: 

User gets to decide priority and threshold-factor for each of the limits.

--------------------------------------------------
option scheduler adaptive-lu
# Order and threshols of selected schedulers
option threshold disk-usage(2048000) file-usage(32) mem-usage(4096) disk-speed(4096)
# 6th node is a slow storage
option brick-priority 1-5:0, 6:100
# Include only the bricks that has at-least 60GB free disk space
option disk-minimum-free 61440000000
--------------------------------------------------

Explaination:
=============
if (> (- max-du min-du) 2GB), pick the min-du
if (> (- max-file-usage min-file-usage) 32) pick min-file-usage
..
if (> (- fastest-disk-speed slowest-disk-speed) 4MBps) pick fastest-disk-speed

Apply priority, when more than one brick is selected by above logic.
Apply rand(count) if more than one brick has same priority.

--
Anand Babu

Anand Babu Periasamy <ab>
Group administrator
Tue 22 Aug 2006 06:41:24 PM UTC, comment #1: 

Creating a file is an atomic action, so it can't be done with achieving 100% distribution.

So, while creating a file, a central control is required to achieve this atomicity. This needs a locking server in fs. Implemetation details of this locking server will be posted later.

About scheduling (using ALU algorithm) that file, please correct me with priorities to be given.

Amount of free space #1
Number of files open #2
Amount of RAM usage  #3
...

Add to the list, or correct the list.

Amar Tumballi <amarts>
Group Member
Thu 03 Aug 2006 03:02:50 PM UTC, original submission:  

Adaptive Least (resource) Used xlator for distributing file creating on subvolumes

Anand Avati <avati>
Group Member

 

(Note: upload size limit is set to 16384 kB, after insertion of the required escape characters.)

Attach Files:
   
   
Comment:
   

No files currently attached

 

Digest:
   bug dependencies.

Items that depend on this one: None found

 

CC list is empty

 

There are 0 votes so far. Votes easily highlight which items people would like to see resolved in priority, independently of the priority of the item set by tracker managers.

Only logged-in users can vote.

 

Follow 7 latest changes.

Date Changed by Updated Field Previous Value => Replaced by
2006-09-14 avati StatusIn Progress Fixed
    Open/ClosedOpen Closed
2006-08-07 avati Dependencies- Depends on bugs #17352
2006-08-07 avati Dependencies- Depends on bugs #17353
2006-08-05 amarts StatusNone In Progress
2006-08-03 avati Priority5 - Normal 7 - High
2006-08-03 avati Assigned toNone amarts

Back to the top

Powered by Savane 3.14-d582.
Corresponding source code