bugGluster - Bugs: bug #17283, XLATOR - AdaptiveLU

 
 

bug #17283: XLATOR - AdaptiveLU

Submitted by:  Anand Avati <avati>
Submitted on:  Thu 03 Aug 2006 03:02:50 PM UTC  
 
Category: GlusterFSSeverity: 5 - Blocker
Priority: 7 - HighItem Group: Missing Feature
Status: FixedPrivacy: Public
Assigned to: Amar Tumballi <amarts>Originator Name: 
Open/Closed: ClosedRelease: 
Operating System: GNU/LinuxReproducibility: None

Add a New Comment(Rich Markup)
   

You are not logged in

Please log in, so followups can be emailed to you.

 

Tue 22 Aug 2006 10:59:46 PM UTC, comment #2:

User gets to decide priority and threshold-factor for each of the limits.

--------------------------------------------------
option scheduler adaptive-lu
# Order and threshols of selected schedulers
option threshold disk-usage(2048000) file-usage(32) mem-usage(4096) disk-speed(4096)
# 6th node is a slow storage
option brick-priority 1-5:0, 6:100
# Include only the bricks that has at-least 60GB free disk space
option disk-minimum-free 61440000000
--------------------------------------------------

Explaination:
=============
if (> (- max-du min-du) 2GB), pick the min-du
if (> (- max-file-usage min-file-usage) 32) pick min-file-usage
..
if (> (- fastest-disk-speed slowest-disk-speed) 4MBps) pick fastest-disk-speed

Apply priority, when more than one brick is selected by above logic.
Apply rand(count) if more than one brick has same priority.

--
Anand Babu

Anand Babu <ab>
Project Administrator
Tue 22 Aug 2006 06:41:24 PM UTC, comment #1:

Creating a file is an atomic action, so it can't be done with achieving 100% distribution.

So, while creating a file, a central control is required to achieve this atomicity. This needs a locking server in fs. Implemetation details of this locking server will be posted later.

About scheduling (using ALU algorithm) that file, please correct me with priorities to be given.

Amount of free space #1
Number of files open #2
Amount of RAM usage #3
...

Add to the list, or correct the list.

Amar Tumballi <amarts>
Project MemberIn charge of this item.
Thu 03 Aug 2006 03:02:50 PM UTC, original submission:

Adaptive Least (resource) Used xlator for distributing file creating on subvolumes

Anand Avati <avati>
Project Member

 

(Note: upload size limit is set to 16384 kB, after insertion of the required escape characters.)

Attach File(s):
   
   
Comment:
   

No files currently attached

 

Digest:
   bug dependencies.

Items that depend on this one: None found

 

CC list is empty

 

Do you think this task is very important?
If so, you can click here to add your encouragement to it.
This task has 0 encouragements so far.

Only logged-in users can vote.

 

Please enter the title of George Orwell's famous dystopian book (it's a date):

 

 

Follow 7 latest changes.

Date Changed By Updated Field Previous Value => Replaced By
Thu 14 Sep 2006 01:44:35 PM UTCavatiStatusIn Progress=>Fixed
  Open/ClosedOpen=>Closed
Mon 07 Aug 2006 12:43:10 PM UTCavatiDependencies-=>Depends on bugs #17352
Mon 07 Aug 2006 12:41:22 PM UTCavatiDependencies-=>Depends on bugs #17353
Sat 05 Aug 2006 06:36:04 PM UTCamartsStatusNone=>In Progress
Thu 03 Aug 2006 11:32:30 PM UTCavatiPriority5 - Normal=>7 - High
Thu 03 Aug 2006 08:48:01 PM UTCavatiAssigned toNone=>amarts

Back to the top


Powered by Savane 3.1-cleanup1