Community Forum

Total Posts: 9 - Pages (1): [1]
user picture Author: Reuven Cohen
Posted: Apr 05 2008 - 10:11 AM
Subject: ElasticDrive Support
Ask any questions you have about ElasticDrive.
Download available here > http://www.elasticdrive.com
Author: mark hellewell
Posted: Apr 07 2008 - 12:44 AM
Subject: re: ElasticDrive Support
Hi there, thanks for earlier help with e2fsck; it did the trick! I have another question, if you're able to help please?

I'm running version 4.1 of ElasticDrive, backed with S3, and am having a few issues at the moment when writing large files (~60 meg or so) to a mounted s3 partition (not RAID). The application that is writing the data seems to get bored of waiting for the data to be written to S3 and times out. Now, I've done some searching on the old AWS support forum and found mention of a 'cache size' option but can't find it in the documentation. Does this option still exist? I think I basically want to increase it so that files "written" to the partition appear to happen quickly. Do I have the right idea or is there another solution you would suggest?

Thanks for any help!
Mark
Author: Max Sev
Posted: Apr 21 2008 - 06:35 PM
Subject: Cann't format filesystem
Hello.
I do this as root at Amazon Ec2 Fedora 8 32-bit instance:

#yum install fuse fuse-devel python-devel python-ctypes python-fuse
#modprobe fuse
#modprobe nbd
edit /etc/elasticdrive.cfg, write right keys and bucket name

[global]
configured=0
fusermount="/usr/bin/fusermount"
pidfile="/var/run/elasticdrive.pid"

[logging]
filename='/var/log/elasticdrive.log'
level=logging.ERROR

[servers]
modules=""

[engines]
modules=""

[drives]
#Path to fuse is the path to the device mount folder. NOT your fuse libraries
fuseblock|/mnt/s3dir="s3://---MY_ACCESS_KEY---:--MY_SECRET_KEY--@aws.amazon.com/?bucket=MY_BUCKET&stripesize=65536&blocksize=4096&blocks=6553600&sizebyblocks=1"


#elasticdrive /etc/elasticdrive.cfg -d
#mkdir -p /mnt/s3dev/ed0
#mke2fs -b 4096 /mnt/s3dev/ed0
At this step I have an error:
Device size reported to be zero. Invalid partition specified, or
partition table wasn't reread after running fdisk, due to
a modified partition being busy and in use. You may need to reboot
to re-read your partition table


So I can't do that 2 commands:
#mkdir /s3
#mount /mnt/s3dev/ed0 /s3 -o loop

and I can't create Elastic Drive.

Can you help me?

Max
Author: Chad Heimbecker
Posted: Aug 14 2008 - 05:22 PM
Subject: re: ElasticDrive Support
Hello,

I am having the same problem with mke2fs as Max above when following your usage & installation instructions.

Has there been any progress or solution to this?

I am running on a x64 FC6 image on EC2. I ran through install no problems, and have modprobe fuse loaded and elasticdrive running, as checked with ps. But I cannot create my mounting filesystem when running:
# mke2fs -b 4096 /mnt/ed0
/mnt/ed0 is not a block special device.
Proceed anyway? (y,n) y
Device size reported to be zero. Invalid partition specified, or
partition table wasn't reread after running fdisk, due to
a modified partition being busy and in use. You may need to reboot
to re-read your partition table

What do I need to do in order to check proper function and/or solve this partition problem?

Any insight is appreciated.

-Chad Heimbecker
Author: Humayun Ghani
Posted: Aug 19 2008 - 10:39 AM
Subject: re: re: ElasticDrive Support
Did you format that partition after mounted it? I think you need to format it so that it could become valid filesystem.
Author: Pat Wendorf
Posted: Aug 19 2008 - 11:04 AM
Subject: re: ElasticDrive Support
The problem he ran into was a missing device node to actually format, I chatted with him on the phone and I have one of our developers looking into the problem. Also when you setup your fuse line to /mnt/ed0, the device itself will be /mnt/ed0/ed0, odd but valid.
Author: Humayun Ghani
Posted: Aug 21 2008 - 02:52 PM
Subject: re: ElasticDrive Support
Hello,
I do this as root at EC2 Fedora6 64-bit instance. I have updated all the required fuse python
and other related libraries. Installed elasticdrive successfully.

Then ran these commands,
mkdir -p /fuse2 /data/s3

elasticdrive /etc/elasticdrive.ini -d
ps aux | grep elastic
Got my elasticdrive running there. It got my bucket also.

But when I run ls -al /fuse2
I don't see ed0. I think that's why when I try to run this
mke2fs -b 4096 /fuse2/ed0
mke2fs 1.39 (29-May-2006)
Could not stat /fuse2/ed0 --- No such file or directory

The device apparently does not exist; did you specify it correctly?


Not sure what I did wrong and what to do now?
Here is my config,
[global]
configured=1
fusermount="/usr/bin/fusermount"
pidfile="/var/run/elasticdrive.pid"

[logging]
filename='/var/log/elasticdrive.log'
level=logging.ERROR


[servers]
modules=""

[engines]
modules=""

[drives]
#Path to fuse is the path to the device mount folder. NOT your fuse libraries
fuseblock|/fuse2="s3://xxxxx:xxxxxxx@aws.amazon.com/?bucket=mytestbucket&stripesize=65536&blocksize=4096&blocks=6553600&sizebyblocks=1&maxthreads=5&ttl=40"



Any help would be appreciated.
Author: Pat Wendorf
Posted: Aug 21 2008 - 03:46 PM
Subject: re: ElasticDrive Support
This is the exact same issue we're seeing on some installs, I have one of the developers looking into it to see if it can be reproduced locally. The symptoms are always the same... the ed0 device node is not showing up when ElasticDrive is running. I'll keep you guys posted here.
Author: Greg Larkin
Posted: Oct 30 2008 - 12:17 AM
Subject: re: re: ElasticDrive Support
Hi Pat,

Do you have any updates on the problem, re: ed0 not appearing in the filesystem? I am running ED inside a CentOS 5.2 VMware virtual machine and have seen this problem.

Strangely, when I run ED in foreground mode, the ed0 file appears, but if I use "-d" to make an ED daemon, the file does not appear.

Can I provide anything else (log file, strace output, etc.) to help you troubleshoot the problem?

Regards,
Greg Larkin
http://www.sourcehosting.net/
Total Posts: 9 - Pages (1): [1]
You must login to post a message to this conference.

Login or Signup to post to the ECP Community Center

IRC: irc.freenode.net #enomalism