Fisheye huge I\O load and slow content indexing

Hi

INVENTORY:

I have fisheye 2.6.2 on centos 5.6 x32 with 3Gb of RAM and 4 cpu cores.

My fishyey opts and arg:

/usr/bin/java -Xms2048m -Xmx2048m -XX:MaxPermSize=256m -Xss512k -XX:MaxNewSize=128m -Dfisheye.library.path= -Dfisheye.inst=/srv/fecru262 -Djava.awt.headless=true -Djava.endorsed.dirs=/srv/fecru262/lib/endorsed -jar /srv/fecru262/fisheyeboot.jar start --Xdisable-dirtree-empty-checks --Xdisable-content-indexing

Repository resides on fisheye server file:///srv/svn-mirror/mirror-rps

iostat -xmn 1 shows huge I\O load generated by fisheye, ~700 writte operation per second. This load persists about a week on INTEL 320 SSD 80GB and content indexing of repository is not finished.

Device: rrqm/s wrqm/s r/s w/s rMB/s wMB/s avgrq-sz avgqu-sz await svctm %util
sdd 0.00 1.00 52.00 765.00 0.42 8.00 21.12 0.16 0.19 0.14 11.10

PROBLEM

1.

iostat -xmn 1 shows huge I\O load generated by fisheye, ~700 writte operation per second. This load persists about a week on INTEL 320 SSD 80GB and content indexing of repository is not finished.

Device: rrqm/s wrqm/s r/s w/s rMB/s wMB/s avgrq-sz avgqu-sz await svctm %util
sdd 0.00 1.00 52.00 765.00 0.42 8.00 21.12 0.16 0.19 0.14 11.10

2. Repository browsing is very slow



I have read all Atlassian documentation abou it and can`t resove issue. Please help me resolve this perfomance issue.

3 answers

This widget could not be displayed.

Hmm, some quick starter questions

  1. How big is your repository?
  2. How is it structured? I mean, is it lots of little repos, or just one big monolithic one? If it is one huge one, have you told Fisheye to scan the whole lot, or just bits of it?
  3. If it's a large single repo, how many revisions are you on?

1. 400MB

2. One big repo with many subdirectories. I told to scan it all (no option, i must did such)

3. 8115 revisions

Ok, that rules out the scalability problem - Fisheye can't cope with a large repo - my current client is on around 60Gb and 500,000 revisions, and Fisheye stopped coping around 250,000 revisions. But 8000 in a 400Mb repo is fine.

Do not know which way to dig. Just out of ideas

Any ideas will be greatky apricated!

This widget could not be displayed.

I would open a request with Atlassian support. We had a similar issue and it was down to the way the trunk, branches and tags were setup in FE, i.e. the reg ex, etc.

We ended up not indexing tags as we were never going to use it for reviews. And we were never going to look at tags in FE either. That took our scan from over 2 weeks and still uncompleted down to a day and a half all done.

What atlassian suport recomend you to do? Do you have any patches or issue references about this problem?

This widget could not be displayed.

A normal trunk/tags/branches repo with 8K commits and 400MB should take about 2 hours at most - factors that can make it slower are lots of tags and branches, lots of complex tags and branches, svn files being on NFS or other network file system or an incorrect symbolic setup (i.e. not using a standard trunk/tags/branches and not changing FishEyes config to cope).

I recommend going to https://support.atlassian.com and opening a suport request.

Suggest an answer

Log in or Sign up to answer
Atlassian Summit 2018

Meet the community IRL

Atlassian Summit is an excellent opportunity for in-person support, training, and networking.

Learn more
Community showcase
Posted Wednesday in New to Jira

Are you planning to trial, or are currently trialling Jira Software? - We want to talk to you!

Hello! I'm Rayen, a product manager at Atlassian. My team and I are working hard to improve the trial experience for Jira Software Cloud. We are interested in   talking to 20 people planning t...

150 views 2 0
Join discussion

Atlassian User Groups

Connect with like-minded Atlassian users at free events near you!

Find a group

Connect with like-minded Atlassian users at free events near you!

Find my local user group

Unfortunately there are no AUG chapters near you at the moment.

Start an AUG

You're one step closer to meeting fellow Atlassian users at your local meet up. Learn more about AUGs

Groups near you