[Dspace-tech] filter-media IOException Permission denied

Discussion:

Van Ly

2009-07-17 07:10:54 UTC

Hi,

I ran a filter-media job and found a number of errors of the kind
`skipping bitstream #N' which to be expected. The very first of them
is listed below. At a guess, it looks like the IOException is due to
the process wanting to create a file but it already exists and this is
a condition for complaint. Do you think if I gave it the `force'
option, this kind of IOException would go away?

bitstream #3636 is fine, I can search for and retrieve it according to handle id.

Thanks in advance.

-- Van Ly

-- details of 1.4.2 Dspace as follows with attempt to interpret the stack trace

[0] // open(2) with O_RDWR | O_CREAT | O_EXCL may fail if file already exists
[1] // has GeneralFile file = getFile(bitstream); file.createNewFile();
[2] // has Bitstream b = targetBundle.createBitstream(destStream);
[3] // MediaFilterManager.java:108 has option to "force all bitstreams to be processed"

... ERROR filtering, skipping bitstream #3636 java.io.IOException: Permission denied
... java.io.IOException: Permission denied
... at java.io.UnixFileSystem.createFileExclusively(Native Method)
[0] at java.io.File.createNewFile(File.java:850)
... at edu.sdsc.grid.io.local.LocalFile.createNewFile(LocalFile.java:486)
[1] at org.dspace.storage.bitstore.BitstreamStorageManager.store(BitstreamStorageManager.java:332)
... at org.dspace.content.Bitstream.create(Bitstream.java:184)
... at org.dspace.content.Bundle.createBitstream(Bundle.java:362)
[2] at org.dspace.app.mediafilter.MediaFilter.processBitstream(MediaFilter.java:168)
... at org.dspace.app.mediafilter.MediaFilterManager.filterBitstream(MediaFilterManager.java:327)
... at org.dspace.app.mediafilter.MediaFilterManager.filterItem(MediaFilterManager.java:296)
... at org.dspace.app.mediafilter.MediaFilterManager.applyFiltersItem(MediaFilterManager.java:266)
... at org.dspace.app.mediafilter.MediaFilterManager.applyFiltersAllItems(MediaFilterManager.java:234)
[3] at org.dspace.app.mediafilter.MediaFilterManager.main(MediaFilterManager.java:185)

Mr Havercamp

2009-07-17 08:22:40 UTC

Permalink

Correct, java.io.File will throw an IOException error if the
createNewFile method attempts to create a new file over the top of an
existing one.

Running filter-media with the -v should force the update on existing
files as well as creating new ones.

Cheers

Hayden

Post by Van Ly
Hi,
I ran a filter-media job and found a number of errors of the kind
`skipping bitstream #N' which to be expected. The very first of them
is listed below. At a guess, it looks like the IOException is due to
the process wanting to create a file but it already exists and this is
a condition for complaint. Do you think if I gave it the `force'
option, this kind of IOException would go away?
bitstream #3636 is fine, I can search for and retrieve it according to handle id.
Thanks in advance.
-- Van Ly
-- details of 1.4.2 Dspace as follows with attempt to interpret the stack trace
[0] // open(2) with O_RDWR | O_CREAT | O_EXCL may fail if file already exists
[1] // has GeneralFile file = getFile(bitstream); file.createNewFile();
[2] // has Bitstream b = targetBundle.createBitstream(destStream);
[3] // MediaFilterManager.java:108 has option to "force all bitstreams to be processed"
... ERROR filtering, skipping bitstream #3636 java.io.IOException: Permission denied
... java.io.IOException: Permission denied
... at java.io.UnixFileSystem.createFileExclusively(Native Method)
[0] at java.io.File.createNewFile(File.java:850)
... at edu.sdsc.grid.io.local.LocalFile.createNewFile(LocalFile.java:486)
[1] at
org.dspace.storage.bitstore.BitstreamStorageManager.store(BitstreamStorageManager.java:332)
... at org.dspace.content.Bitstream.create(Bitstream.java:184)
... at org.dspace.content.Bundle.createBitstream(Bundle.java:362)
[2] at
org.dspace.app.mediafilter.MediaFilter.processBitstream(MediaFilter.java:168)
... at
org.dspace.app.mediafilter.MediaFilterManager.filterBitstream(MediaFilterManager.java:327)
... at
org.dspace.app.mediafilter.MediaFilterManager.filterItem(MediaFilterManager.java:296)
... at
org.dspace.app.mediafilter.MediaFilterManager.applyFiltersItem(MediaFilterManager.java:266)
... at
org.dspace.app.mediafilter.MediaFilterManager.applyFiltersAllItems(MediaFilterManager.java:234)
[3] at
org.dspace.app.mediafilter.MediaFilterManager.main(MediaFilterManager.java:185)
------------------------------------------------------------------------
------------------------------------------------------------------------------
Enter the BlackBerry Developer Challenge
This is your chance to win up to $100,000 in prizes! For a limited time,
vendors submitting new applications to BlackBerry App World(TM) will have
the opportunity to enter the BlackBerry Developer Challenge. See full prize
details at: http://p.sf.net/sfu/Challenge
------------------------------------------------------------------------
_______________________________________________
DSpace-tech mailing list
https://lists.sourceforge.net/lists/listinfo/dspace-tech

Van Ly

2009-07-20 03:31:41 UTC

Permalink

Thanks for that. If filter-media is applied on package ingest, is it
necessary to run it as cronjob at all?

-- Van Ly

Post by Mr Havercamp
Correct, java.io.File will throw an IOException error if the
createNewFile method attempts to create a new file over the top of an
existing one.
Running filter-media with the -v should force the update on existing
files as well as creating new ones.
Cheers
Hayden

------------------------------------------------------------------------------
Enter the BlackBerry Developer Challenge
This is your chance to win up to $100,000 in prizes! For a limited time,
vendors submitting new applications to BlackBerry App World(TM) will have
the opportunity to enter the BlackBerry Developer Challenge. See full prize
details at: http://p.sf.net/sfu/Challenge
_______________________________________________
DSpace-tech mailing list
https://lists.sourceforge.net/lists/listinfo/dspace-tech

----------------------------------------------------------------
This message was sent using IMP, the Internet Messaging Program.

Mr Havercamp

2009-07-20 06:29:48 UTC

Permalink

No but it makes it easier to manage thumb and preview generation if you do.

Post by Van Ly
Thanks for that. If filter-media is applied on package ingest, is it
necessary to run it as cronjob at all?
-- Van Ly

----------------------------------------------------------------
This message was sent using IMP, the Internet Messaging Program.
------------------------------------------------------------------------------
Enter the BlackBerry Developer Challenge
This is your chance to win up to $100,000 in prizes! For a limited time,
vendors submitting new applications to BlackBerry App World(TM) will have
the opportunity to enter the BlackBerry Developer Challenge. See full prize
details at: http://p.sf.net/sfu/Challenge
_______________________________________________
DSpace-tech mailing list
https://lists.sourceforge.net/lists/listinfo/dspace-tech