Put resulting data from more_data into memory
Closed this issue · 6 comments
@MiguelAngelRG suggested that to solve issues with low image quantity, that we produce new data. This is quite a normal with CNNs, as they can't tell the difference with data that has slightly been rotated.
I have implemented this in 91e4f2b, but as you can see it only writes the transformed files to the disk.
I believe that it would be ideal to have this done in memory on runtime.
Hi Keiron,
Have you taken a look to the (Python Image Library)
http://effbot.org/imagingbook/introduction.htm
http://simplecv-examples.readthedocs.org/en/latest/examples/basics.html
I am wondering if you would like a string in order to save all bytes from
the picture.
Kind regars.
Miguel Angel.
On 17 August 2015 at 02:34, KeironO notifications@github.com wrote:
@MiguelAngelRG https://github.com/MiguelAngelRG suggested that to solve
issues with low image quantity, that we produce new data. This is quite a
normal with CNNs, as they can't tell the difference with data that has
slightly been rotated.I have implemented this in 91e4f2b
91e4f2b,
but as you can see it writes the files to the disk.I believe that it would be ideal to have this done in memory on runtime.
—
Reply to this email directly or view it on GitHub
#3.
Hi Miguel,
I have used PIL throughout the project, it's just I'm not entirely sure how I can get it to function with our currently existing codebase!
Thanks,
K.
Hi Keiron,
After having the conversation with you I was thinking that you just have
different ways to do that, as I suppose that you know:
- Classes: https://docs.python.org/2/tutorial/classes.html
- Byte arrays:
http://stackoverflow.com/questions/855191/how-big-can-a-python-array-get
(here you can see the maximum size that you could use in order to create an
array). Here you have the libraries
https://docs.python.org/2/library/array.html - External libraries like Python Image Library but If you want to create a
"standard" version of PyVec you should use the other solutions.
What do you think ?..
Kind regards,
Miguel Angel.
On 17 August 2015 at 19:14, KeironO notifications@github.com wrote:
Hi Miguel,
I have used PIL throughout the project, it's just I'm not entirely sure
how I can get it to function with our currently existing codebase!Thanks,
K.
—
Reply to this email directly or view it on GitHub
#3 (comment).
And how can I load this in a similar way to the way I am currently loading data?
I have take a look of your code and I do not understand why do you want to
rotate the image?
And the other thing that I do not understand is do you want to put 5000
images on memory in order to
do no create a intermediate files (temp files)? This is the goal that you
want to achieve ?
On 17 August 2015 at 19:55, KeironO notifications@github.com wrote:
And how can I load this in a similar way to the way I am currently loading
data?—
Reply to this email directly or view it on GitHub
#3 (comment).
Upon consideration, we no longer require this.