2

as I'm well aware, using AppendTo for large lists isn't recommended as the function gets progressively slower with each appending done.

Lots of suggestions talk about using Reap and Sow, however the ones I found don't deal with nested lists. My question is relatively simple, how to substitute AppendTo with Reap, Sow as directly as possible?

Specific information regarding my problem: I would like to append data in form of

data = {{x}, {y}}

to a list, so after a few iterations, the list would look something like

list = {{{x1}, {y1}}, {{x2}, {y2}}, {{x3}, {y3}}}

My solution works for only 1 iteration, and then breaks apart because of increasing use of Flatten, so it's obviously a non-working solution. Of course, I'm open to other alternatives, faster than AppendTo.

m_goldberg
  • 107,779
  • 16
  • 103
  • 257
blairo
  • 71
  • 5
  • You can sow the x and y variables to different tags, then use Thread or Transpose to shape the separate x and y lists into the shape you want. Look at the second argument to Sow – Jason B. May 07 '16 at 09:53
  • 1
    If you always generate pairs {x,y}, what is the problem with Reap/Sow here? If you do list = Reap[ Do[ Sow[ {x[i], y[i]} ], {i,3} ] ][[2,1]] you get what you want, no Flattening needed. If you generate x and y separately, see @JasonB's comment. – Marius Ladegård Meyer May 07 '16 at 09:55
  • 1
    There is undocumented Internal`Bag described by Daniel Lichtblau in this answer. Look also at this thread for further discussion. – Alexey Popkov May 07 '16 at 10:52
  • @MariusLadegårdMeyer your suggestion did the trick, with the few modifications :) thanks to everyone! – blairo May 07 '16 at 11:17

1 Answers1

3

Thanks to the suggestions above, I could replace the following use of AppendTo[]:

For[i=1,i<10,i++,
 data = {{x},{y}};
 AppendTo[list,data];
];

with the use of Reap[] and Sow[]:

list=Reap[
 For[i=1,i<10,i++,
  data={{x},{y}};
  Sow[data];
 ];
][[2, 1]];

The latter produces one extra set of outer curly brackets, which you can easily remove with Flatten[].

blairo
  • 71
  • 5
  • If you really need to loop, you should use Do instead of For. But probably there is a way to do what you want with Table instead, creating the list directly. Also, in you answer, there is no need whatsoever to include list={};. This is extremely rarely needed. – Marius Ladegård Meyer May 07 '16 at 12:00
  • 1
    Noted. The data collection is a part of a larger program, hence no table :) – blairo May 07 '16 at 12:22
  • Seems to me that list = Table[{{x}, {y}}, {i, 9}] is shorter and clearer. – bill s May 07 '16 at 12:50