-
Notifications
You must be signed in to change notification settings - Fork 0
/
CHANGES.txt
3501 lines (2642 loc) · 124 KB
/
CHANGES.txt
1
2
3
4
5
6
7
8
9
10
11
12
13
14
15
16
17
18
19
20
21
22
23
24
25
26
27
28
29
30
31
32
33
34
35
36
37
38
39
40
41
42
43
44
45
46
47
48
49
50
51
52
53
54
55
56
57
58
59
60
61
62
63
64
65
66
67
68
69
70
71
72
73
74
75
76
77
78
79
80
81
82
83
84
85
86
87
88
89
90
91
92
93
94
95
96
97
98
99
100
101
102
103
104
105
106
107
108
109
110
111
112
113
114
115
116
117
118
119
120
121
122
123
124
125
126
127
128
129
130
131
132
133
134
135
136
137
138
139
140
141
142
143
144
145
146
147
148
149
150
151
152
153
154
155
156
157
158
159
160
161
162
163
164
165
166
167
168
169
170
171
172
173
174
175
176
177
178
179
180
181
182
183
184
185
186
187
188
189
190
191
192
193
194
195
196
197
198
199
200
201
202
203
204
205
206
207
208
209
210
211
212
213
214
215
216
217
218
219
220
221
222
223
224
225
226
227
228
229
230
231
232
233
234
235
236
237
238
239
240
241
242
243
244
245
246
247
248
249
250
251
252
253
254
255
256
257
258
259
260
261
262
263
264
265
266
267
268
269
270
271
272
273
274
275
276
277
278
279
280
281
282
283
284
285
286
287
288
289
290
291
292
293
294
295
296
297
298
299
300
301
302
303
304
305
306
307
308
309
310
311
312
313
314
315
316
317
318
319
320
321
322
323
324
325
326
327
328
329
330
331
332
333
334
335
336
337
338
339
340
341
342
343
344
345
346
347
348
349
350
351
352
353
354
355
356
357
358
359
360
361
362
363
364
365
366
367
368
369
370
371
372
373
374
375
376
377
378
379
380
381
382
383
384
385
386
387
388
389
390
391
392
393
394
395
396
397
398
399
400
401
402
403
404
405
406
407
408
409
410
411
412
413
414
415
416
417
418
419
420
421
422
423
424
425
426
427
428
429
430
431
432
433
434
435
436
437
438
439
440
441
442
443
444
445
446
447
448
449
450
451
452
453
454
455
456
457
458
459
460
461
462
463
464
465
466
467
468
469
470
471
472
473
474
475
476
477
478
479
480
481
482
483
484
485
486
487
488
489
490
491
492
493
494
495
496
497
498
499
500
501
502
503
504
505
506
507
508
509
510
511
512
513
514
515
516
517
518
519
520
521
522
523
524
525
526
527
528
529
530
531
532
533
534
535
536
537
538
539
540
541
542
543
544
545
546
547
548
549
550
551
552
553
554
555
556
557
558
559
560
561
562
563
564
565
566
567
568
569
570
571
572
573
574
575
576
577
578
579
580
581
582
583
584
585
586
587
588
589
590
591
592
593
594
595
596
597
598
599
600
601
602
603
604
605
606
607
608
609
610
611
612
613
614
615
616
617
618
619
620
621
622
623
624
625
626
627
628
629
630
631
632
633
634
635
636
637
638
639
640
641
642
643
644
645
646
647
648
649
650
651
652
653
654
655
656
657
658
659
660
661
662
663
664
665
666
667
668
669
670
671
672
673
674
675
676
677
678
679
680
681
682
683
684
685
686
687
688
689
690
691
692
693
694
695
696
697
698
699
700
701
702
703
704
705
706
707
708
709
710
711
712
713
714
715
716
717
718
719
720
721
722
723
724
725
726
727
728
729
730
731
732
733
734
735
736
737
738
739
740
741
742
743
744
745
746
747
748
749
750
751
752
753
754
755
756
757
758
759
760
761
762
763
764
765
766
767
768
769
770
771
772
773
774
775
776
777
778
779
780
781
782
783
784
785
786
787
788
789
790
791
792
793
794
795
796
797
798
799
800
801
802
803
804
805
806
807
808
809
810
811
812
813
814
815
816
817
818
819
820
821
822
823
824
825
826
827
828
829
830
831
832
833
834
835
836
837
838
839
840
841
842
843
844
845
846
847
848
849
850
851
852
853
854
855
856
857
858
859
860
861
862
863
864
865
866
867
868
869
870
871
872
873
874
875
876
877
878
879
880
881
882
883
884
885
886
887
888
889
890
891
892
893
894
895
896
897
898
899
900
901
902
903
904
905
906
907
908
909
910
911
912
913
914
915
916
917
918
919
920
921
922
923
924
925
926
927
928
929
930
931
932
933
934
935
936
937
938
939
940
941
942
943
944
945
946
947
948
949
950
951
952
953
954
955
956
957
958
959
960
961
962
963
964
965
966
967
968
969
970
971
972
973
974
975
976
977
978
979
980
981
982
983
984
985
986
987
988
989
990
991
992
993
994
995
996
997
998
999
1000
Spark Change Log
----------------
Release 0.9.1
Revert "[maven-release-plugin] prepare release v0.9.1-rc2"
Tathagata Das <[email protected]>
2014-03-26 21:53:07 -0700
Commit: ea5da04
Revert "[maven-release-plugin] prepare for next development iteration"
Tathagata Das <[email protected]>
2014-03-26 21:51:40 -0700
Commit: d16e863
[SPARK-1327] GLM needs to check addIntercept for intercept and weights
Xiangrui Meng <[email protected]>
2014-03-26 19:30:57 -0700
Commit: 4901604, github.com/apache/spark/pull/236
SPARK-1322, top in pyspark should sort result in descending order.
Prashant Sharma <[email protected]>
2014-03-26 11:15:02 -0700
Commit: 2f90dc5, github.com/apache/spark/pull/235
[maven-release-plugin] prepare for next development iteration
Ubuntu <[email protected]>
2014-03-26 09:26:45 +0000
Commit: 1f785d4
[maven-release-plugin] prepare release v0.9.1-rc2
Ubuntu <[email protected]>
2014-03-26 09:26:40 +0000
Commit: 1197280
Updated CHANGES.txt
Tathagata Das <[email protected]>
2014-03-26 02:10:57 -0700
Commit: 7495dba
[SPARK-782] Made Spark use existing shaded ASM and removed Spark's ASM dependency
Tathagata Das <[email protected]>
2014-03-25 21:35:36 -0700
Commit: da87240, github.com/apache/spark/pull/232
Revert "[maven-release-plugin] prepare release v0.9.1-rc1"
Tathagata Das <[email protected]>
2014-03-25 15:01:52 -0700
Commit: 55abe72
Revert "[maven-release-plugin] prepare for next development iteration"
Tathagata Das <[email protected]>
2014-03-25 15:01:36 -0700
Commit: b94f997
[maven-release-plugin] prepare for next development iteration
Ubuntu <[email protected]>
2014-03-24 06:56:16 +0000
Commit: 12e237e
[maven-release-plugin] prepare release v0.9.1-rc1
Ubuntu <[email protected]>
2014-03-24 06:56:10 +0000
Commit: 81c6a06
Removed all occurences of incubator from all the pom.xml.
Tathagata Das <[email protected]>
2014-03-23 23:31:59 -0700
Commit: 60ddb34
Updated CHANGES.txt file.
Tathagata Das <[email protected]>
2014-03-23 13:16:50 -0700
Commit: f176b03
Fix to Stage UI to display numbers on progress bar
Emtiaz Ahmed <[email protected]>
2014-03-21 18:07:05 -0700
Commit: 5e7ac0d, github.com/apache/spark/pull/201
SPARK-1284: Fix improper use of SimpleDateFormat
zsxwing <[email protected]>
2014-03-21 16:39:23 -0700
Commit: 8856076, github.com/apache/spark/pull/179
[SPARK-1273] use doi links in mllib-guide
Xiangrui Meng <[email protected]>
2014-03-21 14:35:32 -0700
Commit: d68549e, github.com/apache/spark/pull/198
Removed incubating from Spark version in all the pom.xml.
Tathagata Das <[email protected]>
2014-03-20 18:02:55 -0700
Commit: 8b1e793
Bumped versions to Spark 0.9.1
Tathagata Das <[email protected]>
2014-03-20 16:55:35 -0700
Commit: 8a882ef, github.com/apache/spark/pull/190
SPARK-1032. If Yarn app fails before registering, app master stays aroun...
Sandy Ryza <[email protected]>
2014-03-20 16:50:44 -0500
Commit: c6630d3, github.com/apache/spark/pull/28
SPARK-1051. On YARN, executors don't doAs submitting user
Sandy Ryza <[email protected]>
2014-03-20 14:48:05 -0500
Commit: 748f002, github.com/apache/spark/pull/29
[SPARK-1285] Backporting updates to streaming docs to branch 0.9
Aaron Kimball <[email protected]>, Tathagata Das <[email protected]>, Chen Chao <[email protected]>, Andrew Or <[email protected]>
2014-03-20 12:27:47 -0700
Commit: 1e36690, github.com/apache/spark/pull/183
[SPARK-1273] MLlib bug fixes, improvements, and doc updates for v0.9.1
Xiangrui Meng <[email protected]>, Sean Owen <[email protected]>, Andrew Tulloch <[email protected]>, Chen Chao <[email protected]>
2014-03-19 19:05:26 -0700
Commit: 1cc979e, github.com/apache/spark/pull/175
[SPARK-1275] Made dev/run-tests executable.
Tathagata Das <[email protected]>
2014-03-19 16:10:45 -0700
Commit: a4eef65, github.com/apache/spark/pull/178
Update the yarn alpha version to 0.9.1-incubating-SNAPSHOT
Thomas Graves <[email protected]>
2014-03-19 12:41:11 -0500
Commit: 72875b2
SPARK-1203 fix saving to hdfs from yarn
Thomas Graves <[email protected]>
2014-03-19 08:19:47 -0500
Commit: 250ec27, github.com/apache/spark/pull/173
bugfix: Wrong "Duration" in "Active Stages" in stages page
shiyun.wxm <[email protected]>
2014-03-19 01:42:42 -0700
Commit: d385b5a, github.com/apache/spark/pull/170
[SPARK-1274] Add dev scripts to merge PRs and create releases from master to branch-0.9
Tathagata Das <[email protected]>
2014-03-18 22:09:16 -0700
Commit: 7ec78bc, github.com/apache/spark/pull/176
Bundle tachyon: SPARK-1269
Nick Lanham <[email protected]>
2014-03-18 22:05:18 -0700
Commit: 0183ddd, github.com/apache/spark/pull/137
[Spark-1261] add instructions for running python examples to doc overview page
Diana Carroll <[email protected]>
2014-03-17 17:37:03 -0700
Commit: 20d9458, github.com/apache/spark/pull/162
SPARK-1244: Throw exception if map output status exceeds frame size
Patrick Wendell <[email protected]>, Andrew Or <[email protected]>
2014-03-17 14:06:28 -0700
Commit: 4562140, github.com/apache/spark/pull/152
SPARK-1240: handle the case of empty RDD when takeSample
CodingCat <[email protected]>
2014-03-16 22:40:22 -0700
Commit: af7e8b1, github.com/apache/spark/pull/135
SPARK-977 Added Python RDD.zip function
Prabin Banka <[email protected]>
2014-03-16 22:16:17 -0700
Commit: 1dc1e98, github.com/apache/spark/pull/76
Spark-1163, Added missing Python RDD functions
prabinb <[email protected]>
2014-03-16 22:14:53 -0700
Commit: 249930a, github.com/apache/spark/pull/92
SPARK-1168, Added foldByKey to pyspark.
Prashant Sharma <[email protected]>
2014-03-16 22:13:33 -0700
Commit: 4480505, github.com/apache/spark/pull/115
Updated link for pyspark examples in docs
Jyotiska NK <[email protected]>
2014-03-16 22:12:51 -0700
Commit: e74e79a, github.com/apache/spark/pull/22
SPARK-1019: pyspark RDD take() throws an NPE
Patrick Wendell <[email protected]>
2014-03-12 23:17:17 -0700
Commit: ef74e44, github.com/apache/spark/pull/112
Fix example bug: compile error
jianghan <[email protected]>
2014-03-12 19:46:48 -0700
Commit: 87e4dd5, github.com/apache/spark/pull/132
SPARK-1162 Added top in python.
Prashant Sharma <[email protected]>
2014-03-12 15:57:54 -0700
Commit: 51a77e9, github.com/apache/spark/pull/93
Version fix in pom file
Patrick Wendell <[email protected]>
2014-03-11 14:48:01 -0700
Commit: 7049164
Log4j build fix on 0.9 branch
Patrick Wendell <[email protected]>
2014-03-11 11:53:29 -0700
Commit: 6cbd580
SPARK-1167: Remove metrics-ganglia from default build due to LGPL issues...
Patrick Wendell <[email protected]>
2014-03-11 11:24:21 -0700
Commit: 0c91927, github.com/apache/spark/pull/108
For outputformats that are Configurable, call setConf before sending data to them.
Bryn Keller <[email protected]>
2014-03-09 17:47:46 -0700
Commit: 6f0db0a, github.com/apache/spark/pull/638
SPARK-1190: Do not initialize log4j if slf4j log4j backend is not being used
Patrick Wendell <[email protected]>
2014-03-08 16:02:56 -0800
Commit: 0f0d044, github.com/apache/spark/pull/107
SPARK-1184: Update the distribution tar.gz to include spark-assembly jar
Mark Grover <[email protected]>
2014-03-05 16:55:36 -0800
Commit: 0fc0fdb, github.com/apache/spark/pull/78
SPARK-1109 wrong API docs for pyspark map function
Prashant Sharma <[email protected]>
2014-03-04 15:33:00 -0800
Commit: 7ea89ec, github.com/apache/spark/pull/73
Add Jekyll tag to isolate "production-only" doc components. (0.9 version)
Patrick Wendell <[email protected]>
2014-03-02 18:18:44 -0800
Commit: 267d96c, github.com/apache/spark/pull/57
Removed reference to incubation in Spark user docs.
Reynold Xin <[email protected]>
2014-02-27 21:14:18 -0800
Commit: f2bf44a, github.com/apache/spark/pull/2
[SPARK-1089] fix the regression problem on ADD_JARS in 0.9
CodingCat <[email protected]>
2014-02-26 23:42:53 -0800
Commit: bc5e7d7, github.com/apache/spark/pull/13
Removed reference to incubation in README.md.
Reynold Xin <[email protected]>
2014-02-26 16:53:56 -0800
Commit: 349764d, github.com/apache/spark/pull/1
SPARK-1115: Catch depickling errors
Bouke van der Bijl <[email protected]>
2014-02-26 14:53:30 -0800
Commit: 886a466, github.com/apache/incubator-spark/pull/644
SPARK-1135: fix broken anchors in docs
Matei Zaharia <[email protected]>
2014-02-26 11:56:12 -0800
Commit: 6fe72dd, github.com/apache/spark/pull/3
Fix removal from shuffleToMapStage to search for a key-value pair with our stage instead of using our shuffleID.
Matei Zaharia <[email protected]>
2014-02-24 17:01:21 -0800
Commit: 0661cdc
SPARK-1124: Fix infinite retries of reduce stage when a map stage failed
Matei Zaharia <[email protected]>
2014-02-24 17:00:47 -0800
Commit: 5e74b8e
[SPARK-1055] fix the SCALA_VERSION and SPARK_VERSION in docker file
CodingCat <[email protected]>, Nan Zhu <[email protected]>
2014-02-22 15:39:41 -0800
Commit: 00db30c, github.com/apache/incubator-spark/pull/634
SPARK-1117: update accumulator docs
Xiangrui Meng <[email protected]>
2014-02-21 22:44:59 -0800
Commit: ed58742, github.com/apache/incubator-spark/pull/631
[SPARK-1113] External spilling - fix Int.MaxValue hash code collision bug
Andrew Or <[email protected]>
2014-02-21 20:06:09 -0800
Commit: 84131fe, github.com/apache/incubator-spark/pull/624
MLLIB-25: Implicit ALS runs out of memory for moderately large numbers of features
Sean Owen <[email protected]>
2014-02-21 13:39:17 -0800
Commit: 998abae, github.com/apache/incubator-spark/pull/629
SPARK-1111: URL Validation Throws Error for HDFS URL's
Patrick Wendell <[email protected]>
2014-02-21 11:12:38 -0800
Commit: b3fff96, github.com/apache/incubator-spark/pull/625
Super minor: Add require for mergeCombiners in combineByKey
Aaron Davidson <[email protected]>
2014-02-20 16:46:29 -0800
Commit: 3c44ff4, github.com/apache/incubator-spark/pull/623
[SPARK-1105] fix site scala version error in docs
CodingCat <[email protected]>
2014-02-19 15:56:24 -0800
Commit: 289d761, github.com/apache/incubator-spark/pull/618
Revert "[SPARK-1105] fix site scala version error in doc"
Patrick Wendell <[email protected]>
2014-02-18 17:47:34 -0800
Commit: 7bde72e
[SPARK-1105] fix site scala version error in doc
CodingCat <[email protected]>
2014-02-18 16:33:41 -0800
Commit: 0f0395c, github.com/apache/incubator-spark/pull/616
Worker registration logging fix
Andrew Ash <[email protected]>
2014-02-17 09:52:16 -0800
Commit: b0b5288, github.com/apache/incubator-spark/pull/608
fix for https://spark-project.atlassian.net/browse/SPARK-1052
Bijay Bisht <[email protected]>
2014-02-16 16:52:57 -0800
Commit: e797c1a, github.com/apache/incubator-spark/pull/568
Add c3 instance types to Spark EC2
Christian Lundgren <[email protected]>
2014-02-13 12:44:21 -0800
Commit: 19b4bb2, github.com/apache/incubator-spark/pull/595
SPARK-1088: Create a script for running tests so we can have version specific testing on Jenkins (branch-0.9)
Reynold Xin <[email protected]>
2014-02-12 23:42:58 -0800
Commit: e5b86b1, github.com/apache/incubator-spark/pull/593
Ported hadoopClient jar for < 1.0.1 fix
Bijay Bisht <[email protected]>
2014-02-12 23:42:10 -0800
Commit: 8093de1, github.com/apache/incubator-spark/pull/584
754bc18 2014-02-12 14:26:39 -0800
Merge pull request #590 from rxin/scalastyle.
[SPARK-1085: Fix Jenkins pull request builder for branch-0.9 (scalastyle command not found)]
28f88c5 2014-02-11 22:43:09 -0800
Merge pull request #583 from colorant/zookeeper.
[Minor fix for ZooKeeperPersistenceEngine to use configured working dir]
e70690f 2014-02-09 23:33:35 -0800
Revert "Merge pull request #560 from pwendell/logging. Closes #560."
[This reverts commit 2e3d1c31db55c7f961e559e47bb497ae15cb74d7.]
de22abc 2014-02-08 23:37:05 -0800
Merge pull request #562 from jyotiska/master. Closes #562.
[Added example Python code for sort]
2e3d1c3 2014-02-08 23:35:41 -0800
Merge pull request #560 from pwendell/logging. Closes #560.
[[WIP] SPARK-1067: Default log4j initialization causes errors for those not using log4j]
22e0a3b 2014-02-08 13:00:07 -0800
Merge pull request #561 from Qiuzhuang/master. Closes #561.
[Kill drivers in postStop() for Worker.]
ce179f6 2014-02-06 22:06:30 -0800
Merge pull request #533 from andrewor14/master. Closes #533.
[External spilling - generalize batching logic]
24e5298 2014-02-06 16:15:36 -0800
Merge pull request #450 from kayousterhout/fetch_failures. Closes #450.
[Only run ResubmitFailedStages event after a fetch fails]
94896bb 2014-02-06 16:13:10 -0800
Merge pull request #321 from kayousterhout/ui_kill_fix. Closes #321.
[Inform DAG scheduler about all started/finished tasks.]
44a2b03 2014-02-05 23:38:25 -0800
Merge pull request #545 from kayousterhout/fix_progress. Closes #545.
[Fix off-by-one error with task progress info log.]
b044b0b 2014-02-05 23:37:38 -0800
Merge pull request #526 from tgravescs/yarn_client_stop_am_fix. Closes #526.
[spark on yarn - yarn-client mode doesn't always exit immediately]
d815cfa 2014-02-04 09:47:25 -0800
Merge pull request #534 from sslavic/patch-1. Closes #534.
[Fixed wrong path to compute-classpath.cmd]
f3cba2d 2014-02-04 09:46:00 -0800
Merge pull request #535 from sslavic/patch-2. Closes #535.
[Fixed typo in scaladoc]
5f63f32 2014-02-03 22:44:30 -0800
Merge pull request #449 from CrazyJvm/master
[SPARK-1028 : fix "set MASTER automatically fails" bug.]
6e4d089 2014-02-03 22:42:43 -0800
Merge pull request #414 from soulmachine/code-style
[Code clean up for mllib]
0021ef9 2014-02-03 22:42:01 -0800
Merge pull request #445 from kayousterhout/exec_lost
[Fail rather than hanging if a task crashes the JVM.]
dc8adf1 2014-02-03 22:41:30 -0800
Merge pull request #489 from ash211/patch-6
[Clarify spark.default.parallelism]
574741f 2014-02-03 22:40:55 -0800
Merge pull request #493 from kayousterhout/double_add
[Fixed bug where task set managers are added to queue twice]
1280e8a 2014-02-03 22:40:29 -0800
Merge pull request #511 from JoshRosen/SPARK-1040
[Fix ClassCastException in JavaPairRDD.collectAsMap() (SPARK-1040)]
2c6c9b9 2014-02-03 22:39:59 -0800
Merge pull request #504 from JoshRosen/SPARK-1025
[Fix PySpark hang when input files are deleted (SPARK-1025)]
b10f607 2014-02-03 22:39:10 -0800
Merge pull request #516 from sarutak/master
[modified SparkPluginBuild.scala to use https protocol for accessing gith...]
18520f5 2014-02-03 22:37:38 -0800
Merge pull request #490 from hsaputra/modify_checkoption_with_isdefined
[Replace the check for None Option with isDefined and isEmpty in Scala code]
a414071 2014-01-31 16:54:33 -0800
Merge pull request #524 from rxin/doc
[Added spark.shuffle.file.buffer.kb to configuration doc.]
a41a83c 2014-01-31 16:53:26 -0800
Merge pull request #527 from ankurdave/graphx-assembly-pom
[Add GraphX to assembly/pom.xml]
d18fe1f 2014-01-28 21:55:15 -0800
Merge pull request #497 from tdas/docs-update
[Updated Spark Streaming Programming Guide]
5edbd17 2014-01-28 21:32:58 -0800
Merge pull request #523 from JoshRosen/SPARK-1043
[Switch from MUTF8 to UTF8 in PySpark serializers.]
[maven-release-plugin] prepare for next development iteration
Ubuntu <[email protected]>
2014-01-24 06:15:15 +0000
Commit: 0f60ef2
Release 0.9.0-incubating
d0a105d Thu Jan 23 20:53:31 2014 -0800
Merge pull request #505 from JoshRosen/SPARK-1026
[Deprecate mapPartitionsWithSplit in PySpark (SPARK-1026)]
e66d4c2 Thu Jan 23 19:47:16 2014 -0800
Merge pull request #503 from pwendell/master
[Fix bug on read-side of external sort when using Snappy.]
e8d3f2b Thu Jan 23 19:20:22 2014 -0800
Merge pull request #502 from pwendell/clone-1
[Remove Hadoop object cloning and warn users making Hadoop RDD's.]
7a62353 Thu Jan 23 19:09:25 2014 -0800
Merge pull request #501 from JoshRosen/cartesian-rdd-fixes
[Fix two bugs in PySpark cartesian(): SPARK-978 and SPARK-1034]
51960b8 Wed Jan 22 19:37:50 2014 -0800
Merge pull request #496 from pwendell/master
[Fix bug in worker clean-up in UI]
828f7b4 Wed Jan 22 15:45:18 2014 -0800
Merge pull request #495 from srowen/GraphXCommonsMathDependency
[Fix graphx Commons Math dependency]
dc5857a Wed Jan 22 14:33:25 2014 -0800
Merge pull request #492 from skicavs/master
[fixed job name and usage information for the JavaSparkPi example]
dd533c9 Wed Jan 22 14:15:58 2014 -0800
Merge pull request #478 from sryza/sandy-spark-1033
[SPARK-1033. Ask for cores in Yarn container requests]
b6fd3cd Tue Jan 21 00:12:01 2014 -0800
Merge pull request #480 from pwendell/0.9-fixes
[Handful of 0.9 fixes]
e5f8917 Mon Jan 20 23:35:07 2014 -0800
Merge pull request #484 from tdas/run-example-fix
[Made run-example respect SPARK_JAVA_OPTS and SPARK_MEM.]
410ba06 Mon Jan 20 22:26:14 2014 -0800
Merge pull request #482 from tdas/streaming-example-fix
[Added StreamingContext.awaitTermination to streaming examples]
f137947 Mon Jan 20 22:24:07 2014 -0800
Merge pull request #483 from pwendell/gitignore
[Restricting /lib to top level directory in .gitignore]
94ae25d Sun Jan 19 11:33:51 2014 -0800
Merge pull request #470 from tgravescs/fix_spark_examples_yarn
[Only log error on missing jar to allow spark examples to jar.]
0f077b5 Sun Jan 19 10:30:29 2014 -0800
Merge pull request #458 from tdas/docs-update
[Updated java API docs for streaming, along with very minor changes in the code examples.]
03019d1 Sat Jan 18 16:29:43 2014 -0800
Merge pull request #459 from srowen/UpdaterL2Regularization
[Correct L2 regularized weight update with canonical form]
76147a2 Sat Jan 18 16:24:16 2014 -0800
Merge pull request #437 from mridulm/master
[Minor api usability changes]
4ac8cab Sat Jan 18 16:22:46 2014 -0800
Merge pull request #426 from mateiz/py-ml-tests
[Re-enable Python MLlib tests (require Python 2.7 and NumPy 1.7+)]
34e911c Sat Jan 18 16:17:34 2014 -0800
Merge pull request #462 from mateiz/conf-file-fix
[Remove Typesafe Config usage and conf files to fix nested property names]
ff7201c Sat Jan 18 12:50:02 2014 -0800
Merge pull request #461 from pwendell/master
[Use renamed shuffle spill config in CoGroupedRDD.scala]
7b0d5a5 Thu Jan 16 23:18:48 2014 -0800
Merge pull request #451 from Qiuzhuang/master
[Fixed Window spark shell launch script error.]
4ccedb3 Wed Jan 15 14:26:48 2014 -0800
Merge pull request #444 from mateiz/py-version
[Clarify that Python 2.7 is only needed for MLlib]
e3fa36f Wed Jan 15 13:56:04 2014 -0800
Merge pull request #442 from pwendell/standalone
[Workers should use working directory as spark home if it's not specified]
29c76d9 Wed Jan 15 13:55:48 2014 -0800
Merge pull request #443 from tdas/filestream-fix
[Made some classes private[stremaing] and deprecated a method in JavaStreamingContext.]
aca40aa Wed Jan 15 11:15:47 2014 -0800
Merge pull request #441 from pwendell/graphx-build
[GraphX shouldn't list Spark as provided.]
e12c374 Wed Jan 15 10:01:43 2014 -0800
Merge pull request #433 from markhamstra/debFix
[Updated Debian packaging]
2f015c2 Tue Jan 14 23:17:28 2014 -0800
Merge pull request #436 from ankurdave/VertexId-case
[Rename VertexID -> VertexId in GraphX]
2859cab Tue Jan 14 23:08:19 2014 -0800
Merge pull request #435 from tdas/filestream-fix
[Fixed the flaky tests by making SparkConf not serializable]
fbfbb33 Tue Jan 14 23:06:29 2014 -0800
Merge pull request #434 from rxin/graphxmaven
[Fixed SVDPlusPlusSuite in Maven build.]
2c6c07f Tue Jan 14 21:53:05 2014 -0800
Merge pull request #424 from jegonzal/GraphXProgrammingGuide
[Additional edits for clarity in the graphx programming guide.]
6fa4e02 Tue Jan 14 21:51:25 2014 -0800
Merge pull request #431 from ankurdave/graphx-caching-doc
[Describe caching and uncaching in GraphX programming guide]
2f930d5 Tue Jan 14 15:00:11 2014 -0800
Merge pull request #428 from pwendell/writeable-objects
[Don't clone records for text files]
329c9df Tue Jan 14 14:53:36 2014 -0800
Merge pull request #429 from ankurdave/graphx-examples-pom.xml
[Add GraphX dependency to examples/pom.xml]
a14933d Tue Jan 14 14:52:42 2014 -0800
Merge pull request #427 from pwendell/deprecate-aggregator
[Deprecate rather than remove old combineValuesByKey function]
119b6c5 Tue Jan 14 13:29:08 2014 -0800
Merge pull request #425 from rxin/scaladoc
[API doc update & make Broadcast public]
bf3b150 Tue Jan 14 09:45:22 2014 -0800
Merge pull request #423 from jegonzal/GraphXProgrammingGuide
[Improving the graphx-programming-guide]
1b4adc2 Tue Jan 14 01:19:24 2014 -0800
Merge pull request #420 from pwendell/header-files
[Add missing header files]
b60840e Tue Jan 14 00:48:34 2014 -0800
Merge pull request #418 from pwendell/0.9-versions
[Version changes for release 0.9.0.]
980250b Tue Jan 14 00:05:37 2014 -0800
Merge pull request #416 from tdas/filestream-fix
[Removed unnecessary DStream operations and updated docs]
055be5c Mon Jan 13 23:26:44 2014 -0800
Merge pull request #415 from pwendell/shuffle-compress
[Enable compression by default for spills]
fdaabdc Mon Jan 13 23:08:26 2014 -0800
Merge pull request #380 from mateiz/py-bayes
[Add Naive Bayes to Python MLlib, and some API fixes]
4a805af Mon Jan 13 22:58:38 2014 -0800
Merge pull request #367 from ankurdave/graphx
[GraphX: Unifying Graphs and Tables]
945fe7a Mon Jan 13 22:56:12 2014 -0800
Merge pull request #408 from pwendell/external-serializers
[Improvements to external sorting]
68641bc Mon Jan 13 22:54:13 2014 -0800
Merge pull request #413 from rxin/scaladoc
[Adjusted visibility of various components and documentation for 0.9.0 release.]
0ca0d4d Mon Jan 13 22:32:21 2014 -0800
Merge pull request #401 from andrewor14/master
[External sorting - Add number of bytes spilled to Web UI]
08b9fec Mon Jan 13 22:29:03 2014 -0800
Merge pull request #409 from tdas/unpersist
[Automatically unpersisting RDDs that have been cleaned up from DStreams]
b07bc02 Mon Jan 13 20:45:22 2014 -0800
Merge pull request #412 from harveyfeng/master
[Add default value for HadoopRDD's `cloneRecords` constructor arg]
a2fee38 Mon Jan 13 19:45:26 2014 -0800
Merge pull request #411 from tdas/filestream-fix
[Improved logic of finding new files in FileInputDStream]
01c0d72 Mon Jan 13 16:24:30 2014 -0800
Merge pull request #410 from rxin/scaladoc1
[Updated JavaStreamingContext to make scaladoc compile.]
8038da2 Mon Jan 13 14:59:30 2014 -0800
Merge pull request #2 from jegonzal/GraphXCCIssue
[Improving documentation and identifying potential bug in CC calculation.]
b93f9d4 Mon Jan 13 12:18:05 2014 -0800
Merge pull request #400 from tdas/dstream-move
[Moved DStream and PairDSream to org.apache.spark.streaming.dstream]
e6ed13f Sun Jan 12 22:35:14 2014 -0800
Merge pull request #397 from pwendell/host-port
[Remove now un-needed hostPort option]
0b96d85 Sun Jan 12 21:31:43 2014 -0800
Merge pull request #399 from pwendell/consolidate-off
[Disable shuffle file consolidation by default]
0ab505a Sun Jan 12 21:31:04 2014 -0800
Merge pull request #395 from hsaputra/remove_simpleredundantreturn_scala
[Remove simple redundant return statements for Scala methods/functions]
405bfe8 Sun Jan 12 20:04:21 2014 -0800
Merge pull request #394 from tdas/error-handling
[Better error handling in Spark Streaming and more API cleanup]
28a6b0c Sun Jan 12 19:49:36 2014 -0800
Merge pull request #398 from pwendell/streaming-api
[Rename DStream.foreach to DStream.foreachRDD]
074f502 Sun Jan 12 17:01:13 2014 -0800
Merge pull request #396 from pwendell/executor-env
[Setting load defaults to true in executor]
82e2b92 Sun Jan 12 16:55:11 2014 -0800
Merge pull request #392 from rxin/listenerbus
[Stop SparkListenerBus daemon thread when DAGScheduler is stopped.]
288a878 Sat Jan 11 21:53:19 2014 -0800
Merge pull request #389 from rxin/clone-writables
[Minor update for clone writables and more documentation.]
dbc11df Sat Jan 11 18:07:13 2014 -0800
Merge pull request #388 from pwendell/master
[Fix UI bug introduced in #244.]
409866b Sat Jan 11 17:12:06 2014 -0800
Merge pull request #393 from pwendell/revert-381
[Revert PR 381]
6510f04 Sat Jan 11 12:48:26 2014 -0800
Merge pull request #387 from jerryshao/conf-fix
[Fix configure didn't work small problem in ALS]
ee6e7f9 Sat Jan 11 12:07:55 2014 -0800
Merge pull request #359 from ScrapCodes/clone-writables
[We clone hadoop key and values by default and reuse objects if asked to.]
4216178 Sat Jan 11 09:46:48 2014 -0800
Merge pull request #373 from jerryshao/kafka-upgrade
[Upgrade Kafka dependecy to 0.8.0 release version]
92ad18b Fri Jan 10 23:25:15 2014 -0800
Merge pull request #376 from prabeesh/master
[Change clientId to random clientId]
0b5ce7a Fri Jan 10 23:23:21 2014 -0800
Merge pull request #386 from pwendell/typo-fix
[Small typo fix]
1d7bef0 Fri Jan 10 18:53:03 2014 -0800
Merge pull request #381 from mateiz/default-ttl
[Fix default TTL for metadata cleaner]
44d6a8e Fri Jan 10 17:51:50 2014 -0800
Merge pull request #382 from RongGu/master
[Fix a type error in comment lines]
88faa30 Fri Jan 10 17:14:22 2014 -0800
Merge pull request #385 from shivaram/add-i2-instances
[Add i2 instance types to Spark EC2.]
f265531 Fri Jan 10 16:25:44 2014 -0800
Merge pull request #383 from tdas/driver-test
[API for automatic driver recovery for streaming programs and other bug fixes]
d37408f Fri Jan 10 16:25:01 2014 -0800
Merge pull request #377 from andrewor14/master
[External Sorting for Aggregator and CoGroupedRDDs (Revisited)]
0eaf01c Fri Jan 10 15:32:19 2014 -0800
Merge pull request #369 from pillis/master
[SPARK-961 Add a Vector.random() method]
7cef843 Fri Jan 10 15:34:15 2014 -0600
Merge pull request #371 from tgravescs/yarn_client_addjar_misc_fixes
[Yarn client addjar and misc fixes]
7b58f11 Fri Jan 10 12:47:46 2014 -0800
Merge pull request #384 from pwendell/debug-logs
[Make DEBUG-level logs consummable.]
23d2995 Fri Jan 10 10:20:02 2014 -0800
Merge pull request #1 from jegonzal/graphx
[ProgrammingGuide]
0ebc973 Thu Jan 9 23:58:49 2014 -0800
Merge pull request #375 from mateiz/option-fix
[Fix bug added when we changed AppDescription.maxCores to an Option]
dd03cea Thu Jan 9 23:38:03 2014 -0800
Merge pull request #378 from pwendell/consolidate_on
[Enable shuffle consolidation by default.]
997c830 Thu Jan 9 22:22:20 2014 -0800
Merge pull request #363 from pwendell/streaming-logs
[Set default logging to WARN for Spark streaming examples.]
300eaa9 Thu Jan 9 20:29:51 2014 -0800
Merge pull request #353 from pwendell/ipython-simplify
[Simplify and fix pyspark script.]
4b074fa Thu Jan 9 19:03:55 2014 -0800
Merge pull request #374 from mateiz/completeness
[Add some missing Java API methods]
a9d5333 Thu Jan 9 18:46:46 2014 -0800
Merge pull request #294 from RongGu/master
[Bug fixes for updating the RDD block's memory and disk usage information]
d86a85e Thu Jan 9 18:37:52 2014 -0800
Merge pull request #293 from pwendell/standalone-driver
[SPARK-998: Support Launching Driver Inside of Standalone Mode]
26cdb5f Thu Jan 9 17:16:34 2014 -0800
Merge pull request #372 from pwendell/log4j-fix-1
[Send logs to stderr by default (instead of stdout).]
12f414e Thu Jan 9 15:31:30 2014 -0800
Merge pull request #362 from mateiz/conf-getters
[Use typed getters for configuration settings]
365cac9 Thu Jan 9 00:56:16 2014 -0800
Merge pull request #361 from rxin/clean
[Minor style cleanup. Mostly on indenting & line width changes.]
73c724e Thu Jan 9 00:32:19 2014 -0800
Merge pull request #368 from pwendell/sbt-fix
[Don't delegate to users `sbt`.]
dceedb4 Wed Jan 8 23:19:28 2014 -0800
Merge pull request #364 from pwendell/fix
[Fixing config option "retained_stages" => "retainedStages".]
04d83fc Wed Jan 8 11:55:37 2014 -0800
Merge pull request #360 from witgo/master
[fix make-distribution.sh show version: command not found]
56ebfea Wed Jan 8 11:50:06 2014 -0800
Merge pull request #357 from hsaputra/set_boolean_paramname
[Set boolean param name for call to SparkHadoopMapReduceUtil.newTaskAttemptID]
bdeaeaf Wed Jan 8 11:48:39 2014 -0800
Merge pull request #358 from pwendell/add-cdh
[Add CDH Repository to Maven Build]
5cae05f Wed Jan 8 11:47:28 2014 -0800
Merge pull request #356 from hsaputra/remove_deprecated_cleanup_method
[Remove calls to deprecated mapred's OutputCommitter.cleanupJob]
6eef78d Wed Jan 8 08:49:20 2014 -0600
Merge pull request #345 from colorant/yarn
[support distributing extra files to worker for yarn client mode]
bb6a39a Tue Jan 7 22:32:18 2014 -0800
Merge pull request #322 from falaki/MLLibDocumentationImprovement
[SPARK-1009 Updated MLlib docs to show how to use it in Python]
cb1b927 Tue Jan 7 22:26:28 2014 -0800
Merge pull request #355 from ScrapCodes/patch-1
[Update README.md]
c0f0155 Tue Jan 7 22:21:52 2014 -0800
Merge pull request #313 from tdas/project-refactor
[Refactored the streaming project to separate external libraries like Twitter, Kafka, Flume, etc.]
f5f12dc Tue Jan 7 21:56:35 2014 -0800
Merge pull request #336 from liancheng/akka-remote-lookup
[Get rid of `Either[ActorRef, ActorSelection]']
11891e6 Wed Jan 8 00:32:18 2014 -0500
Merge pull request #327 from lucarosellini/master
[Added ‘-i’ command line option to Spark REPL]
7d0aac9 Wed Jan 8 00:30:45 2014 -0500
Merge pull request #354 from hsaputra/addasfheadertosbt
[Add ASF header to the new sbt script.]
d75dc42 Wed Jan 8 00:30:03 2014 -0500
Merge pull request #350 from mateiz/standalone-limit
[Add way to limit default # of cores used by apps in standalone mode]
61674bc Tue Jan 7 18:32:13 2014 -0800
Merge pull request #352 from markhamstra/oldArch
[Don't leave os.arch unset after BlockManagerSuite]
b2e690f Tue Jan 7 16:57:08 2014 -0800
Merge pull request #328 from falaki/MatrixFactorizationModel-fix
[SPARK-1012: DAGScheduler Exception Fix]
6ccf8ce Tue Jan 7 15:49:14 2014 -0800
Merge pull request #351 from pwendell/maven-fix
[Add log4j exclusion rule to maven.]
7d5fa17 Tue Jan 7 11:31:34 2014 -0800
Merge pull request #337 from yinxusen/mllib-16-bugfix
[Mllib 16 bugfix]
71fc113 Tue Jan 7 11:30:35 2014 -0800
Merge pull request #349 from CodingCat/support-worker_dir
[add the comments about SPARK_WORKER_DIR]
15d9534 Tue Jan 7 08:10:02 2014 -0800
Merge pull request #318 from srowen/master
[Suggested small changes to Java code for slightly more standard style, encapsulation and in some cases performance]
468af0f Tue Jan 7 08:09:01 2014 -0800
Merge pull request #348 from prabeesh/master
[spark -> org.apache.spark]
c3cf047 Tue Jan 7 00:54:25 2014 -0800
Merge pull request #339 from ScrapCodes/conf-improvements
[Conf improvements]
a862caf Tue Jan 7 00:18:20 2014 -0800
Merge pull request #331 from holdenk/master
[Add a script to download sbt if not present on the system]
b97ef21 Mon Jan 6 20:12:57 2014 -0800
Merge pull request #346 from sproblvem/patch-1
[Update stop-slaves.sh]
7210257 Mon Jan 6 18:25:44 2014 -0800
Merge pull request #128 from adamnovak/master
[Fix failing "sbt/sbt publish-local" by adding a no-argument PrimitiveKeyOpenHashMap constructor]
e4d6057 Mon Jan 6 14:56:54 2014 -0800
Merge pull request #343 from pwendell/build-fix
[Fix test breaking downstream builds]
93bf962 Mon Jan 6 11:42:41 2014 -0800
Merge pull request #340 from ScrapCodes/sbt-fixes
[Made java options to be applied during tests so that they become self explanatory.]
60edeb3 Mon Jan 6 11:40:32 2014 -0800
Merge pull request #338 from ScrapCodes/ning-upgrade
[SPARK-1005 Ning upgrade]
c708e81 Mon Jan 6 11:35:48 2014 -0800
Merge pull request #341 from ash211/patch-5
[Clarify spark.cores.max in docs]
33fcb91 Mon Jan 6 11:19:23 2014 -0800
Merge pull request #342 from tgravescs/fix_maven_protobuf
[Change protobuf version for yarn alpha back to 2.4.1]
357083c Mon Jan 6 10:29:04 2014 -0800
Merge pull request #330 from tgravescs/fix_addjars_null_handling
[Fix handling of empty SPARK_EXAMPLES_JAR]
a2e7e04 Sun Jan 5 22:37:36 2014 -0800
Merge pull request #333 from pwendell/logging-silence
[Quiet ERROR-level Akka Logs]
5b0986a Sun Jan 5 19:25:09 2014 -0800
Merge pull request #334 from pwendell/examples-fix
[Removing SPARK_EXAMPLES_JAR in the code]
f4b924f Sun Jan 5 17:11:47 2014 -0800
Merge pull request #335 from rxin/ser
[Fall back to zero-arg constructor for Serializer initialization if there is no constructor that accepts SparkConf.]
d43ad3e Sat Jan 4 16:29:30 2014 -0800
Merge pull request #292 from soulmachine/naive-bayes
[standard Naive Bayes classifier]
86404da Sat Jan 4 14:55:54 2014 -0800
Merge pull request #127 from jegonzal/MapByPartition
[Adding mapEdges and mapTriplets by Partition]
e68cdb1 Sat Jan 4 13:46:02 2014 -0800
Merge pull request #124 from jianpingjwang/master
[refactor and bug fix]
280ddf6 Sat Jan 4 12:54:41 2014 -0800
Merge pull request #121 from ankurdave/more-simplify
[Simplify GraphImpl internals further]
10fe23b Fri Jan 3 23:50:14 2014 -0800
Merge pull request #329 from pwendell/remove-binaries
[SPARK-1002: Remove Binaries from Spark Source]
c4d6145 Fri Jan 3 16:30:53 2014 -0800
Merge pull request #325 from witgo/master
[Modify spark on yarn to create SparkConf process]
4ae101f Fri Jan 3 11:24:35 2014 -0800
Merge pull request #317 from ScrapCodes/spark-915-segregate-scripts
[Spark-915 segregate scripts]
87248bd Fri Jan 3 00:45:31 2014 -0800
Merge pull request #1 from apache/master
[Merge latest Spark changes]
30b9db0 Thu Jan 2 23:15:55 2014 -0800
Merge pull request #285 from colorant/yarn-refactor
[Yarn refactor]
498a5f0 Thu Jan 2 19:06:40 2014 -0800
Merge pull request #323 from tgravescs/sparkconf_yarn_fix
[fix spark on yarn after the sparkConf changes]
0475ca8 Thu Jan 2 15:17:08 2014 -0800
Merge pull request #320 from kayousterhout/erroneous_failed_msg
[Remove erroneous FAILED state for killed tasks.]
588a169 Thu Jan 2 13:20:54 2014 -0800
Merge pull request #297 from tdas/window-improvement
[Improvements to DStream window ops and refactoring of Spark's CheckpointSuite]
5e67cdc Thu Jan 2 12:56:28 2014 -0800
Merge pull request #319 from kayousterhout/remove_error_method
[Removed redundant TaskSetManager.error() function.]
ca67909 Thu Jan 2 15:54:54 2014 -0500
Merge pull request #311 from tmyklebu/master
[SPARK-991: Report information gleaned from a Python stacktrace in the UI]
3713f81 Wed Jan 1 21:29:12 2014 -0800
Merge pull request #309 from mateiz/conf2
[SPARK-544. Migrate configuration to a SparkConf class]
c1d928a Wed Jan 1 17:03:48 2014 -0800
Merge pull request #312 from pwendell/log4j-fix-2
[SPARK-1008: Logging improvments]
dc9cb83 Wed Jan 1 13:28:34 2014 -0800
Merge pull request #126 from jegonzal/FixingPersist
[Fixing Persist Behavior]
9a0ff72 Tue Dec 31 21:50:24 2013 -0800
Merge pull request #314 from witgo/master
[restore core/pom.xml file modification]