awesome_bot 1.12.0 → 1.12.1

Sign up to get free protection for your applications and to get access to all the features.
checksums.yaml CHANGED
@@ -1,7 +1,7 @@
1
1
  ---
2
2
  SHA1:
3
- metadata.gz: 61e7d39fd465602a61c824ad316ac2d6f0b116c3
4
- data.tar.gz: 8e662e958ea3c4744d0e2ac64e94ea32755e2e82
3
+ metadata.gz: e84b396684fa21d86231abc47feb9ed41b93ff6e
4
+ data.tar.gz: 178afbac5f1d6332623454dc0e06c1058abcf280
5
5
  SHA512:
6
- metadata.gz: e4226ba76b6387d7b5a3ed4c251613ca39be19c366494694d954e4984e3286e2e1e13a791842cc7ba57fe9293e90dcb042ca372236de7ab834c68bf2f3d26c70
7
- data.tar.gz: d9d51330bf8f9f70e76178b291a973e7e46998dc9448fcf7025734dbca6c9a11343427a63c367441a00eb432e6b607d23bfa3b9dd39c35a51b78dd17ff098ae7
6
+ metadata.gz: ffd1d9002e4561b86e6b0e18884e5404b6035bc7fceab60e8d1e8b1de117d477421214c640b4ec74e29dc9de5b235736297565e99eb1a2e72e4d4624dd5aed8a
7
+ data.tar.gz: d39f13a048e0a937ce2a8578e81d78880f61ed3d72cb15955895818f5767a8431ba97bbc12d571c6b5539386dfd92ae091c2f82d1f355ce69ada2ff7817d6f5a
data/.travis.yml CHANGED
@@ -14,11 +14,11 @@ script:
14
14
  - awesome_bot bin/assets/test-redirect --allow-redirect
15
15
  - awesome_bot bin/assets/test-redirect --allow-redirect -a 301
16
16
  - awesome_bot bin/assets/test-statuses --white-list bot,bad,super
17
- - awesome_bot bin/assets/test-errors
17
+ - awesome_bot bin/assets/test-errors --allow-redirect
18
18
  - awesome_bot -f bin/assets/test-no-issues,bin/assets/test-no-links
19
19
  - awesome_bot -f bin/assets/test-no-issues,bin/assets/test-redirect --allow-redirect
20
20
  - awesome_bot bin/assets/test-no-* --allow-redirect
21
- - awesome_bot bin/assets/test-ssl --allow-ssl
22
- - awesome_bot bin/assets/test-errors
21
+ - awesome_bot bin/assets/test-ssl --allow-ssl
22
+ - awesome_bot bin/assets/test-invalid.md --allow-redirect --allow-dupe
23
23
  - awesome_bot README.md --allow-dupe --white-list gph.is,giphy,travis-ci.org,codeload,badge,rubydoc,rubygems,circleci
24
24
  - gem install awesome_bot
data/CHANGELOG.md CHANGED
@@ -2,6 +2,10 @@
2
2
 
3
3
  Changes by [Daniel Khamsing][] unless otherwise noted.
4
4
 
5
+ # 1.12.1
6
+
7
+ - handle invalid byte sequence, reported by [Manu Zhang](https://github.com/manuzhang)
8
+
5
9
  # 1.12.0
6
10
 
7
11
  - add `allow` option to allow specific error status codes, i.e. `--allow 301` or `--allow 403,429`
@@ -0,0 +1,844 @@
1
+ Apache Gearpump 0.8.0
2
+ ==================
3
+
4
+ Apache Incubation:
5
+ -------------------
6
+ Apache Gearpump enters Apache incubation. Now, we are working on importing the source code to Apache Git (INFRA-11435), and
7
+ a bunch of other tasks (GEARPUMP-1).
8
+
9
+ Apache Gearpump Jira: https://issues.apache.org/jira/browse/GEARPUMP
10
+ Mail list:
11
+
12
+ * Subscribe link to User list: user-subscribe@gearpump.incubator.apache.org
13
+ * Subscribe link to Dev list: dev-subscribe@gearpump.incubator.apache.org
14
+ * Subscribe link to Private list: private-subscribe@gearpump.incubator.apache.org
15
+ * Subscribe link to commits list: commits-subscribe@gearpump.incubator.apache.org
16
+
17
+ What are the changes for the process for Apache Incubation?
18
+ ------------------
19
+ The code importing to Apache Git is still in process. During this transition time,
20
+ We will follow these procedures:
21
+
22
+ 1. For new issue, we should no longer open issue in Github issues. Instead, we
23
+ need to open an issue at Apache Jira: https://issues.apache.org/jira/browse/GEARPUMP
24
+ 2. Pull Requests are still submitted to http://github.com/gearpump/gearpump for review.
25
+ 3. We should cross post the link of PR to Jira site, and Jira link to Pull Request context.
26
+ 4. Code will still be commited to https://github.com/gearpump/gearpump
27
+ 5. During this transition time, document change doesn't require a +1 if it comes from committers.
28
+ 6. The release tag requires a consensus in project discussion like sync-meeting. But it doesn't
29
+ additional "+1" on code commit.
30
+ For example, we will ask around that whether it is OK to trigger a tag; if every one agrees,
31
+ then the assignee can tag the build and change the release doc directly without a written "+1" on the commit.
32
+
33
+ After the transition period, the proposed process is like this:
34
+
35
+ 1. The official repo will be at git://git.apache.org/gearpump.git, all other repos will be
36
+ mirror of this repo.
37
+ 2. We will disable "write" in github issues, and switch to Apache Jira.
38
+ 3. We will enable Apache Github integration, which allow us to mirror official Git repo in Github.
39
+ 4. When the user submit a PR, there should be at least one +1 before doing merge.
40
+ 5. For all commits, the commit should commit the path manually to official repo
41
+ git://git.apache.org/gearpump.git, "Github merge" will be disabled.
42
+ 6. For document change, we can have further discussion on whether it should requires a +1.
43
+
44
+ Before completing importing source code to Apache Git, we will still use
45
+
46
+ Why we make a tag release now, but not wait until Apache importing complete?
47
+ ------------------
48
+ There are quite a lot of open task at https://issues.apache.org/jira/browse/GEARPUMP-1, which
49
+ would take a significant time. For example, we still don't have the new maven artifact yet.
50
+
51
+ Making incremental releases like this one allow us to be more prepared to make a full Apache release.
52
+
53
+ Highlights:
54
+ ------------------
55
+ 1. Update Akka to Akka 2.4.2 (#1988). Now we only support Java 8 and Scala 2.11, Java7, Scala 2.10 support is dropped
56
+ (Be compatible with Akka 2.4.2). The performance of Gearpump 0.8.0 is as good at Gearpump 0.76.
57
+ 2. Fix Min clock slow-advancing issue (#1318) when some graph edge (Possibly means networking between two hosts) don't
58
+ have enough traffic.
59
+ 3. Add OAuth2 social login for UI server.
60
+
61
+ Lowlights:
62
+ -------------------
63
+ Akka-stream DSL module is temporary disabled, as Akka-Stream 2.4.2 has big API change compared with Akka-Stream 1.0. We'd
64
+ like to add the full functional module back in next release.
65
+
66
+ Change log:
67
+ ------------------
68
+ From now on, new issues should be submitted to https://issues.apache.org/jira/browse/GEARPUMP
69
+
70
+ - GEARPUMP-10, Downgrade netty from Netty 4 to Netty 3.8 cause the OAuth2 authentication failure
71
+ - GEARPUMP-9, Clean and fix integration test
72
+ - GEARPUMP-8, fix "two machines can possibly have same worker id for single-master cluster"
73
+ - GEARPUMP-6: show add/remove worker buttons for admin
74
+ - GEARPUMP-5, Add additional authorization check like checking user-organization for cloudfoundry OAuth2 Authenticator.
75
+ - GEARPUMP-3, Define REST API to add/remove worker instances, which allow us to scale out in YARN.
76
+ - GEARPUMP-2, Define REST API to submit job jar
77
+ - #1988, upgrade akka to akka 2.4.2
78
+ - #2015, do not send AckRequest or LatencyProbe when no pending messages
79
+ - #1943 allow user to config how many executors to use in an application
80
+ - #1641, add exactly-once it
81
+ - #1318, fix MinClock not updated fast enough for slow stream
82
+ - #1981, Support OAuth2 Social login
83
+ - #2007, add Java DSL
84
+ - #2002, add akka stream examples
85
+ - #1996, EmbeddedCluster requires master configuration like ClusterActorRefProvider.
86
+ - #1989: add confirmation dialog for kill app and restart app
87
+ - #1983, fix KafkaUtilSpec failure
88
+ - #1975, fix storm integration test
89
+ - #1972, backoff retry kafka consuming on exception
90
+ - #1966 make Partitioner API Java compatible
91
+ - #1892: added instruction text to operate network graph (2) minor tweaks of context menu
92
+ - #1963, rename CommitGuideline.md to CONTRIBUTING.md
93
+ - #1958: better test report organizing
94
+ - #1906: some visual glitches found in mobile view
95
+
96
+ Gearpump 0.7.6
97
+ ===================
98
+ Highlights:
99
+ -------------------
100
+ 1. #1648 Support submit storm jar via dashboard
101
+ 2. Support StreamCQL over Gearpump
102
+
103
+ Change log:
104
+ -------------------
105
+ - #1924, fix storm test spec failure
106
+ - #1926, fix client side configuration does not work in CGroup
107
+ - #1648, support submit storm jar via rest interface
108
+ - #1933, Fixes some of the documentation typos, adds SBT configuration
109
+ - #1936, allow user to config kafka source start offset time
110
+ - #1777, Dynamic DAG failed after changing parallelism for many times
111
+ - #1932, Fix client config overwrites critical system config
112
+ - #1895, make GearpumpNimbus a standalone service
113
+ - #1910, enlarge timeout in MasterClient
114
+ - #1952, document how to use StreamCQL over Gearpump
115
+
116
+ Gearpump 0.7.5
117
+ ===================
118
+ Highlights:
119
+ -------------------
120
+ 1. #1723, Add an experimental cgroup module for CPU isolation.
121
+ 2. #1767, Add docs and implementation to support storm 0.10.
122
+ 3. Make UI mobile phone friendly.
123
+
124
+ Change log:
125
+ -------------------
126
+ - #1919, fix AppMasterSpec
127
+ - #1723 add an experiment module to do cgroup CPU isolation.
128
+ - #1913, add warning for detected loop in DAG.
129
+ - #1896, move storm examples under integration test
130
+ - #1897, increase akka logger start up timeout for unit test
131
+ - #1843 Add a Rest service to launch a new worker
132
+ - #1904, fixed "DAG canvas context menu cannot be displayed."
133
+ - #1898: in integration test, there need a retry attempting for login
134
+ - #1882: extract the tool tip string to externalized file
135
+ - #1837, Use java.net.preferIPv4Stack to force IPv4
136
+ - #1885, Shorten the table view when disabled in mobile.
137
+ - #1883,URL redirection error when accessing index.html
138
+ - #1874, Format the login failure message to more readable format.
139
+ - #1876, Shell command yarnclient should use 1 as the the default count for "addWorker"
140
+ - #1877, Fix several navigation issues on Mobile phone
141
+ - #1830: removed cluster side menu and tuned main navbar
142
+ - #1681: show application last error in overview page
143
+ - #1866, use geardefault.conf to replace reference.conf to avoid confusion
144
+ - #1767, Add docs and implementation to support storm 0.10
145
+ - #1868: show correct data points when switch historical view and recent view.
146
+ - #1864, Add robots.txt to disable search engine crawling
147
+ - #1860, add licenses for included source and binary libraries.
148
+ - #1804, fix UI authentication document page format
149
+
150
+ Gearpump 0.7.4
151
+ ===================
152
+ Change log:
153
+ -------------------
154
+ - #1247, add authentication for UI
155
+ - #1855: when service is unavailable, do not query models without waiting.
156
+ - #1833 update performance related doc
157
+ - #1831, Services exits on bind failure
158
+ - #1779: show critical path latency for application
159
+ - #1733 dynamic dag fall back to last dag version in case of Master HA
160
+ - #1804, fix navbar on mobile
161
+ - #1713 regression on HBaseSink
162
+ - #1838 YARN failure trying to contact YarnAppMaster when launched in YARN
163
+
164
+ Gearpump 0.7.3
165
+ ===================
166
+ Change logs:
167
+ -------------------
168
+ - #1816: Akka GC problem. After fixing, performance gain 30%
169
+ - #1820, http cache is not effective
170
+ - #1817 Problems launching Gearpump in YARN environment
171
+
172
+ Gearpump 0.7.2
173
+ ===================
174
+ Change logs:
175
+ -------------------
176
+ - #1814: metrics data will not update
177
+ - #1812 add gearpump.verbose-gc in gear.conf
178
+ - #1754, use scala binary version in example jar name
179
+ - #1804, polish documents
180
+ - #1803 fix performance regression
181
+
182
+ Gearpump 0.7.1
183
+ ===================
184
+ Highlights:
185
+ -------------------
186
+ 1. #1411. new UI experience. now the frontend UI can safely support applications with tens of thousands to tasks.
187
+ 2. #1514 Add Akka-stream 1.0 experimental module
188
+ 3. #1698, refactor on yarn experiment module, with bug fixes, and enhanced functions, like dynamically adding/removing machines.
189
+ 4. #1679, fix dynamic dag bug (fail to transit)
190
+ 5. #1547, add a SequenceFileSink
191
+
192
+ Change logs:
193
+ -------------------
194
+ - #1761, add more source comments and fix several typo
195
+ - #1799, amend two PROXY typos in files
196
+ - #1411: new UI to allow to scale to thousands of tasks.
197
+ - #1794, split dispatchers of Task and Netty
198
+ - #1018 transfer Any in Message
199
+ - #1792, fix storm module config conflict
200
+ - #1785, [yarn] UI daemon process cannot be terminated
201
+ - #1789 fix DynamicDagSpec
202
+ - #1784, document the limitation of yarnclient command line.
203
+ - #1778, AppSubmitter "-config" option is not used
204
+ - #1782, add doc to run storm over Gearpump application on yarn
205
+ - #1774, remove MaxPermSize JVM option as JDK8 no longer support it.
206
+ - #1772, When upload application in UI, custom config file is not effective
207
+ - #1770, processor metrics is aggregated in wrong way
208
+ - #1768, TaskFilterAggregator is not working
209
+ - #1763, change all GearPump to Gearpump
210
+ - #1411: metrics charts would not update after 15 seconds
211
+ - #1756, add HistoryMetricsConfig for master info and worker info
212
+ - #1754 standardize archive name
213
+ - #1753 update server channel group name
214
+ - #1747: storm spec failure due to parse application id
215
+ - #1747: updated the way to parse application id in command-line
216
+ - #1743, fixing some typo in the example folder
217
+ - #1744, Separate global config and application specific config, allow to config log level for specific
218
+ class.
219
+ - #1734, handle smoothly when more resources are allocated than required.
220
+ - #1698, refactor on gearpump-yarn experiment module
221
+ - #1716: enable code coverage check for master branch
222
+ - #1720, support automatic integration test
223
+ - #1719 unhandled PutKVSuccess in Master
224
+ - #1714: some navbar visual issues
225
+ - #1499, Aggregate the metrics on server
226
+ - #1711: layout is more responsive on small devices
227
+ - #1679 dynamic dag will fall back when replacing a processor failed
228
+ - #1707, support html test report in integration test
229
+ - #1670, regression, change taskActor back to use stashing.
230
+ - #1703: task metrics in bar chart were empty
231
+ - #1701: wrong dirty check of modify processor and more
232
+ - #1384: rest service url was not set correctly
233
+ - #1682: allow specify a transition time when changing parallelism
234
+ - #1691: dashboard layout and textual changes and update to dashing...
235
+ - #1640 YARN deployment - no easy way of obtaining master address...
236
+ - #1688, Reduce unimportant logs in travis UT console
237
+ - #1671, make default timeout shorter to be more UI responsive.
238
+ - #1685, Should not publish gearpump-integration-test to maven
239
+ - #1683, Allow metrics to be aggregated before sending to UI
240
+ - #1223: will mark application with a warning when stalling task de...
241
+ - #1670, #1653, fix dynamic dag bug
242
+ - #1659 add a rest api to terminate service process
243
+ - #1672: when worker is killed, its detail page will no longer be updated
244
+ - #1660 remove Try block,give debug info to user instead.
245
+ - #1666: will should application details (and load metrics afterwards)
246
+ - #1651, fix change processor's parallelism on dashboard
247
+ - #1536, fix storm at least once support
248
+ - #1655: added a test case for replacing a processor
249
+ - #1653 fix replacing a processor
250
+ - #1639 refine daemon's classpath
251
+ - #1652, submit app with no arguments from dashboard returns warning
252
+ - #1547 add a SequenceFileSink
253
+ - #1424: when application is terminated, related status indicators ...
254
+ - #1645: parse appid in submission response better
255
+ - #1514, add an experimental module to support akka-stream 1.0
256
+ - #1643, fix UI timeout issue when metrics is disabled
257
+ - #1632 Remove duplicate of repository
258
+ - #1630, StormBoltOutputCollector skips reporting on ack disabled
259
+
260
+ Gearpump 0.7.0
261
+ ===================
262
+ Highlights:
263
+ ---------------
264
+ 1. New end-to-end integration test, better test coverage (#1243 Thanks to contribution by Stanley, Tianlun, Huafeng, Kewei)
265
+ 2. Storm binary compatibility. (still has some limitation)
266
+ 3. New Document site(#1506).
267
+ 4. Secure YARN and secure HBase support(#1458)
268
+ 5. spray is replaced by akka-http (#1261)
269
+ 6. New serialization implementation(#1445 allow user to custom a serialization framework).
270
+
271
+ Change log:
272
+ ---------------------
273
+ - #1627, refine on custom serialization doc.
274
+ - #1624, fix the worker report resource timeout settings.
275
+ - #1384: removed wrong page redirection
276
+ - #1243: provide an integration test suite
277
+ - #1607 fix NONE_SESSION when restart tasks
278
+ - #1609, fix storm message timestamp bugs
279
+ - #1579 Additional documentation changes
280
+ - #1536, support storm ack
281
+ - #1581, fix HadoopCheckpointStore
282
+ - #1506 Totally reorganize documentation
283
+ - #1538 fix yarn application classpath
284
+ - #1519 fix performance regression
285
+ - #1485 no more pending messages in ExpressTransport
286
+ - #1458, enable secured HBase
287
+ - #1496, fix StormSerializer Kryo buffer overflow
288
+ - #1478: click on location button will copy text to clipboard
289
+ - #1491, fix ContainerLaunchContextSpec
290
+ - #1489, remove terminated executor from ExecutorManager
291
+ - #1481, improve storm over gearpump perf
292
+ - #1479: add uptime field in service interface
293
+ - #1481, fix storm performance
294
+ - #1482, fix TaskScheduler over schedules when multiple executors down at once
295
+ - #1458 support launching Gearpump in secured Yarn cluster
296
+ - #1476 fix serialization in transport layer
297
+ - #1470: updated a broken dashboard dependency
298
+ - #1463, fix storm config
299
+ - #1465 fix DistributedShell
300
+ - #1462 pass user config to SerializerPool
301
+ - #1453: allows use DEL to remove processor/edge-
302
+ - #491: Added support for composing DAG from scratch
303
+ - #1449 fix copy file to local in LocalJarStoreService-
304
+ - #1387 decouple serializer for Message
305
+ - #1445 refactor serialization implementation
306
+ - #1343, support Storm emitDirect and DirectGrouping
307
+ - #809: static resources are now sent to client gzipped
308
+ - #1438: polished modify processor dialog
309
+ - #1423: show full error log in a popup
310
+ - #1423: show error message when uploading is failed and polished the dialog
311
+ - #1430: turn off illegal header warning
312
+ - #1428, add unidoc plugin which allow us to build the scaladoc for the whole project(include all sub-projects)
313
+ - #1228, add data source and data sink for java api
314
+ - #1228, further simplify the java interface
315
+ - #1422: removed if-modified-since header. it is not relevant and is handled very different by different web servers
316
+ - #1228, add java interface for Graph API
317
+ - #1411: chart will always fill data points for 15 minutes
318
+ - #1261, #1127, replace spray with akka-http
319
+ - #1373 add duplicated edge detecting
320
+ - #1412: add 'no-cache' header in ajax responses
321
+ - #1194 add graph cycle detection
322
+ - #491, add a rest api to acquire Gearpump's built-in partitioners
323
+ - #1405: now the number of executors is back
324
+ - #1371: a right way to show historical metrics (2) added committed�?
325
+ - #1402, fix NoneGroupingPartitioner
326
+ - #1399: in application overview page the task count of executor wa...
327
+ - #1397, allow KafkaSink to receive Message of bytes
328
+ - #1395, cross publishSigned
329
+ - #1374 remove jars of yarn in executor's classpath
330
+ - #1266: should exclude dead edges
331
+ - #1238, adds BroadcastPartitioner
332
+ - #1381 test on travis out of memory
333
+ - #1379, support storm tick tuple
334
+
335
+ Gearpump 0.6.1
336
+ ==========================
337
+ Highlight: new version UI dashboard.
338
+
339
+ Change log:
340
+ --------------------
341
+ - #1369: object path and metrics name are divided by ':' now
342
+ - #1369: fixed data initialization issue of echart
343
+ - #1364, add default value for BYTES_PER_MESSAGE of SOLStreamProducer
344
+ - #1361: able to show multiple tasks in chart (better not select mo�?
345
+ - #1358: properties will be updated (2) moved roboto font and echart�?
346
+
347
+ Gearpump 0.6
348
+ ==========================
349
+ Highlight: new version UI dashboard.
350
+
351
+ Change log:
352
+ --------------------
353
+ - #606: ui v2
354
+ - #1352, return appmaster config
355
+ - #1344 fix Master HA bug
356
+
357
+ Gearpump 0.5.0
358
+ ==========================
359
+ Highlights:
360
+ ----------------
361
+ 1. Rename package name to io.gearpump
362
+
363
+ Change log:
364
+ ----------------------
365
+ - #1341, Cannot submit application in UI if one master is killed and another master started
366
+
367
+ Gearpump 0.4.4
368
+ ==========================
369
+ Highlights:
370
+ ----------------
371
+ 1. Allow user to change the DAG on the fly by providing a new jar.
372
+ 2. Add hadoop storage for Transactional topology
373
+ 3. shade environment dependencies jars.
374
+ 4. Support scala 2.10 and scala 2.11
375
+
376
+ Change log:
377
+ ----------------------
378
+ - #1339, metrics typo
379
+ - #1336, verbose log to console
380
+ - #1331, check whether we have duplicate metric before registering.
381
+ - #1330, Worker cannot init when setting HDFS as jarStore
382
+ - #1334, fix Storm LocalCluster dependencies
383
+ - #1324, tag storm tuple with timestamp
384
+ - #1246 isolate processors' classpath
385
+ - #1327, move project state and dsl to under streaming
386
+ - #924, fix storm wordcount example
387
+ - #1319 fix application HA not working
388
+ - #1315, fix clock stalling
389
+ - #1305 remove JarFileContainer, replace it with Path.
390
+ - #1313, fix 2.10 build failure
391
+ - #601, 1. add jvm metrics 2. add master and worker metrics.
392
+ - #1296, enable cross compile and publish
393
+ - #606, add more rest service for new UI(version 2)
394
+ - #1013, track task checkpoint time at ClockService
395
+ - #1301, fix state example tests
396
+ - #339, add Hadoop-compatible CheckpointStore
397
+ - #1278, Optimize the build script for scalajs.
398
+ - #1285, fix travis deploy build script
399
+ - #1241 shade akka-kryo-serialization
400
+ - #1278 split services into 2 projects for scala.js
401
+ - #1290, purify state dependencies
402
+ - #1289, construct HTable at cluster side
403
+ - #1288: upgraded to vis 4.7.0 and optimized redraw
404
+
405
+ gearpump-0.4.2
406
+ ==============
407
+ Change logs:
408
+ --------------------
409
+ - #1217, Remove unnecessary dependencies from project core
410
+ - #1249, separate classpath for different daemon tools
411
+ - #1254, Add error reporting service and UI
412
+ - #1251, refine the build package layout.
413
+ - #1253, Partitioner instance is wrongly shared by multiple tasks
414
+ - #1223: stalling status might not be updated in expected way
415
+ - #1257, return error information when rest api failed.
416
+ - #1258: support filter metrics
417
+ - #1245, Replace processor won't work for data source
418
+ - #1267, print services help into to console
419
+ - #1269: could not specify transit time (2) improved time picker select behavior
420
+ - #1241 shade guava, gs-collections and codahale-metric
421
+ - #1275, fix HealthChecker
422
+ - #1273, refine the metrics UI
423
+ - #1270, add flow control for metrics data
424
+ - #1281, make Processor ReferenceEqual=
425
+ - #1244 simplify Build.scala
426
+
427
+ gearpump-0.4.1
428
+ ==============
429
+
430
+ Change logs:
431
+ --------------------
432
+ - #1175 refactor dsl source and sink to remove hbase/kafka dependencies.
433
+ - #1154: allow user to submit app by UI
434
+ - #1165, fix random UT failures, avoid create new process in UT
435
+ - #1166, throw exception when submit application failed. fix #1151, reduce the memory footprint of each Task
436
+ - #1098, decouple KafkaStorage from KafkaSource
437
+ - #1189 remove unnecessary dependency
438
+ - #1192, fix potential message loss exception in ExpressTransport
439
+ - #1191 change Kryo's instantiator strategy, add fallback strategy when serialization fails.
440
+ - #1156: (1) ui supports replace processor (2) network graph would not be destroyed (3) changed dropdown menu look and feel (4) updated js libraries
441
+ - #1208 zookeeper.connect is being overridden to localhost:2181
442
+ - #1210, fix kafka examples
443
+
444
+ gearpump-0.4
445
+ ===================
446
+ Highlights:
447
+ ----------------
448
+ 1. Better YARN support, and error handling.
449
+ 2. UI allow user to submit a application directly
450
+ 3. Split framework lib with application lib, to reduce class path pollution(ongoing). (#1017)
451
+ 4. Exactly once message processing API (#6).
452
+ 5. Improved Data Connector with Kafka, and Hbase. (#1012)
453
+ 6. Dynamic DAG(#101). Which allow user to replace a computation processor(e.g. Change the parallelism, or change to upgraded implementation Task class)
454
+
455
+ Change logs:
456
+ --------------------
457
+ - #1154: UI, allow user to submit application jar in UI
458
+ - #1162: UI Backend, Rest backend cannot resume connection with master after master restart
459
+ - #1159: memory leak in worker thread pool.
460
+ - #1157: refactor rest interface and UT
461
+ - #1151: reduce the memory footprint when there are thousands of tasks
462
+ - #1149: Shell tools printed too much detail on console
463
+ - #1146: actor hungry when worker use block-io to wait response from FileServer.
464
+ - #1088: move hbase code to external/
465
+ - #1140: pass app name to task
466
+ - #1017: Split daemon dependencies with core dependencies
467
+ - #1144: fix out of memory when trying to scale gearpump to 2000 task on a 2 core machine
468
+ - #995: Command line parser should be able to fall back to MAIN-CLASS definition in MANIFEST.IN when mainClass is not specified in command line options.
469
+ - #1136: fix a dead-lock when shutting down actor system.
470
+ - #101: feature dynamic dag, which allows user to change the running topology in the fly.
471
+ - #1115: design better interface for kafka module
472
+ - #1123: UI, able to restart a running application via dashboard
473
+ - #1037: When user create daemon logs like ui.log in the running, we should be able to recreate a new log file.
474
+ - #1106: cache opensource webfont lato (831kb in total) locally so that there is no error when no internet access
475
+ - #1097: appdag should adapt to window size automatically.
476
+ - #1096: (1) echart would not response resizing (2) metric selector did not work due to angularjs 1.4 breaking change (3) tested and updated other js libraries
477
+ - #1094: service unreachable message will be shown when health check fails
478
+ - #1066: AppSubmitter should not return 0 when error occurred
479
+ - #1056: fix yarn client, to be able to submit applications to master when running in YARN
480
+ - #1083: fix KafkaWordCount example
481
+ - #1080: [UI] uses moving average 1 minute instead of mean rate. As the meanrate changes much slower.
482
+ - #1017, split the lib directory into daemon, and lib. So that user application can have less dependencies.
483
+ - #1067. [YARN]Changing visibility of yarn resources
484
+ - #1064: UI. edge data was not constructed correctly
485
+ - #1060: Add default kafka message decoder
486
+ - #1012, add Source and Sink API
487
+ - #1044 print worker hostname in master log when registering
488
+ - #922: UI. get version by rest api
489
+ - #1025: master is binding to incorrect port when deployed on Yarn
490
+ - #964: #966. Use FSM to manage state in YarnApplicationMaster. Adding missing UT.
491
+ - #1010, Simplify the travis build so that it take less time.
492
+
493
+ gearpump-0.3.7
494
+ ===================
495
+
496
+ Highlight: experimental transactional support
497
+
498
+ Change list
499
+ -----------------
500
+ - #1006, revert the display clock to original version
501
+ - #1004, fix transactional state compile failure
502
+ - #6, add transaction api
503
+ - #902, delete kafka topic on close
504
+ - #826: upgraded to visjs 4.1.0-develop
505
+ - #924, show application name and status on "gear info"
506
+ - #981, add prompt for ClassNotFoundException
507
+
508
+ gearpump-0.3.6
509
+ =====================
510
+ Change list
511
+ ------------------
512
+ - #977, speedup the UT by avoiding creating multiple sub process JVMs.
513
+ - #974, Remove unnecessary MasterProxy creation in unit test
514
+ - #969 Tests for examples create a test harness per test
515
+ - #968, update Codecov upload method
516
+ - #960, Services Specs do not terminate ClockService
517
+ - #959, LOG in TimeoutScheduler causes JVM exit
518
+ - #935 improve the application clock
519
+ - #659, remove kafka integration test
520
+ - #947 optimize checkMessage performance in TaskActor
521
+ - #945, [NPE regression] Partitioner is null
522
+ - #941, allow user to define custom partitioner by REST
523
+ - #890: add cloudera manager integration support for gearpump
524
+ - #928 continue to improve the performance of taskActor.allowSendingMoreMessages
525
+ - #936 bumping up version of sbt-scoverage plugin
526
+ - #934, allow user to define uid for edge partitioner.
527
+ - #928 improve the allowSendingMsg performance
528
+ - #926: previous restcall should be dropped if the page is destroyed
529
+
530
+ gearpump-0.3.5
531
+ =====================
532
+ Change list
533
+ ------------------
534
+ - #729 remove argument '-master' in YARN service and documents.
535
+ - #759, fix storm connector bug due to unstable topology sort of DAG
536
+ - #775, fix netty config
537
+ - #778, log improvements
538
+ - #781 when launching lots of tasks, the application failed to transfer message across hosts
539
+ - #782, a) add wildcard match to return metrics(support glob char . and *), b) add diagnosis message if the clock stop advancing
540
+ - #786, Read user config from classpath, the appmaster/executor wil use the dynamic user config
541
+ - #773: skew chart will show relative skew
542
+ - #790, 1) return detail task data in appmaster REST. 2) bind executor id with executor system id
543
+ - #795 TaskScheduleImpl'bug when executor failed
544
+ - #799 Getting 2.10 cross build working
545
+ - #802 add process id and host name in executor log file
546
+ - #803: (1) websocket is by default not preferred (2) throughput should be added as sum not mean (3) changed input/output message to sink/source processor receive/send throughput
547
+ - #805, metrics rest service should return latest metrics received
548
+ - #684 - setting -Xmx for master and worker when running on Yarn This will prevent JVMs from growing above limits and get killed by Yarn
549
+ - #796: (1) added executor info (2) fixed skew chart issue for the first node
550
+ - #801, add config service for master and worker.
551
+ - #741 add a example transport use case
552
+ - #814, expose TaskActor.minClock through TaskContext
553
+ - #741 refine example
554
+ - #817 split examples jar into multiple jars
555
+ - #824, allow to use default partitioner when defining a DAG
556
+ - #829, add some handy operator like groupByKey, sum, for KV Stream
557
+ - #831: uses pagination control to speedup table rendering
558
+ - #816: use multi-select control to select tasks
559
+ - #840: task charts data were incorrect
560
+ - #844, expose upstream minclock
561
+ - #204, page rank demo code
562
+ - #846, support more anyVals in user config
563
+ - #843, Can't put custom user config in application.conf
564
+ - #849, set default hostname to 127.0.0.1 in UT
565
+ - #851, JVM not exited when there is exception due to akka create non-daemon threads
566
+ - #854, fix storm connector performance
567
+ - #856, Service launch failed
568
+ - #853, fix resource leak(thread not closed, process not killed in UT. Also increase the PermGen size to avoid Permgen OOM.
569
+ - #859, random UT fail due to akka bug, "akka cluster deadlock when initializing"
570
+ - #865, Change the default timeout setting in akka test expectMsg
571
+ - #871, Add explicit error log for kryo serialization exception
572
+ - #877: source node and sink node were not calculated correctly.
573
+ - #874, [TaskActor] task onStart should be called after the network transport layer is ready
574
+ - #879: split metrics into different views and changed tooltip control
575
+ - #881: diverse issues of skew charts and made tooltip nice
576
+ - #876: clock is updated every second-
577
+ - #885: wrong application clock in some case
578
+ - #53, rest interface to submit a dag by JSON representation
579
+ - #887, add a rest to get stalling tasks
580
+ - #801: added download links for configurations-
581
+ - #742 add a rest to get Gearpump version
582
+ - #898, Downgrade akka version from 2.3.9 to 2.3.6
583
+ - #900, Use gearpump.hostname by default=
584
+ - #719 add Kafka Source and HBase Sink for dsl
585
+ - #905: Upgrade sbt-pack from 0.6.8 to 0.6.9
586
+ - #602: dashboard will freeze when server is unreachable
587
+ - #907: calculate application clock update frequency for a 30 second time frame
588
+ - #919: vis.js's version was not updated
589
+
590
+ gearpump-0.3.4
591
+ ====================
592
+ Change List:
593
+ ----------------
594
+ - #768, Serious performance degrade of ui server on windows
595
+ - #765, improve the graph type inference so we don't need to set template argument type explicitly
596
+
597
+ gearpump-0.3.3
598
+ ====================
599
+ Change List:
600
+ ----------------
601
+ - #716, Refine the user interface. improve the user interface, like Application, Processor
602
+ - #755, fix Build breakage,
603
+ - #729, remove argument '-master' in command line option, use gear.conf instead.
604
+ - #713, provide an option to read from beginning of a topic
605
+ - #746, support state clock for task so that we can retrieve the state timestamp
606
+ - #744: fix several metrics issues
607
+ - #638, Use Subscription to link two processor
608
+ - #662, [UI] added processor details tab
609
+ - #735, [yarn]Launch UI in the same container of Yarn AppMaster container.
610
+ - #732: [UI]add more charts and add more metrics to dag
611
+ - #731 rename TaskDescription to ProcessorDescription
612
+ - #708, fix storm connector config classpath
613
+ - #722: [UI]use different color and opacity for edges
614
+ - #708, allow user to pass in a customized storm config
615
+ - #709: [UI]npe when streaming dag is not initialized
616
+ - #704, DAG processor name is "undefined" if "description` field of TaskDescription is not defined
617
+ - #706, Remove example jars from gearpump built-in classpath.
618
+ - #701 add a HBase sink
619
+ - #28, add an experiment module to support a very basic flatmap dsl
620
+ - #666, add UI for stock crawler example
621
+ - #691: [UI] fix metrics
622
+ - #680, add a service in appmaster to support query of task actorRef
623
+ - #210, allow easier remote debugging executor process
624
+ - #666, add a stock index crawler example,
625
+ - #658 make config of Gearpump on Yarn configurable
626
+ - #676, add a storm connector to allow user to run arbitrary storm jar
627
+ - #657, remove unnecessary yarn deps
628
+ - #672, extend Task to support unmanaged messages so that every task can serve as full functional service
629
+ - #670, fix yarn application path and log path
630
+ - #665, Add scheduleOnce interface in TaskContext
631
+
632
+ gearpump-0.3.2
633
+ ====================
634
+ Change List:
635
+ - #654, Use yarn to distribute whole gearpump package instead of jars
636
+ - #631, remove unnecessary storm dependencies
637
+ - #652, log conflict between slf4j and log4j
638
+ - #652, log is muted when running on yarn
639
+ - #650, remove logback classic slf4j binding from classpath
640
+ - #648, yarn unable to start worker
641
+ - #27, Integrate YARN into scheduler
642
+ - #643: metrics tables are now sortable
643
+ - #639, fix parallelism is 0 on GlobalGrouping
644
+ - #636, fix FieldsGroupingPartitioner
645
+ - #629 - query backend for actual websocket address
646
+ - #634: create websocket can be failed when url is undefined
647
+ - #415, support storm connector
648
+ - #613, Show metrics charts in application's detail page
649
+ - #546 add a rest api to query WebSocket url
650
+ - #624, add description field to TaskDescription
651
+ - #434 add api/v1.0 prefix for all rest services
652
+ - #618 fix no data returned when call Metrics rest
653
+ - #607, bump up kafka version to 0.8.2.1
654
+ - #615, Incorrect Dag edge width
655
+ - #608 increase the maximum frame size of Akka
656
+ - #611: dag looks more elegant
657
+
658
+ gearpump-0.3.1
659
+ ====================
660
+ Change List:
661
+ - #591, (1) added metrics to application detail page (2) periodically update page contents without pressing refresh (3) replaced angular-dashboard-framework with bootstrap + angular
662
+ - #600, Config API should return all config under section "gearpump"
663
+ - #597, by default, app wil run for ever except you kill it explicitly.
664
+ - #595, use smaller metrics interval
665
+ - #417, update READ.ME and refactor DistributedShell
666
+ - #388, catch netty channel close exception and warn
667
+ - #589, change applicationData's timestamp to 24-h format
668
+ - #417, deploy a service across the cluster
669
+ - #568, enable history metrics service
670
+ - #584, KafkaOffsetManager should only stores one offset per timestamp
671
+ - #562 fix AppMaster and Executor restart infinitely
672
+ - #576, Add processor level for REST returned DAG, so that the UI can render the DAG correctly.
673
+ - #568, [REST] add history metrics service in backend
674
+ - #571 AppMaster failed to recover
675
+ - #569, dag cannot be rendered
676
+ - #566, a) add rest service to shutdown an application b) add a rest service to provide app configuration
677
+ - #564, REST should return more data for Application information
678
+ - #561, add more task metrics
679
+ - #558, [REST]Add missing "name" field for metric Histogram
680
+ - #556, Use "Processor" to replace taskGroup in source code
681
+ - #555, DAG data returned should contains processor Id
682
+ - #544, (1) dashboard will now request appmaster details only once 2) visdag is no longer a widget of adf (3) reduced animation of visdag
683
+ - #526, Kafka tests are failing in master branch
684
+ - #467, Expose codahale metrics by rest service
685
+ - #526, temporary disabled kafka examples to make build pass
686
+ - #513, Several remain UI issues in new dashboard, like version tag in dashboard
687
+ - #516, Travis failed to deploy the binary to github release
688
+
689
+ gearpump-0.3.0-rc1
690
+ ====================
691
+ Change List:
692
+ ---------------
693
+ - #510, add log directory for UI server
694
+ - #485, retain inactive application history in Master
695
+ - #504, 1) AppMaster return more detailed application runtime information. 2) fix a worker bug when returning executors which run on worker.
696
+ - #422, [UI] show the number of executors (2) changed layout of application page
697
+ - #417, add a experiment module to distribute a zip file to different machines
698
+ - #502, fix KafkaStorage loading data for async kafka consumer
699
+ - #422, [UI] (1) added home directory in UI (2) removed millis from duration 3) updated dag control height
700
+ - #476, fix worker and master log path format in rest service
701
+ - #498, worker rest data is not updated in UI
702
+ - #397, move distributed shell from experiments to examples folder
703
+ - #493 add implicit sender so that the Task can send itself messages[work around]
704
+ - #427, use new kafka producer in kafka 0.8.2
705
+ - #422, added cluster page to show master and worker information
706
+ - #489, make the worker rest information easier to parse
707
+ - #202, Add a default serializer for all kinds of messages
708
+ - #477, REST Workers should return more information
709
+ - #456, uses webjars to serve visjs 3.10.0
710
+ - #483, upgrade visdag to 3.10 because widget does not repaint correctly when a node is moved
711
+ - #473, Use webjars with spray support instead of bower to serve static resources
712
+ - #477, return more data for rest call workers/
713
+ - #474, fix rest service UT test fail.
714
+ - #479, publish test jar as artifacts
715
+ - #419, Reorder the application log by master startup timestamp
716
+ - #456, Use visdag to render the graph DAG
717
+ - #464, Travis bower integration
718
+ - #394, fix kafka producer hang issue
719
+ - #468, For test code, the ClockService will throw exception when the DAG is not defined
720
+ - #465, fix appname prefix bug
721
+ - #461, AppMasterSpec and WorkServiceSpec UT are failing
722
+ - #270, Create a force-direct dag
723
+ - #453, Add rest service to serve master info
724
+ - #423, refactor task by separating TaskActor and Task
725
+ - #422, add worker rest api
726
+ - #449: avoid load external resource by removing all CDN external links
727
+ - #397 refactor distributed shell by using new Cluster API
728
+ - #441, ui-portal is failed to build because of spray version conflict
729
+ - #430 use application name as unique identifier for an application
730
+ - #440, moved dashboard code from conf to service/dashboard
731
+ - #402, refactor task manager
732
+ - #280, Add websockets to REST api
733
+ - #269, Define UI Dashboard structure
734
+ - #406, custom executor jvm config in gear.conf is not effective.
735
+ - #394, fix ActorSystemBooter process not shut down after application finishes
736
+ - #412, add version.sbt
737
+ - #410 Add sbt-eclipse plugin and wiki for how to build gearpump on eclipse
738
+ - #408, handle Ctrl+C(sigint) gracefully.
739
+ - #396, bump up kafka version to 0.8.2.0
740
+ - #398, Expose more metrics info
741
+ - #389, fix kafka fetch thread bug
742
+ - #386 UT fail due to unclosed sequence file
743
+ - #370, refactor streaming appmaster
744
+ - #358, use uPickle for REST Service
745
+ - #372, fix DAG subgraph build and more Graph UT
746
+ - #377, fix KafkaSource.pull performance due to the List.append is not having good performance
747
+ - #378, construct the serializer explicitly, instead of implicitly via the kryo serializer akka extension
748
+ - #380, set the context class loader as the URL class loader for ActorSystem.
749
+
750
+ gearpump-0.2.3
751
+ ====================
752
+ Change List:
753
+ ---------------
754
+ - #333, KafkaUtilSpec causes out of memory on travis
755
+ - #335, #359, Enable auto-deployment to sonatype
756
+ - #299, Some UT may fail randomly, most because of the expectMsg time out
757
+ - #338, fix kafka leader not available exception
758
+ - #349, scoverage dependencies get into snapshot build binaries.
759
+ - #352, add RollingCountSpec
760
+ - #356, User's application.conf can not be loaded due to empty config.
761
+ - #373, add more restrict checks for warning, deprecation and feature
762
+
763
+ gearpump-0.2.2
764
+ ====================
765
+ Change List:
766
+ -----------------
767
+ - #327 fix 0.2.1 build error
768
+ - #308 add another dag example project
769
+ - #330 Allow user to output the metrics to log file besides graphite
770
+
771
+ gearpump-0.2.1
772
+ ====================
773
+
774
+ Change List:
775
+ -----------------
776
+ - #244, add more UT,
777
+ - #250, refactor kafka implementations
778
+ - #301, fix UserConfig ClassNotFoundException
779
+ - #306, ClassNotFound for customized Application type
780
+ - #299 fix SeqFileStreamProcessorSpec
781
+ - #320 fix dead lock in StreamTestUtil.createEchoTaskActor
782
+ - #317, allow user to customize the akka system config for appmaster
783
+ - #244, add KafkaUtilSpec and kafka integration test
784
+
785
+ gearpump-0.2
786
+ =========================
787
+
788
+ Highlights:
789
+ -----------------
790
+ - Published a tech paper about the design on https://typesafe.com/blog/gearpump-real-time-streaming-engine-using-akka
791
+ - UT coverage rate to 70%
792
+ - Add support for general replay-able data source to support at least once delivery.
793
+ - More robust streaming. Be resilient to message loss, message duplication, and zombie processes.
794
+ - Refactor Kafka data source for at least once delivery.
795
+ - Support general applications besides streaming, add an experimental distributedshell application under experiments/.
796
+ - Re-defined the AppMaster, and Task interface, It is much easier to write an application now.
797
+ - Support submitting and distributing large applications jars.
798
+ - Add CI tool, nightly build, code coverage, and defined a formal commit guideline.
799
+
800
+ Change list:
801
+ -------------------
802
+ - #274 AppMaster cannot connect to worker if there are multiple interface on one machine
803
+ - #272 Too many dead log messages in the log
804
+ - #266 Kafka grouper conf is incorrect
805
+ - #259 fix stream replay api and impl
806
+ - #245 jacoco conflict with codecov
807
+ - #244 Add more unit test for better test coverage
808
+ - #242 Add application submitter username so that we can separate the logs for different user
809
+ - #239 REST AppMasterService test failed
810
+ - #237 Add more information in log line
811
+ - #233 Add TIMEOUT for interactive messages between two parties
812
+ - #230 Executor fails to connect with AppMaster when in a multiple NIC environment
813
+ - #229 Add a default cluster config under conf/
814
+ - #226 return error message to user if not enough slots
815
+ - #225 Gearpump logging application logs to different streams(and to persistent storage)
816
+ - #222 TimeStampFilter implementation is wrong
817
+ - #221 AppMastersDataRequest, AppMasterDataRequest and AppMasterDataDetailRequest should return information about failed appmaster attempts
818
+ - #217 Write a small custom AppMaster example, which can run distributed shell.
819
+ - #216 Support large application jars
820
+ - #215 Improve the API and configs so it more easy to write and submit a new application.
821
+ - #213 Add documents about how we do benchmark
822
+ - #212 when network partition happen there maybe zombie tasks still sending messages for a while
823
+ - #208 Support long-running applications
824
+ - #196 When AppMasterStarter fails to load a class, the whole Gearpump cluster crash
825
+ - #191 Add docs for all examples
826
+ - #184 When packing example to a uber jar, should not include core and streaming jars
827
+ - #176 Fix NPE for REST /appmaster/0?detail=true when no appmasters have launched
828
+ - #169 Convert REST CustomSerializers to extend DefaultJsonProtocol
829
+ - #162 version conflicts between dependencies of sub projects bug
830
+ - #148 Revert code to be Java 6 compatible
831
+ - #145 Add instructions document for Gearpump commit process
832
+ - #138 Update ReadMe.md project description
833
+ - #135 Add travis build|passing status icon to README.md
834
+ - #130 AppMaster, TaskActor class references should not be explicitly referenced in SubmitApplication and TaskDescription - messages
835
+ - #127 Document how to run coverage reports, fix sigar exception seen during tests.
836
+ - #117 Fix style and code warnings, use slf4j where appropriate
837
+ - #116 Add unit tests to gearpump-core
838
+ - #115 Setup travis CI and codecov.io for Gearpump
839
+ - #112 Break up examples into separate projects as prerequisite to #100
840
+ - #110 Netty Java code cleanup
841
+ - #108 Spout and Bolt classes should be renamed
842
+ - #106 Add unit tests for REST api
843
+ - #104 ActorInitializationException while running wordCount in local mode
844
+ - #103 Build error, unable to resolve akka-data-replication
@@ -67,7 +67,8 @@ module AwesomeBot
67
67
 
68
68
  def cli_process(filename, options)
69
69
  begin
70
- content = File.read filename
70
+ untrusted = File.read filename
71
+ content = untrusted.encode('UTF-16', :invalid => :replace, :replace => '').encode('UTF-8')
71
72
  rescue => error
72
73
  puts "File open error: #{error}"
73
74
  return error
@@ -5,5 +5,5 @@ module AwesomeBot
5
5
  'Great for "awesome" projects.'
6
6
  PROJECT_URL = 'https://github.com/dkhamsing/awesome_bot'
7
7
 
8
- VERSION = '1.12.0'
8
+ VERSION = '1.12.1'
9
9
  end
metadata CHANGED
@@ -1,14 +1,14 @@
1
1
  --- !ruby/object:Gem::Specification
2
2
  name: awesome_bot
3
3
  version: !ruby/object:Gem::Version
4
- version: 1.12.0
4
+ version: 1.12.1
5
5
  platform: ruby
6
6
  authors:
7
7
  - Daniel Khamsing
8
8
  autorequire:
9
9
  bindir: bin
10
10
  cert_chain: []
11
- date: 2016-06-03 00:00:00.000000000 Z
11
+ date: 2016-06-14 00:00:00.000000000 Z
12
12
  dependencies:
13
13
  - !ruby/object:Gem::Dependency
14
14
  name: parallel
@@ -43,6 +43,7 @@ files:
43
43
  - bin/assets/test-bad-link
44
44
  - bin/assets/test-dupe
45
45
  - bin/assets/test-errors
46
+ - bin/assets/test-invalid.md
46
47
  - bin/assets/test-link-issue
47
48
  - bin/assets/test-no-dupes
48
49
  - bin/assets/test-no-issues