Code samples in repo

[mrandrewandrade]

Going through the guide and it's a bit tedious to type out all of the code examples. Copy pasting is a bit tedious as well due to line endings and “” instead of ""

Would you accept PR which includes the code examples from the book ? Many textbooks have the code examples available on their website.

[bllchmbrs]

Hey! Thanks for the thought. As we just finalized the entire book, I think we are a bit premature in getting all of the code samples in here. I certainly empathize with the challenge that you're facing :).

Can you give me another week or so to figure out the best approach and then I can follow up?

Thanks,
Bill

[mrandrewandrade]

Congrats! Looking forward to it. Let me know if I can help out, even parsing the LaTeX / markdown / restructured to one list of core would be great Le lun. 27 nov. 2017 à 15:43, Bill Chambers <notifications@github.com> a écrit :

…

Hey! Thanks for the thought. As we just finalized the entire book, I think we are a *bit* premature in getting all of the code samples in here. I certainly empathize with the challenge that you're facing :). Can you give me another week or so to figure out the best approach and then I can follow up? Thanks, Bill — You are receiving this because you authored the thread. Reply to this email directly, view it on GitHub <#3 (comment)>, or mute the thread <https://github.com/notifications/unsubscribe-auth/AEZvXJLvvWzNlPaNjax0Jd20oWJS5qjoks5s6tilgaJpZM4Qqj0c> .

[mrandrewandrade]

I also added the code to a gist here if it's helpful!

[bllchmbrs]

hey @mrandrewandrade, the book has finally gone to print! Sorry for the delay on this. However, now that it's gone to print - we're ready to stat adding the code samples!

What I'm going to do is try to pull all of them out of the book now in order to post them here. I don't expect it to take too long, but feel free to let me know if you have any thoughts!

[mrandrewandrade]

Sounds awesome! If you need a script to do it let me know! Assuming it was done in LaTeX?

…

On Thu, Feb 8, 2018 at 5:17 PM Bill Chambers ***@***.***> wrote: hey @mrandrewandrade <https://github.com/mrandrewandrade>, the book has finally gone to print! Sorry for the delay on this. However, now that it's gone to print - we're ready to stat adding the code samples! What I'm going to do is try to pull all of them out of the book now in order to post them here. I don't expect it to take too long, but feel free to let me know if you have any thoughts! — You are receiving this because you were mentioned. Reply to this email directly, view it on GitHub <#3 (comment)>, or mute the thread <https://github.com/notifications/unsubscribe-auth/AEZvXGJLKH3zY6Bu18iwY1GXSh-H9aQDks5tSywVgaJpZM4Qqj0c> .

[artem0]

Will be this code samples used in the book or it's located in another repository?

[bllchmbrs]

They will be in this repo.

[masonl]

i was going through your free preview copy and run into some issue with python code to select top 5. I have to make following change to get the top 5 rows, otherwise, the 'ORDER BY' won't work:
old:
purchaseByCustomerPerHour = streamingDataFrame
.selectExpr(
'CustomerId',
'(UnitPrice * Quantity) as total_cost',
'InvoiceDate')
.groupBy(
col('CustomerId'),
window(col('InvoiceDate'), '1 day'))
.sum('total_cost')

new:
purchaseByCustomerPerHour = streamingDataFrame
.selectExpr(
'CustomerId',
'(UnitPrice * Quantity) as total_cost',
'InvoiceDate')
.groupBy(
col('CustomerId'),
window(col('InvoiceDate'), '1 day'))
.sum('total_cost')
.withColumnRenamed('sum(total_cost)', 'sum_total_cost')

old:
spark.sql("""
SELECT *
FROM customer_purchases
ORDER BY 'sum(total_cost)' DESC
""").show(5)

new:
spark.sql("""
SELECT *
FROM customer_purchases
ORDER BY sum_total_cost DESC
""").show(5)

[bllchmbrs]

I think those version are likely old. The book has changed quite a bit since then.

[masonl]

@anabranch I see, thanks.

[bllchmbrs]

Code is posted! It's under the code folder. Let me know if you see any issues!