I have been mainly using HiveQL,SparkQL in my current firm for doing data engineering task which is mainly DWH and Batch processing.

I want to switch but i have seen some job posts asking for Python / Scala / Java .

I am really confused on what should i pick up.While in my current firm its a Scala code implementation running under the hood but we mainly using SparkSQL queries .

My end goal is to try and land a job at Amazon as a Data Engineer at some point in my career.Which programming language should i be focusing on if i want to have a steady career growth and get a job where i can do stream processing.

If it helps i am based out in India

I am developing an MVP for a SaaS product as a progressive web app hosted on Firebase at the request of a VC. As I get started I am reminded why I f**king hate TypeScript/JavaScript so much. I'd say between not being that good at FE to begin with and having to manage dumb error messages I am losing velocity. I'd love to develop this in Scala.JS and Laminar as it’s so much simpler and I already know Scala fairly well, but I am worried that if when the MVP needs to scale and onboard new developers I will have trouble finding any. Should I just suck it up and use React? Part of me feels like I am putting the cart in front of the horse worrying about what will happen if this product will get funding when it hasn't yet.

The "RoguelikeDev Does The Complete Roguelike Tutorial" has just started. I'm going to attempt to follow along for the first time... and you can too! Week 1 has just started.

WIP Roguelike

I've made a little roguelike starter kit for Indigo to do some of the heavy lifting.

https://github.com/PurpleKingdomGames/indigo-roguelike-starterkit

In truth I hope to stay ahead of the tutorial to make sure the starter kit has all the tools needed for anyone else having a go. I have to make sure it works somehow!

You can follow my own progress here and use it as a reference if it helps:

https://github.com/davesmith00000/roguelike-tutorial

If you do have a go and get stuck, feel free to join the indigo Discord and say hello.

I have been learning Scala for two years on my own whenever i get some free time .In a week i spent around 45 mins-1hour.I know I am not very good at it but I dont know what should i learn to improve.

I have made a very small project : https://github.com/dionesh12/ETLFramework.

If anyone could go through it and recommend as to how i should improve or should i quit while i am ahead if its really bad i will be extremely grateful

Introduction

When I saw opaque types and inline methods, I quickly thook about type-level assertions evaluated at compile time. I was pretty hyped by this idea so I made Iron.

Iron uses Dotty's inline and opaque types to create almost zero-overhead (and true zero-overhead for the next Scala 3 release) type constraints for Scala. It also supports runtime constraints.

Actually, Iron is almost full-vanilla (By vanilla I mean "without macro/black magic"). Inline methods, implicit conversions and opaque types are powerful enough to use them for 90% of the library. Thank you Dotty.

Usage

Passing a value A to a parameter/variable/return requiring a Constrained[A, B] will (using a given method) implicitly get a Constraint[A, B] (alias: ==>[A, B]) and use Constraint#assert. If the result is false, a compile time error is thrown.

Example:

import io.github.iltotore.iron.*, constraint.*, numeric.constraint.*

inline def log(x: Double ==> Greater[0d]): Double = Math.log(x)

Using to type aliases, we can sugar even more our constraint:

import io.github.iltotore.iron.*, constraint.*, numeric.constraint.*

type >[A, V] = A ==> Greater[V]

inline def log(x: Double > 0d): Double = Math.log(x)

log(-1) //Compile time error

If the constraint is evaluated at compile time, no runtime overhead left. For example, log(2) desugars to:

// Scala 3.0.0
Math.log(Constrained.unchecked(-1)) //Constrained.unchecked returns the passed argument

// Next release
Math.log(2)

That's all ! I hope this library will help. Check the readme for further informations.

• Github: https://github.com/Iltotore/iron/
• Wiki: https://github.com/Iltotore/iron/wiki/
• Scaladoc: https://iltotore.github.io/iron/scaladoc/

Hi! I'm currently digging through Programming in Scala - Fifth Edition. While I generally like the new control syntax, now in chapter 9.4 I realize that it does not extend to user defined control structures. E.g given

def myscope(byNameParam : => Unit) : Unit =  
  println("BEGIN")  
  byNameParam  
  println("END")

I cannot use

myscope
  println("test")

but instead still have to use

myscope {
  println("test")
}

This is slightly annoying. Will this restriction be lifted at some point?

Interesting to see such a big personality in crypto space endorsing Scala.

Link: https://youtu.be/FKh8hjJNhWc?t=2008

I have seen that there some libraries that use type level programming that try to simulate the aforementioned types but my question has to do with built-in support of these types. Thanks

I'm studying Scala with the Coursera specialization. I want to start with scala because 2 reasons: 1) functional programming and 2) higher salaries. I think in November I will complete the specialization. I have 10 years of experience with .NET, Angular, Python, and some Julia. I'm Latin American, very well paid for Latin American standards. My question is... how do you focus the career plan to get a remote job with North American salaries with North American company?

I'm paid above average for national standards, but the average at the USA is much higher... I would be happy to find a Job with a USA-average salary.....

Hi Guys, Did anyone here purchase the "Programming in Scala, 5th edition" which is updated for Scala 3?

• How is it?
• Would you recommend buying it?

Link for the book: https://www.artima.com/shop/programming_in_scala_5ed

Thanks

Please post the job with the following template:

Company Name | Title(s) of position(s) being hired for | City, [State/Province,] Country | {ONSITE, REMOTE} | {Full Time, Part Time, Contract} | (Optional) $approximate salary  description  contact information 

Posters: Please only post if you are personally involved in the hiring party -- no 3rd party recruiters (you must post the name of the company)

Readers: please only email submitters if you personally are interested in the job—no recruiters or sales calls.

Beginner here to Big Data, I have been exploring Spark (PySpark to be very specific) but if I want to scale up with Data Engineering (Big Data skillset) do I need to pickup Scala since it is similar to Java and is little too verbose which kinda demotivates me.

Suggestions and advices please

Hi there! Just thought I would post this for discussion purposes.

I just wanted to talk about some of the somewhat mysterious circumstances we are left with regarding Scala ad Caelum (SaC). Hopefully Dark Road continues to fill in blanks.

I'd like to think there's some ambiguity on things as we have been shown several conflicting visuals of SaC across the 3 games noted in the title:

KH3: We see a memory version of what SaC was like for Master Xehanort (MX) through his Dream Portal. This is from his time as an apprentice prior to his Mark of Mastery exam.

Dark Road: We see his time as an apprentice at SaC.

Union Cross: >!We see a very unique version of SaC with grey architecture. We also discover that Xehanort was originally born there (most likely) and was brought to Destiny Islands by a mysterious old person. Brain also awakens in a version of SaC where Siegward meets with him and we see a statue of Ephemer in a fountain (hinting he has passed away). This is the same grey architecture.!<

The timeline is very important for things as it's clear SaC goes through some visual changes and understanding the context of things makes it a little complicated.

It seems that the implied timeline of events is as follows:

>!1) Ephemer comes out of his pod and uses the Master Keeper to change Daybreak Town to SaC!<

>!2) Somehow(?) people take up residency of SaC (i.e. Siegward and Xehanort's mom exists)!<

>!3) Ephemer dies and his memorialized in the main plaza!<

>!4) Brain ends up in SaC one way or another (not really clear how from Ux's ending)!<

5. Brain makes a family so that Eraqus can be born (assuming he's his ancestor)

>!5) Baby Xehanort (BX) is born and is taken away from SaC for...reasons!<

>!6) BX arrives in Destiny Islands!<

7. Young Xehanort (YX) meets his Brown Hood self and travels to SaC (now the white version and no other people around)

8. YX goes through Dark Road storyline (wherever that leads)

9. YX meets MoM (ReMind DLC) and learns his "purpose"

10. YX becomes MX and everything from BBS-DDD happens

11. Sora turns MX's time travel abilities against him by using him as a portal to travel to SaC as he remembers it

That's about the extent of what we've seen with SaC so far as far as I can tell.

Here's a few interesting questions/insights:

>!1) What happened to people living in SaC after BX is taken away? It seems the city is more or less deserted save for the few people we see

I want to use Scala microservices on AWS Lambda, who has experience with, how did you organize the deployment process?

I've been recently gaining interest in Scala as a tool for data engineering. I was trying to do some cool Data Analysis pipelines on Scala as a practice but I can't seem to find any libraries or learning resources for the exploratory data analysis phase, nor the feature engineering and selection.

I wonder if anyone here is aware of any libraries/notebooks or other materials showing tools to do EDA (especially visualization) and preprocessing on Scala. Thanks

I'm starting a small actor oriented project in Typed Akka and was thinking of possibly using this as an excuse to update my knowledge by doing the project in Scala 3. I noticed that the official quick start giter8 template akka/akka-quickstart-scala.g8 uses Scala version 2.13.1

I have attempted to add Akka dependencies to the Scala 3 template scala/scala3.g8 and also attempted to change the Scala version number in the Akka template but both result in unresolved dependencies and failed to build.

Is there a way to get Scala 3 and Typed Akka up and running with current versions (I saw an older unofficial template from 2019 using Dotty but nothing more recent)?

If I must I can postpone using Scala 3 to a later project. It is more vital that this use Akka than that it use Scala 3.

[ Removed by reddit in response to a copyright notice. ]

Alright, girls, boys, and those who lie in-between. We know there are already libraries written in Scala 3, but how many end-user apps are there? Because I have one for you! 🥳

... and it's a calculator.

https://github.com/makingthematrix/scalaonandroid/tree/main/calculator3

From here you can download the APK file and install it on your phone with `adb` and a USB cable. I don't think it makes sense to register this app on F-Droid or, gods have mercy, Google Play Store. In the future, I will do it with a more complex app I have in plans, but for now, `adb install` is the way to go). Or you can copy the whole repo and build the app yourselves.

Here's how it looks like:

Scala 3 Calculator

This remarkable achievement of razor-edge tech and top-notch UX wouldn't be possible without all the brilliant people working on Scala 3, GraalVM, Gluon, JavaFX, and scala-maven-plugin. Me, I'm just putting the puzzles together.

That being said, Scala 3 support still needs some love. There are issues, mostly around JVM/Scala compatibility (Java modules *coff* *coff*) . Now I will spend some time describing what I found about them the best I could - and nagging the above-mentioned brilliant people to take a look. But, all in all, I think we're really doing great. I didn't expect the migration to be so easy. Just as earlier I didn't expect all these different pieces would so easily fall into their places and a Scala app on Android would just work. I feel... grateful. And also super happy - hence the tone of this entry.

Cheers 😊

Thank you to everyone who worked on this and the humble genius dr odersky

Is there a way to examine the LLVM IR generated by scala native?

I ran the sample template project listed here - https://scala-native.readthedocs.io/en/latest/user/sbt.html#minimal-sbt-project and got a bunch of ll files - 0.ll, 1.ll, 2.ll, etc each of which seems to contain obfuscated LLVM IR. Is it meant to look like this and be unreadable?

I can see that there is a Main.NIR file (as expected). Do I need to convert the NIR to LLVM IR in some way?

I couldn't find any relation between Scala and Lisp. However, most of the Scala Job openings ask for either Scala experience or Lisp experience.

>For example, I think curly braces work perfectly well as delimiters, and that's why I picked them. We could have insisted on begin/end or something else, but I don't think it actually works better.

This syntax has a lot of discussion

Martin once said brace works pretty well .

What is the consideration for adding such a controversial syntax now ?

Hello, I have been a python developers for about 5 years and had recently been doing scala, I had to learn it for a job that required spark and found it great in general and I can now understand better the enthousiasm about it. Now for my question, I am a data engineer and have been to a couple of jobs where scala developers show this attitude about python as it is some sort of easy shallow langage. I just wanted to understand if this is a general trend in the industry that I must get used to. I get how scala can be smarter and more mathy etc. which is cool but what's with attitude ? Now with python becoming more and more popular, I have a hard time understanding where these people are coming from... just a thought nothing personal

Hey all, Im curious if anyone who was not a scala developer has ever managed to find a scala opportunity with equal or higher salary? I cant afford to go lower in compensation and I am increasingly enjoying the language. For context, as above stated, I am primarily a typescript backend developer

Please post the job with the following template:

Company Name | Title(s) of position(s) being hired for | City, [State/Province,] Country | {ONSITE, REMOTE} | {Full Time, Part Time, Contract} | (Optional) $approximate salary  description  contact information 

Posters: Please only post if you are personally involved in the hiring party -- no 3rd party recruiters (you must post the name of the company)

Readers: please only email submitters if you personally are interested in the job—no recruiters or sales calls.