TL;DR:
As explained on Steven Weyhrich's great and authoritative Apple II History Site, Wozniak simply sat down and wrote his Integer-BASIC on paper, while assembling it at the same time by hand. In his own words:
I had no assembler, that was another thing. To use an assembler, they figured that somebody was going to buy this processor to use for a company, and their company can pay a few thousand dollars in time-sharing charges to use an assembler that was available in time-share. I didn’t have any money like that, so a friend taught me that you just sort of look at each instruction, you write your instructions on the right side of the page, you write the addresses over on the left side, and you then look up the hex data for each instruction–you could assemble it yourself. So I would just sit there and assemble it myself. The BASIC, which we shipped with the first Apple II’s, was never assembled – ever. There was one handwritten copy, all handwritten, all hand-assembled. So we were in an era that we could not afford tools.
This quote is taken from a transcription of a speech Wozniak held at he Apple World Convention in 1986. See here for the section about his BASIC.
The Question
Was this simply a high-level concept, actual machine code for the 6502, or an actual implementation on a different system?
Actual machine code on paper for the 6502. (*1,*2)
Was the development only on paper, or was a host computer involved (possibly at his work at HP)?
On paper. A computer was used to test the implementation of the stack machine evaluating expressions. It was written in ALGOL. In addition it is mentioned that he used a HP calculator as well to get used to stack-'thinking'
Did he test it elsewhere before putting it on the Apple 1?
Only on the Apple 1 - they didn't had the money to buy computing time for a cross assembler, as he mentions.
How was this possible?
While it's not a job for an extended weekend, writing a BASIC is not as hard as some may think. To start with, a BASIC is at the core a rather simple program consisting of a few fixed parts like
- A line editor
- A fetch and execute loop
- An expression evaluator
- Memory (variable) access
- (Garbage collection *3)
- An error handling/output function
- Startup (cold boot) and recovery (warm boot)
Each of them are rather short tasks and can be written down independent. Some just a few lines, some may require a few pages.
The rest of an interpreter is
- a collection of functions
One for every BASIC command, Every Instruction and every function. They are what the fetch and execute loop calls with every found token, which brings the last two parts:
- A list of all commands, instructions and functions to be searched and pointing to its entry point
- A list of error codes/messages
All of these parts are on their own quite manageable on paper and by hand. Programming is about organization of your task, BASIC being not only no exemption, but a perfect candidate in the way it operates.
*1 - Since he did it in 6500 assembly, it can be assumed that this happened after acquiring a first 6502 at Wescon in September 1975. What's interesting is that despite having a 6502 and writing a BASIC in 6500 Assembler he still made the board to accept a 6800 as well.
*2 - 6502 Assembler is rather easy to translate by hand, as every mnemonic plus addressing mode equals a single opcode and parameter encoding can as well be directly made according to addressing mode. No complex encoding to manage, like on a 8086 or 6800.
*3 - Usually, but Integer BASIC worked without