System commands
\a tables \s number of secondary threadss \b views \S random seed \B pending views \t timer \c console size \T timeout \cd change directory \ts time and space \C HTTP size \u reload user password file \d directory \v variables \e error trap clients \w workspace \E TLS server mode \W week offset \f functions \x expunge \g garbage collection mode \z date parsing \l load file or directory \1 & \2 redirect \o offset from UTC \_ hide q code \p listening port \ terminate \P precision \ toggle q/k \r replication master \\ quit \r rename
System commands control the q environment. They have the form:
\cmd [p]
for some command cmd, and optional parameter list p.
Commands with optional parameters that set values, will show the current values if the parameters are omitted.
Some system commands have equivalent command-line parameters.
The system keyword executes a string representation of a system command and returns its result.
\a (tables)
\a [namespace]
Lists tables in namespace; default: current namespace.
q)\a
`symbol$()
q)aa:bb:23
q)\a
`symbol$()
q)tt:([]dd:12 34)
q)\a
,`tt
q).nn.vv:([]uu:12 45)
q)\a
,`tt
q)\a .n
'.n
q)\a .nn
,`vv
q)\d .nn
q.nn)\a
,`vv
q.nn)vv
uu
--
12
45
q.nn)
\b (views)
\b [namespace]
Lists dependencies (views) in namespace. Defaults to current namespace.
q)a::x+y
q)b::x+1
q)\b
`s#`a`b
\B (pending views)
\B [namespace]
Lists pending dependencies (views) in namespace, i.e. dependencies not yet referenced, or not referenced after their referents have changed. Defaults to current namespace.
q)a::x+1 / a depends on x
q)\B / the dependency is pending
,`a
q)x:10
q)\B / still pending after x is defined
,`a
q)a / use a
11
q)\B / no longer pending
`symbol$()
\c (console size)
\c [size]
Show or set console maximum rows and columns.
size is a pair of integers: rows and columns.
The default 25 80; values are coerced to the range [10,2000].
These settings determine when q truncates output with ..
You do not usually need to set this
If the environment variables LINES and COLUMNS are found they’ll be taken as the default value. See Bash documentation for shopt parameter checkwinsize to make sure they’re reset as needed.
q)\c
45 160
q)\c 5 5
q)\c
10 10
q)til each 20+til 10
0 1 2 3..
0 1 2 3..
0 1 2 3..
0 1 2 3..
0 1 2 3..
0 1 2 3..
0 1 2 3..
..
\C (HTTP size)
\C [size]
Show or set HTTP display maximum rows and columns.
size is a pair of integers: rows and columns.
The default is 36 2000; values are coerced to the range [10,2000].
\cd (change directory)
\cd [name]
Changes the current directory.
~/q$ q
KDB+ 2.6 2010.05.10 Copyright (C) 1993-2010 Kx Systems
..
q)\cd
"/home/guest/q"
q)\cd /home/guest/dev
q)\cd
"/home/guest/dev"
\d (directory)
\d [namespace]
Sets the current namespace (also known as directory or context). The namespace can be empty, and a new namespace is created when an object is defined in it. The q session prompt indicates the current namespace.
q)\d / default namespace
`.
q)\d .o / change to .o
q.o)\f
`Cols`Columns`FG`Fkey`Gkey`Key`Special..
q.o)\d . / return to default
q)key` / lists namespaces other than .z
`q`Q`o`h
q)\d .s / change to non-existent namespace
q.s)key` / not yet created
`q`Q`o`h
q.s)a:1 / create object, also creates namespace
q.s)key`
`q`Q`o`h`s
Q for Mortals §12.7 Working in a Context
\e (error trap clients)
\e [mode]
This enables error trapping for client requests. The default mode is 0 (off).
| mode | behavior |
|---|---|
| 0 | When a client request has an error, by default the server clears the stack. Appropriate for production use as it enables the server to continue processing other client requests. |
| 1 | The server suspends on an error, and does not process other requests until the stack is cleared. Appropriate for development: enables debugging on the server. |
| 2 | Dumps stack to stderr for untrapped errors during request from a remote. (Since V3.5 2016.10.03) |
\E (TLS server mode)
\E
Displays TLS server mode as an int:
0i plain
1i plain and TLS
2i TLS only
Command-line option -E to set the mode
\f (functions)
\f [namespace]
Lists functions in namespace, default current namespace.
q)f:g:h:{x+2*y}
q)\f
`f`g`h
q)\f .h
`cd`code`data`eb`ec`ed`es`estr`fram`ha`hb`hc`he`hn`hp`hr`ht`hta`htac`htc`html`http`hu`hu..
q){x where x like"ht??"}system"f .h"
`htac`html`http
\g (garbage collection mode)
\g [mode]
Show or set garbage-collection mode. The default mode is 0.
| B | mode | behavior |
|---|---|---|
| 0 | deferred | returns memory to the OS when either .Q.gc[] is called or an allocation fails, hence has a performance advantage, but can be more difficult to dimension or manage memory requirements. |
| 1 | immediate | returns (certain types of) memory to the OS as soon as no longer referenced; has an associated performance overhead. |
Command-line option -g
Q for Mortals
§13.1.10 Garbage Collection \g
\l (load file or directory)
\l name \l .
Where name is the name of a
- q script, executes the script
- serialized object, deserializes it into memory as variable
name - directory of a splayed table, maps the table to variable
name, without loading any columns into memory - directory and the value of one of the permitted partition types, the most recent partition directory is inspected for splayed directories and each such directory mapped into memory with the name of the splayed directory
- directory containing a kdb+ database, recursively loads whatever it finds there: serialized objects, scripts, splayed tables, etc.
Current directory When a directory is opened, it becomes the current directory.
Reload current directory You can reload the current database with \l .. This will ignore scripts and reload only data.
Never mind the dollars If a file or directory under the path being loaded has a dollar-sign suffix then it is ignored. e.g. db/tickdata/myfile$ and db/tickdata/mydir$ would be ignored on \l db/tickdata or on \l . if db/tickdata is the current directory.
q)\l sp.q / load sp.q script
...
q)\a / tables defined in sp.q
`p`s`sp
q)\l db/tickdata / load the data found in db/tickdata
q)\a / with tables quote and trade
`p`quote`s`sp`trade
Operating systems may create hidden files, such as DS_Store, that block \l on a directory.
load,
.Q.l (load)
Q for Mortals
§10.3 Scripts
\o (offset from UTC)
\o [n]
Show or set the local time offset, as integer n hours from UTC, or as minutes if abs[n]>23.
The initial value of 0N means the machine’s offset is used.
q)\o
0N
q).z.p / UTC
2010.05.31D23:45:52.086467000
q).z.P / local time is UTC + 8
2010.06.01D07:45:53.830469000
q)\o -5 / set local time as UTC - 5
q).z.P
2010.05.31D18:45:58.470468000
q)\o 390 / set local time as UTC + 6:30
q).z.P
2010.06.01D06:16:06.603981000
This corresponds to the -o command line parameter.
\p (listening port)
Show or set listening port
\p [rp,][hostname:][portnumber|servicename]
See Listening port for detail.
hopen
-p command-line option
Multithreaded input mode,
Changes in 3.5
Socket sharding with kdb+ and Linux
\P (precision)
\P [n]
Show or set display precision for floating-point numbers, i.e. the number of digits shown.
The default value of n is 7 and possible values are integers in the range [0,17]. A value of 0 means use maximum precision. This is used when exporting to CSV files.
$ q
q)\P / default
7i
q)reciprocal 7 / 7 digits shown
0.1428571
q)123456789 / integers shown in full
123456789
q)123456789f / floats shown to 7 significant digits
1.234568e+08
q)\P 3
q)1%3
0.333
q)\P 10
q)1%3
0.3333333333
Use .Q.fmt and .q.f to format numbers to given width and precision
q).Q.fmt[8;6]a / format to width 8, 6 decimal places
"0.142857"
q).Q.f[2;]each 9.996 34.3445 7817047037.90 / format to 2 decimal places
"10.00"
"34.34"
"7817047037.90"
.Q.f,
.Q.fmt
Precision,
-P command-line option,
-27! internal function
What Every Computer Scientist Should Know About Floating-Point Arithmetic
\r (replication primary)
\r
This should not be executed manually otherwise it can disrupt replication. It is executed automatically by the replicating process on the primary process, and returns the log file name and log file count.
\r (rename)
\r src dst
Rename file src to dst.
It is equivalent to the Unix mv command, or the windows move command (except that it will not rename to a different disk drive).
\s (number of secondary threads)
\s [N]
Show or , where N is an integer, set the number of secondary threads available for parallel processing, within the limit set by the -s command-line option.
N is an integer.
Since V3.5 2017.05.02, secondary threads can be adjusted dynamically up to the maximum specified on the command line. A negative N indicates processes should be used, instead of threads.
q)0N!("current secondary threads";system"s");system"s 4";0N!("current,max secondary threads";system"s";system"s 0N"); / q -s 8
("current secondary threads";0i)
("current,max secondary threads";4i;8i)
q)system"s 0" / disable secondary threads
q)system"s 0N" / show max secondary threads
8i
N parallel processing uses
------------------------------------
>0 N threads
<0 processes with handles in .z.pd
For processes:
peachor':will call.z.pdfor a list of handles to the processes, which must have been started previously- the absolute value of
-Nin the command line is ignored
-s command-line option,
Parallel processing
\S (random seed)
\S [n]
Where n is
- omitted: display the last value to which the random seed was initialized
0N: display the current value of the random seed (since V3.6)- non-zero integer: re-initialize the seed to
n
Note that \S displays the last value to which the seed was initialized: it is not updated as the random-number generator (rng) is used.
q)\S / default
-314159i
q)5?10
8 1 9 5 4
q)5?10
6 6 1 8 5
q)\S -314159 / restore default seed
q)5?10 / same random numbers generated
8 1 9 5 4
q)\S / seed is not updated
-314159
q)x:system "S 0N" / current value of seed
q)r:10?10
q)system "S ",string x / re-initialize seed
q)r~10?10
1b
Allows user to save and restore state of the rng. (Since V3.6 2017.09.26.)
q)x:system"S 0N";r:10?10;system"S ",string x;r~10?10
Thread-local
Since V3.1 2013.08.19 random-number generation (rng) is thread-local.
\S 1234 sets the seed for the rng for the main thread only.
The rng in a secondary thread is assigned a seed based on the secondary thread number.
In multithreaded input mode, the seed is based on the socket descriptor.
Instances started on ports 20000 through 20099 (secondary threads, used with e.g. q -s -4 have the main thread’s default seed based on the port number.
\t (timer)
\t [ [N|[:n ]e] ]
This command has two different uses, according to the parameter. If the parameter is omitted, it shows the number of milliseconds between timer ticks: 0 means the timer is off.
N(integer)-
Set the number of milliseconds between timer ticks. If 0, the timer is disabled, otherwise the timer is enabled and the first tick given. On each tick, the function assigned to
.z.tsis executed. -
This usage corresponds to the
-tcommand-line option [:n] e(expression)-
A q expression
e(other than a single integer) is executed and the execution time shown in milliseconds. Since V3.0 2011.11.22, ifnis specified,eis executedntimes.
q)/Show or set timer ticks
q)\t / default off
0
q).z.ts:{show`second$.z.N}
q)\t 1000 / tick each second
q)13:12:52
13:12:53
13:12:54
\t 0 / turn off
q)/Time an expression
q)\t log til 100000 / milliseconds for log of first 100000 numbers
3
q)\t:100 log til 100000 / timing for 100 repetitions
186
Actual timer tick frequency
The actual timer tick frequency is determined by the timing granularity supported by the underlying operating system. This can be considerably different from a millisecond.
\T (timeout)
\T [n]
Show or set the client execution timeout, as n (integer) number of seconds a client call will execute before timing out.
The default is 0: no timeout.
Note this is in seconds, not milliseconds like \t.
\ts (time and space)
\ts[:n] exp
Executes the expression exp and shows the execution time in milliseconds and the space used in bytes.
q)\ts log til 100000
7 2621568
Since 3.1 2014.02.07
q)\ts:10000 log til 1000 /same as \ts do[10000; log til 1000]
329 24672
\u (reload user password file)
\u
When q is invoked with the -u parameter specifying a user password file, then \u will reload the password file. This allows updates to the password file while the server is running.
\v (variables)
\v [namespace]
Lists the variables in the given namespace, default current namespace.
q)a:1+b:2
q)\v
`a`b
q)\v .h
`HOME`br`c0`c1`logo`sa`sb`sc`tx`ty
q){x where x like"????"}system"v .h"
`HOME`logo
To expunge a from the default namespace
delete a from `.
Q for Mortals §12.5 Expunging from a Context
\w (workspace)
\w [0|1|n]
With no parameter, returns current memory usage, as a list of 6 long integers.
0 number of bytes allocated
1 bytes available in heap
2 maximum heap size so far
3 limit on thread heap size, from -w command-line option
4 mapped bytes
5 physical memory
q)\w
168144 67108864 67108864 0 0 8589934592
\w 0 and \w 1 return a pair of longs:
0 number of internalized symbols
1 corresponding memory usage
q)\w 0
577 25436
The utility .Q.w formats all this information.
Run-time increase
Since 2017.11.06, \w allows the workspace limit to be increased at run-time, if it was initialized via the
-w command-line option.
E.g. system "w 128" sets the -w limit to the larger of 128 MB and the current setting and returns it.
If the system tries to allocate more memory than allowed, it signals -w abort and terminates with exit code 1.
Specifying too large a number will fall back to the same behavior as \w 0 or \w 1.
q)\w
339168 67108864 67108864 104857600 0 8589934592
q)\w 0
651 28009
q)\w 128
134217728
q)\w 1000000000
1048576000000000
q)\w 1000000000000
651 28009
If the workspace limit has not been set by the command-line option -w, an error is signalled.
q)\w 3
'-w init via cmd line
Domain-local Since V4.0 2020.03.17 returns information for the current memory domain only.
q)value each ("\\d .m";"\\w";"\\d .";"\\w")
::
353968 67108864 67108864 0 0 8589934592
::
354032 67108864 67108864 0 0 8589934592
-w command-line option
.m namespace
\W (week offset)
\W [n]
Show or set the start-of-week offset n, where 0 is Saturday. The default is 2, i.e Monday.
\x (expunge)
\x .z.p*
By default, callbacks like .z.po are not defined in the session. After they have been assigned, you can restore the default using \x to delete the definition that was made.
q).z.pi / default has no user defined function
'.z.pi
q).z.pi:{">",.Q.s value x} / assign function
q)2+3
>5
q)\x .z.pi / restore default
Works only for .z.p* variables defined in k before q.k is loaded
For example, as .z.ph is defined in q.k, there is no default for it to be reset to.
\z (date parsing)
\z [0|1]
Show or set the format for "D"$ date parsing. B is 0 for mm/dd/yyyy and 1 for dd/mm/yyyy.
q)\z
0
q)"D"$"06/01/2010"
2010.06.01
q)\z 1
q)"D"$"06/01/2010"
2010.01.06
\1 & \2 (redirect)
\[1|2] filename
\1 and \2 let you redirect stdout and stderr to files from within the q session. The files and intermediate directories are created if necessary.
~/q$ rm -f t1.txt t2.txt
~/q$ l64/q
KDB+ 2.6 2010.05.10 Copyright (C) 1993-2010 Kx Systems
...
q)\1 t1.txt / stdout
q)\2 t2.txt / stderr
til 10
2 + "hello"
\\
~/q$ cat t1.txt / entry in stdout
0 1 2 3 4 5 6 7 8 9
~/q$ cat t2.txt / entry in stderr
q)q)'type
On macOS and Linux \1 /dev/stdin returns output to the default.
\_ (hide q code)
\_ [scriptname]
This command has two different uses depending on whether a parameter is given.
If no parameter, then \_ checks if client write-access is blocked.
q)\_
0b
If a parameter is given, it should be a scriptname and \_ f.q makes a runtime script f.q_. The q code loaded from a runtime script cannot be viewed or serialized.
q)`:t1.q 0:enlist "a:123;f:{x+2*y}"
q)\_ t1.q / create locked script
`t1.q_
q)\l t1.q_ / can be loaded as usual
q)a / definitions are correct
123
q)f[10;1 2 3]
12 14 16
q)f / q code is not displayed
locked
q)-8!f / or serialized
'type
[0] -8!f
^
q)read0`:t1.q
"a:123;f:{x+2*y}"
q)read0`:t1.q_ / file contents are scrambled
"'\374E\331\207'\262\355"
"S\014%\210\0273\245"
\ (terminate)
At the debugger’s q)) prompt clears one level from the execution stack and (eventually) returns to the interactive session.
q)f:{g[]}
q)g:{'`xyz}
q)f[]
{g[]}
'xyz
@
{'`xyz}
::
q))\
q)
Without a suspension, \ toggles in an out of the k interpreter.
If there is a suspension, this exits one level of the suspension. Otherwise, it toggles between q and k mode. (To switch languages from inside a suspension, type "\".)
q){1+x}"hello"
{1+x}
'type
+
1
"hello"
q))\ / clear suspension (only one level)
q)\ / toggle to k mode
\ (toggle q/k)
In the interactive session \ toggles between the q and k interpreters.
q)\
\
!5 / this is k
0 1 2 3 4
\
q)
The k programming language is exposed infrastructure.
\\ (quit)
\\
- In the interactive session type
\\at the prompt to quit the session. - Inside a function, use
value"\\\\"orexit 0for the same result.
Final comments
The text following \\ and white space is ignored by q. This is often useful in scripts where \\ can be followed by comments or usage examples.
Interrupt and terminate
Ctl-c signals an interrupt to the interpreter.
Some operations are coded so tightly the interrupt might not be registered.
Ctl-z will kill the q session. Nothing in memory is saved.
OS commands
If an expression begins with \ but is not recognized as a system command, then it is executed as an OS command.
Typos can get passed to the OS
q)\ls / usual ls command
"help.q"
"k4.lic"
"l64"
"odbc.k"
"profile.q"
"q.k"
..
When you are run
rm -r /you are have of many problem, but Big Data is not of one of them. — DevOps Borat