Details of upload 129653c8-fe0a-41fd-b703-d4c5d3a5807e

Created at
2022-09-15T16:55:53.209Z
Total number of tests
804
JUnit report XML
View report
GitHub repository
ably/ably-cocoa
Commit SHA
c5b377a
Pull request base ref
main
Pull request head ref
integration/no_connection_time_serial
Branch / tag name
1496/merge
Workflow asset retention period
90 days
GitHub action
__run_5
GitHub run ID
3062153835
GitHub run attempt
1
GitHub run number
265
GitHub job
check
GitHub job URL
Not known
Loop iteration
1

Test failures

There are 25 failures in this upload.

Failure ID Test case ID Test class Test case Message
1f9b4498-f16d-4a82-8776-0c85ee7d01bf 181c0d92-7356-4faf-acd0-7cc9b78a0aa2 AuthTests test__148__JWT_and_realtime__when_token_expires_and_has_a_means_to_renew__reconnects_using_authCallback_and_obtains_a_new_token() expected to equal <lcEhRuofMs>, got <sC6La1kOO5> (/Users/runner/work/ably-cocoa/ably-cocoa/Spec/Tests/AuthTests.swift#CharacterRangeLen=0&EndingLineNumber=4180&StartingLineNumber=4180)
e79f4d94-4fb8-432e-9478-8947857e6134 1cf86794-ca47-4832-a5b5-2c9cc8f9586f RealtimeClientChannelTests test__011__Channel__EventEmitter__channel_states_and_events__ChannelStateChange_will_contain_a_resumed_boolean_attribute_with_value__true__if_the_bit_flag_RESUMED_was_included() Waited more than 20.0 seconds (/Users/runner/work/ably-cocoa/ably-cocoa/Spec/Tests/RealtimeClientChannelTests.swift#CharacterRangeLen=0&EndingLineNumber=506&StartingLineNumber=506)
7bfd4c7e-b4af-4392-8e0b-9c71313b9813 a3124efd-3216-40d1-95e6-e703a2678dfd RealtimeClientChannelTests test__138__Channel__crypto__if_configured_for_encryption__channels_encrypt_and_decrypt_messages__data() expected to equal <third>, got <second> (/Users/runner/work/ably-cocoa/ably-cocoa/Spec/Tests/RealtimeClientChannelTests.swift#CharacterRangeLen=0&EndingLineNumber=4362&StartingLineNumber=4362)
18957a47-5a22-40d1-8f93-cae39a544029 896d48fd-c709-4e4a-9b12-bcd9504dd99f RealtimeClientConnectionTests test__003__Connection__API_version_param_must_be_included_in_all_connections() expected to param <v=1.2> exists, got <key=_tmp_eAqbHg.0A4mIg:dIeOhbze3X5aw5-qUqKPD9ChXZJm0MO64xLaWUNSjog&echo=true&agent=ably-cocoa/1.2.13%20macOS/10.15.7&v=2.0&format=msgpack> (/Users/runner/work/ably-cocoa/ably-cocoa/Spec/Tests/RealtimeClientConnectionTests.swift#CharacterRangeLen=0&EndingLineNumber=351&StartingLineNumber=351)
8e3557b3-6ba0-4c87-8c12-c16c22cdb84d 89889c54-8d41-4c49-a967-c0c1f051c5e6 RealtimeClientConnectionTests test__033__Connection__ACK_and_NACK__ProtocolMessage__should_continue_incrementing_msgSerial_serially_if_the_connection_resumes_successfully() expected to equal <5>, got <0> (/Users/runner/work/ably-cocoa/ably-cocoa/Spec/Tests/RealtimeClientConnectionTests.swift#CharacterRangeLen=0&EndingLineNumber=1068&StartingLineNumber=1068)
74cff3c9-66b1-4832-b138-9b9d52fd992b 4e71277a-67db-4317-9b0a-ac4ad4c6451e RealtimeClientConnectionTests test__034__Connection__ACK_and_NACK__ProtocolMessage__should_reset_msgSerial_serially_if_the_connection_does_not_resume() expected to equal <40012>, got <90001> (/Users/runner/work/ably-cocoa/ably-cocoa/Spec/Tests/RealtimeClientConnectionTests.swift#CharacterRangeLen=0&EndingLineNumber=1139&StartingLineNumber=1139)
21601f11-52c2-4168-a3a5-4f32c0c909e2 c04a5534-6e53-49f5-b598-550bb4089dc6 RealtimeClientConnectionTests test__054__Connection__connection_request_fails__on_DISCONNECTED_after_CONNECTED__should_not_emit_error_with_a_renewable_token() expected to be nil, got <Error 80018 - Invalid connection serial> (/Users/runner/work/ably-cocoa/ably-cocoa/Spec/Tests/RealtimeClientConnectionTests.swift#CharacterRangeLen=0&EndingLineNumber=1923&StartingLineNumber=1923)
232931d2-e3a8-4a46-b3a6-ae63ac473730 d461b7e0-3cb1-49ba-b6f4-7a85cd2f7681 RealtimeClientConnectionTests test__061__Connection__connection_request_fails__should_change_the_state_to_SUSPENDED_when_the_connection_state_has_been_in_the_DISCONNECTED_state_for_more_than_the_connectionStateTtl() expected to be nil, got <Error 80018 - Invalid connection serial> (/Users/runner/work/ably-cocoa/ably-cocoa/Spec/Tests/RealtimeClientConnectionTests.swift#CharacterRangeLen=0&EndingLineNumber=2265&StartingLineNumber=2265)
ac9485fc-e6d3-4405-9361-0241c31518d8 8a0dcaeb-fe47-495d-8269-63b823db2177 RealtimeClientConnectionTests test__066__Connection__connection_failures_once_CONNECTED__ACK_and_NACK_responses_for_published_messages_can_only_ever_be_received_on_the_transport_connection_on_which_those_messages_were_sent() Shouldn't be called (/Users/runner/work/ably-cocoa/ably-cocoa/Spec/Tests/RealtimeClientConnectionTests.swift#CharacterRangeLen=0&EndingLineNumber=2787&StartingLineNumber=2787)
88abe404-1b12-43cf-aeec-18f0f408fa2c 8bee007f-fc22-44f9-9ef4-2e1f4e2b476a RealtimeClientConnectionTests test__068__Connection__connection_failures_once_CONNECTED__System_s_response_to_a_resume_request__CONNECTED_ProtocolMessage_with_the_same_connectionId_as_the_current_client__and_no_error() expected to equal <mXJvpe13T->, got <BTuHys3GxC> (/Users/runner/work/ably-cocoa/ably-cocoa/Spec/Tests/RealtimeClientConnectionTests.swift#CharacterRangeLen=0&EndingLineNumber=2447&StartingLineNumber=2447)
491e823f-c728-44fa-bca5-2e1909445065 b2ea3eff-5e84-425d-947f-de001e3f7c3f RealtimeClientConnectionTests test__069__Connection__connection_failures_once_CONNECTED__System_s_response_to_a_resume_request__CONNECTED_ProtocolMessage_with_the_same_connectionId_as_the_current_client_and_an_non_fatal_error() expected to equal <zkgekcd1Y4>, got <IHX228kAQw> (/Users/runner/work/ably-cocoa/ably-cocoa/Spec/Tests/RealtimeClientConnectionTests.swift#CharacterRangeLen=0&EndingLineNumber=2495&StartingLineNumber=2495)
4a674188-d8a4-4bc9-9428-a54e16edf648 e563b0c8-d19a-4f85-95d6-e104e15bf2d7 RealtimeClientConnectionTests test__070__Connection__connection_failures_once_CONNECTED__System_s_response_to_a_resume_request__CONNECTED_ProtocolMessage_with_a_new_connectionId_and_an_error() Waited more than 20.0 seconds (/Users/runner/work/ably-cocoa/ably-cocoa/Spec/Tests/RealtimeClientConnectionTests.swift#CharacterRangeLen=0&EndingLineNumber=2528&StartingLineNumber=2528)
67df31c6-2066-4091-82ba-9320be1e94ea 5b38c413-5707-4522-af8e-b9f76f441add RealtimeClientConnectionTests test__075__Connection__connection_failures_once_CONNECTED__when_connection__ttl_plus_idle_interval__period_has_passed_since_last_activity__reattaches_to_the_same_channels_after_a_new_connection_has_been_established() Waited more than 20.0 seconds (/Users/runner/work/ably-cocoa/ably-cocoa/Spec/Tests/RealtimeClientConnectionTests.swift#CharacterRangeLen=0&EndingLineNumber=2853&StartingLineNumber=2853)
1a0b0254-1a83-44fe-b530-a5619300498f 902857b0-ca0b-4d90-8165-f4ee2474cf7f RealtimeClientConnectionTests test__076__Connection__connection_failures_once_CONNECTED__when_connection__ttl_plus_idle_interval__period_has_NOT_passed_since_last_activity__uses_the_same_connection() expected to equal <zGsyuDiDlP>, got <1_SoWcCBwS> (/Users/runner/work/ably-cocoa/ably-cocoa/Spec/Tests/RealtimeClientConnectionTests.swift#CharacterRangeLen=0&EndingLineNumber=2899&StartingLineNumber=2899)
444ed8c6-0289-42fb-a8c5-87f8ce7e93d2 3d3a2781-f9cc-42a5-9576-37b79fc2cc4f RealtimeClientConnectionTests test__082__Connection__Connection_recovery__when_a_connection_is_successfully_recovered__Connection_id_will_be_identical_to_the_id_of_the_connection_that_was_recovered_and_Connection_key_will_always_be_updated_to_the_ConnectionDetails_connectionKey_provided_in_the_first_CONNECTED_ProtocolMessage() expected to equal <7k_c_UUm-U>, got <DcIzT8AjqF> (/Users/runner/work/ably-cocoa/ably-cocoa/Spec/Tests/RealtimeClientConnectionTests.swift#CharacterRangeLen=0&EndingLineNumber=3101&StartingLineNumber=3101)
693d41ee-a58b-4cdc-a8eb-7e8a463883f5 e5b94fba-1e6f-411a-9356-68480d872058 RealtimeClientConnectionTests test__108__Connection__Operating_System_events_for_network_internet_connectivity_changes__re_authenticate_and_resume_the_connection_when_the_client_is_forcibly_disconnected_following_a_DISCONNECTED_message_containing_an_error_code_greater_than_or_equal_to_40140_and_less_than_40150() expected to be nil, got <Error 80018 - Invalid connection serial> (/Users/runner/work/ably-cocoa/ably-cocoa/Spec/Tests/RealtimeClientConnectionTests.swift#CharacterRangeLen=0&EndingLineNumber=4256&StartingLineNumber=4256)
dd2d8d7e-7843-4909-906b-434edae35384 f03a47fa-2ca3-4d5d-a1f0-b922bba53d81 RealtimeClientPresenceTests test__023__Presence__Channel_state_change_side_effects__channel_enters_the_SUSPENDED_state__should_maintain_the_PresenceMap_and_any_members_present_before_and_after_the_sync_should_not_emit_presence_events() expected to have Array<ARTPresenceMessage> with count 3, got 4 Actual Value: [<ARTPresenceMessage: 0x7f86536e8f10> {id: ghzEjDfIsq:2:0,clientId: user3,connectionId: ghzEjDfIsq,timestamp: 2022-09-15 16:49:32 +0000,encoding: (null),data: (null),action: 1,syncSessionId: 2}, <ARTPresenceMessage: 0x7f865dc451e0> {id: ghzEjDfIsq:0:0,clientId: user1,connectionId: ghzEjDfIsq,timestamp: 2022-09-15 16:49:32 +0000,encoding: (null),data: (null),action: 1,syncSessionId: 2}, <ARTPresenceMessage: 0x7f86536e8ec0> {id: ghzEjDfIsq:1:0,clientId: user2,connectionId: ghzEjDfIsq,timestamp: 2022-09-15 16:49:32 +0000,encoding: (null),data: (null),action: 1,syncSessionId: 2}, <ARTPresenceMessage: 0x7f865dd86e50> {id: NtlRaAIjLn:0:0,clientId: tester,connectionId: NtlRaAIjLn,timestamp: 2022-09-15 16:49:33 +0000,encoding: (null),data: (null),action: 1,syncSessionId: 2}] (/Users/runner/work/ably-cocoa/ably-cocoa/Spec/Tests/RealtimeClientPresenceTests.swift#CharacterRangeLen=0&EndingLineNumber=787&StartingLineNumber=787)
394657db-7e9f-4a79-a6c0-3c889b54b84e 1a0d6474-285c-4fcb-8aba-438c3723ad7b RealtimeClientPresenceTests test__094__Presence__Connection_state_conditions__all_presence_messages_will_be_queued_and_delivered_as_soon_as_the_connection_state_returns_to_CONNECTED() expected to be nil, got <Error 90001 - Unable to perform operation on channel: test-314--OSX-test__094__Presence__Connection_state_conditions__all_presence_messages_will_be_queued_and_delivered_as_soon_as_the_connection_state_returns_to_CONNECTED-684953453.331534-68794BFD-7064-4CA9-9335-8674AED22919 (not currently attached)> (/Users/runner/work/ably-cocoa/ably-cocoa/Spec/Tests/RealtimeClientPresenceTests.swift#CharacterRangeLen=0&EndingLineNumber=3039&StartingLineNumber=3039)
ae2872ca-2307-4ad7-9358-80a736fa2810 4ba6726c-a48c-46fa-85c2-31ee6db80716 RealtimeClientTests test__001__RealtimeClient__All_WebSocket_connections_should_include_the_current_API_version() expected to param <v=1.2> exists, got <key=_tmp_eAqbHg.0A4mIg:dIeOhbze3X5aw5-qUqKPD9ChXZJm0MO64xLaWUNSjog&echo=true&agent=ably-cocoa/1.2.13%20macOS/10.15.7&v=2.0&format=msgpack> (/Users/runner/work/ably-cocoa/ably-cocoa/Spec/Tests/RealtimeClientTests.swift#CharacterRangeLen=0&EndingLineNumber=51&StartingLineNumber=51)
e9761b0e-2505-405d-bb48-e5e8f87a92f8 da4d7d42-c79b-45fe-8d99-4ea6377fbabf RealtimeClientTests test__006__RealtimeClient__should_accept_acks_with_different_order() failed - 80018: Invalid connection serial (/Users/runner/work/ably-cocoa/ably-cocoa/Spec/Tests/RealtimeClientTests.swift#CharacterRangeLen=0&EndingLineNumber=16&StartingLineNumber=16)
9d4314a3-1385-47ab-99d1-bbe28dd733ee be9e53f7-9876-4494-b1df-4f4071258a94 RealtimeClientTests test__016__RealtimeClient__options__should_attempt_to_recover_the_connection_state_if_recover_string_is_assigned() failed - 40007: Unable to recover connection (requested connectionSerial is after the most recent one we could locate) (/Users/runner/work/ably-cocoa/ably-cocoa/Spec/Tests/RealtimeClientTests.swift#CharacterRangeLen=0&EndingLineNumber=16&StartingLineNumber=16)
d2ad2ed5-50bc-4b82-8b74-63c18231e727 e3b1b00c-fa5a-4e37-9ad9-e6ca8adad4e2 RealtimeClientTests test__037__RealtimeClient__Auth_authorize_should_upgrade_the_connection_with_current_token__when_the_connection_is_in_the_SUSPENDED_state_when_auth_authorize_is_called__after_obtaining_a_token_the_library_should_move_to_the_CONNECTING_state_and_initiate_a_connection_attempt_using_the_new_token() expected to be nil, got <Error 80018 - Invalid connection serial> (/Users/runner/work/ably-cocoa/ably-cocoa/Spec/Tests/RealtimeClientTests.swift#CharacterRangeLen=0&EndingLineNumber=1053&StartingLineNumber=1053)
f6edb39b-f7ab-407d-8781-220ae1af3a0a a54428fb-682f-4f07-98b2-9c7ed614f0c3 RealtimeClientTests test__040__RealtimeClient__Auth_authorize_should_upgrade_the_connection_with_current_token__when_the_connection_is_in_the_FAILED_state_when_auth_authorize_is_called__after_obtaining_a_token_the_library_should_move_to_the_CONNECTING_state_and_initiate_a_connection_attempt_using_the_new_token() expected to be nil, got <Error 80018 - Invalid connection serial> (/Users/runner/work/ably-cocoa/ably-cocoa/Spec/Tests/RealtimeClientTests.swift#CharacterRangeLen=0&EndingLineNumber=1218&StartingLineNumber=1218)
ed4f96da-957d-42dc-ae15-17d07d201be6 3454ff51-e12f-4e5b-a328-1344bf55934b RestClientTests test__001__RestClient__All_REST_requests_should_include_the_current_API_version() expected to equal <1.2>, got <2.0> (/Users/runner/work/ably-cocoa/ably-cocoa/Spec/Tests/RestClientTests.swift#CharacterRangeLen=0&EndingLineNumber=156&StartingLineNumber=156)
88f1e96a-2d4d-4823-b148-a51ec8209290 36841c8e-f199-458e-8fcc-867af1261a18 RestClientTests test__010__RestClient__X_Ably_Version_must_be_included_in_all_REST_requests() expected to equal <1.2>, got <2.0> (/Users/runner/work/ably-cocoa/ably-cocoa/Spec/Tests/RestClientTests.swift#CharacterRangeLen=0&EndingLineNumber=1648&StartingLineNumber=1648)