Sep 16 14:34:58 devstack cinder-volume[75486]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "singleton_lock" {{(pid=75486) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} Sep 16 14:34:58 devstack cinder-volume[75486]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "singleton_lock" {{(pid=75486) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} Sep 16 14:34:58 devstack cinder-volume[75486]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "singleton_lock" {{(pid=75486) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} Sep 16 14:35:00 devstack cinder-volume[75486]: INFO dbcounter [None req-7a316aef-88c3-4ae0-9259-a0a05b655104 None None] Registered counter for database cinder Sep 16 14:35:00 devstack cinder-volume[75486]: DEBUG oslo_db.sqlalchemy.engines [None req-7a316aef-88c3-4ae0-9259-a0a05b655104 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=75486) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.10/site-packages/oslo_db/sqlalchemy/engines.py:397}} Sep 16 14:35:00 devstack cinder-volume[75486]: DEBUG dbcounter [-] [75486] Writer thread running {{(pid=75486) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:102}} Sep 16 14:35:00 devstack cinder-volume[75486]: INFO cinder.rpc [None req-7a316aef-88c3-4ae0-9259-a0a05b655104 None None] Automatically selected cinder-scheduler objects version 1.39 as minimum service version. Sep 16 14:35:00 devstack cinder-volume[75486]: INFO cinder.rpc [None req-7a316aef-88c3-4ae0-9259-a0a05b655104 None None] Automatically selected cinder-scheduler RPC version 3.12 as minimum service version. Sep 16 14:35:00 devstack cinder-volume[75486]: DEBUG oslo_db.sqlalchemy.engines [None req-7a316aef-88c3-4ae0-9259-a0a05b655104 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=75486) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.10/site-packages/oslo_db/sqlalchemy/engines.py:397}} Sep 16 14:35:00 devstack cinder-volume[75486]: INFO cinder.volume.manager [None req-7a316aef-88c3-4ae0-9259-a0a05b655104 None None] Determined volume DB was empty at startup. Sep 16 14:35:00 devstack cinder-volume[75486]: DEBUG cinder.volume.manager [None req-7a316aef-88c3-4ae0-9259-a0a05b655104 None None] Cinder Volume DB check: vol_db_empty=True {{(pid=75486) __init__ /opt/stack/cinder/cinder/volume/manager.py:288}} Sep 16 14:35:00 devstack cinder-volume[75486]: INFO cinder.volume.manager [None req-7a316aef-88c3-4ae0-9259-a0a05b655104 None None] Service not found for updating active_backend_id, assuming default for driver init. Sep 16 14:35:00 devstack cinder-volume[75486]: WARNING stevedore.named [None req-7a316aef-88c3-4ae0-9259-a0a05b655104 None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Sep 16 14:35:00 devstack cinder-volume[75486]: WARNING castellan.key_manager [None req-7a316aef-88c3-4ae0-9259-a0a05b655104 None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Sep 16 14:35:00 devstack cinder-volume[75486]: WARNING cinder.keymgr.conf_key_mgr [None req-7a316aef-88c3-4ae0-9259-a0a05b655104 None None] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Sep 16 14:35:01 devstack cinder-volume[75486]: DEBUG cinder.volume.drivers.lvm [None req-7a316aef-88c3-4ae0-9259-a0a05b655104 None None] Attempting to initialize LVM driver with the following target_driver: cinder.volume.targets.lio.LioAdm {{(pid=75486) __init__ /opt/stack/cinder/cinder/volume/drivers/lvm.py:106}} Sep 16 14:35:01 devstack cinder-volume[75486]: DEBUG oslo_concurrency.processutils [None req-7a316aef-88c3-4ae0-9259-a0a05b655104 None None] Running cmd (subprocess): cinder-rtstool verify {{(pid=75486) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 14:35:01 devstack cinder-volume[75486]: DEBUG oslo_concurrency.processutils [None req-7a316aef-88c3-4ae0-9259-a0a05b655104 None None] CMD "cinder-rtstool verify" returned: 0 in 0.934s {{(pid=75486) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 14:35:02 devstack cinder-volume[75486]: DEBUG oslo_db.sqlalchemy.engines [None req-7a316aef-88c3-4ae0-9259-a0a05b655104 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=75486) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.10/site-packages/oslo_db/sqlalchemy/engines.py:397}} Sep 16 14:35:02 devstack cinder-volume[75486]: INFO cinder.rpc [None req-7a316aef-88c3-4ae0-9259-a0a05b655104 None None] Automatically selected cinder-volume objects version 1.39 as minimum service version. Sep 16 14:35:02 devstack cinder-volume[75486]: INFO cinder.rpc [None req-7a316aef-88c3-4ae0-9259-a0a05b655104 None None] Automatically selected cinder-volume RPC version 3.20 as minimum service version. Sep 16 14:35:02 devstack cinder-volume[75486]: WARNING stevedore.named [None req-7a316aef-88c3-4ae0-9259-a0a05b655104 None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Sep 16 14:35:02 devstack cinder-volume[75486]: WARNING castellan.key_manager [None req-7a316aef-88c3-4ae0-9259-a0a05b655104 None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Sep 16 14:35:02 devstack cinder-volume[75486]: INFO cinder.volume.manager [None req-7a316aef-88c3-4ae0-9259-a0a05b655104 None None] Image-volume cache enabled for host devstack@lvmdriver-1. Sep 16 14:35:02 devstack cinder-volume[75486]: DEBUG oslo_db.sqlalchemy.engines [None req-7a316aef-88c3-4ae0-9259-a0a05b655104 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=75486) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.10/site-packages/oslo_db/sqlalchemy/engines.py:397}} Sep 16 14:35:02 devstack cinder-volume[75486]: INFO oslo_service.backend._eventlet.service [None req-7a316aef-88c3-4ae0-9259-a0a05b655104 None None] Starting 1 workers Sep 16 14:35:02 devstack cinder-volume[75486]: DEBUG oslo_service.backend._eventlet.service [None req-7a316aef-88c3-4ae0-9259-a0a05b655104 None None] Started child 75623 {{(pid=75486) _start_child /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/backend/_eventlet/service.py:490}} Sep 16 14:35:02 devstack cinder-volume[75486]: DEBUG oslo_service.backend._eventlet.service [None req-7a316aef-88c3-4ae0-9259-a0a05b655104 None None] Full set of CONF: {{(pid=75486) wait /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/backend/_eventlet/service.py:564}} Sep 16 14:35:02 devstack cinder-volume[75486]: DEBUG oslo_service.backend._eventlet.service [None req-7a316aef-88c3-4ae0-9259-a0a05b655104 None None] ******************************************************************************** {{(pid=75486) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2804}} Sep 16 14:35:02 devstack cinder-volume[75486]: DEBUG oslo_service.backend._eventlet.service [None req-7a316aef-88c3-4ae0-9259-a0a05b655104 None None] Configuration options gathered from: {{(pid=75486) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2805}} Sep 16 14:35:02 devstack cinder-volume[75486]: DEBUG oslo_service.backend._eventlet.service [None req-7a316aef-88c3-4ae0-9259-a0a05b655104 None None] command line args: ['--config-file', '/etc/cinder/cinder.conf'] {{(pid=75486) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2806}} Sep 16 14:35:02 devstack cinder-volume[75486]: DEBUG oslo_service.backend._eventlet.service [None req-7a316aef-88c3-4ae0-9259-a0a05b655104 None None] config files: ['/etc/cinder/cinder.conf'] {{(pid=75486) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2807}} Sep 16 14:35:02 devstack cinder-volume[75486]: DEBUG oslo_service.backend._eventlet.service [None req-7a316aef-88c3-4ae0-9259-a0a05b655104 None None] ================================================================================ {{(pid=75486) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2809}} Sep 16 14:35:02 devstack cinder-volume[75486]: DEBUG oslo_service.backend._eventlet.service [None req-7a316aef-88c3-4ae0-9259-a0a05b655104 None None] allow_availability_zone_fallback = False {{(pid=75486) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 16 14:35:02 devstack cinder-volume[75486]: DEBUG oslo_service.backend._eventlet.service [None req-7a316aef-88c3-4ae0-9259-a0a05b655104 None None] allow_compression_on_image_upload = False {{(pid=75486) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 16 14:35:02 devstack cinder-volume[75486]: DEBUG oslo_service.backend._eventlet.service [None req-7a316aef-88c3-4ae0-9259-a0a05b655104 None None] allowed_direct_url_schemes = [] {{(pid=75486) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 16 14:35:02 devstack cinder-volume[75486]: DEBUG oslo_service.backend._eventlet.service [None req-7a316aef-88c3-4ae0-9259-a0a05b655104 None None] api_rate_limit = True {{(pid=75486) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 16 14:35:02 devstack cinder-volume[75486]: DEBUG oslo_service.backend._eventlet.service [None req-7a316aef-88c3-4ae0-9259-a0a05b655104 None None] auth_strategy = keystone {{(pid=75486) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 16 14:35:02 devstack cinder-volume[75486]: DEBUG oslo_service.backend._eventlet.service [None req-7a316aef-88c3-4ae0-9259-a0a05b655104 None None] az_cache_duration = 3600 {{(pid=75486) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 16 14:35:02 devstack cinder-volume[75486]: DEBUG oslo_service.backend._eventlet.service [None req-7a316aef-88c3-4ae0-9259-a0a05b655104 None None] backend_availability_zone = None {{(pid=75486) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 16 14:35:02 devstack cinder-volume[75486]: DEBUG oslo_service.backend._eventlet.service [None req-7a316aef-88c3-4ae0-9259-a0a05b655104 None None] backend_host = None {{(pid=75486) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 16 14:35:02 devstack cinder-volume[75486]: DEBUG oslo_service.backend._eventlet.service [None req-7a316aef-88c3-4ae0-9259-a0a05b655104 None None] backend_name = None {{(pid=75486) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 16 14:35:02 devstack cinder-volume[75486]: DEBUG oslo_service.backend._eventlet.service [None req-7a316aef-88c3-4ae0-9259-a0a05b655104 None None] backend_stats_polling_interval = 60 {{(pid=75486) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 16 14:35:02 devstack cinder-volume[75486]: DEBUG oslo_service.backend._eventlet.service [None req-7a316aef-88c3-4ae0-9259-a0a05b655104 None None] backup_api_class = cinder.backup.api.API {{(pid=75486) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 16 14:35:02 devstack cinder-volume[75486]: DEBUG oslo_service.backend._eventlet.service [None req-7a316aef-88c3-4ae0-9259-a0a05b655104 None None] backup_manager = cinder.backup.manager.BackupManager {{(pid=75486) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 16 14:35:02 devstack cinder-volume[75486]: DEBUG oslo_service.backend._eventlet.service [None req-7a316aef-88c3-4ae0-9259-a0a05b655104 None None] backup_name_template = backup-%s {{(pid=75486) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 16 14:35:02 devstack cinder-volume[75486]: DEBUG oslo_service.backend._eventlet.service [None req-7a316aef-88c3-4ae0-9259-a0a05b655104 None None] backup_use_same_host = False {{(pid=75486) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 16 14:35:02 devstack cinder-volume[75486]: DEBUG oslo_service.backend._eventlet.service [None req-7a316aef-88c3-4ae0-9259-a0a05b655104 None None] backup_use_temp_snapshot = False {{(pid=75486) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 16 14:35:02 devstack cinder-volume[75486]: DEBUG oslo_service.backend._eventlet.service [None req-7a316aef-88c3-4ae0-9259-a0a05b655104 None None] chap_password = **** {{(pid=75486) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 16 14:35:02 devstack cinder-volume[75486]: DEBUG oslo_service.backend._eventlet.service [None req-7a316aef-88c3-4ae0-9259-a0a05b655104 None None] chap_username = {{(pid=75486) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 16 14:35:02 devstack cinder-volume[75486]: DEBUG oslo_service.backend._eventlet.service [None req-7a316aef-88c3-4ae0-9259-a0a05b655104 None None] chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=75486) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 16 14:35:02 devstack cinder-volume[75486]: DEBUG oslo_service.backend._eventlet.service [None req-7a316aef-88c3-4ae0-9259-a0a05b655104 None None] cinder_internal_tenant_project_id = 9b7315773d9c426f8ff8ef3b9460cf4d {{(pid=75486) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 16 14:35:02 devstack cinder-volume[75486]: DEBUG oslo_service.backend._eventlet.service [None req-7a316aef-88c3-4ae0-9259-a0a05b655104 None None] cinder_internal_tenant_user_id = 73df27e14439482e83497ba46b8b1082 {{(pid=75486) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 16 14:35:02 devstack cinder-volume[75486]: DEBUG oslo_service.backend._eventlet.service [None req-7a316aef-88c3-4ae0-9259-a0a05b655104 None None] cloned_volume_same_az = True {{(pid=75486) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 16 14:35:02 devstack cinder-volume[75486]: DEBUG oslo_service.backend._eventlet.service [None req-7a316aef-88c3-4ae0-9259-a0a05b655104 None None] cluster = None {{(pid=75486) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 16 14:35:02 devstack cinder-volume[75486]: DEBUG oslo_service.backend._eventlet.service [None req-7a316aef-88c3-4ae0-9259-a0a05b655104 None None] compression_format = gzip {{(pid=75486) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 16 14:35:02 devstack cinder-volume[75486]: DEBUG oslo_service.backend._eventlet.service [None req-7a316aef-88c3-4ae0-9259-a0a05b655104 None None] compute_api_class = cinder.compute.nova.API {{(pid=75486) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 16 14:35:02 devstack cinder-volume[75486]: DEBUG oslo_service.backend._eventlet.service [None req-7a316aef-88c3-4ae0-9259-a0a05b655104 None None] config_dir = [] {{(pid=75486) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 16 14:35:02 devstack cinder-volume[75486]: DEBUG oslo_service.backend._eventlet.service [None req-7a316aef-88c3-4ae0-9259-a0a05b655104 None None] config_file = ['/etc/cinder/cinder.conf'] {{(pid=75486) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 16 14:35:02 devstack cinder-volume[75486]: DEBUG oslo_service.backend._eventlet.service [None req-7a316aef-88c3-4ae0-9259-a0a05b655104 None None] config_source = [] {{(pid=75486) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 16 14:35:02 devstack cinder-volume[75486]: DEBUG oslo_service.backend._eventlet.service [None req-7a316aef-88c3-4ae0-9259-a0a05b655104 None None] consistencygroup_api_class = cinder.consistencygroup.api.API {{(pid=75486) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 16 14:35:02 devstack cinder-volume[75486]: DEBUG oslo_service.backend._eventlet.service [None req-7a316aef-88c3-4ae0-9259-a0a05b655104 None None] control_exchange = openstack {{(pid=75486) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 16 14:35:02 devstack cinder-volume[75486]: DEBUG oslo_service.backend._eventlet.service [None req-7a316aef-88c3-4ae0-9259-a0a05b655104 None None] debug = True {{(pid=75486) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 16 14:35:02 devstack cinder-volume[75486]: DEBUG oslo_service.backend._eventlet.service [None req-7a316aef-88c3-4ae0-9259-a0a05b655104 None None] default_availability_zone = None {{(pid=75486) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 16 14:35:02 devstack cinder-volume[75486]: DEBUG oslo_service.backend._eventlet.service [None req-7a316aef-88c3-4ae0-9259-a0a05b655104 None None] default_group_type = None {{(pid=75486) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 16 14:35:02 devstack cinder-volume[75486]: DEBUG oslo_service.backend._eventlet.service [None req-7a316aef-88c3-4ae0-9259-a0a05b655104 None None] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO'] {{(pid=75486) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 16 14:35:02 devstack cinder-volume[75486]: DEBUG oslo_service.backend._eventlet.service [None req-7a316aef-88c3-4ae0-9259-a0a05b655104 None None] default_volume_type = lvmdriver-1 {{(pid=75486) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 16 14:35:02 devstack cinder-volume[75486]: DEBUG oslo_service.backend._eventlet.service [None req-7a316aef-88c3-4ae0-9259-a0a05b655104 None None] driver_client_cert = None {{(pid=75486) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 16 14:35:02 devstack cinder-volume[75486]: DEBUG oslo_service.backend._eventlet.service [None req-7a316aef-88c3-4ae0-9259-a0a05b655104 None None] driver_client_cert_key = None {{(pid=75486) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 16 14:35:02 devstack cinder-volume[75486]: DEBUG oslo_service.backend._eventlet.service [None req-7a316aef-88c3-4ae0-9259-a0a05b655104 None None] driver_data_namespace = None {{(pid=75486) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 16 14:35:02 devstack cinder-volume[75486]: DEBUG oslo_service.backend._eventlet.service [None req-7a316aef-88c3-4ae0-9259-a0a05b655104 None None] driver_ssl_cert_path = None {{(pid=75486) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 16 14:35:02 devstack cinder-volume[75486]: DEBUG oslo_service.backend._eventlet.service [None req-7a316aef-88c3-4ae0-9259-a0a05b655104 None None] driver_ssl_cert_verify = False {{(pid=75486) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 16 14:35:02 devstack cinder-volume[75623]: INFO cinder.service [-] Starting cinder-volume node (version 26.1.0) Sep 16 14:35:02 devstack cinder-volume[75486]: DEBUG oslo_service.backend._eventlet.service [None req-7a316aef-88c3-4ae0-9259-a0a05b655104 None None] driver_use_ssl = False {{(pid=75486) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 16 14:35:02 devstack cinder-volume[75486]: DEBUG oslo_service.backend._eventlet.service [None req-7a316aef-88c3-4ae0-9259-a0a05b655104 None None] enable_force_upload = False {{(pid=75486) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 16 14:35:02 devstack cinder-volume[75486]: DEBUG oslo_service.backend._eventlet.service [None req-7a316aef-88c3-4ae0-9259-a0a05b655104 None None] enable_new_services = True {{(pid=75486) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 16 14:35:02 devstack cinder-volume[75486]: DEBUG oslo_service.backend._eventlet.service [None req-7a316aef-88c3-4ae0-9259-a0a05b655104 None None] enable_unsupported_driver = False {{(pid=75486) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 16 14:35:02 devstack cinder-volume[75486]: DEBUG oslo_service.backend._eventlet.service [None req-7a316aef-88c3-4ae0-9259-a0a05b655104 None None] enabled_backends = ['lvmdriver-1'] {{(pid=75486) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 16 14:35:02 devstack cinder-volume[75486]: DEBUG oslo_service.backend._eventlet.service [None req-7a316aef-88c3-4ae0-9259-a0a05b655104 None None] enforce_multipath_for_image_xfer = False {{(pid=75486) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 16 14:35:02 devstack cinder-volume[75486]: DEBUG oslo_service.backend._eventlet.service [None req-7a316aef-88c3-4ae0-9259-a0a05b655104 None None] filter_function = None {{(pid=75486) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 16 14:35:02 devstack cinder-volume[75486]: DEBUG oslo_service.backend._eventlet.service [None req-7a316aef-88c3-4ae0-9259-a0a05b655104 None None] glance_api_insecure = False {{(pid=75486) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 16 14:35:02 devstack cinder-volume[75486]: DEBUG oslo_service.backend._eventlet.service [None req-7a316aef-88c3-4ae0-9259-a0a05b655104 None None] glance_api_servers = ['http://192.168.122.206/image'] {{(pid=75486) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 16 14:35:02 devstack cinder-volume[75486]: DEBUG oslo_service.backend._eventlet.service [None req-7a316aef-88c3-4ae0-9259-a0a05b655104 None None] glance_api_ssl_compression = False {{(pid=75486) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 16 14:35:02 devstack cinder-volume[75486]: DEBUG oslo_service.backend._eventlet.service [None req-7a316aef-88c3-4ae0-9259-a0a05b655104 None None] glance_ca_certificates_file = None {{(pid=75486) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 16 14:35:02 devstack cinder-volume[75486]: DEBUG oslo_service.backend._eventlet.service [None req-7a316aef-88c3-4ae0-9259-a0a05b655104 None None] glance_catalog_info = image:glance:publicURL {{(pid=75486) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 16 14:35:02 devstack cinder-volume[75486]: DEBUG oslo_service.backend._eventlet.service [None req-7a316aef-88c3-4ae0-9259-a0a05b655104 None None] glance_certfile = None {{(pid=75486) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 16 14:35:02 devstack cinder-volume[75486]: DEBUG oslo_service.backend._eventlet.service [None req-7a316aef-88c3-4ae0-9259-a0a05b655104 None None] glance_core_properties = ['checksum', 'container_format', 'disk_format', 'image_name', 'image_id', 'min_disk', 'min_ram', 'name', 'size'] {{(pid=75486) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 16 14:35:02 devstack cinder-volume[75486]: DEBUG oslo_service.backend._eventlet.service [None req-7a316aef-88c3-4ae0-9259-a0a05b655104 None None] glance_keyfile = None {{(pid=75486) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 16 14:35:02 devstack cinder-volume[75486]: DEBUG oslo_service.backend._eventlet.service [None req-7a316aef-88c3-4ae0-9259-a0a05b655104 None None] glance_num_retries = 3 {{(pid=75486) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 16 14:35:02 devstack cinder-volume[75486]: DEBUG oslo_service.backend._eventlet.service [None req-7a316aef-88c3-4ae0-9259-a0a05b655104 None None] glance_request_timeout = None {{(pid=75486) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 16 14:35:02 devstack cinder-volume[75486]: DEBUG oslo_service.backend._eventlet.service [None req-7a316aef-88c3-4ae0-9259-a0a05b655104 None None] goodness_function = None {{(pid=75486) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 16 14:35:02 devstack cinder-volume[75486]: DEBUG oslo_service.backend._eventlet.service [None req-7a316aef-88c3-4ae0-9259-a0a05b655104 None None] graceful_shutdown_timeout = 5 {{(pid=75486) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 16 14:35:02 devstack cinder-volume[75486]: DEBUG oslo_service.backend._eventlet.service [None req-7a316aef-88c3-4ae0-9259-a0a05b655104 None None] group_api_class = cinder.group.api.API {{(pid=75486) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 16 14:35:02 devstack cinder-volume[75486]: DEBUG oslo_service.backend._eventlet.service [None req-7a316aef-88c3-4ae0-9259-a0a05b655104 None None] host = devstack {{(pid=75486) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 16 14:35:02 devstack cinder-volume[75486]: DEBUG oslo_service.backend._eventlet.service [None req-7a316aef-88c3-4ae0-9259-a0a05b655104 None None] image_compress_on_upload = True {{(pid=75486) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 16 14:35:02 devstack cinder-volume[75486]: DEBUG oslo_service.backend._eventlet.service [None req-7a316aef-88c3-4ae0-9259-a0a05b655104 None None] image_conversion_address_space_limit = 1 {{(pid=75486) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 16 14:35:02 devstack cinder-volume[75486]: DEBUG oslo_service.backend._eventlet.service [None req-7a316aef-88c3-4ae0-9259-a0a05b655104 None None] image_conversion_cpu_limit = 60 {{(pid=75486) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 16 14:35:02 devstack cinder-volume[75486]: DEBUG oslo_service.backend._eventlet.service [None req-7a316aef-88c3-4ae0-9259-a0a05b655104 None None] image_conversion_dir = /opt/stack/data/cinder/conversion {{(pid=75486) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 16 14:35:02 devstack cinder-volume[75486]: DEBUG oslo_service.backend._eventlet.service [None req-7a316aef-88c3-4ae0-9259-a0a05b655104 None None] image_conversion_disable = False {{(pid=75486) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 16 14:35:02 devstack cinder-volume[75486]: DEBUG oslo_service.backend._eventlet.service [None req-7a316aef-88c3-4ae0-9259-a0a05b655104 None None] image_upload_use_cinder_backend = False {{(pid=75486) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 16 14:35:02 devstack cinder-volume[75486]: DEBUG oslo_service.backend._eventlet.service [None req-7a316aef-88c3-4ae0-9259-a0a05b655104 None None] image_upload_use_internal_tenant = False {{(pid=75486) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 16 14:35:02 devstack cinder-volume[75486]: DEBUG oslo_service.backend._eventlet.service [None req-7a316aef-88c3-4ae0-9259-a0a05b655104 None None] image_volume_cache_enabled = False {{(pid=75486) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 16 14:35:02 devstack cinder-volume[75486]: DEBUG oslo_service.backend._eventlet.service [None req-7a316aef-88c3-4ae0-9259-a0a05b655104 None None] image_volume_cache_max_count = 0 {{(pid=75486) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 16 14:35:02 devstack cinder-volume[75486]: DEBUG oslo_service.backend._eventlet.service [None req-7a316aef-88c3-4ae0-9259-a0a05b655104 None None] image_volume_cache_max_size_gb = 0 {{(pid=75486) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 16 14:35:02 devstack cinder-volume[75486]: DEBUG oslo_service.backend._eventlet.service [None req-7a316aef-88c3-4ae0-9259-a0a05b655104 None None] init_host_max_objects_retrieval = 0 {{(pid=75486) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 16 14:35:02 devstack cinder-volume[75486]: DEBUG oslo_service.backend._eventlet.service [None req-7a316aef-88c3-4ae0-9259-a0a05b655104 None None] instance_format = [instance: %(uuid)s] {{(pid=75486) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 16 14:35:02 devstack cinder-volume[75486]: DEBUG oslo_service.backend._eventlet.service [None req-7a316aef-88c3-4ae0-9259-a0a05b655104 None None] instance_uuid_format = [instance: %(uuid)s] {{(pid=75486) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 16 14:35:02 devstack cinder-volume[75486]: DEBUG oslo_service.backend._eventlet.service [None req-7a316aef-88c3-4ae0-9259-a0a05b655104 None None] iscsi_iotype = fileio {{(pid=75486) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 16 14:35:02 devstack cinder-volume[75486]: DEBUG oslo_service.backend._eventlet.service [None req-7a316aef-88c3-4ae0-9259-a0a05b655104 None None] iscsi_target_flags = {{(pid=75486) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 16 14:35:02 devstack cinder-volume[75486]: DEBUG oslo_service.backend._eventlet.service [None req-7a316aef-88c3-4ae0-9259-a0a05b655104 None None] iscsi_write_cache = on {{(pid=75486) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 16 14:35:02 devstack cinder-volume[75486]: DEBUG oslo_service.backend._eventlet.service [None req-7a316aef-88c3-4ae0-9259-a0a05b655104 None None] iser_helper = tgtadm {{(pid=75486) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 16 14:35:02 devstack cinder-volume[75486]: DEBUG oslo_service.backend._eventlet.service [None req-7a316aef-88c3-4ae0-9259-a0a05b655104 None None] iser_ip_address = 192.168.122.206 {{(pid=75486) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 16 14:35:02 devstack cinder-volume[75486]: DEBUG oslo_service.backend._eventlet.service [None req-7a316aef-88c3-4ae0-9259-a0a05b655104 None None] iser_port = 3260 {{(pid=75486) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 16 14:35:02 devstack cinder-volume[75486]: DEBUG oslo_service.backend._eventlet.service [None req-7a316aef-88c3-4ae0-9259-a0a05b655104 None None] iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=75486) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 16 14:35:02 devstack cinder-volume[75486]: DEBUG oslo_service.backend._eventlet.service [None req-7a316aef-88c3-4ae0-9259-a0a05b655104 None None] log_color = False {{(pid=75486) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 16 14:35:02 devstack cinder-volume[75486]: DEBUG oslo_service.backend._eventlet.service [None req-7a316aef-88c3-4ae0-9259-a0a05b655104 None None] log_config_append = None {{(pid=75486) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 16 14:35:02 devstack cinder-volume[75486]: DEBUG oslo_service.backend._eventlet.service [None req-7a316aef-88c3-4ae0-9259-a0a05b655104 None None] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=75486) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 16 14:35:02 devstack cinder-volume[75486]: DEBUG oslo_service.backend._eventlet.service [None req-7a316aef-88c3-4ae0-9259-a0a05b655104 None None] log_dir = None {{(pid=75486) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 16 14:35:02 devstack cinder-volume[75486]: DEBUG oslo_service.backend._eventlet.service [None req-7a316aef-88c3-4ae0-9259-a0a05b655104 None None] log_file = None {{(pid=75486) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 16 14:35:02 devstack cinder-volume[75486]: DEBUG oslo_service.backend._eventlet.service [None req-7a316aef-88c3-4ae0-9259-a0a05b655104 None None] log_options = True {{(pid=75486) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 16 14:35:02 devstack cinder-volume[75486]: DEBUG oslo_service.backend._eventlet.service [None req-7a316aef-88c3-4ae0-9259-a0a05b655104 None None] log_rotate_interval = 1 {{(pid=75486) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 16 14:35:02 devstack cinder-volume[75486]: DEBUG oslo_service.backend._eventlet.service [None req-7a316aef-88c3-4ae0-9259-a0a05b655104 None None] log_rotate_interval_type = days {{(pid=75486) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 16 14:35:02 devstack cinder-volume[75486]: DEBUG oslo_service.backend._eventlet.service [None req-7a316aef-88c3-4ae0-9259-a0a05b655104 None None] log_rotation_type = none {{(pid=75486) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 16 14:35:02 devstack cinder-volume[75486]: DEBUG oslo_service.backend._eventlet.service [None req-7a316aef-88c3-4ae0-9259-a0a05b655104 None None] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=75486) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 16 14:35:02 devstack cinder-volume[75486]: DEBUG oslo_service.backend._eventlet.service [None req-7a316aef-88c3-4ae0-9259-a0a05b655104 None None] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=75486) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 16 14:35:02 devstack cinder-volume[75486]: DEBUG oslo_service.backend._eventlet.service [None req-7a316aef-88c3-4ae0-9259-a0a05b655104 None None] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=75486) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 16 14:35:02 devstack cinder-volume[75486]: DEBUG oslo_service.backend._eventlet.service [None req-7a316aef-88c3-4ae0-9259-a0a05b655104 None None] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=75486) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 16 14:35:02 devstack cinder-volume[75486]: DEBUG oslo_service.backend._eventlet.service [None req-7a316aef-88c3-4ae0-9259-a0a05b655104 None None] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=75486) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 16 14:35:02 devstack cinder-volume[75486]: DEBUG oslo_service.backend._eventlet.service [None req-7a316aef-88c3-4ae0-9259-a0a05b655104 None None] max_age = 0 {{(pid=75486) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 16 14:35:02 devstack cinder-volume[75486]: DEBUG oslo_service.backend._eventlet.service [None req-7a316aef-88c3-4ae0-9259-a0a05b655104 None None] max_logfile_count = 30 {{(pid=75486) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 16 14:35:02 devstack cinder-volume[75486]: DEBUG oslo_service.backend._eventlet.service [None req-7a316aef-88c3-4ae0-9259-a0a05b655104 None None] max_logfile_size_mb = 200 {{(pid=75486) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 16 14:35:02 devstack cinder-volume[75486]: DEBUG oslo_service.backend._eventlet.service [None req-7a316aef-88c3-4ae0-9259-a0a05b655104 None None] max_over_subscription_ratio = 20.0 {{(pid=75486) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 16 14:35:02 devstack cinder-volume[75486]: DEBUG oslo_service.backend._eventlet.service [None req-7a316aef-88c3-4ae0-9259-a0a05b655104 None None] message_reap_interval = 86400 {{(pid=75486) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 16 14:35:02 devstack cinder-volume[75486]: DEBUG oslo_service.backend._eventlet.service [None req-7a316aef-88c3-4ae0-9259-a0a05b655104 None None] message_ttl = 2592000 {{(pid=75486) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 16 14:35:02 devstack cinder-volume[75486]: DEBUG oslo_service.backend._eventlet.service [None req-7a316aef-88c3-4ae0-9259-a0a05b655104 None None] migration_create_volume_timeout_secs = 300 {{(pid=75486) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 16 14:35:02 devstack cinder-volume[75486]: DEBUG oslo_service.backend._eventlet.service [None req-7a316aef-88c3-4ae0-9259-a0a05b655104 None None] monkey_patch = False {{(pid=75486) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 16 14:35:02 devstack cinder-volume[75486]: DEBUG oslo_service.backend._eventlet.service [None req-7a316aef-88c3-4ae0-9259-a0a05b655104 None None] monkey_patch_modules = [] {{(pid=75486) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 16 14:35:02 devstack cinder-volume[75486]: DEBUG oslo_service.backend._eventlet.service [None req-7a316aef-88c3-4ae0-9259-a0a05b655104 None None] my_ip = 192.168.122.206 {{(pid=75486) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 16 14:35:02 devstack cinder-volume[75486]: DEBUG oslo_service.backend._eventlet.service [None req-7a316aef-88c3-4ae0-9259-a0a05b655104 None None] no_snapshot_gb_quota = False {{(pid=75486) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 16 14:35:02 devstack cinder-volume[75486]: DEBUG oslo_service.backend._eventlet.service [None req-7a316aef-88c3-4ae0-9259-a0a05b655104 None None] num_iser_scan_tries = 3 {{(pid=75486) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 16 14:35:02 devstack cinder-volume[75486]: DEBUG oslo_service.backend._eventlet.service [None req-7a316aef-88c3-4ae0-9259-a0a05b655104 None None] num_shell_tries = 3 {{(pid=75486) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 16 14:35:02 devstack cinder-volume[75486]: DEBUG oslo_service.backend._eventlet.service [None req-7a316aef-88c3-4ae0-9259-a0a05b655104 None None] num_volume_device_scan_tries = 3 {{(pid=75486) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 16 14:35:02 devstack cinder-volume[75486]: DEBUG oslo_service.backend._eventlet.service [None req-7a316aef-88c3-4ae0-9259-a0a05b655104 None None] nvmeof_conn_info_version = 1 {{(pid=75486) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 16 14:35:02 devstack cinder-volume[75486]: DEBUG oslo_service.backend._eventlet.service [None req-7a316aef-88c3-4ae0-9259-a0a05b655104 None None] nvmet_ns_id = 10 {{(pid=75486) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 16 14:35:02 devstack cinder-volume[75486]: DEBUG oslo_service.backend._eventlet.service [None req-7a316aef-88c3-4ae0-9259-a0a05b655104 None None] nvmet_port_id = 1 {{(pid=75486) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 16 14:35:02 devstack cinder-volume[75486]: DEBUG oslo_service.backend._eventlet.service [None req-7a316aef-88c3-4ae0-9259-a0a05b655104 None None] osapi_max_limit = 1000 {{(pid=75486) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 16 14:35:02 devstack cinder-volume[75486]: DEBUG oslo_service.backend._eventlet.service [None req-7a316aef-88c3-4ae0-9259-a0a05b655104 None None] osapi_volume_ext_list = [] {{(pid=75486) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 16 14:35:02 devstack cinder-volume[75486]: DEBUG oslo_service.backend._eventlet.service [None req-7a316aef-88c3-4ae0-9259-a0a05b655104 None None] osapi_volume_extension = ['cinder.api.contrib.standard_extensions'] {{(pid=75486) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 16 14:35:02 devstack cinder-volume[75486]: DEBUG oslo_service.backend._eventlet.service [None req-7a316aef-88c3-4ae0-9259-a0a05b655104 None None] osapi_volume_listen = 0.0.0.0 {{(pid=75486) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 16 14:35:02 devstack cinder-volume[75486]: DEBUG oslo_service.backend._eventlet.service [None req-7a316aef-88c3-4ae0-9259-a0a05b655104 None None] osapi_volume_listen_port = 8776 {{(pid=75486) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 16 14:35:02 devstack cinder-volume[75486]: DEBUG oslo_service.backend._eventlet.service [None req-7a316aef-88c3-4ae0-9259-a0a05b655104 None None] osapi_volume_use_ssl = False {{(pid=75486) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 16 14:35:02 devstack cinder-volume[75486]: DEBUG oslo_service.backend._eventlet.service [None req-7a316aef-88c3-4ae0-9259-a0a05b655104 None None] osapi_volume_workers = 2 {{(pid=75486) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 16 14:35:02 devstack cinder-volume[75486]: DEBUG oslo_service.backend._eventlet.service [None req-7a316aef-88c3-4ae0-9259-a0a05b655104 None None] per_volume_size_limit = -1 {{(pid=75486) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 16 14:35:02 devstack cinder-volume[75486]: DEBUG oslo_service.backend._eventlet.service [None req-7a316aef-88c3-4ae0-9259-a0a05b655104 None None] periodic_fuzzy_delay = 60 {{(pid=75486) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 16 14:35:02 devstack cinder-volume[75486]: DEBUG oslo_service.backend._eventlet.service [None req-7a316aef-88c3-4ae0-9259-a0a05b655104 None None] periodic_interval = 60 {{(pid=75486) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 16 14:35:02 devstack cinder-volume[75486]: DEBUG oslo_service.backend._eventlet.service [None req-7a316aef-88c3-4ae0-9259-a0a05b655104 None None] project_id_regex = [0-9a-f\-]+ {{(pid=75486) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 16 14:35:02 devstack cinder-volume[75486]: DEBUG oslo_service.backend._eventlet.service [None req-7a316aef-88c3-4ae0-9259-a0a05b655104 None None] public_endpoint = None {{(pid=75486) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 16 14:35:02 devstack cinder-volume[75486]: DEBUG oslo_service.backend._eventlet.service [None req-7a316aef-88c3-4ae0-9259-a0a05b655104 None None] publish_errors = False {{(pid=75486) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 16 14:35:02 devstack cinder-volume[75486]: DEBUG oslo_service.backend._eventlet.service [None req-7a316aef-88c3-4ae0-9259-a0a05b655104 None None] quota_backup_gigabytes = 1000 {{(pid=75486) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 16 14:35:02 devstack cinder-volume[75486]: DEBUG oslo_service.backend._eventlet.service [None req-7a316aef-88c3-4ae0-9259-a0a05b655104 None None] quota_backups = 10 {{(pid=75486) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 16 14:35:02 devstack cinder-volume[75486]: DEBUG oslo_service.backend._eventlet.service [None req-7a316aef-88c3-4ae0-9259-a0a05b655104 None None] quota_driver = cinder.quota.DbQuotaDriver {{(pid=75486) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 16 14:35:02 devstack cinder-volume[75486]: DEBUG oslo_service.backend._eventlet.service [None req-7a316aef-88c3-4ae0-9259-a0a05b655104 None None] quota_gigabytes = 1000 {{(pid=75486) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 16 14:35:02 devstack cinder-volume[75486]: DEBUG oslo_service.backend._eventlet.service [None req-7a316aef-88c3-4ae0-9259-a0a05b655104 None None] quota_groups = 10 {{(pid=75486) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 16 14:35:02 devstack cinder-volume[75486]: DEBUG oslo_service.backend._eventlet.service [None req-7a316aef-88c3-4ae0-9259-a0a05b655104 None None] quota_snapshots = 10 {{(pid=75486) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 16 14:35:02 devstack cinder-volume[75486]: DEBUG oslo_service.backend._eventlet.service [None req-7a316aef-88c3-4ae0-9259-a0a05b655104 None None] quota_volumes = 10 {{(pid=75486) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 16 14:35:02 devstack cinder-volume[75486]: DEBUG oslo_service.backend._eventlet.service [None req-7a316aef-88c3-4ae0-9259-a0a05b655104 None None] rate_limit_burst = 0 {{(pid=75486) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 16 14:35:02 devstack cinder-volume[75486]: DEBUG oslo_service.backend._eventlet.service [None req-7a316aef-88c3-4ae0-9259-a0a05b655104 None None] rate_limit_except_level = CRITICAL {{(pid=75486) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 16 14:35:02 devstack cinder-volume[75486]: DEBUG oslo_service.backend._eventlet.service [None req-7a316aef-88c3-4ae0-9259-a0a05b655104 None None] rate_limit_interval = 0 {{(pid=75486) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 16 14:35:02 devstack cinder-volume[75486]: DEBUG oslo_service.backend._eventlet.service [None req-7a316aef-88c3-4ae0-9259-a0a05b655104 None None] reinit_driver_count = 3 {{(pid=75486) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 16 14:35:02 devstack cinder-volume[75486]: DEBUG oslo_service.backend._eventlet.service [None req-7a316aef-88c3-4ae0-9259-a0a05b655104 None None] replication_device = **** {{(pid=75486) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 16 14:35:02 devstack cinder-volume[75486]: DEBUG oslo_service.backend._eventlet.service [None req-7a316aef-88c3-4ae0-9259-a0a05b655104 None None] report_discard_supported = False {{(pid=75486) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 16 14:35:02 devstack cinder-volume[75486]: DEBUG oslo_service.backend._eventlet.service [None req-7a316aef-88c3-4ae0-9259-a0a05b655104 None None] report_interval = 120 {{(pid=75486) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 16 14:35:02 devstack cinder-volume[75486]: DEBUG oslo_service.backend._eventlet.service [None req-7a316aef-88c3-4ae0-9259-a0a05b655104 None None] reservation_clean_interval = 86400 {{(pid=75486) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 16 14:35:02 devstack cinder-volume[75486]: DEBUG oslo_service.backend._eventlet.service [None req-7a316aef-88c3-4ae0-9259-a0a05b655104 None None] reservation_expire = 86400 {{(pid=75486) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 16 14:35:02 devstack cinder-volume[75486]: DEBUG oslo_service.backend._eventlet.service [None req-7a316aef-88c3-4ae0-9259-a0a05b655104 None None] reserved_image_namespaces = [] {{(pid=75486) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 16 14:35:02 devstack cinder-volume[75486]: DEBUG oslo_service.backend._eventlet.service [None req-7a316aef-88c3-4ae0-9259-a0a05b655104 None None] reserved_percentage = 0 {{(pid=75486) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 16 14:35:02 devstack cinder-volume[75486]: DEBUG oslo_service.backend._eventlet.service [None req-7a316aef-88c3-4ae0-9259-a0a05b655104 None None] resource_query_filters_file = /etc/cinder/resource_filters.json {{(pid=75486) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 16 14:35:02 devstack cinder-volume[75486]: DEBUG oslo_service.backend._eventlet.service [None req-7a316aef-88c3-4ae0-9259-a0a05b655104 None None] rootwrap_config = /etc/cinder/rootwrap.conf {{(pid=75486) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 16 14:35:02 devstack cinder-volume[75486]: DEBUG oslo_service.backend._eventlet.service [None req-7a316aef-88c3-4ae0-9259-a0a05b655104 None None] rpc_response_timeout = 120 {{(pid=75486) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 16 14:35:02 devstack cinder-volume[75486]: DEBUG oslo_service.backend._eventlet.service [None req-7a316aef-88c3-4ae0-9259-a0a05b655104 None None] run_external_periodic_tasks = True {{(pid=75486) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 16 14:35:02 devstack cinder-volume[75486]: DEBUG oslo_service.backend._eventlet.service [None req-7a316aef-88c3-4ae0-9259-a0a05b655104 None None] scheduler_manager = cinder.scheduler.manager.SchedulerManager {{(pid=75486) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 16 14:35:02 devstack cinder-volume[75486]: DEBUG oslo_service.backend._eventlet.service [None req-7a316aef-88c3-4ae0-9259-a0a05b655104 None None] scst_target_driver = iscsi {{(pid=75486) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 16 14:35:02 devstack cinder-volume[75486]: DEBUG oslo_service.backend._eventlet.service [None req-7a316aef-88c3-4ae0-9259-a0a05b655104 None None] scst_target_iqn_name = None {{(pid=75486) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 16 14:35:02 devstack cinder-volume[75486]: DEBUG oslo_service.backend._eventlet.service [None req-7a316aef-88c3-4ae0-9259-a0a05b655104 None None] service_down_time = 720 {{(pid=75486) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 16 14:35:02 devstack cinder-volume[75486]: DEBUG oslo_service.backend._eventlet.service [None req-7a316aef-88c3-4ae0-9259-a0a05b655104 None None] shell_completion = None {{(pid=75486) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 16 14:35:02 devstack cinder-volume[75486]: DEBUG oslo_service.backend._eventlet.service [None req-7a316aef-88c3-4ae0-9259-a0a05b655104 None None] snapshot_name_template = snapshot-%s {{(pid=75486) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 16 14:35:02 devstack cinder-volume[75486]: DEBUG oslo_service.backend._eventlet.service [None req-7a316aef-88c3-4ae0-9259-a0a05b655104 None None] snapshot_same_host = True {{(pid=75486) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 16 14:35:02 devstack cinder-volume[75486]: DEBUG oslo_service.backend._eventlet.service [None req-7a316aef-88c3-4ae0-9259-a0a05b655104 None None] split_loggers = False {{(pid=75486) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 16 14:35:02 devstack cinder-volume[75486]: DEBUG oslo_service.backend._eventlet.service [None req-7a316aef-88c3-4ae0-9259-a0a05b655104 None None] state_path = /opt/stack/data/cinder {{(pid=75486) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 16 14:35:02 devstack cinder-volume[75486]: DEBUG oslo_service.backend._eventlet.service [None req-7a316aef-88c3-4ae0-9259-a0a05b655104 None None] storage_availability_zone = nova {{(pid=75486) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 16 14:35:02 devstack cinder-volume[75486]: DEBUG oslo_service.backend._eventlet.service [None req-7a316aef-88c3-4ae0-9259-a0a05b655104 None None] storage_protocol = iSCSI {{(pid=75486) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 16 14:35:02 devstack cinder-volume[75486]: DEBUG oslo_service.backend._eventlet.service [None req-7a316aef-88c3-4ae0-9259-a0a05b655104 None None] syslog_log_facility = LOG_USER {{(pid=75486) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 16 14:35:02 devstack cinder-volume[75486]: DEBUG oslo_service.backend._eventlet.service [None req-7a316aef-88c3-4ae0-9259-a0a05b655104 None None] target_helper = lioadm {{(pid=75486) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 16 14:35:02 devstack cinder-volume[75486]: DEBUG oslo_service.backend._eventlet.service [None req-7a316aef-88c3-4ae0-9259-a0a05b655104 None None] target_ip_address = 192.168.122.206 {{(pid=75486) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 16 14:35:02 devstack cinder-volume[75486]: DEBUG oslo_service.backend._eventlet.service [None req-7a316aef-88c3-4ae0-9259-a0a05b655104 None None] target_port = 3260 {{(pid=75486) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 16 14:35:02 devstack cinder-volume[75486]: DEBUG oslo_service.backend._eventlet.service [None req-7a316aef-88c3-4ae0-9259-a0a05b655104 None None] target_prefix = iqn.2010-10.org.openstack: {{(pid=75486) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 16 14:35:02 devstack cinder-volume[75486]: DEBUG oslo_service.backend._eventlet.service [None req-7a316aef-88c3-4ae0-9259-a0a05b655104 None None] target_protocol = iscsi {{(pid=75486) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 16 14:35:02 devstack cinder-volume[75486]: DEBUG oslo_service.backend._eventlet.service [None req-7a316aef-88c3-4ae0-9259-a0a05b655104 None None] target_secondary_ip_addresses = [] {{(pid=75486) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 16 14:35:02 devstack cinder-volume[75486]: DEBUG oslo_service.backend._eventlet.service [None req-7a316aef-88c3-4ae0-9259-a0a05b655104 None None] trace_flags = None {{(pid=75486) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 16 14:35:02 devstack cinder-volume[75486]: DEBUG oslo_service.backend._eventlet.service [None req-7a316aef-88c3-4ae0-9259-a0a05b655104 None None] transfer_api_class = cinder.transfer.api.API {{(pid=75486) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 16 14:35:02 devstack cinder-volume[75486]: DEBUG oslo_service.backend._eventlet.service [None req-7a316aef-88c3-4ae0-9259-a0a05b655104 None None] transport_url = **** {{(pid=75486) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 16 14:35:02 devstack cinder-volume[75486]: DEBUG oslo_service.backend._eventlet.service [None req-7a316aef-88c3-4ae0-9259-a0a05b655104 None None] until_refresh = 0 {{(pid=75486) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 16 14:35:02 devstack cinder-volume[75486]: DEBUG oslo_service.backend._eventlet.service [None req-7a316aef-88c3-4ae0-9259-a0a05b655104 None None] use_chap_auth = False {{(pid=75486) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 16 14:35:02 devstack cinder-volume[75486]: DEBUG oslo_service.backend._eventlet.service [None req-7a316aef-88c3-4ae0-9259-a0a05b655104 None None] use_default_quota_class = True {{(pid=75486) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 16 14:35:02 devstack cinder-volume[75486]: DEBUG oslo_service.backend._eventlet.service [None req-7a316aef-88c3-4ae0-9259-a0a05b655104 None None] use_journal = False {{(pid=75486) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 16 14:35:02 devstack cinder-volume[75486]: DEBUG oslo_service.backend._eventlet.service [None req-7a316aef-88c3-4ae0-9259-a0a05b655104 None None] use_json = False {{(pid=75486) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 16 14:35:02 devstack cinder-volume[75486]: DEBUG oslo_service.backend._eventlet.service [None req-7a316aef-88c3-4ae0-9259-a0a05b655104 None None] use_multipath_for_image_xfer = False {{(pid=75486) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 16 14:35:02 devstack cinder-volume[75486]: DEBUG oslo_service.backend._eventlet.service [None req-7a316aef-88c3-4ae0-9259-a0a05b655104 None None] use_stderr = False {{(pid=75486) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 16 14:35:02 devstack cinder-volume[75486]: DEBUG oslo_service.backend._eventlet.service [None req-7a316aef-88c3-4ae0-9259-a0a05b655104 None None] use_syslog = False {{(pid=75486) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 16 14:35:02 devstack cinder-volume[75486]: DEBUG oslo_service.backend._eventlet.service [None req-7a316aef-88c3-4ae0-9259-a0a05b655104 None None] verify_glance_signatures = enabled {{(pid=75486) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 16 14:35:02 devstack cinder-volume[75486]: DEBUG oslo_service.backend._eventlet.service [None req-7a316aef-88c3-4ae0-9259-a0a05b655104 None None] vmdk_allowed_types = ['streamOptimized', 'monolithicSparse'] {{(pid=75486) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 16 14:35:02 devstack cinder-volume[75486]: DEBUG oslo_service.backend._eventlet.service [None req-7a316aef-88c3-4ae0-9259-a0a05b655104 None None] volume_api_class = cinder.volume.api.API {{(pid=75486) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 16 14:35:02 devstack cinder-volume[75486]: DEBUG oslo_service.backend._eventlet.service [None req-7a316aef-88c3-4ae0-9259-a0a05b655104 None None] volume_backend_name = None {{(pid=75486) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 16 14:35:02 devstack cinder-volume[75486]: DEBUG oslo_service.backend._eventlet.service [None req-7a316aef-88c3-4ae0-9259-a0a05b655104 None None] volume_clear = zero {{(pid=75486) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 16 14:35:02 devstack cinder-volume[75486]: DEBUG oslo_service.backend._eventlet.service [None req-7a316aef-88c3-4ae0-9259-a0a05b655104 None None] volume_clear_ionice = None {{(pid=75486) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 16 14:35:02 devstack cinder-volume[75486]: DEBUG oslo_service.backend._eventlet.service [None req-7a316aef-88c3-4ae0-9259-a0a05b655104 None None] volume_clear_size = 0 {{(pid=75486) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 16 14:35:02 devstack cinder-volume[75486]: DEBUG oslo_service.backend._eventlet.service [None req-7a316aef-88c3-4ae0-9259-a0a05b655104 None None] volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=75486) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 16 14:35:02 devstack cinder-volume[75486]: DEBUG oslo_service.backend._eventlet.service [None req-7a316aef-88c3-4ae0-9259-a0a05b655104 None None] volume_copy_bps_limit = 0 {{(pid=75486) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 16 14:35:02 devstack cinder-volume[75486]: DEBUG oslo_service.backend._eventlet.service [None req-7a316aef-88c3-4ae0-9259-a0a05b655104 None None] volume_dd_blocksize = 1M {{(pid=75486) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 16 14:35:02 devstack cinder-volume[75486]: DEBUG oslo_service.backend._eventlet.service [None req-7a316aef-88c3-4ae0-9259-a0a05b655104 None None] volume_manager = cinder.volume.manager.VolumeManager {{(pid=75486) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 16 14:35:02 devstack cinder-volume[75486]: DEBUG oslo_service.backend._eventlet.service [None req-7a316aef-88c3-4ae0-9259-a0a05b655104 None None] volume_name_template = volume-%s {{(pid=75486) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 16 14:35:02 devstack cinder-volume[75486]: DEBUG oslo_service.backend._eventlet.service [None req-7a316aef-88c3-4ae0-9259-a0a05b655104 None None] volume_service_inithost_offload = False {{(pid=75486) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 16 14:35:02 devstack cinder-volume[75486]: DEBUG oslo_service.backend._eventlet.service [None req-7a316aef-88c3-4ae0-9259-a0a05b655104 None None] volume_usage_audit_period = month {{(pid=75486) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 16 14:35:02 devstack cinder-volume[75486]: DEBUG oslo_service.backend._eventlet.service [None req-7a316aef-88c3-4ae0-9259-a0a05b655104 None None] volumes_dir = /opt/stack/data/cinder/volumes {{(pid=75486) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 16 14:35:02 devstack cinder-volume[75486]: DEBUG oslo_service.backend._eventlet.service [None req-7a316aef-88c3-4ae0-9259-a0a05b655104 None None] watch_log_file = False {{(pid=75486) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 16 14:35:02 devstack cinder-volume[75486]: DEBUG oslo_service.backend._eventlet.service [None req-7a316aef-88c3-4ae0-9259-a0a05b655104 None None] zoning_mode = None {{(pid=75486) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 16 14:35:02 devstack cinder-volume[75486]: DEBUG oslo_service.backend._eventlet.service [None req-7a316aef-88c3-4ae0-9259-a0a05b655104 None None] os_brick.lock_path = /opt/stack/data/cinder {{(pid=75486) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 14:35:02 devstack cinder-volume[75486]: DEBUG oslo_service.backend._eventlet.service [None req-7a316aef-88c3-4ae0-9259-a0a05b655104 None None] os_brick.wait_mpath_device_attempts = 4 {{(pid=75486) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 14:35:02 devstack cinder-volume[75486]: DEBUG oslo_service.backend._eventlet.service [None req-7a316aef-88c3-4ae0-9259-a0a05b655104 None None] os_brick.wait_mpath_device_interval = 1 {{(pid=75486) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 14:35:02 devstack cinder-volume[75486]: DEBUG oslo_service.backend._eventlet.service [None req-7a316aef-88c3-4ae0-9259-a0a05b655104 None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=75486) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 14:35:02 devstack cinder-volume[75486]: DEBUG oslo_service.backend._eventlet.service [None req-7a316aef-88c3-4ae0-9259-a0a05b655104 None None] oslo_concurrency.disable_process_locking = False {{(pid=75486) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 14:35:02 devstack cinder-volume[75486]: DEBUG oslo_service.backend._eventlet.service [None req-7a316aef-88c3-4ae0-9259-a0a05b655104 None None] oslo_concurrency.lock_path = /opt/stack/data/cinder {{(pid=75486) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 14:35:02 devstack cinder-volume[75486]: DEBUG oslo_service.backend._eventlet.service [None req-7a316aef-88c3-4ae0-9259-a0a05b655104 None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=75486) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 14:35:02 devstack cinder-volume[75486]: DEBUG oslo_service.backend._eventlet.service [None req-7a316aef-88c3-4ae0-9259-a0a05b655104 None None] keystone_authtoken.admin_password = **** {{(pid=75486) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 14:35:02 devstack cinder-volume[75486]: DEBUG oslo_service.backend._eventlet.service [None req-7a316aef-88c3-4ae0-9259-a0a05b655104 None None] keystone_authtoken.admin_tenant_name = admin {{(pid=75486) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 14:35:02 devstack cinder-volume[75486]: DEBUG oslo_service.backend._eventlet.service [None req-7a316aef-88c3-4ae0-9259-a0a05b655104 None None] keystone_authtoken.admin_token = **** {{(pid=75486) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 14:35:02 devstack cinder-volume[75486]: DEBUG oslo_service.backend._eventlet.service [None req-7a316aef-88c3-4ae0-9259-a0a05b655104 None None] keystone_authtoken.admin_user = None {{(pid=75486) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 14:35:02 devstack cinder-volume[75486]: DEBUG oslo_service.backend._eventlet.service [None req-7a316aef-88c3-4ae0-9259-a0a05b655104 None None] keystone_authtoken.auth_admin_prefix = {{(pid=75486) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 14:35:02 devstack cinder-volume[75486]: DEBUG oslo_service.backend._eventlet.service [None req-7a316aef-88c3-4ae0-9259-a0a05b655104 None None] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=75486) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 14:35:02 devstack cinder-volume[75486]: DEBUG oslo_service.backend._eventlet.service [None req-7a316aef-88c3-4ae0-9259-a0a05b655104 None None] keystone_authtoken.auth_port = 35357 {{(pid=75486) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 14:35:02 devstack cinder-volume[75486]: DEBUG oslo_service.backend._eventlet.service [None req-7a316aef-88c3-4ae0-9259-a0a05b655104 None None] keystone_authtoken.auth_protocol = https {{(pid=75486) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 14:35:02 devstack cinder-volume[75486]: DEBUG oslo_service.backend._eventlet.service [None req-7a316aef-88c3-4ae0-9259-a0a05b655104 None None] keystone_authtoken.auth_section = None {{(pid=75486) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 14:35:02 devstack cinder-volume[75486]: DEBUG oslo_service.backend._eventlet.service [None req-7a316aef-88c3-4ae0-9259-a0a05b655104 None None] keystone_authtoken.auth_type = password {{(pid=75486) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 14:35:02 devstack cinder-volume[75486]: DEBUG oslo_service.backend._eventlet.service [None req-7a316aef-88c3-4ae0-9259-a0a05b655104 None None] keystone_authtoken.auth_uri = None {{(pid=75486) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 14:35:02 devstack cinder-volume[75486]: DEBUG oslo_service.backend._eventlet.service [None req-7a316aef-88c3-4ae0-9259-a0a05b655104 None None] keystone_authtoken.auth_version = None {{(pid=75486) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 14:35:02 devstack cinder-volume[75486]: DEBUG oslo_service.backend._eventlet.service [None req-7a316aef-88c3-4ae0-9259-a0a05b655104 None None] keystone_authtoken.cache = None {{(pid=75486) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 14:35:02 devstack cinder-volume[75486]: DEBUG oslo_service.backend._eventlet.service [None req-7a316aef-88c3-4ae0-9259-a0a05b655104 None None] keystone_authtoken.cafile = /opt/stack/data/ca-bundle.pem {{(pid=75486) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 14:35:02 devstack cinder-volume[75486]: DEBUG oslo_service.backend._eventlet.service [None req-7a316aef-88c3-4ae0-9259-a0a05b655104 None None] keystone_authtoken.certfile = None {{(pid=75486) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 14:35:02 devstack cinder-volume[75486]: DEBUG oslo_service.backend._eventlet.service [None req-7a316aef-88c3-4ae0-9259-a0a05b655104 None None] keystone_authtoken.delay_auth_decision = False {{(pid=75486) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 14:35:02 devstack cinder-volume[75486]: DEBUG oslo_service.backend._eventlet.service [None req-7a316aef-88c3-4ae0-9259-a0a05b655104 None None] keystone_authtoken.enforce_token_bind = permissive {{(pid=75486) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 14:35:02 devstack cinder-volume[75486]: DEBUG oslo_service.backend._eventlet.service [None req-7a316aef-88c3-4ae0-9259-a0a05b655104 None None] keystone_authtoken.http_connect_timeout = None {{(pid=75486) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 14:35:02 devstack cinder-volume[75486]: DEBUG oslo_service.backend._eventlet.service [None req-7a316aef-88c3-4ae0-9259-a0a05b655104 None None] keystone_authtoken.http_request_max_retries = 3 {{(pid=75486) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 14:35:02 devstack cinder-volume[75486]: DEBUG oslo_service.backend._eventlet.service [None req-7a316aef-88c3-4ae0-9259-a0a05b655104 None None] keystone_authtoken.identity_uri = None {{(pid=75486) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 14:35:02 devstack cinder-volume[75486]: DEBUG oslo_service.backend._eventlet.service [None req-7a316aef-88c3-4ae0-9259-a0a05b655104 None None] keystone_authtoken.include_service_catalog = True {{(pid=75486) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 14:35:02 devstack cinder-volume[75486]: DEBUG oslo_service.backend._eventlet.service [None req-7a316aef-88c3-4ae0-9259-a0a05b655104 None None] keystone_authtoken.insecure = False {{(pid=75486) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 14:35:02 devstack cinder-volume[75486]: DEBUG oslo_service.backend._eventlet.service [None req-7a316aef-88c3-4ae0-9259-a0a05b655104 None None] keystone_authtoken.interface = public {{(pid=75486) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 14:35:02 devstack cinder-volume[75486]: DEBUG oslo_service.backend._eventlet.service [None req-7a316aef-88c3-4ae0-9259-a0a05b655104 None None] keystone_authtoken.keyfile = None {{(pid=75486) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 14:35:02 devstack cinder-volume[75486]: DEBUG oslo_service.backend._eventlet.service [None req-7a316aef-88c3-4ae0-9259-a0a05b655104 None None] keystone_authtoken.memcache_password = {{(pid=75486) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 14:35:02 devstack cinder-volume[75486]: DEBUG oslo_service.backend._eventlet.service [None req-7a316aef-88c3-4ae0-9259-a0a05b655104 None None] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=75486) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 14:35:02 devstack cinder-volume[75486]: DEBUG oslo_service.backend._eventlet.service [None req-7a316aef-88c3-4ae0-9259-a0a05b655104 None None] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=75486) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 14:35:02 devstack cinder-volume[75486]: DEBUG oslo_service.backend._eventlet.service [None req-7a316aef-88c3-4ae0-9259-a0a05b655104 None None] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=75486) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 14:35:03 devstack cinder-volume[75486]: DEBUG oslo_service.backend._eventlet.service [None req-7a316aef-88c3-4ae0-9259-a0a05b655104 None None] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=75486) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 14:35:03 devstack cinder-volume[75486]: DEBUG oslo_service.backend._eventlet.service [None req-7a316aef-88c3-4ae0-9259-a0a05b655104 None None] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=75486) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 14:35:03 devstack cinder-volume[75486]: DEBUG oslo_service.backend._eventlet.service [None req-7a316aef-88c3-4ae0-9259-a0a05b655104 None None] keystone_authtoken.memcache_sasl_enabled = False {{(pid=75486) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 14:35:03 devstack cinder-volume[75486]: DEBUG oslo_service.backend._eventlet.service [None req-7a316aef-88c3-4ae0-9259-a0a05b655104 None None] keystone_authtoken.memcache_secret_key = **** {{(pid=75486) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 14:35:03 devstack cinder-volume[75486]: DEBUG oslo_service.backend._eventlet.service [None req-7a316aef-88c3-4ae0-9259-a0a05b655104 None None] keystone_authtoken.memcache_security_strategy = None {{(pid=75486) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 14:35:03 devstack cinder-volume[75486]: DEBUG oslo_service.backend._eventlet.service [None req-7a316aef-88c3-4ae0-9259-a0a05b655104 None None] keystone_authtoken.memcache_tls_allowed_ciphers = None {{(pid=75486) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 14:35:03 devstack cinder-volume[75486]: DEBUG oslo_service.backend._eventlet.service [None req-7a316aef-88c3-4ae0-9259-a0a05b655104 None None] keystone_authtoken.memcache_tls_cafile = None {{(pid=75486) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 14:35:03 devstack cinder-volume[75486]: DEBUG oslo_service.backend._eventlet.service [None req-7a316aef-88c3-4ae0-9259-a0a05b655104 None None] keystone_authtoken.memcache_tls_certfile = None {{(pid=75486) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 14:35:03 devstack cinder-volume[75486]: DEBUG oslo_service.backend._eventlet.service [None req-7a316aef-88c3-4ae0-9259-a0a05b655104 None None] keystone_authtoken.memcache_tls_enabled = False {{(pid=75486) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 14:35:03 devstack cinder-volume[75486]: DEBUG oslo_service.backend._eventlet.service [None req-7a316aef-88c3-4ae0-9259-a0a05b655104 None None] keystone_authtoken.memcache_tls_keyfile = None {{(pid=75486) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 14:35:03 devstack cinder-volume[75486]: DEBUG oslo_service.backend._eventlet.service [None req-7a316aef-88c3-4ae0-9259-a0a05b655104 None None] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=75486) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 14:35:03 devstack cinder-volume[75486]: DEBUG oslo_service.backend._eventlet.service [None req-7a316aef-88c3-4ae0-9259-a0a05b655104 None None] keystone_authtoken.memcache_username = {{(pid=75486) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 14:35:03 devstack cinder-volume[75486]: DEBUG oslo_service.backend._eventlet.service [None req-7a316aef-88c3-4ae0-9259-a0a05b655104 None None] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=75486) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 14:35:03 devstack cinder-volume[75486]: DEBUG oslo_service.backend._eventlet.service [None req-7a316aef-88c3-4ae0-9259-a0a05b655104 None None] keystone_authtoken.region_name = None {{(pid=75486) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 14:35:03 devstack cinder-volume[75486]: DEBUG oslo_service.backend._eventlet.service [None req-7a316aef-88c3-4ae0-9259-a0a05b655104 None None] keystone_authtoken.service_token_roles = ['service'] {{(pid=75486) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 14:35:03 devstack cinder-volume[75486]: DEBUG oslo_service.backend._eventlet.service [None req-7a316aef-88c3-4ae0-9259-a0a05b655104 None None] keystone_authtoken.service_token_roles_required = False {{(pid=75486) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 14:35:03 devstack cinder-volume[75486]: DEBUG oslo_service.backend._eventlet.service [None req-7a316aef-88c3-4ae0-9259-a0a05b655104 None None] keystone_authtoken.service_type = None {{(pid=75486) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 14:35:03 devstack cinder-volume[75486]: DEBUG oslo_service.backend._eventlet.service [None req-7a316aef-88c3-4ae0-9259-a0a05b655104 None None] keystone_authtoken.token_cache_time = 300 {{(pid=75486) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 14:35:03 devstack cinder-volume[75486]: DEBUG oslo_service.backend._eventlet.service [None req-7a316aef-88c3-4ae0-9259-a0a05b655104 None None] keystone_authtoken.www_authenticate_uri = None {{(pid=75486) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 14:35:03 devstack cinder-volume[75486]: DEBUG oslo_service.backend._eventlet.service [None req-7a316aef-88c3-4ae0-9259-a0a05b655104 None None] cache.backend = dogpile.cache.null {{(pid=75486) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 14:35:03 devstack cinder-volume[75486]: DEBUG oslo_service.backend._eventlet.service [None req-7a316aef-88c3-4ae0-9259-a0a05b655104 None None] cache.backend_argument = **** {{(pid=75486) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 14:35:03 devstack cinder-volume[75486]: DEBUG oslo_service.backend._eventlet.service [None req-7a316aef-88c3-4ae0-9259-a0a05b655104 None None] cache.backend_expiration_time = None {{(pid=75486) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 14:35:03 devstack cinder-volume[75486]: DEBUG oslo_service.backend._eventlet.service [None req-7a316aef-88c3-4ae0-9259-a0a05b655104 None None] cache.config_prefix = cache.oslo {{(pid=75486) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 14:35:03 devstack cinder-volume[75486]: DEBUG oslo_service.backend._eventlet.service [None req-7a316aef-88c3-4ae0-9259-a0a05b655104 None None] cache.dead_timeout = 60.0 {{(pid=75486) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 14:35:03 devstack cinder-volume[75486]: DEBUG oslo_service.backend._eventlet.service [None req-7a316aef-88c3-4ae0-9259-a0a05b655104 None None] cache.debug_cache_backend = False {{(pid=75486) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 14:35:03 devstack cinder-volume[75486]: DEBUG oslo_service.backend._eventlet.service [None req-7a316aef-88c3-4ae0-9259-a0a05b655104 None None] cache.enable_retry_client = False {{(pid=75486) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 14:35:03 devstack cinder-volume[75486]: DEBUG oslo_service.backend._eventlet.service [None req-7a316aef-88c3-4ae0-9259-a0a05b655104 None None] cache.enable_socket_keepalive = False {{(pid=75486) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 14:35:03 devstack cinder-volume[75486]: DEBUG oslo_service.backend._eventlet.service [None req-7a316aef-88c3-4ae0-9259-a0a05b655104 None None] cache.enabled = False {{(pid=75486) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 14:35:03 devstack cinder-volume[75486]: DEBUG oslo_service.backend._eventlet.service [None req-7a316aef-88c3-4ae0-9259-a0a05b655104 None None] cache.enforce_fips_mode = False {{(pid=75486) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 14:35:03 devstack cinder-volume[75486]: DEBUG oslo_service.backend._eventlet.service [None req-7a316aef-88c3-4ae0-9259-a0a05b655104 None None] cache.expiration_time = 600 {{(pid=75486) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 14:35:03 devstack cinder-volume[75486]: DEBUG oslo_service.backend._eventlet.service [None req-7a316aef-88c3-4ae0-9259-a0a05b655104 None None] cache.hashclient_retry_attempts = 2 {{(pid=75486) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 14:35:03 devstack cinder-volume[75486]: DEBUG oslo_service.backend._eventlet.service [None req-7a316aef-88c3-4ae0-9259-a0a05b655104 None None] cache.hashclient_retry_delay = 1.0 {{(pid=75486) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 14:35:03 devstack cinder-volume[75486]: DEBUG oslo_service.backend._eventlet.service [None req-7a316aef-88c3-4ae0-9259-a0a05b655104 None None] cache.memcache_dead_retry = 300 {{(pid=75486) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 14:35:03 devstack cinder-volume[75486]: DEBUG oslo_service.backend._eventlet.service [None req-7a316aef-88c3-4ae0-9259-a0a05b655104 None None] cache.memcache_password = **** {{(pid=75486) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 14:35:03 devstack cinder-volume[75486]: DEBUG oslo_service.backend._eventlet.service [None req-7a316aef-88c3-4ae0-9259-a0a05b655104 None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=75486) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 14:35:03 devstack cinder-volume[75486]: DEBUG oslo_service.backend._eventlet.service [None req-7a316aef-88c3-4ae0-9259-a0a05b655104 None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=75486) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 14:35:03 devstack cinder-volume[75486]: DEBUG oslo_service.backend._eventlet.service [None req-7a316aef-88c3-4ae0-9259-a0a05b655104 None None] cache.memcache_pool_maxsize = 10 {{(pid=75486) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 14:35:03 devstack cinder-volume[75486]: DEBUG oslo_service.backend._eventlet.service [None req-7a316aef-88c3-4ae0-9259-a0a05b655104 None None] cache.memcache_pool_unused_timeout = 60 {{(pid=75486) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 14:35:03 devstack cinder-volume[75486]: DEBUG oslo_service.backend._eventlet.service [None req-7a316aef-88c3-4ae0-9259-a0a05b655104 None None] cache.memcache_sasl_enabled = False {{(pid=75486) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 14:35:03 devstack cinder-volume[75486]: DEBUG oslo_service.backend._eventlet.service [None req-7a316aef-88c3-4ae0-9259-a0a05b655104 None None] cache.memcache_servers = ['localhost:11211'] {{(pid=75486) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 14:35:03 devstack cinder-volume[75486]: DEBUG oslo_service.backend._eventlet.service [None req-7a316aef-88c3-4ae0-9259-a0a05b655104 None None] cache.memcache_socket_timeout = 1.0 {{(pid=75486) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 14:35:03 devstack cinder-volume[75486]: DEBUG oslo_service.backend._eventlet.service [None req-7a316aef-88c3-4ae0-9259-a0a05b655104 None None] cache.memcache_username = None {{(pid=75486) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 14:35:03 devstack cinder-volume[75486]: DEBUG oslo_service.backend._eventlet.service [None req-7a316aef-88c3-4ae0-9259-a0a05b655104 None None] cache.proxies = [] {{(pid=75486) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 14:35:03 devstack cinder-volume[75486]: DEBUG oslo_service.backend._eventlet.service [None req-7a316aef-88c3-4ae0-9259-a0a05b655104 None None] cache.redis_db = 0 {{(pid=75486) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 14:35:03 devstack cinder-volume[75486]: DEBUG oslo_service.backend._eventlet.service [None req-7a316aef-88c3-4ae0-9259-a0a05b655104 None None] cache.redis_password = **** {{(pid=75486) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 14:35:03 devstack cinder-volume[75486]: DEBUG oslo_service.backend._eventlet.service [None req-7a316aef-88c3-4ae0-9259-a0a05b655104 None None] cache.redis_sentinel_service_name = mymaster {{(pid=75486) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 14:35:03 devstack cinder-volume[75486]: DEBUG oslo_service.backend._eventlet.service [None req-7a316aef-88c3-4ae0-9259-a0a05b655104 None None] cache.redis_sentinels = ['localhost:26379'] {{(pid=75486) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 14:35:03 devstack cinder-volume[75486]: DEBUG oslo_service.backend._eventlet.service [None req-7a316aef-88c3-4ae0-9259-a0a05b655104 None None] cache.redis_server = localhost:6379 {{(pid=75486) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 14:35:03 devstack cinder-volume[75486]: DEBUG oslo_service.backend._eventlet.service [None req-7a316aef-88c3-4ae0-9259-a0a05b655104 None None] cache.redis_socket_timeout = 1.0 {{(pid=75486) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 14:35:03 devstack cinder-volume[75486]: DEBUG oslo_service.backend._eventlet.service [None req-7a316aef-88c3-4ae0-9259-a0a05b655104 None None] cache.redis_username = None {{(pid=75486) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 14:35:03 devstack cinder-volume[75486]: DEBUG oslo_service.backend._eventlet.service [None req-7a316aef-88c3-4ae0-9259-a0a05b655104 None None] cache.retry_attempts = 2 {{(pid=75486) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 14:35:03 devstack cinder-volume[75486]: DEBUG oslo_service.backend._eventlet.service [None req-7a316aef-88c3-4ae0-9259-a0a05b655104 None None] cache.retry_delay = 0.0 {{(pid=75486) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 14:35:03 devstack cinder-volume[75486]: DEBUG oslo_service.backend._eventlet.service [None req-7a316aef-88c3-4ae0-9259-a0a05b655104 None None] cache.socket_keepalive_count = 1 {{(pid=75486) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 14:35:03 devstack cinder-volume[75486]: DEBUG oslo_service.backend._eventlet.service [None req-7a316aef-88c3-4ae0-9259-a0a05b655104 None None] cache.socket_keepalive_idle = 1 {{(pid=75486) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 14:35:03 devstack cinder-volume[75486]: DEBUG oslo_service.backend._eventlet.service [None req-7a316aef-88c3-4ae0-9259-a0a05b655104 None None] cache.socket_keepalive_interval = 1 {{(pid=75486) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 14:35:03 devstack cinder-volume[75486]: DEBUG oslo_service.backend._eventlet.service [None req-7a316aef-88c3-4ae0-9259-a0a05b655104 None None] cache.tls_allowed_ciphers = None {{(pid=75486) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 14:35:03 devstack cinder-volume[75486]: DEBUG oslo_service.backend._eventlet.service [None req-7a316aef-88c3-4ae0-9259-a0a05b655104 None None] cache.tls_cafile = None {{(pid=75486) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 14:35:03 devstack cinder-volume[75486]: DEBUG oslo_service.backend._eventlet.service [None req-7a316aef-88c3-4ae0-9259-a0a05b655104 None None] cache.tls_certfile = None {{(pid=75486) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 14:35:03 devstack cinder-volume[75486]: DEBUG oslo_service.backend._eventlet.service [None req-7a316aef-88c3-4ae0-9259-a0a05b655104 None None] cache.tls_enabled = False {{(pid=75486) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 14:35:03 devstack cinder-volume[75486]: DEBUG oslo_service.backend._eventlet.service [None req-7a316aef-88c3-4ae0-9259-a0a05b655104 None None] cache.tls_keyfile = None {{(pid=75486) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 14:35:03 devstack cinder-volume[75486]: DEBUG oslo_service.backend._eventlet.service [None req-7a316aef-88c3-4ae0-9259-a0a05b655104 None None] coordination.backend_url = **** {{(pid=75486) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 14:35:03 devstack cinder-volume[75486]: DEBUG oslo_service.backend._eventlet.service [None req-7a316aef-88c3-4ae0-9259-a0a05b655104 None None] database.asyncio_connection = **** {{(pid=75486) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 14:35:03 devstack cinder-volume[75486]: DEBUG oslo_service.backend._eventlet.service [None req-7a316aef-88c3-4ae0-9259-a0a05b655104 None None] database.asyncio_slave_connection = **** {{(pid=75486) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 14:35:03 devstack cinder-volume[75486]: DEBUG oslo_service.backend._eventlet.service [None req-7a316aef-88c3-4ae0-9259-a0a05b655104 None None] database.backend = sqlalchemy {{(pid=75486) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 14:35:03 devstack cinder-volume[75486]: DEBUG oslo_service.backend._eventlet.service [None req-7a316aef-88c3-4ae0-9259-a0a05b655104 None None] database.connection = **** {{(pid=75486) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 14:35:03 devstack cinder-volume[75486]: DEBUG oslo_service.backend._eventlet.service [None req-7a316aef-88c3-4ae0-9259-a0a05b655104 None None] database.connection_debug = 0 {{(pid=75486) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 14:35:03 devstack cinder-volume[75486]: DEBUG oslo_service.backend._eventlet.service [None req-7a316aef-88c3-4ae0-9259-a0a05b655104 None None] database.connection_parameters = {{(pid=75486) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 14:35:03 devstack cinder-volume[75486]: DEBUG oslo_service.backend._eventlet.service [None req-7a316aef-88c3-4ae0-9259-a0a05b655104 None None] database.connection_recycle_time = 3600 {{(pid=75486) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 14:35:03 devstack cinder-volume[75486]: DEBUG oslo_service.backend._eventlet.service [None req-7a316aef-88c3-4ae0-9259-a0a05b655104 None None] database.connection_trace = False {{(pid=75486) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 14:35:03 devstack cinder-volume[75486]: DEBUG oslo_service.backend._eventlet.service [None req-7a316aef-88c3-4ae0-9259-a0a05b655104 None None] database.db_inc_retry_interval = True {{(pid=75486) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 14:35:03 devstack cinder-volume[75486]: DEBUG oslo_service.backend._eventlet.service [None req-7a316aef-88c3-4ae0-9259-a0a05b655104 None None] database.db_max_retries = 20 {{(pid=75486) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 14:35:03 devstack cinder-volume[75486]: DEBUG oslo_service.backend._eventlet.service [None req-7a316aef-88c3-4ae0-9259-a0a05b655104 None None] database.db_max_retry_interval = 10 {{(pid=75486) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 14:35:03 devstack cinder-volume[75486]: DEBUG oslo_service.backend._eventlet.service [None req-7a316aef-88c3-4ae0-9259-a0a05b655104 None None] database.db_retry_interval = 1 {{(pid=75486) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 14:35:03 devstack cinder-volume[75486]: DEBUG oslo_service.backend._eventlet.service [None req-7a316aef-88c3-4ae0-9259-a0a05b655104 None None] database.max_overflow = 50 {{(pid=75486) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 14:35:03 devstack cinder-volume[75486]: DEBUG oslo_service.backend._eventlet.service [None req-7a316aef-88c3-4ae0-9259-a0a05b655104 None None] database.max_pool_size = 5 {{(pid=75486) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 14:35:03 devstack cinder-volume[75486]: DEBUG oslo_service.backend._eventlet.service [None req-7a316aef-88c3-4ae0-9259-a0a05b655104 None None] database.max_retries = 10 {{(pid=75486) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 14:35:03 devstack cinder-volume[75486]: DEBUG oslo_service.backend._eventlet.service [None req-7a316aef-88c3-4ae0-9259-a0a05b655104 None None] database.mysql_sql_mode = TRADITIONAL {{(pid=75486) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 14:35:03 devstack cinder-volume[75486]: DEBUG oslo_service.backend._eventlet.service [None req-7a316aef-88c3-4ae0-9259-a0a05b655104 None None] database.mysql_wsrep_sync_wait = None {{(pid=75486) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 14:35:03 devstack cinder-volume[75486]: DEBUG oslo_service.backend._eventlet.service [None req-7a316aef-88c3-4ae0-9259-a0a05b655104 None None] database.pool_timeout = None {{(pid=75486) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 14:35:03 devstack cinder-volume[75486]: DEBUG oslo_service.backend._eventlet.service [None req-7a316aef-88c3-4ae0-9259-a0a05b655104 None None] database.retry_interval = 10 {{(pid=75486) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 14:35:03 devstack cinder-volume[75486]: DEBUG oslo_service.backend._eventlet.service [None req-7a316aef-88c3-4ae0-9259-a0a05b655104 None None] database.slave_connection = **** {{(pid=75486) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 14:35:03 devstack cinder-volume[75486]: DEBUG oslo_service.backend._eventlet.service [None req-7a316aef-88c3-4ae0-9259-a0a05b655104 None None] database.sqlite_synchronous = True {{(pid=75486) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 14:35:03 devstack cinder-volume[75486]: DEBUG oslo_service.backend._eventlet.service [None req-7a316aef-88c3-4ae0-9259-a0a05b655104 None None] database.use_db_reconnect = False {{(pid=75486) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 14:35:03 devstack cinder-volume[75486]: DEBUG oslo_service.backend._eventlet.service [None req-7a316aef-88c3-4ae0-9259-a0a05b655104 None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=75486) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 14:35:03 devstack cinder-volume[75486]: DEBUG oslo_service.backend._eventlet.service [None req-7a316aef-88c3-4ae0-9259-a0a05b655104 None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=75486) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 14:35:03 devstack cinder-volume[75486]: DEBUG oslo_service.backend._eventlet.service [None req-7a316aef-88c3-4ae0-9259-a0a05b655104 None None] oslo_messaging_metrics.metrics_process_name = {{(pid=75486) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 14:35:03 devstack cinder-volume[75486]: DEBUG oslo_service.backend._eventlet.service [None req-7a316aef-88c3-4ae0-9259-a0a05b655104 None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=75486) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 14:35:03 devstack cinder-volume[75486]: DEBUG oslo_service.backend._eventlet.service [None req-7a316aef-88c3-4ae0-9259-a0a05b655104 None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=75486) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 14:35:03 devstack cinder-volume[75486]: DEBUG oslo_service.backend._eventlet.service [None req-7a316aef-88c3-4ae0-9259-a0a05b655104 None None] profiler.connection_string = messaging:// {{(pid=75486) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 14:35:03 devstack cinder-volume[75486]: DEBUG oslo_service.backend._eventlet.service [None req-7a316aef-88c3-4ae0-9259-a0a05b655104 None None] profiler.enabled = False {{(pid=75486) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 14:35:03 devstack cinder-volume[75486]: DEBUG oslo_service.backend._eventlet.service [None req-7a316aef-88c3-4ae0-9259-a0a05b655104 None None] profiler.es_doc_type = notification {{(pid=75486) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 14:35:03 devstack cinder-volume[75486]: DEBUG oslo_service.backend._eventlet.service [None req-7a316aef-88c3-4ae0-9259-a0a05b655104 None None] profiler.es_scroll_size = 10000 {{(pid=75486) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 14:35:03 devstack cinder-volume[75486]: DEBUG oslo_service.backend._eventlet.service [None req-7a316aef-88c3-4ae0-9259-a0a05b655104 None None] profiler.es_scroll_time = 2m {{(pid=75486) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 14:35:03 devstack cinder-volume[75486]: DEBUG oslo_service.backend._eventlet.service [None req-7a316aef-88c3-4ae0-9259-a0a05b655104 None None] profiler.filter_error_trace = False {{(pid=75486) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 14:35:03 devstack cinder-volume[75486]: DEBUG oslo_service.backend._eventlet.service [None req-7a316aef-88c3-4ae0-9259-a0a05b655104 None None] profiler.hmac_keys = **** {{(pid=75486) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 14:35:03 devstack cinder-volume[75486]: DEBUG oslo_service.backend._eventlet.service [None req-7a316aef-88c3-4ae0-9259-a0a05b655104 None None] profiler.sentinel_service_name = mymaster {{(pid=75486) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 14:35:03 devstack cinder-volume[75486]: DEBUG oslo_service.backend._eventlet.service [None req-7a316aef-88c3-4ae0-9259-a0a05b655104 None None] profiler.socket_timeout = 0.1 {{(pid=75486) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 14:35:03 devstack cinder-volume[75486]: DEBUG oslo_service.backend._eventlet.service [None req-7a316aef-88c3-4ae0-9259-a0a05b655104 None None] profiler.trace_requests = False {{(pid=75486) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 14:35:03 devstack cinder-volume[75486]: DEBUG oslo_service.backend._eventlet.service [None req-7a316aef-88c3-4ae0-9259-a0a05b655104 None None] profiler.trace_sqlalchemy = False {{(pid=75486) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 14:35:03 devstack cinder-volume[75486]: DEBUG oslo_service.backend._eventlet.service [None req-7a316aef-88c3-4ae0-9259-a0a05b655104 None None] profiler_jaeger.process_tags = {} {{(pid=75486) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 14:35:03 devstack cinder-volume[75486]: DEBUG oslo_service.backend._eventlet.service [None req-7a316aef-88c3-4ae0-9259-a0a05b655104 None None] profiler_jaeger.service_name_prefix = None {{(pid=75486) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 14:35:03 devstack cinder-volume[75486]: DEBUG oslo_service.backend._eventlet.service [None req-7a316aef-88c3-4ae0-9259-a0a05b655104 None None] profiler_otlp.service_name_prefix = None {{(pid=75486) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 14:35:03 devstack cinder-volume[75486]: DEBUG oslo_service.backend._eventlet.service [None req-7a316aef-88c3-4ae0-9259-a0a05b655104 None None] oslo_policy.enforce_new_defaults = False {{(pid=75486) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 14:35:03 devstack cinder-volume[75486]: WARNING oslo_config.cfg [None req-7a316aef-88c3-4ae0-9259-a0a05b655104 None None] Deprecated: Option "enforce_scope" from group "oslo_policy" is deprecated for removal (This configuration was added temporarily to facilitate a smooth transition to the new RBAC. OpenStack will always enforce scope checks. This configuration option is deprecated and will be removed in the 2025.2 cycle.). Its value may be silently ignored in the future. Sep 16 14:35:03 devstack cinder-volume[75486]: DEBUG oslo_service.backend._eventlet.service [None req-7a316aef-88c3-4ae0-9259-a0a05b655104 None None] oslo_policy.enforce_scope = False {{(pid=75486) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 14:35:03 devstack cinder-volume[75486]: DEBUG oslo_service.backend._eventlet.service [None req-7a316aef-88c3-4ae0-9259-a0a05b655104 None None] oslo_policy.policy_default_rule = default {{(pid=75486) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 14:35:03 devstack cinder-volume[75486]: DEBUG oslo_service.backend._eventlet.service [None req-7a316aef-88c3-4ae0-9259-a0a05b655104 None None] oslo_policy.policy_dirs = ['policy.d'] {{(pid=75486) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 14:35:03 devstack cinder-volume[75486]: DEBUG oslo_service.backend._eventlet.service [None req-7a316aef-88c3-4ae0-9259-a0a05b655104 None None] oslo_policy.policy_file = policy.yaml {{(pid=75486) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 14:35:03 devstack cinder-volume[75486]: DEBUG oslo_service.backend._eventlet.service [None req-7a316aef-88c3-4ae0-9259-a0a05b655104 None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=75486) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 14:35:03 devstack cinder-volume[75486]: DEBUG oslo_service.backend._eventlet.service [None req-7a316aef-88c3-4ae0-9259-a0a05b655104 None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=75486) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 14:35:03 devstack cinder-volume[75486]: DEBUG oslo_service.backend._eventlet.service [None req-7a316aef-88c3-4ae0-9259-a0a05b655104 None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=75486) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 14:35:03 devstack cinder-volume[75486]: DEBUG oslo_service.backend._eventlet.service [None req-7a316aef-88c3-4ae0-9259-a0a05b655104 None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=75486) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 14:35:03 devstack cinder-volume[75486]: DEBUG oslo_service.backend._eventlet.service [None req-7a316aef-88c3-4ae0-9259-a0a05b655104 None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=75486) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 14:35:03 devstack cinder-volume[75486]: DEBUG oslo_service.backend._eventlet.service [None req-7a316aef-88c3-4ae0-9259-a0a05b655104 None None] oslo_policy.remote_timeout = 60.0 {{(pid=75486) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 14:35:03 devstack cinder-volume[75486]: DEBUG oslo_service.backend._eventlet.service [None req-7a316aef-88c3-4ae0-9259-a0a05b655104 None None] privsep_osbrick.capabilities = [21, 2] {{(pid=75486) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 14:35:03 devstack cinder-volume[75486]: DEBUG oslo_service.backend._eventlet.service [None req-7a316aef-88c3-4ae0-9259-a0a05b655104 None None] privsep_osbrick.group = None {{(pid=75486) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 14:35:03 devstack cinder-volume[75486]: DEBUG oslo_service.backend._eventlet.service [None req-7a316aef-88c3-4ae0-9259-a0a05b655104 None None] privsep_osbrick.helper_command = None {{(pid=75486) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 14:35:03 devstack cinder-volume[75486]: DEBUG oslo_service.backend._eventlet.service [None req-7a316aef-88c3-4ae0-9259-a0a05b655104 None None] privsep_osbrick.log_daemon_traceback = False {{(pid=75486) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 14:35:03 devstack cinder-volume[75486]: DEBUG oslo_service.backend._eventlet.service [None req-7a316aef-88c3-4ae0-9259-a0a05b655104 None None] privsep_osbrick.logger_name = os_brick.privileged {{(pid=75486) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 14:35:03 devstack cinder-volume[75486]: DEBUG oslo_service.backend._eventlet.service [None req-7a316aef-88c3-4ae0-9259-a0a05b655104 None None] privsep_osbrick.thread_pool_size = 3 {{(pid=75486) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 14:35:03 devstack cinder-volume[75486]: DEBUG oslo_service.backend._eventlet.service [None req-7a316aef-88c3-4ae0-9259-a0a05b655104 None None] privsep_osbrick.user = None {{(pid=75486) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 14:35:03 devstack cinder-volume[75486]: DEBUG oslo_service.backend._eventlet.service [None req-7a316aef-88c3-4ae0-9259-a0a05b655104 None None] cinder_sys_admin.capabilities = [0, 1, 2, 3, 12, 21] {{(pid=75486) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 14:35:03 devstack cinder-volume[75486]: DEBUG oslo_service.backend._eventlet.service [None req-7a316aef-88c3-4ae0-9259-a0a05b655104 None None] cinder_sys_admin.group = None {{(pid=75486) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 14:35:03 devstack cinder-volume[75486]: DEBUG oslo_service.backend._eventlet.service [None req-7a316aef-88c3-4ae0-9259-a0a05b655104 None None] cinder_sys_admin.helper_command = None {{(pid=75486) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 14:35:03 devstack cinder-volume[75486]: DEBUG oslo_service.backend._eventlet.service [None req-7a316aef-88c3-4ae0-9259-a0a05b655104 None None] cinder_sys_admin.log_daemon_traceback = False {{(pid=75486) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 14:35:03 devstack cinder-volume[75486]: DEBUG oslo_service.backend._eventlet.service [None req-7a316aef-88c3-4ae0-9259-a0a05b655104 None None] cinder_sys_admin.logger_name = oslo_privsep.daemon {{(pid=75486) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 14:35:03 devstack cinder-volume[75486]: DEBUG oslo_service.backend._eventlet.service [None req-7a316aef-88c3-4ae0-9259-a0a05b655104 None None] cinder_sys_admin.thread_pool_size = 3 {{(pid=75486) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 14:35:03 devstack cinder-volume[75486]: DEBUG oslo_service.backend._eventlet.service [None req-7a316aef-88c3-4ae0-9259-a0a05b655104 None None] cinder_sys_admin.user = None {{(pid=75486) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 14:35:03 devstack cinder-volume[75486]: DEBUG oslo_service.backend._eventlet.service [None req-7a316aef-88c3-4ae0-9259-a0a05b655104 None None] service_user.auth_section = None {{(pid=75486) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 14:35:03 devstack cinder-volume[75486]: DEBUG oslo_service.backend._eventlet.service [None req-7a316aef-88c3-4ae0-9259-a0a05b655104 None None] service_user.auth_type = password {{(pid=75486) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 14:35:03 devstack cinder-volume[75486]: DEBUG oslo_service.backend._eventlet.service [None req-7a316aef-88c3-4ae0-9259-a0a05b655104 None None] service_user.cafile = /opt/stack/data/ca-bundle.pem {{(pid=75486) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 14:35:03 devstack cinder-volume[75486]: DEBUG oslo_service.backend._eventlet.service [None req-7a316aef-88c3-4ae0-9259-a0a05b655104 None None] service_user.certfile = None {{(pid=75486) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 14:35:03 devstack cinder-volume[75486]: DEBUG oslo_service.backend._eventlet.service [None req-7a316aef-88c3-4ae0-9259-a0a05b655104 None None] service_user.collect_timing = False {{(pid=75486) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 14:35:03 devstack cinder-volume[75486]: DEBUG oslo_service.backend._eventlet.service [None req-7a316aef-88c3-4ae0-9259-a0a05b655104 None None] service_user.insecure = False {{(pid=75486) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 14:35:03 devstack cinder-volume[75486]: DEBUG oslo_service.backend._eventlet.service [None req-7a316aef-88c3-4ae0-9259-a0a05b655104 None None] service_user.keyfile = None {{(pid=75486) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 14:35:03 devstack cinder-volume[75486]: DEBUG oslo_service.backend._eventlet.service [None req-7a316aef-88c3-4ae0-9259-a0a05b655104 None None] service_user.send_service_user_token = True {{(pid=75486) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 14:35:03 devstack cinder-volume[75486]: DEBUG oslo_service.backend._eventlet.service [None req-7a316aef-88c3-4ae0-9259-a0a05b655104 None None] service_user.split_loggers = False {{(pid=75486) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 14:35:03 devstack cinder-volume[75486]: DEBUG oslo_service.backend._eventlet.service [None req-7a316aef-88c3-4ae0-9259-a0a05b655104 None None] service_user.timeout = None {{(pid=75486) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 14:35:03 devstack cinder-volume[75486]: DEBUG oslo_service.backend._eventlet.service [None req-7a316aef-88c3-4ae0-9259-a0a05b655104 None None] glance.auth_section = None {{(pid=75486) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 14:35:03 devstack cinder-volume[75486]: DEBUG oslo_service.backend._eventlet.service [None req-7a316aef-88c3-4ae0-9259-a0a05b655104 None None] glance.auth_type = password {{(pid=75486) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 14:35:03 devstack cinder-volume[75486]: DEBUG oslo_service.backend._eventlet.service [None req-7a316aef-88c3-4ae0-9259-a0a05b655104 None None] glance.cafile = /opt/stack/data/ca-bundle.pem {{(pid=75486) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 14:35:03 devstack cinder-volume[75486]: DEBUG oslo_service.backend._eventlet.service [None req-7a316aef-88c3-4ae0-9259-a0a05b655104 None None] glance.certfile = None {{(pid=75486) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 14:35:03 devstack cinder-volume[75486]: DEBUG oslo_service.backend._eventlet.service [None req-7a316aef-88c3-4ae0-9259-a0a05b655104 None None] glance.collect_timing = False {{(pid=75486) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 14:35:03 devstack cinder-volume[75486]: DEBUG oslo_service.backend._eventlet.service [None req-7a316aef-88c3-4ae0-9259-a0a05b655104 None None] glance.insecure = False {{(pid=75486) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 14:35:03 devstack cinder-volume[75486]: DEBUG oslo_service.backend._eventlet.service [None req-7a316aef-88c3-4ae0-9259-a0a05b655104 None None] glance.keyfile = None {{(pid=75486) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 14:35:03 devstack cinder-volume[75486]: DEBUG oslo_service.backend._eventlet.service [None req-7a316aef-88c3-4ae0-9259-a0a05b655104 None None] glance.split_loggers = False {{(pid=75486) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 14:35:03 devstack cinder-volume[75486]: DEBUG oslo_service.backend._eventlet.service [None req-7a316aef-88c3-4ae0-9259-a0a05b655104 None None] glance.timeout = None {{(pid=75486) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 14:35:03 devstack cinder-volume[75486]: DEBUG oslo_service.backend._eventlet.service [None req-7a316aef-88c3-4ae0-9259-a0a05b655104 None None] backend_defaults.backend_availability_zone = None {{(pid=75486) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 14:35:03 devstack cinder-volume[75486]: DEBUG oslo_service.backend._eventlet.service [None req-7a316aef-88c3-4ae0-9259-a0a05b655104 None None] backend_defaults.backend_native_threads_pool_size = 20 {{(pid=75486) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 14:35:03 devstack cinder-volume[75486]: DEBUG oslo_service.backend._eventlet.service [None req-7a316aef-88c3-4ae0-9259-a0a05b655104 None None] backend_defaults.backup_use_temp_snapshot = False {{(pid=75486) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 14:35:03 devstack cinder-volume[75486]: DEBUG oslo_service.backend._eventlet.service [None req-7a316aef-88c3-4ae0-9259-a0a05b655104 None None] backend_defaults.chap_password = **** {{(pid=75486) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 14:35:03 devstack cinder-volume[75486]: DEBUG oslo_service.backend._eventlet.service [None req-7a316aef-88c3-4ae0-9259-a0a05b655104 None None] backend_defaults.chap_username = {{(pid=75486) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 14:35:03 devstack cinder-volume[75486]: DEBUG oslo_service.backend._eventlet.service [None req-7a316aef-88c3-4ae0-9259-a0a05b655104 None None] backend_defaults.chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=75486) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 14:35:03 devstack cinder-volume[75486]: DEBUG oslo_service.backend._eventlet.service [None req-7a316aef-88c3-4ae0-9259-a0a05b655104 None None] backend_defaults.driver_client_cert = None {{(pid=75486) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 14:35:03 devstack cinder-volume[75486]: DEBUG oslo_service.backend._eventlet.service [None req-7a316aef-88c3-4ae0-9259-a0a05b655104 None None] backend_defaults.driver_client_cert_key = None {{(pid=75486) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 14:35:03 devstack cinder-volume[75486]: DEBUG oslo_service.backend._eventlet.service [None req-7a316aef-88c3-4ae0-9259-a0a05b655104 None None] backend_defaults.driver_data_namespace = None {{(pid=75486) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 14:35:03 devstack cinder-volume[75486]: DEBUG oslo_service.backend._eventlet.service [None req-7a316aef-88c3-4ae0-9259-a0a05b655104 None None] backend_defaults.driver_ssl_cert_path = None {{(pid=75486) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 14:35:03 devstack cinder-volume[75486]: DEBUG oslo_service.backend._eventlet.service [None req-7a316aef-88c3-4ae0-9259-a0a05b655104 None None] backend_defaults.driver_ssl_cert_verify = False {{(pid=75486) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 14:35:03 devstack cinder-volume[75486]: DEBUG oslo_service.backend._eventlet.service [None req-7a316aef-88c3-4ae0-9259-a0a05b655104 None None] backend_defaults.driver_use_ssl = False {{(pid=75486) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 14:35:03 devstack cinder-volume[75486]: DEBUG oslo_service.backend._eventlet.service [None req-7a316aef-88c3-4ae0-9259-a0a05b655104 None None] backend_defaults.enable_unsupported_driver = False {{(pid=75486) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 14:35:03 devstack cinder-volume[75486]: DEBUG oslo_service.backend._eventlet.service [None req-7a316aef-88c3-4ae0-9259-a0a05b655104 None None] backend_defaults.enforce_multipath_for_image_xfer = False {{(pid=75486) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 14:35:03 devstack cinder-volume[75486]: DEBUG oslo_service.backend._eventlet.service [None req-7a316aef-88c3-4ae0-9259-a0a05b655104 None None] backend_defaults.extra_capabilities = {} {{(pid=75486) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 14:35:03 devstack cinder-volume[75486]: DEBUG oslo_service.backend._eventlet.service [None req-7a316aef-88c3-4ae0-9259-a0a05b655104 None None] backend_defaults.filter_function = None {{(pid=75486) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 14:35:03 devstack cinder-volume[75486]: DEBUG oslo_service.backend._eventlet.service [None req-7a316aef-88c3-4ae0-9259-a0a05b655104 None None] backend_defaults.goodness_function = None {{(pid=75486) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 14:35:03 devstack cinder-volume[75486]: DEBUG oslo_service.backend._eventlet.service [None req-7a316aef-88c3-4ae0-9259-a0a05b655104 None None] backend_defaults.image_upload_use_cinder_backend = False {{(pid=75486) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 14:35:03 devstack cinder-volume[75486]: DEBUG oslo_service.backend._eventlet.service [None req-7a316aef-88c3-4ae0-9259-a0a05b655104 None None] backend_defaults.image_upload_use_internal_tenant = False {{(pid=75486) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 14:35:03 devstack cinder-volume[75486]: DEBUG oslo_service.backend._eventlet.service [None req-7a316aef-88c3-4ae0-9259-a0a05b655104 None None] backend_defaults.image_volume_cache_enabled = False {{(pid=75486) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 14:35:03 devstack cinder-volume[75486]: DEBUG oslo_service.backend._eventlet.service [None req-7a316aef-88c3-4ae0-9259-a0a05b655104 None None] backend_defaults.image_volume_cache_max_count = 0 {{(pid=75486) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 14:35:03 devstack cinder-volume[75486]: DEBUG oslo_service.backend._eventlet.service [None req-7a316aef-88c3-4ae0-9259-a0a05b655104 None None] backend_defaults.image_volume_cache_max_size_gb = 0 {{(pid=75486) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 14:35:03 devstack cinder-volume[75486]: DEBUG oslo_service.backend._eventlet.service [None req-7a316aef-88c3-4ae0-9259-a0a05b655104 None None] backend_defaults.iscsi_iotype = fileio {{(pid=75486) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 14:35:03 devstack cinder-volume[75486]: DEBUG oslo_service.backend._eventlet.service [None req-7a316aef-88c3-4ae0-9259-a0a05b655104 None None] backend_defaults.iscsi_target_flags = {{(pid=75486) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 14:35:03 devstack cinder-volume[75486]: DEBUG oslo_service.backend._eventlet.service [None req-7a316aef-88c3-4ae0-9259-a0a05b655104 None None] backend_defaults.iscsi_write_cache = on {{(pid=75486) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 14:35:03 devstack cinder-volume[75486]: DEBUG oslo_service.backend._eventlet.service [None req-7a316aef-88c3-4ae0-9259-a0a05b655104 None None] backend_defaults.iser_helper = tgtadm {{(pid=75486) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 14:35:03 devstack cinder-volume[75486]: DEBUG oslo_service.backend._eventlet.service [None req-7a316aef-88c3-4ae0-9259-a0a05b655104 None None] backend_defaults.iser_ip_address = 192.168.122.206 {{(pid=75486) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 14:35:03 devstack cinder-volume[75486]: DEBUG oslo_service.backend._eventlet.service [None req-7a316aef-88c3-4ae0-9259-a0a05b655104 None None] backend_defaults.iser_port = 3260 {{(pid=75486) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 14:35:03 devstack cinder-volume[75486]: DEBUG oslo_service.backend._eventlet.service [None req-7a316aef-88c3-4ae0-9259-a0a05b655104 None None] backend_defaults.iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=75486) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 14:35:03 devstack cinder-volume[75486]: DEBUG oslo_service.backend._eventlet.service [None req-7a316aef-88c3-4ae0-9259-a0a05b655104 None None] backend_defaults.lvm_conf_file = /etc/cinder/lvm.conf {{(pid=75486) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 14:35:03 devstack cinder-volume[75623]: INFO cinder.volume.manager [None req-16af0d3d-76b6-4744-8c19-2d17a64c8b0c None None] Starting volume driver LVMVolumeDriver (3.0.0) Sep 16 14:35:03 devstack cinder-volume[75486]: DEBUG oslo_service.backend._eventlet.service [None req-7a316aef-88c3-4ae0-9259-a0a05b655104 None None] backend_defaults.lvm_mirrors = 0 {{(pid=75486) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 14:35:03 devstack cinder-volume[75486]: DEBUG oslo_service.backend._eventlet.service [None req-7a316aef-88c3-4ae0-9259-a0a05b655104 None None] backend_defaults.lvm_share_target = False {{(pid=75486) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 14:35:03 devstack cinder-volume[75486]: DEBUG oslo_service.backend._eventlet.service [None req-7a316aef-88c3-4ae0-9259-a0a05b655104 None None] backend_defaults.lvm_suppress_fd_warnings = False {{(pid=75486) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 14:35:03 devstack cinder-volume[75486]: DEBUG oslo_service.backend._eventlet.service [None req-7a316aef-88c3-4ae0-9259-a0a05b655104 None None] backend_defaults.lvm_type = auto {{(pid=75486) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 14:35:03 devstack cinder-volume[75486]: DEBUG oslo_service.backend._eventlet.service [None req-7a316aef-88c3-4ae0-9259-a0a05b655104 None None] backend_defaults.max_over_subscription_ratio = 20.0 {{(pid=75486) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 14:35:03 devstack cinder-volume[75486]: DEBUG oslo_service.backend._eventlet.service [None req-7a316aef-88c3-4ae0-9259-a0a05b655104 None None] backend_defaults.num_iser_scan_tries = 3 {{(pid=75486) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 14:35:03 devstack cinder-volume[75486]: DEBUG oslo_service.backend._eventlet.service [None req-7a316aef-88c3-4ae0-9259-a0a05b655104 None None] backend_defaults.num_shell_tries = 3 {{(pid=75486) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 14:35:03 devstack cinder-volume[75486]: DEBUG oslo_service.backend._eventlet.service [None req-7a316aef-88c3-4ae0-9259-a0a05b655104 None None] backend_defaults.num_volume_device_scan_tries = 3 {{(pid=75486) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 14:35:03 devstack cinder-volume[75486]: DEBUG oslo_service.backend._eventlet.service [None req-7a316aef-88c3-4ae0-9259-a0a05b655104 None None] backend_defaults.nvmeof_conn_info_version = 1 {{(pid=75486) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 14:35:03 devstack cinder-volume[75486]: DEBUG oslo_service.backend._eventlet.service [None req-7a316aef-88c3-4ae0-9259-a0a05b655104 None None] backend_defaults.nvmet_ns_id = 10 {{(pid=75486) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 14:35:03 devstack cinder-volume[75486]: DEBUG oslo_service.backend._eventlet.service [None req-7a316aef-88c3-4ae0-9259-a0a05b655104 None None] backend_defaults.nvmet_port_id = 1 {{(pid=75486) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 14:35:03 devstack cinder-volume[75486]: DEBUG oslo_service.backend._eventlet.service [None req-7a316aef-88c3-4ae0-9259-a0a05b655104 None None] backend_defaults.replication_device = **** {{(pid=75486) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 14:35:03 devstack cinder-volume[75486]: DEBUG oslo_service.backend._eventlet.service [None req-7a316aef-88c3-4ae0-9259-a0a05b655104 None None] backend_defaults.report_discard_supported = False {{(pid=75486) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 14:35:03 devstack cinder-volume[75486]: DEBUG oslo_service.backend._eventlet.service [None req-7a316aef-88c3-4ae0-9259-a0a05b655104 None None] backend_defaults.reserved_percentage = 0 {{(pid=75486) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 14:35:03 devstack cinder-volume[75486]: DEBUG oslo_service.backend._eventlet.service [None req-7a316aef-88c3-4ae0-9259-a0a05b655104 None None] backend_defaults.scst_target_driver = iscsi {{(pid=75486) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 14:35:03 devstack cinder-volume[75486]: DEBUG oslo_service.backend._eventlet.service [None req-7a316aef-88c3-4ae0-9259-a0a05b655104 None None] backend_defaults.scst_target_iqn_name = None {{(pid=75486) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 14:35:03 devstack cinder-volume[75623]: DEBUG oslo_concurrency.processutils [None req-16af0d3d-76b6-4744-8c19-2d17a64c8b0c None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=75623) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 14:35:03 devstack cinder-volume[75486]: DEBUG oslo_service.backend._eventlet.service [None req-7a316aef-88c3-4ae0-9259-a0a05b655104 None None] backend_defaults.storage_protocol = iSCSI {{(pid=75486) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 14:35:03 devstack cinder-volume[75486]: DEBUG oslo_service.backend._eventlet.service [None req-7a316aef-88c3-4ae0-9259-a0a05b655104 None None] backend_defaults.suppress_requests_ssl_warnings = False {{(pid=75486) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 14:35:03 devstack cinder-volume[75486]: DEBUG oslo_service.backend._eventlet.service [None req-7a316aef-88c3-4ae0-9259-a0a05b655104 None None] backend_defaults.target_helper = tgtadm {{(pid=75486) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 14:35:03 devstack cinder-volume[75486]: DEBUG oslo_service.backend._eventlet.service [None req-7a316aef-88c3-4ae0-9259-a0a05b655104 None None] backend_defaults.target_ip_address = 192.168.122.206 {{(pid=75486) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 14:35:03 devstack cinder-volume[75486]: DEBUG oslo_service.backend._eventlet.service [None req-7a316aef-88c3-4ae0-9259-a0a05b655104 None None] backend_defaults.target_port = 3260 {{(pid=75486) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 14:35:03 devstack cinder-volume[75486]: DEBUG oslo_service.backend._eventlet.service [None req-7a316aef-88c3-4ae0-9259-a0a05b655104 None None] backend_defaults.target_prefix = iqn.2010-10.org.openstack: {{(pid=75486) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 14:35:03 devstack cinder-volume[75486]: DEBUG oslo_service.backend._eventlet.service [None req-7a316aef-88c3-4ae0-9259-a0a05b655104 None None] backend_defaults.target_protocol = iscsi {{(pid=75486) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 14:35:03 devstack cinder-volume[75486]: DEBUG oslo_service.backend._eventlet.service [None req-7a316aef-88c3-4ae0-9259-a0a05b655104 None None] backend_defaults.target_secondary_ip_addresses = [] {{(pid=75486) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 14:35:03 devstack cinder-volume[75486]: DEBUG oslo_service.backend._eventlet.service [None req-7a316aef-88c3-4ae0-9259-a0a05b655104 None None] backend_defaults.trace_flags = None {{(pid=75486) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 14:35:03 devstack cinder-volume[75486]: DEBUG oslo_service.backend._eventlet.service [None req-7a316aef-88c3-4ae0-9259-a0a05b655104 None None] backend_defaults.unique_fqdn_network = True {{(pid=75486) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 14:35:03 devstack cinder-volume[75486]: DEBUG oslo_service.backend._eventlet.service [None req-7a316aef-88c3-4ae0-9259-a0a05b655104 None None] backend_defaults.use_chap_auth = False {{(pid=75486) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 14:35:03 devstack cinder-volume[75486]: DEBUG oslo_service.backend._eventlet.service [None req-7a316aef-88c3-4ae0-9259-a0a05b655104 None None] backend_defaults.use_multipath_for_image_xfer = False {{(pid=75486) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 14:35:03 devstack cinder-volume[75486]: DEBUG oslo_service.backend._eventlet.service [None req-7a316aef-88c3-4ae0-9259-a0a05b655104 None None] backend_defaults.volume_backend_name = None {{(pid=75486) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 14:35:03 devstack cinder-volume[75486]: DEBUG oslo_service.backend._eventlet.service [None req-7a316aef-88c3-4ae0-9259-a0a05b655104 None None] backend_defaults.volume_clear = zero {{(pid=75486) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 14:35:03 devstack cinder-volume[75486]: DEBUG oslo_service.backend._eventlet.service [None req-7a316aef-88c3-4ae0-9259-a0a05b655104 None None] backend_defaults.volume_clear_ionice = None {{(pid=75486) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 14:35:03 devstack cinder-volume[75486]: DEBUG oslo_service.backend._eventlet.service [None req-7a316aef-88c3-4ae0-9259-a0a05b655104 None None] backend_defaults.volume_clear_size = 0 {{(pid=75486) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 14:35:03 devstack cinder-volume[75486]: DEBUG oslo_service.backend._eventlet.service [None req-7a316aef-88c3-4ae0-9259-a0a05b655104 None None] backend_defaults.volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=75486) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 14:35:03 devstack cinder-volume[75486]: DEBUG oslo_service.backend._eventlet.service [None req-7a316aef-88c3-4ae0-9259-a0a05b655104 None None] backend_defaults.volume_copy_bps_limit = 0 {{(pid=75486) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 14:35:03 devstack cinder-volume[75486]: DEBUG oslo_service.backend._eventlet.service [None req-7a316aef-88c3-4ae0-9259-a0a05b655104 None None] backend_defaults.volume_dd_blocksize = 1M {{(pid=75486) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 14:35:03 devstack cinder-volume[75486]: DEBUG oslo_service.backend._eventlet.service [None req-7a316aef-88c3-4ae0-9259-a0a05b655104 None None] backend_defaults.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=75486) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 14:35:03 devstack cinder-volume[75486]: DEBUG oslo_service.backend._eventlet.service [None req-7a316aef-88c3-4ae0-9259-a0a05b655104 None None] backend_defaults.volume_group = cinder-volumes {{(pid=75486) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 14:35:03 devstack cinder-volume[75486]: DEBUG oslo_service.backend._eventlet.service [None req-7a316aef-88c3-4ae0-9259-a0a05b655104 None None] backend_defaults.volumes_dir = /opt/stack/data/cinder/volumes {{(pid=75486) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 14:35:03 devstack cinder-volume[75486]: DEBUG oslo_service.backend._eventlet.service [None req-7a316aef-88c3-4ae0-9259-a0a05b655104 None None] oslo_reports.file_event_handler = None {{(pid=75486) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 14:35:03 devstack cinder-volume[75486]: DEBUG oslo_service.backend._eventlet.service [None req-7a316aef-88c3-4ae0-9259-a0a05b655104 None None] oslo_reports.file_event_handler_interval = 1 {{(pid=75486) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 14:35:03 devstack cinder-volume[75486]: DEBUG oslo_service.backend._eventlet.service [None req-7a316aef-88c3-4ae0-9259-a0a05b655104 None None] oslo_reports.log_dir = None {{(pid=75486) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 14:35:03 devstack cinder-volume[75486]: DEBUG oslo_service.backend._eventlet.service [None req-7a316aef-88c3-4ae0-9259-a0a05b655104 None None] lvmdriver-1.backend_availability_zone = None {{(pid=75486) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 14:35:03 devstack cinder-volume[75486]: DEBUG oslo_service.backend._eventlet.service [None req-7a316aef-88c3-4ae0-9259-a0a05b655104 None None] lvmdriver-1.backend_host = None {{(pid=75486) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 14:35:03 devstack cinder-volume[75486]: DEBUG oslo_service.backend._eventlet.service [None req-7a316aef-88c3-4ae0-9259-a0a05b655104 None None] lvmdriver-1.backend_native_threads_pool_size = None {{(pid=75486) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 14:35:03 devstack cinder-volume[75486]: DEBUG oslo_service.backend._eventlet.service [None req-7a316aef-88c3-4ae0-9259-a0a05b655104 None None] lvmdriver-1.backup_use_temp_snapshot = None {{(pid=75486) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 14:35:03 devstack cinder-volume[75486]: DEBUG oslo_service.backend._eventlet.service [None req-7a316aef-88c3-4ae0-9259-a0a05b655104 None None] lvmdriver-1.chap_password = **** {{(pid=75486) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 14:35:03 devstack cinder-volume[75486]: DEBUG oslo_service.backend._eventlet.service [None req-7a316aef-88c3-4ae0-9259-a0a05b655104 None None] lvmdriver-1.chap_username = None {{(pid=75486) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 14:35:03 devstack cinder-volume[75486]: DEBUG oslo_service.backend._eventlet.service [None req-7a316aef-88c3-4ae0-9259-a0a05b655104 None None] lvmdriver-1.chiscsi_conf = None {{(pid=75486) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 14:35:03 devstack cinder-volume[75486]: DEBUG oslo_service.backend._eventlet.service [None req-7a316aef-88c3-4ae0-9259-a0a05b655104 None None] lvmdriver-1.driver_client_cert = None {{(pid=75486) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 14:35:03 devstack cinder-volume[75486]: DEBUG oslo_service.backend._eventlet.service [None req-7a316aef-88c3-4ae0-9259-a0a05b655104 None None] lvmdriver-1.driver_client_cert_key = None {{(pid=75486) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 14:35:03 devstack cinder-volume[75486]: DEBUG oslo_service.backend._eventlet.service [None req-7a316aef-88c3-4ae0-9259-a0a05b655104 None None] lvmdriver-1.driver_data_namespace = None {{(pid=75486) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 14:35:03 devstack cinder-volume[75486]: DEBUG oslo_service.backend._eventlet.service [None req-7a316aef-88c3-4ae0-9259-a0a05b655104 None None] lvmdriver-1.driver_ssl_cert_path = None {{(pid=75486) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 14:35:03 devstack cinder-volume[75486]: DEBUG oslo_service.backend._eventlet.service [None req-7a316aef-88c3-4ae0-9259-a0a05b655104 None None] lvmdriver-1.driver_ssl_cert_verify = None {{(pid=75486) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 14:35:03 devstack cinder-volume[75486]: DEBUG oslo_service.backend._eventlet.service [None req-7a316aef-88c3-4ae0-9259-a0a05b655104 None None] lvmdriver-1.driver_use_ssl = None {{(pid=75486) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 14:35:03 devstack cinder-volume[75486]: DEBUG oslo_service.backend._eventlet.service [None req-7a316aef-88c3-4ae0-9259-a0a05b655104 None None] lvmdriver-1.enable_unsupported_driver = None {{(pid=75486) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 14:35:03 devstack cinder-volume[75486]: DEBUG oslo_service.backend._eventlet.service [None req-7a316aef-88c3-4ae0-9259-a0a05b655104 None None] lvmdriver-1.enforce_multipath_for_image_xfer = None {{(pid=75486) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 14:35:03 devstack cinder-volume[75486]: DEBUG oslo_service.backend._eventlet.service [None req-7a316aef-88c3-4ae0-9259-a0a05b655104 None None] lvmdriver-1.extra_capabilities = None {{(pid=75486) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 14:35:03 devstack cinder-volume[75486]: DEBUG oslo_service.backend._eventlet.service [None req-7a316aef-88c3-4ae0-9259-a0a05b655104 None None] lvmdriver-1.filter_function = None {{(pid=75486) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 14:35:03 devstack cinder-volume[75486]: DEBUG oslo_service.backend._eventlet.service [None req-7a316aef-88c3-4ae0-9259-a0a05b655104 None None] lvmdriver-1.goodness_function = None {{(pid=75486) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 14:35:03 devstack cinder-volume[75486]: DEBUG oslo_service.backend._eventlet.service [None req-7a316aef-88c3-4ae0-9259-a0a05b655104 None None] lvmdriver-1.image_upload_use_cinder_backend = None {{(pid=75486) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 14:35:03 devstack cinder-volume[75486]: DEBUG oslo_service.backend._eventlet.service [None req-7a316aef-88c3-4ae0-9259-a0a05b655104 None None] lvmdriver-1.image_upload_use_internal_tenant = None {{(pid=75486) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 14:35:03 devstack cinder-volume[75486]: DEBUG oslo_service.backend._eventlet.service [None req-7a316aef-88c3-4ae0-9259-a0a05b655104 None None] lvmdriver-1.image_volume_cache_enabled = True {{(pid=75486) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 14:35:03 devstack cinder-volume[75486]: DEBUG oslo_service.backend._eventlet.service [None req-7a316aef-88c3-4ae0-9259-a0a05b655104 None None] lvmdriver-1.image_volume_cache_max_count = None {{(pid=75486) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 14:35:03 devstack cinder-volume[75486]: DEBUG oslo_service.backend._eventlet.service [None req-7a316aef-88c3-4ae0-9259-a0a05b655104 None None] lvmdriver-1.image_volume_cache_max_size_gb = None {{(pid=75486) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 14:35:03 devstack cinder-volume[75486]: DEBUG oslo_service.backend._eventlet.service [None req-7a316aef-88c3-4ae0-9259-a0a05b655104 None None] lvmdriver-1.iscsi_iotype = None {{(pid=75486) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 14:35:03 devstack cinder-volume[75486]: DEBUG oslo_service.backend._eventlet.service [None req-7a316aef-88c3-4ae0-9259-a0a05b655104 None None] lvmdriver-1.iscsi_target_flags = None {{(pid=75486) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 14:35:03 devstack cinder-volume[75486]: DEBUG oslo_service.backend._eventlet.service [None req-7a316aef-88c3-4ae0-9259-a0a05b655104 None None] lvmdriver-1.iscsi_write_cache = None {{(pid=75486) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 14:35:03 devstack cinder-volume[75486]: DEBUG oslo_service.backend._eventlet.service [None req-7a316aef-88c3-4ae0-9259-a0a05b655104 None None] lvmdriver-1.iser_helper = None {{(pid=75486) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 14:35:03 devstack cinder-volume[75486]: DEBUG oslo_service.backend._eventlet.service [None req-7a316aef-88c3-4ae0-9259-a0a05b655104 None None] lvmdriver-1.iser_ip_address = None {{(pid=75486) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 14:35:03 devstack cinder-volume[75486]: DEBUG oslo_service.backend._eventlet.service [None req-7a316aef-88c3-4ae0-9259-a0a05b655104 None None] lvmdriver-1.iser_port = None {{(pid=75486) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 14:35:03 devstack cinder-volume[75486]: DEBUG oslo_service.backend._eventlet.service [None req-7a316aef-88c3-4ae0-9259-a0a05b655104 None None] lvmdriver-1.iser_target_prefix = None {{(pid=75486) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 14:35:03 devstack cinder-volume[75486]: DEBUG oslo_service.backend._eventlet.service [None req-7a316aef-88c3-4ae0-9259-a0a05b655104 None None] lvmdriver-1.lvm_conf_file = None {{(pid=75486) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 14:35:03 devstack cinder-volume[75486]: DEBUG oslo_service.backend._eventlet.service [None req-7a316aef-88c3-4ae0-9259-a0a05b655104 None None] lvmdriver-1.lvm_mirrors = None {{(pid=75486) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 14:35:03 devstack cinder-volume[75486]: DEBUG oslo_service.backend._eventlet.service [None req-7a316aef-88c3-4ae0-9259-a0a05b655104 None None] lvmdriver-1.lvm_share_target = None {{(pid=75486) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 14:35:03 devstack cinder-volume[75486]: DEBUG oslo_service.backend._eventlet.service [None req-7a316aef-88c3-4ae0-9259-a0a05b655104 None None] lvmdriver-1.lvm_suppress_fd_warnings = None {{(pid=75486) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 14:35:03 devstack cinder-volume[75486]: DEBUG oslo_service.backend._eventlet.service [None req-7a316aef-88c3-4ae0-9259-a0a05b655104 None None] lvmdriver-1.lvm_type = auto {{(pid=75486) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 14:35:03 devstack cinder-volume[75486]: DEBUG oslo_service.backend._eventlet.service [None req-7a316aef-88c3-4ae0-9259-a0a05b655104 None None] lvmdriver-1.max_over_subscription_ratio = None {{(pid=75486) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 14:35:03 devstack cinder-volume[75486]: DEBUG oslo_service.backend._eventlet.service [None req-7a316aef-88c3-4ae0-9259-a0a05b655104 None None] lvmdriver-1.num_iser_scan_tries = None {{(pid=75486) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 14:35:03 devstack cinder-volume[75486]: DEBUG oslo_service.backend._eventlet.service [None req-7a316aef-88c3-4ae0-9259-a0a05b655104 None None] lvmdriver-1.num_shell_tries = None {{(pid=75486) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 14:35:03 devstack cinder-volume[75486]: DEBUG oslo_service.backend._eventlet.service [None req-7a316aef-88c3-4ae0-9259-a0a05b655104 None None] lvmdriver-1.num_volume_device_scan_tries = None {{(pid=75486) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 14:35:03 devstack cinder-volume[75486]: DEBUG oslo_service.backend._eventlet.service [None req-7a316aef-88c3-4ae0-9259-a0a05b655104 None None] lvmdriver-1.nvmeof_conn_info_version = None {{(pid=75486) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 14:35:03 devstack cinder-volume[75486]: DEBUG oslo_service.backend._eventlet.service [None req-7a316aef-88c3-4ae0-9259-a0a05b655104 None None] lvmdriver-1.nvmet_ns_id = None {{(pid=75486) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 14:35:03 devstack cinder-volume[75486]: DEBUG oslo_service.backend._eventlet.service [None req-7a316aef-88c3-4ae0-9259-a0a05b655104 None None] lvmdriver-1.nvmet_port_id = None {{(pid=75486) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 14:35:03 devstack cinder-volume[75486]: DEBUG oslo_service.backend._eventlet.service [None req-7a316aef-88c3-4ae0-9259-a0a05b655104 None None] lvmdriver-1.replication_device = **** {{(pid=75486) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 14:35:03 devstack cinder-volume[75486]: DEBUG oslo_service.backend._eventlet.service [None req-7a316aef-88c3-4ae0-9259-a0a05b655104 None None] lvmdriver-1.report_discard_supported = None {{(pid=75486) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 14:35:03 devstack cinder-volume[75486]: DEBUG oslo_service.backend._eventlet.service [None req-7a316aef-88c3-4ae0-9259-a0a05b655104 None None] lvmdriver-1.reserved_percentage = None {{(pid=75486) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 14:35:03 devstack cinder-volume[75486]: DEBUG oslo_service.backend._eventlet.service [None req-7a316aef-88c3-4ae0-9259-a0a05b655104 None None] lvmdriver-1.scst_target_driver = None {{(pid=75486) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 14:35:03 devstack cinder-volume[75486]: DEBUG oslo_service.backend._eventlet.service [None req-7a316aef-88c3-4ae0-9259-a0a05b655104 None None] lvmdriver-1.scst_target_iqn_name = None {{(pid=75486) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 14:35:03 devstack cinder-volume[75486]: DEBUG oslo_service.backend._eventlet.service [None req-7a316aef-88c3-4ae0-9259-a0a05b655104 None None] lvmdriver-1.storage_protocol = None {{(pid=75486) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 14:35:03 devstack cinder-volume[75486]: DEBUG oslo_service.backend._eventlet.service [None req-7a316aef-88c3-4ae0-9259-a0a05b655104 None None] lvmdriver-1.suppress_requests_ssl_warnings = None {{(pid=75486) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 14:35:03 devstack cinder-volume[75486]: DEBUG oslo_service.backend._eventlet.service [None req-7a316aef-88c3-4ae0-9259-a0a05b655104 None None] lvmdriver-1.target_helper = lioadm {{(pid=75486) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 14:35:03 devstack cinder-volume[75486]: DEBUG oslo_service.backend._eventlet.service [None req-7a316aef-88c3-4ae0-9259-a0a05b655104 None None] lvmdriver-1.target_ip_address = None {{(pid=75486) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 14:35:03 devstack cinder-volume[75486]: DEBUG oslo_service.backend._eventlet.service [None req-7a316aef-88c3-4ae0-9259-a0a05b655104 None None] lvmdriver-1.target_port = 3260 {{(pid=75486) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 14:35:03 devstack cinder-volume[75486]: DEBUG oslo_service.backend._eventlet.service [None req-7a316aef-88c3-4ae0-9259-a0a05b655104 None None] lvmdriver-1.target_prefix = iqn.2010-10.org.openstack: {{(pid=75486) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 14:35:03 devstack cinder-volume[75486]: DEBUG oslo_service.backend._eventlet.service [None req-7a316aef-88c3-4ae0-9259-a0a05b655104 None None] lvmdriver-1.target_protocol = iscsi {{(pid=75486) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 14:35:03 devstack cinder-volume[75486]: DEBUG oslo_service.backend._eventlet.service [None req-7a316aef-88c3-4ae0-9259-a0a05b655104 None None] lvmdriver-1.target_secondary_ip_addresses = None {{(pid=75486) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 14:35:03 devstack cinder-volume[75486]: DEBUG oslo_service.backend._eventlet.service [None req-7a316aef-88c3-4ae0-9259-a0a05b655104 None None] lvmdriver-1.trace_flags = None {{(pid=75486) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 14:35:03 devstack cinder-volume[75486]: DEBUG oslo_service.backend._eventlet.service [None req-7a316aef-88c3-4ae0-9259-a0a05b655104 None None] lvmdriver-1.unique_fqdn_network = None {{(pid=75486) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 14:35:03 devstack cinder-volume[75486]: DEBUG oslo_service.backend._eventlet.service [None req-7a316aef-88c3-4ae0-9259-a0a05b655104 None None] lvmdriver-1.use_chap_auth = None {{(pid=75486) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 14:35:03 devstack cinder-volume[75486]: DEBUG oslo_service.backend._eventlet.service [None req-7a316aef-88c3-4ae0-9259-a0a05b655104 None None] lvmdriver-1.use_multipath_for_image_xfer = None {{(pid=75486) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 14:35:03 devstack cinder-volume[75486]: DEBUG oslo_service.backend._eventlet.service [None req-7a316aef-88c3-4ae0-9259-a0a05b655104 None None] lvmdriver-1.volume_backend_name = lvmdriver-1 {{(pid=75486) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 14:35:03 devstack cinder-volume[75486]: DEBUG oslo_service.backend._eventlet.service [None req-7a316aef-88c3-4ae0-9259-a0a05b655104 None None] lvmdriver-1.volume_clear = zero {{(pid=75486) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 14:35:03 devstack cinder-volume[75486]: DEBUG oslo_service.backend._eventlet.service [None req-7a316aef-88c3-4ae0-9259-a0a05b655104 None None] lvmdriver-1.volume_clear_ionice = None {{(pid=75486) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 14:35:03 devstack cinder-volume[75486]: DEBUG oslo_service.backend._eventlet.service [None req-7a316aef-88c3-4ae0-9259-a0a05b655104 None None] lvmdriver-1.volume_clear_size = None {{(pid=75486) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 14:35:03 devstack cinder-volume[75486]: DEBUG oslo_service.backend._eventlet.service [None req-7a316aef-88c3-4ae0-9259-a0a05b655104 None None] lvmdriver-1.volume_copy_blkio_cgroup_name = None {{(pid=75486) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 14:35:03 devstack cinder-volume[75486]: DEBUG oslo_service.backend._eventlet.service [None req-7a316aef-88c3-4ae0-9259-a0a05b655104 None None] lvmdriver-1.volume_copy_bps_limit = None {{(pid=75486) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 14:35:03 devstack cinder-volume[75486]: DEBUG oslo_service.backend._eventlet.service [None req-7a316aef-88c3-4ae0-9259-a0a05b655104 None None] lvmdriver-1.volume_dd_blocksize = None {{(pid=75486) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 14:35:03 devstack cinder-volume[75486]: DEBUG oslo_service.backend._eventlet.service [None req-7a316aef-88c3-4ae0-9259-a0a05b655104 None None] lvmdriver-1.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=75486) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 14:35:03 devstack cinder-volume[75486]: DEBUG oslo_service.backend._eventlet.service [None req-7a316aef-88c3-4ae0-9259-a0a05b655104 None None] lvmdriver-1.volume_group = stack-volumes-lvmdriver-1 {{(pid=75486) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 14:35:03 devstack cinder-volume[75486]: DEBUG oslo_service.backend._eventlet.service [None req-7a316aef-88c3-4ae0-9259-a0a05b655104 None None] lvmdriver-1.volumes_dir = None {{(pid=75486) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 14:35:03 devstack cinder-volume[75486]: DEBUG oslo_service.backend._eventlet.service [None req-7a316aef-88c3-4ae0-9259-a0a05b655104 None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=75486) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 14:35:03 devstack cinder-volume[75486]: DEBUG oslo_service.backend._eventlet.service [None req-7a316aef-88c3-4ae0-9259-a0a05b655104 None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=75486) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 14:35:03 devstack cinder-volume[75486]: DEBUG oslo_service.backend._eventlet.service [None req-7a316aef-88c3-4ae0-9259-a0a05b655104 None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=75486) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 14:35:03 devstack cinder-volume[75486]: DEBUG oslo_service.backend._eventlet.service [None req-7a316aef-88c3-4ae0-9259-a0a05b655104 None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=75486) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 14:35:03 devstack cinder-volume[75486]: DEBUG oslo_service.backend._eventlet.service [None req-7a316aef-88c3-4ae0-9259-a0a05b655104 None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=75486) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 14:35:03 devstack cinder-volume[75486]: DEBUG oslo_service.backend._eventlet.service [None req-7a316aef-88c3-4ae0-9259-a0a05b655104 None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=75486) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 14:35:03 devstack cinder-volume[75486]: DEBUG oslo_service.backend._eventlet.service [None req-7a316aef-88c3-4ae0-9259-a0a05b655104 None None] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=75486) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 14:35:03 devstack cinder-volume[75486]: DEBUG oslo_service.backend._eventlet.service [None req-7a316aef-88c3-4ae0-9259-a0a05b655104 None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=75486) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 14:35:03 devstack cinder-volume[75486]: DEBUG oslo_service.backend._eventlet.service [None req-7a316aef-88c3-4ae0-9259-a0a05b655104 None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=75486) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 14:35:03 devstack cinder-volume[75486]: DEBUG oslo_service.backend._eventlet.service [None req-7a316aef-88c3-4ae0-9259-a0a05b655104 None None] oslo_messaging_rabbit.hostname = devstack {{(pid=75486) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 14:35:03 devstack cinder-volume[75486]: DEBUG oslo_service.backend._eventlet.service [None req-7a316aef-88c3-4ae0-9259-a0a05b655104 None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=75486) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 14:35:03 devstack cinder-volume[75486]: DEBUG oslo_service.backend._eventlet.service [None req-7a316aef-88c3-4ae0-9259-a0a05b655104 None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=75486) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 14:35:03 devstack cinder-volume[75486]: DEBUG oslo_service.backend._eventlet.service [None req-7a316aef-88c3-4ae0-9259-a0a05b655104 None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=75486) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 14:35:03 devstack cinder-volume[75486]: DEBUG oslo_service.backend._eventlet.service [None req-7a316aef-88c3-4ae0-9259-a0a05b655104 None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=75486) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 14:35:03 devstack cinder-volume[75486]: DEBUG oslo_service.backend._eventlet.service [None req-7a316aef-88c3-4ae0-9259-a0a05b655104 None None] oslo_messaging_rabbit.kombu_reconnect_splay = 0.0 {{(pid=75486) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 14:35:03 devstack cinder-volume[75486]: DEBUG oslo_service.backend._eventlet.service [None req-7a316aef-88c3-4ae0-9259-a0a05b655104 None None] oslo_messaging_rabbit.processname = cinder-volume {{(pid=75486) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 14:35:03 devstack cinder-volume[75486]: DEBUG oslo_service.backend._eventlet.service [None req-7a316aef-88c3-4ae0-9259-a0a05b655104 None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=75486) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 14:35:03 devstack cinder-volume[75486]: DEBUG oslo_service.backend._eventlet.service [None req-7a316aef-88c3-4ae0-9259-a0a05b655104 None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=75486) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 14:35:03 devstack cinder-volume[75486]: DEBUG oslo_service.backend._eventlet.service [None req-7a316aef-88c3-4ae0-9259-a0a05b655104 None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=75486) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 14:35:03 devstack cinder-volume[75486]: DEBUG oslo_service.backend._eventlet.service [None req-7a316aef-88c3-4ae0-9259-a0a05b655104 None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=75486) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 14:35:03 devstack cinder-volume[75486]: DEBUG oslo_service.backend._eventlet.service [None req-7a316aef-88c3-4ae0-9259-a0a05b655104 None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=75486) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 14:35:03 devstack cinder-volume[75486]: DEBUG oslo_service.backend._eventlet.service [None req-7a316aef-88c3-4ae0-9259-a0a05b655104 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=75486) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 14:35:03 devstack cinder-volume[75486]: DEBUG oslo_service.backend._eventlet.service [None req-7a316aef-88c3-4ae0-9259-a0a05b655104 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=75486) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 14:35:03 devstack cinder-volume[75486]: DEBUG oslo_service.backend._eventlet.service [None req-7a316aef-88c3-4ae0-9259-a0a05b655104 None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=75486) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 14:35:03 devstack cinder-volume[75486]: DEBUG oslo_service.backend._eventlet.service [None req-7a316aef-88c3-4ae0-9259-a0a05b655104 None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=75486) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 14:35:03 devstack cinder-volume[75486]: DEBUG oslo_service.backend._eventlet.service [None req-7a316aef-88c3-4ae0-9259-a0a05b655104 None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=75486) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 14:35:03 devstack cinder-volume[75486]: DEBUG oslo_service.backend._eventlet.service [None req-7a316aef-88c3-4ae0-9259-a0a05b655104 None None] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=75486) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 14:35:03 devstack cinder-volume[75486]: DEBUG oslo_service.backend._eventlet.service [None req-7a316aef-88c3-4ae0-9259-a0a05b655104 None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=75486) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 14:35:03 devstack cinder-volume[75486]: DEBUG oslo_service.backend._eventlet.service [None req-7a316aef-88c3-4ae0-9259-a0a05b655104 None None] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=75486) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 14:35:03 devstack cinder-volume[75486]: DEBUG oslo_service.backend._eventlet.service [None req-7a316aef-88c3-4ae0-9259-a0a05b655104 None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=75486) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 14:35:03 devstack cinder-volume[75486]: DEBUG oslo_service.backend._eventlet.service [None req-7a316aef-88c3-4ae0-9259-a0a05b655104 None None] oslo_messaging_rabbit.ssl = False {{(pid=75486) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 14:35:03 devstack cinder-volume[75486]: DEBUG oslo_service.backend._eventlet.service [None req-7a316aef-88c3-4ae0-9259-a0a05b655104 None None] oslo_messaging_rabbit.ssl_ca_file = {{(pid=75486) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 14:35:03 devstack cinder-volume[75486]: DEBUG oslo_service.backend._eventlet.service [None req-7a316aef-88c3-4ae0-9259-a0a05b655104 None None] oslo_messaging_rabbit.ssl_cert_file = {{(pid=75486) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 14:35:03 devstack cinder-volume[75486]: DEBUG oslo_service.backend._eventlet.service [None req-7a316aef-88c3-4ae0-9259-a0a05b655104 None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=75486) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 14:35:03 devstack cinder-volume[75486]: DEBUG oslo_service.backend._eventlet.service [None req-7a316aef-88c3-4ae0-9259-a0a05b655104 None None] oslo_messaging_rabbit.ssl_key_file = {{(pid=75486) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 14:35:03 devstack cinder-volume[75486]: DEBUG oslo_service.backend._eventlet.service [None req-7a316aef-88c3-4ae0-9259-a0a05b655104 None None] oslo_messaging_rabbit.ssl_version = {{(pid=75486) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 14:35:03 devstack cinder-volume[75486]: DEBUG oslo_service.backend._eventlet.service [None req-7a316aef-88c3-4ae0-9259-a0a05b655104 None None] oslo_messaging_rabbit.use_queue_manager = False {{(pid=75486) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 14:35:03 devstack cinder-volume[75486]: DEBUG oslo_service.backend._eventlet.service [None req-7a316aef-88c3-4ae0-9259-a0a05b655104 None None] oslo_messaging_notifications.driver = [] {{(pid=75486) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 14:35:03 devstack cinder-volume[75486]: DEBUG oslo_service.backend._eventlet.service [None req-7a316aef-88c3-4ae0-9259-a0a05b655104 None None] oslo_messaging_notifications.retry = -1 {{(pid=75486) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 14:35:03 devstack cinder-volume[75486]: DEBUG oslo_service.backend._eventlet.service [None req-7a316aef-88c3-4ae0-9259-a0a05b655104 None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=75486) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 14:35:03 devstack cinder-volume[75486]: DEBUG oslo_service.backend._eventlet.service [None req-7a316aef-88c3-4ae0-9259-a0a05b655104 None None] oslo_messaging_notifications.transport_url = **** {{(pid=75486) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 14:35:03 devstack cinder-volume[75486]: DEBUG oslo_service.backend._eventlet.service [None req-7a316aef-88c3-4ae0-9259-a0a05b655104 None None] key_manager.backend = cinder.keymgr.conf_key_mgr.ConfKeyManager {{(pid=75486) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 14:35:03 devstack cinder-volume[75486]: DEBUG oslo_service.backend._eventlet.service [None req-7a316aef-88c3-4ae0-9259-a0a05b655104 None None] key_manager.fixed_key = **** {{(pid=75486) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 14:35:03 devstack cinder-volume[75486]: DEBUG oslo_service.backend._eventlet.service [None req-7a316aef-88c3-4ae0-9259-a0a05b655104 None None] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=75486) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 14:35:03 devstack cinder-volume[75486]: DEBUG oslo_service.backend._eventlet.service [None req-7a316aef-88c3-4ae0-9259-a0a05b655104 None None] barbican.barbican_api_version = None {{(pid=75486) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 14:35:03 devstack cinder-volume[75486]: DEBUG oslo_service.backend._eventlet.service [None req-7a316aef-88c3-4ae0-9259-a0a05b655104 None None] barbican.barbican_endpoint = None {{(pid=75486) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 14:35:03 devstack cinder-volume[75486]: DEBUG oslo_service.backend._eventlet.service [None req-7a316aef-88c3-4ae0-9259-a0a05b655104 None None] barbican.barbican_endpoint_type = public {{(pid=75486) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 14:35:03 devstack cinder-volume[75486]: DEBUG oslo_service.backend._eventlet.service [None req-7a316aef-88c3-4ae0-9259-a0a05b655104 None None] barbican.barbican_region_name = None {{(pid=75486) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 14:35:03 devstack cinder-volume[75486]: DEBUG oslo_service.backend._eventlet.service [None req-7a316aef-88c3-4ae0-9259-a0a05b655104 None None] barbican.cafile = None {{(pid=75486) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 14:35:03 devstack cinder-volume[75486]: DEBUG oslo_service.backend._eventlet.service [None req-7a316aef-88c3-4ae0-9259-a0a05b655104 None None] barbican.certfile = None {{(pid=75486) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 14:35:03 devstack cinder-volume[75486]: DEBUG oslo_service.backend._eventlet.service [None req-7a316aef-88c3-4ae0-9259-a0a05b655104 None None] barbican.collect_timing = False {{(pid=75486) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 14:35:03 devstack cinder-volume[75486]: DEBUG oslo_service.backend._eventlet.service [None req-7a316aef-88c3-4ae0-9259-a0a05b655104 None None] barbican.insecure = False {{(pid=75486) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 14:35:03 devstack cinder-volume[75486]: DEBUG oslo_service.backend._eventlet.service [None req-7a316aef-88c3-4ae0-9259-a0a05b655104 None None] barbican.keyfile = None {{(pid=75486) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 14:35:03 devstack cinder-volume[75486]: DEBUG oslo_service.backend._eventlet.service [None req-7a316aef-88c3-4ae0-9259-a0a05b655104 None None] barbican.number_of_retries = 60 {{(pid=75486) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 14:35:03 devstack cinder-volume[75486]: DEBUG oslo_service.backend._eventlet.service [None req-7a316aef-88c3-4ae0-9259-a0a05b655104 None None] barbican.retry_delay = 1 {{(pid=75486) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 14:35:03 devstack cinder-volume[75486]: DEBUG oslo_service.backend._eventlet.service [None req-7a316aef-88c3-4ae0-9259-a0a05b655104 None None] barbican.send_service_user_token = False {{(pid=75486) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 14:35:03 devstack cinder-volume[75486]: DEBUG oslo_service.backend._eventlet.service [None req-7a316aef-88c3-4ae0-9259-a0a05b655104 None None] barbican.split_loggers = False {{(pid=75486) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 14:35:03 devstack cinder-volume[75486]: DEBUG oslo_service.backend._eventlet.service [None req-7a316aef-88c3-4ae0-9259-a0a05b655104 None None] barbican.timeout = None {{(pid=75486) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 14:35:03 devstack cinder-volume[75486]: DEBUG oslo_service.backend._eventlet.service [None req-7a316aef-88c3-4ae0-9259-a0a05b655104 None None] barbican.verify_ssl = True {{(pid=75486) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 14:35:03 devstack cinder-volume[75486]: DEBUG oslo_service.backend._eventlet.service [None req-7a316aef-88c3-4ae0-9259-a0a05b655104 None None] barbican.verify_ssl_path = None {{(pid=75486) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 14:35:03 devstack cinder-volume[75486]: DEBUG oslo_service.backend._eventlet.service [None req-7a316aef-88c3-4ae0-9259-a0a05b655104 None None] barbican_service_user.auth_section = None {{(pid=75486) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 14:35:03 devstack cinder-volume[75486]: DEBUG oslo_service.backend._eventlet.service [None req-7a316aef-88c3-4ae0-9259-a0a05b655104 None None] barbican_service_user.auth_type = None {{(pid=75486) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 14:35:03 devstack cinder-volume[75486]: DEBUG oslo_service.backend._eventlet.service [None req-7a316aef-88c3-4ae0-9259-a0a05b655104 None None] barbican_service_user.cafile = None {{(pid=75486) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 14:35:03 devstack cinder-volume[75486]: DEBUG oslo_service.backend._eventlet.service [None req-7a316aef-88c3-4ae0-9259-a0a05b655104 None None] barbican_service_user.certfile = None {{(pid=75486) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 14:35:03 devstack cinder-volume[75486]: DEBUG oslo_service.backend._eventlet.service [None req-7a316aef-88c3-4ae0-9259-a0a05b655104 None None] barbican_service_user.collect_timing = False {{(pid=75486) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 14:35:03 devstack cinder-volume[75486]: DEBUG oslo_service.backend._eventlet.service [None req-7a316aef-88c3-4ae0-9259-a0a05b655104 None None] barbican_service_user.insecure = False {{(pid=75486) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 14:35:03 devstack cinder-volume[75486]: DEBUG oslo_service.backend._eventlet.service [None req-7a316aef-88c3-4ae0-9259-a0a05b655104 None None] barbican_service_user.keyfile = None {{(pid=75486) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 14:35:03 devstack cinder-volume[75486]: DEBUG oslo_service.backend._eventlet.service [None req-7a316aef-88c3-4ae0-9259-a0a05b655104 None None] barbican_service_user.split_loggers = False {{(pid=75486) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 14:35:03 devstack cinder-volume[75486]: DEBUG oslo_service.backend._eventlet.service [None req-7a316aef-88c3-4ae0-9259-a0a05b655104 None None] barbican_service_user.timeout = None {{(pid=75486) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 14:35:03 devstack cinder-volume[75486]: DEBUG oslo_service.backend._eventlet.service [None req-7a316aef-88c3-4ae0-9259-a0a05b655104 None None] vault.approle_role_id = **** {{(pid=75486) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 14:35:03 devstack cinder-volume[75486]: DEBUG oslo_service.backend._eventlet.service [None req-7a316aef-88c3-4ae0-9259-a0a05b655104 None None] vault.approle_secret_id = **** {{(pid=75486) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 14:35:03 devstack cinder-volume[75486]: DEBUG oslo_service.backend._eventlet.service [None req-7a316aef-88c3-4ae0-9259-a0a05b655104 None None] vault.kv_mountpoint = secret {{(pid=75486) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 14:35:03 devstack cinder-volume[75486]: DEBUG oslo_service.backend._eventlet.service [None req-7a316aef-88c3-4ae0-9259-a0a05b655104 None None] vault.kv_path = None {{(pid=75486) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 14:35:03 devstack cinder-volume[75486]: DEBUG oslo_service.backend._eventlet.service [None req-7a316aef-88c3-4ae0-9259-a0a05b655104 None None] vault.kv_version = 2 {{(pid=75486) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 14:35:03 devstack cinder-volume[75486]: DEBUG oslo_service.backend._eventlet.service [None req-7a316aef-88c3-4ae0-9259-a0a05b655104 None None] vault.namespace = None {{(pid=75486) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 14:35:03 devstack cinder-volume[75486]: DEBUG oslo_service.backend._eventlet.service [None req-7a316aef-88c3-4ae0-9259-a0a05b655104 None None] vault.root_token_id = **** {{(pid=75486) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 14:35:03 devstack cinder-volume[75486]: DEBUG oslo_service.backend._eventlet.service [None req-7a316aef-88c3-4ae0-9259-a0a05b655104 None None] vault.ssl_ca_crt_file = None {{(pid=75486) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 14:35:03 devstack cinder-volume[75486]: DEBUG oslo_service.backend._eventlet.service [None req-7a316aef-88c3-4ae0-9259-a0a05b655104 None None] vault.timeout = 60.0 {{(pid=75486) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 14:35:03 devstack cinder-volume[75486]: DEBUG oslo_service.backend._eventlet.service [None req-7a316aef-88c3-4ae0-9259-a0a05b655104 None None] vault.use_ssl = False {{(pid=75486) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 14:35:03 devstack cinder-volume[75486]: DEBUG oslo_service.backend._eventlet.service [None req-7a316aef-88c3-4ae0-9259-a0a05b655104 None None] vault.vault_url = http://127.0.0.1:8200 {{(pid=75486) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 14:35:03 devstack cinder-volume[75486]: DEBUG oslo_service.backend._eventlet.service [None req-7a316aef-88c3-4ae0-9259-a0a05b655104 None None] ******************************************************************************** {{(pid=75486) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2828}} Sep 16 14:35:03 devstack cinder-volume[75623]: DEBUG oslo_concurrency.processutils [None req-16af0d3d-76b6-4744-8c19-2d17a64c8b0c None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.178s {{(pid=75623) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 14:35:03 devstack cinder-volume[75623]: DEBUG oslo_concurrency.processutils [None req-16af0d3d-76b6-4744-8c19-2d17a64c8b0c None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=75623) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 14:35:03 devstack cinder-volume[75623]: DEBUG oslo_concurrency.processutils [None req-16af0d3d-76b6-4744-8c19-2d17a64c8b0c None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.091s {{(pid=75623) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 14:35:03 devstack cinder-volume[75623]: DEBUG oslo_concurrency.processutils [None req-16af0d3d-76b6-4744-8c19-2d17a64c8b0c None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=75623) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 14:35:03 devstack cinder-volume[75623]: DEBUG oslo_concurrency.processutils [None req-16af0d3d-76b6-4744-8c19-2d17a64c8b0c None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.086s {{(pid=75623) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 14:35:03 devstack cinder-volume[75623]: DEBUG oslo_concurrency.processutils [None req-16af0d3d-76b6-4744-8c19-2d17a64c8b0c None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings -o name stack-volumes-lvmdriver-1 {{(pid=75623) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 14:35:03 devstack sudo[75677]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings -o name stack-volumes-lvmdriver-1 Sep 16 14:35:03 devstack sudo[75677]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 14:35:05 devstack sudo[75677]: pam_unix(sudo:session): session closed for user root Sep 16 14:35:05 devstack cinder-volume[75623]: DEBUG oslo_concurrency.processutils [None req-16af0d3d-76b6-4744-8c19-2d17a64c8b0c None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings -o name stack-volumes-lvmdriver-1" returned: 0 in 2.028s {{(pid=75623) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 14:35:05 devstack cinder-volume[75623]: DEBUG oslo_concurrency.processutils [None req-16af0d3d-76b6-4744-8c19-2d17a64c8b0c None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75623) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 14:35:05 devstack sudo[75790]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Sep 16 14:35:05 devstack sudo[75790]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 14:35:07 devstack sudo[75790]: pam_unix(sudo:session): session closed for user root Sep 16 14:35:07 devstack cinder-volume[75623]: DEBUG oslo_concurrency.processutils [None req-16af0d3d-76b6-4744-8c19-2d17a64c8b0c None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 5 in 1.961s {{(pid=75623) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 14:35:07 devstack cinder-volume[75623]: DEBUG oslo_concurrency.processutils [None req-16af0d3d-76b6-4744-8c19-2d17a64c8b0c None None] 'sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool' failed. Not Retrying. {{(pid=75623) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:423}} Sep 16 14:35:07 devstack cinder-volume[75623]: INFO cinder.brick.local_dev.lvm [None req-16af0d3d-76b6-4744-8c19-2d17a64c8b0c None None] Logical Volume not found when querying LVM info. (vg_name=stack-volumes-lvmdriver-1, lv_name=stack-volumes-lvmdriver-1-pool Sep 16 14:35:07 devstack cinder-volume[75623]: DEBUG oslo_concurrency.processutils [None req-16af0d3d-76b6-4744-8c19-2d17a64c8b0c None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=75623) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 14:35:07 devstack cinder-volume[75623]: DEBUG oslo_concurrency.processutils [None req-16af0d3d-76b6-4744-8c19-2d17a64c8b0c None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.084s {{(pid=75623) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 14:35:07 devstack cinder-volume[75623]: DEBUG oslo_concurrency.processutils [None req-16af0d3d-76b6-4744-8c19-2d17a64c8b0c None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=75623) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 14:35:07 devstack sudo[75893]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Sep 16 14:35:07 devstack sudo[75893]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 14:35:09 devstack sudo[75893]: pam_unix(sudo:session): session closed for user root Sep 16 14:35:09 devstack cinder-volume[75623]: DEBUG oslo_concurrency.processutils [None req-16af0d3d-76b6-4744-8c19-2d17a64c8b0c None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 1.910s {{(pid=75623) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 14:35:09 devstack cinder-volume[75623]: DEBUG cinder.brick.local_dev.lvm [None req-16af0d3d-76b6-4744-8c19-2d17a64c8b0c None None] Creating thin pool 'stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool' with size 28.5g of total 30.0g {{(pid=75623) create_thin_pool /opt/stack/cinder/cinder/brick/local_dev/lvm.py:550}} Sep 16 14:35:09 devstack cinder-volume[75623]: DEBUG oslo_concurrency.processutils [None req-16af0d3d-76b6-4744-8c19-2d17a64c8b0c None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -T -L 28.5g stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75623) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 14:35:09 devstack sudo[75983]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -T -L 28.5g stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Sep 16 14:35:09 devstack sudo[75983]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 14:35:12 devstack cinder-volume[75486]: DEBUG dbcounter [-] [75486] Writing DB stats cinder:SELECT=8,cinder:INSERT=1,cinder:UPDATE=1 {{(pid=75486) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Sep 16 14:35:13 devstack sudo[75983]: pam_unix(sudo:session): session closed for user root Sep 16 14:35:13 devstack cinder-volume[75623]: DEBUG oslo_concurrency.processutils [None req-16af0d3d-76b6-4744-8c19-2d17a64c8b0c None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -T -L 28.5g stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 3.570s {{(pid=75623) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 14:35:13 devstack cinder-volume[75623]: DEBUG oslo_concurrency.processutils [None req-16af0d3d-76b6-4744-8c19-2d17a64c8b0c None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=75623) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 14:35:13 devstack cinder-volume[75623]: DEBUG oslo_concurrency.processutils [None req-16af0d3d-76b6-4744-8c19-2d17a64c8b0c None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.092s {{(pid=75623) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 14:35:13 devstack cinder-volume[75623]: DEBUG oslo_concurrency.processutils [None req-16af0d3d-76b6-4744-8c19-2d17a64c8b0c None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75623) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 14:35:13 devstack sudo[76184]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Sep 16 14:35:13 devstack sudo[76184]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 14:35:15 devstack sudo[76184]: pam_unix(sudo:session): session closed for user root Sep 16 14:35:15 devstack cinder-volume[75623]: DEBUG oslo_concurrency.processutils [None req-16af0d3d-76b6-4744-8c19-2d17a64c8b0c None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 2.016s {{(pid=75623) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 14:35:15 devstack cinder-volume[75623]: DEBUG oslo_concurrency.processutils [None req-16af0d3d-76b6-4744-8c19-2d17a64c8b0c None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=75623) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 14:35:15 devstack cinder-volume[75623]: DEBUG oslo_concurrency.processutils [None req-16af0d3d-76b6-4744-8c19-2d17a64c8b0c None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.073s {{(pid=75623) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 14:35:15 devstack cinder-volume[75623]: DEBUG oslo_concurrency.processutils [None req-16af0d3d-76b6-4744-8c19-2d17a64c8b0c None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C pvs --noheadings --unit=g -o vg_name,name,size,free --separator | --nosuffix --ignoreskippedcluster {{(pid=75623) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 14:35:15 devstack sudo[76221]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C pvs --noheadings --unit=g -o vg_name,name,size,free --separator | --nosuffix --ignoreskippedcluster Sep 16 14:35:15 devstack sudo[76221]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 14:35:17 devstack sudo[76221]: pam_unix(sudo:session): session closed for user root Sep 16 14:35:17 devstack cinder-volume[75623]: DEBUG oslo_concurrency.processutils [None req-16af0d3d-76b6-4744-8c19-2d17a64c8b0c None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C pvs --noheadings --unit=g -o vg_name,name,size,free --separator | --nosuffix --ignoreskippedcluster" returned: 0 in 2.075s {{(pid=75623) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 14:35:17 devstack cinder-volume[75623]: DEBUG oslo_concurrency.processutils [None req-16af0d3d-76b6-4744-8c19-2d17a64c8b0c None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=75623) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 14:35:17 devstack sudo[76250]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Sep 16 14:35:17 devstack sudo[76250]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 14:35:20 devstack sudo[76250]: pam_unix(sudo:session): session closed for user root Sep 16 14:35:20 devstack cinder-volume[75623]: DEBUG oslo_concurrency.processutils [None req-16af0d3d-76b6-4744-8c19-2d17a64c8b0c None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 2.771s {{(pid=75623) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 14:35:20 devstack cinder-volume[75623]: DEBUG oslo_concurrency.processutils [None req-16af0d3d-76b6-4744-8c19-2d17a64c8b0c None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=75623) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 14:35:20 devstack sudo[76313]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Sep 16 14:35:20 devstack sudo[76313]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 14:35:23 devstack sudo[76313]: pam_unix(sudo:session): session closed for user root Sep 16 14:35:23 devstack cinder-volume[75623]: DEBUG oslo_concurrency.processutils [None req-16af0d3d-76b6-4744-8c19-2d17a64c8b0c None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 2.650s {{(pid=75623) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 14:35:23 devstack cinder-volume[75623]: DEBUG oslo_concurrency.processutils [None req-16af0d3d-76b6-4744-8c19-2d17a64c8b0c None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75623) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 14:35:23 devstack sudo[76318]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 16 14:35:23 devstack sudo[76318]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 14:35:26 devstack sudo[76318]: pam_unix(sudo:session): session closed for user root Sep 16 14:35:26 devstack cinder-volume[75623]: DEBUG oslo_concurrency.processutils [None req-16af0d3d-76b6-4744-8c19-2d17a64c8b0c None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 2.858s {{(pid=75623) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 14:35:26 devstack cinder-volume[75623]: DEBUG oslo_concurrency.processutils [None req-16af0d3d-76b6-4744-8c19-2d17a64c8b0c None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75623) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 14:35:26 devstack sudo[76323]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Sep 16 14:35:26 devstack sudo[76323]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 14:35:28 devstack sudo[76323]: pam_unix(sudo:session): session closed for user root Sep 16 14:35:28 devstack cinder-volume[75623]: DEBUG oslo_concurrency.processutils [None req-16af0d3d-76b6-4744-8c19-2d17a64c8b0c None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 2.666s {{(pid=75623) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 14:35:28 devstack cinder-volume[75623]: DEBUG oslo_concurrency.processutils [None req-16af0d3d-76b6-4744-8c19-2d17a64c8b0c None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=75623) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 14:35:28 devstack cinder-volume[75623]: DEBUG oslo_concurrency.processutils [None req-16af0d3d-76b6-4744-8c19-2d17a64c8b0c None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.112s {{(pid=75623) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 14:35:28 devstack cinder-volume[75623]: DEBUG oslo_concurrency.processutils [None req-16af0d3d-76b6-4744-8c19-2d17a64c8b0c None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75623) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 14:35:29 devstack sudo[76361]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Sep 16 14:35:29 devstack sudo[76361]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 14:35:31 devstack sudo[76361]: pam_unix(sudo:session): session closed for user root Sep 16 14:35:31 devstack cinder-volume[75623]: DEBUG oslo_concurrency.processutils [None req-16af0d3d-76b6-4744-8c19-2d17a64c8b0c None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 2.109s {{(pid=75623) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 14:35:31 devstack cinder-volume[75623]: INFO cinder.volume.drivers.lvm [None req-16af0d3d-76b6-4744-8c19-2d17a64c8b0c None None] Enabling LVM thin provisioning by default because a thin pool exists. Sep 16 14:35:31 devstack cinder-volume[75623]: DEBUG oslo_concurrency.processutils [None req-16af0d3d-76b6-4744-8c19-2d17a64c8b0c None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=75623) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 14:35:31 devstack cinder-volume[75623]: DEBUG oslo_concurrency.processutils [None req-16af0d3d-76b6-4744-8c19-2d17a64c8b0c None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.088s {{(pid=75623) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 14:35:31 devstack cinder-volume[75623]: DEBUG oslo_concurrency.processutils [None req-16af0d3d-76b6-4744-8c19-2d17a64c8b0c None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75623) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 14:35:31 devstack sudo[76465]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Sep 16 14:35:31 devstack sudo[76465]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 14:35:33 devstack sudo[76465]: pam_unix(sudo:session): session closed for user root Sep 16 14:35:33 devstack cinder-volume[75623]: DEBUG oslo_concurrency.processutils [None req-16af0d3d-76b6-4744-8c19-2d17a64c8b0c None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 1.918s {{(pid=75623) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 14:35:33 devstack cinder-volume[75623]: DEBUG cinder.volume.drivers.lvm [None req-16af0d3d-76b6-4744-8c19-2d17a64c8b0c None None] Updating volume stats {{(pid=75623) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:227}} Sep 16 14:35:33 devstack cinder-volume[75623]: DEBUG oslo_concurrency.processutils [None req-16af0d3d-76b6-4744-8c19-2d17a64c8b0c None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=75623) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 14:35:33 devstack sudo[76548]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Sep 16 14:35:33 devstack sudo[76548]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 14:35:35 devstack sudo[76548]: pam_unix(sudo:session): session closed for user root Sep 16 14:35:35 devstack cinder-volume[75623]: DEBUG oslo_concurrency.processutils [None req-16af0d3d-76b6-4744-8c19-2d17a64c8b0c None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 2.034s {{(pid=75623) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 14:35:35 devstack cinder-volume[75623]: DEBUG oslo_concurrency.processutils [None req-16af0d3d-76b6-4744-8c19-2d17a64c8b0c None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75623) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 14:35:35 devstack sudo[76632]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 16 14:35:35 devstack sudo[76632]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 14:35:37 devstack sudo[76632]: pam_unix(sudo:session): session closed for user root Sep 16 14:35:37 devstack cinder-volume[75623]: DEBUG oslo_concurrency.processutils [None req-16af0d3d-76b6-4744-8c19-2d17a64c8b0c None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 1.922s {{(pid=75623) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 14:35:37 devstack cinder-volume[75623]: DEBUG oslo_concurrency.processutils [None req-16af0d3d-76b6-4744-8c19-2d17a64c8b0c None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75623) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 14:35:37 devstack sudo[76635]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Sep 16 14:35:37 devstack sudo[76635]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 14:35:39 devstack sudo[76635]: pam_unix(sudo:session): session closed for user root Sep 16 14:35:39 devstack cinder-volume[75623]: DEBUG oslo_concurrency.processutils [None req-16af0d3d-76b6-4744-8c19-2d17a64c8b0c None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 2.092s {{(pid=75623) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 14:35:39 devstack cinder-volume[75623]: DEBUG oslo_concurrency.processutils [None req-16af0d3d-76b6-4744-8c19-2d17a64c8b0c None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75623) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 14:35:39 devstack sudo[76639]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 16 14:35:39 devstack sudo[76639]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 14:35:41 devstack sudo[76639]: pam_unix(sudo:session): session closed for user root Sep 16 14:35:41 devstack cinder-volume[75623]: DEBUG oslo_concurrency.processutils [None req-16af0d3d-76b6-4744-8c19-2d17a64c8b0c None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 2.052s {{(pid=75623) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 14:35:41 devstack cinder-volume[75623]: INFO cinder.volume.driver [None req-16af0d3d-76b6-4744-8c19-2d17a64c8b0c None None] Driver hasn't implemented _init_vendor_properties() Sep 16 14:35:41 devstack cinder-volume[75623]: DEBUG cinder.volume.driver [None req-16af0d3d-76b6-4744-8c19-2d17a64c8b0c None None] Initialized capabilities list: {'volume_backend_name': 'lvmdriver-1', 'vendor_name': 'Open Source', 'driver_version': '3.0.0', 'storage_protocol': 'iSCSI', 'pools': [{'pool_name': 'lvmdriver-1', 'total_capacity_gb': 28.5, 'free_capacity_gb': 28.5, 'reserved_percentage': 0, 'location_info': 'LVMVolumeDriver:devstack:stack-volumes-lvmdriver-1:thin:0', 'QoS_support': False, 'provisioned_capacity_gb': 0.0, 'max_over_subscription_ratio': '20.0', 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'total_volumes': 1, 'filter_function': None, 'goodness_function': None, 'multiattach': True, 'backend_state': 'up'}], 'shared_targets': False, 'sparse_copy_volume': True, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=75623) init_capabilities /opt/stack/cinder/cinder/volume/driver.py:860}} Sep 16 14:35:41 devstack cinder-volume[75623]: DEBUG oslo_db.sqlalchemy.engines [None req-16af0d3d-76b6-4744-8c19-2d17a64c8b0c None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=75623) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.10/site-packages/oslo_db/sqlalchemy/engines.py:397}} Sep 16 14:35:41 devstack cinder-volume[75623]: DEBUG dbcounter [-] [75623] Writer thread running {{(pid=75623) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:102}} Sep 16 14:35:41 devstack cinder-volume[75623]: DEBUG cinder.db.sqlalchemy.api [None req-16af0d3d-76b6-4744-8c19-2d17a64c8b0c None None] Building query based on filter {{(pid=75623) _process_snaps_filters /opt/stack/cinder/cinder/db/sqlalchemy/api.py:3917}} Sep 16 14:35:41 devstack cinder-volume[75623]: DEBUG cinder.image.image_utils [None req-16af0d3d-76b6-4744-8c19-2d17a64c8b0c None None] Configuration image_conversion_dir is None or the path doesn't exist. {{(pid=75623) cleanup_temporary_file /opt/stack/cinder/cinder/image/image_utils.py:1266}} Sep 16 14:35:41 devstack cinder-volume[75623]: INFO cinder.keymgr.migration [None req-c928857f-bd4b-4624-a98d-140685af8ff7 None None] Not migrating encryption keys because the ConfKeyManager is still in use. Sep 16 14:35:41 devstack cinder-volume[75623]: DEBUG cinder.volume.drivers.lvm [None req-16af0d3d-76b6-4744-8c19-2d17a64c8b0c None None] Updating volume stats {{(pid=75623) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:227}} Sep 16 14:35:41 devstack cinder-volume[75623]: DEBUG oslo_concurrency.processutils [None req-16af0d3d-76b6-4744-8c19-2d17a64c8b0c None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=75623) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 14:35:41 devstack sudo[76647]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Sep 16 14:35:41 devstack sudo[76647]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 14:35:43 devstack sudo[76647]: pam_unix(sudo:session): session closed for user root Sep 16 14:35:43 devstack cinder-volume[75623]: DEBUG oslo_concurrency.processutils [None req-16af0d3d-76b6-4744-8c19-2d17a64c8b0c None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 1.955s {{(pid=75623) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 14:35:43 devstack cinder-volume[75623]: DEBUG oslo_concurrency.processutils [None req-16af0d3d-76b6-4744-8c19-2d17a64c8b0c None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75623) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 14:35:43 devstack sudo[76693]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 16 14:35:43 devstack sudo[76693]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 14:35:45 devstack sudo[76693]: pam_unix(sudo:session): session closed for user root Sep 16 14:35:45 devstack cinder-volume[75623]: DEBUG oslo_concurrency.processutils [None req-16af0d3d-76b6-4744-8c19-2d17a64c8b0c None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 2.017s {{(pid=75623) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 14:35:45 devstack cinder-volume[75623]: DEBUG oslo_concurrency.processutils [None req-16af0d3d-76b6-4744-8c19-2d17a64c8b0c None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75623) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 14:35:45 devstack sudo[76793]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Sep 16 14:35:45 devstack sudo[76793]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 14:35:47 devstack sudo[76793]: pam_unix(sudo:session): session closed for user root Sep 16 14:35:47 devstack cinder-volume[75623]: DEBUG oslo_concurrency.processutils [None req-16af0d3d-76b6-4744-8c19-2d17a64c8b0c None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 2.049s {{(pid=75623) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 14:35:47 devstack cinder-volume[75623]: DEBUG oslo_concurrency.processutils [None req-16af0d3d-76b6-4744-8c19-2d17a64c8b0c None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75623) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 14:35:47 devstack sudo[76796]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 16 14:35:47 devstack sudo[76796]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 14:35:49 devstack sudo[76796]: pam_unix(sudo:session): session closed for user root Sep 16 14:35:49 devstack cinder-volume[75623]: DEBUG oslo_concurrency.processutils [None req-16af0d3d-76b6-4744-8c19-2d17a64c8b0c None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 1.954s {{(pid=75623) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 14:35:49 devstack cinder-volume[75623]: DEBUG cinder.manager [None req-16af0d3d-76b6-4744-8c19-2d17a64c8b0c None None] Notifying Schedulers of capabilities ... {{(pid=75623) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 16 14:35:49 devstack cinder-volume[75623]: INFO cinder.volume.manager [None req-16af0d3d-76b6-4744-8c19-2d17a64c8b0c None None] Driver initialization completed successfully. Sep 16 14:35:50 devstack cinder-volume[75623]: INFO cinder.manager [None req-16af0d3d-76b6-4744-8c19-2d17a64c8b0c None None] Initiating service 2 cleanup Sep 16 14:35:50 devstack cinder-volume[75623]: INFO cinder.manager [None req-16af0d3d-76b6-4744-8c19-2d17a64c8b0c None None] Service 2 cleanup completed. Sep 16 14:35:50 devstack cinder-volume[75623]: DEBUG cinder.service [None req-16af0d3d-76b6-4744-8c19-2d17a64c8b0c None None] Creating RPC server for service cinder-volume {{(pid=75623) start /opt/stack/cinder/cinder/service.py:239}} Sep 16 14:35:50 devstack cinder-volume[75623]: DEBUG cinder.service [None req-16af0d3d-76b6-4744-8c19-2d17a64c8b0c None None] Pinning object versions for RPC server serializer to 1.39 {{(pid=75623) start /opt/stack/cinder/cinder/service.py:245}} Sep 16 14:35:50 devstack cinder-volume[75623]: INFO cinder.volume.manager [None req-16af0d3d-76b6-4744-8c19-2d17a64c8b0c None None] Initializing RPC dependent components of volume driver LVMVolumeDriver (3.0.0) Sep 16 14:35:50 devstack cinder-volume[75623]: DEBUG cinder.volume.drivers.lvm [None req-16af0d3d-76b6-4744-8c19-2d17a64c8b0c None None] Updating volume stats {{(pid=75623) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:227}} Sep 16 14:35:50 devstack cinder-volume[75623]: DEBUG oslo_concurrency.processutils [None req-16af0d3d-76b6-4744-8c19-2d17a64c8b0c None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=75623) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 14:35:50 devstack sudo[76800]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Sep 16 14:35:50 devstack sudo[76800]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 14:35:52 devstack sudo[76800]: pam_unix(sudo:session): session closed for user root Sep 16 14:35:52 devstack cinder-volume[75623]: DEBUG oslo_concurrency.processutils [None req-16af0d3d-76b6-4744-8c19-2d17a64c8b0c None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 2.141s {{(pid=75623) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 14:35:52 devstack cinder-volume[75623]: DEBUG oslo_concurrency.processutils [None req-16af0d3d-76b6-4744-8c19-2d17a64c8b0c None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75623) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 14:35:52 devstack sudo[76809]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 16 14:35:52 devstack sudo[76809]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 14:35:54 devstack sudo[76809]: pam_unix(sudo:session): session closed for user root Sep 16 14:35:55 devstack cinder-volume[75623]: DEBUG oslo_concurrency.processutils [None req-16af0d3d-76b6-4744-8c19-2d17a64c8b0c None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 2.473s {{(pid=75623) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 14:35:55 devstack cinder-volume[75623]: DEBUG oslo_concurrency.processutils [None req-16af0d3d-76b6-4744-8c19-2d17a64c8b0c None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75623) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 14:35:55 devstack sudo[76812]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Sep 16 14:35:55 devstack sudo[76812]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 14:35:57 devstack sudo[76812]: pam_unix(sudo:session): session closed for user root Sep 16 14:35:57 devstack cinder-volume[75623]: DEBUG oslo_concurrency.processutils [None req-16af0d3d-76b6-4744-8c19-2d17a64c8b0c None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 2.067s {{(pid=75623) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 14:35:57 devstack cinder-volume[75623]: DEBUG oslo_concurrency.processutils [None req-16af0d3d-76b6-4744-8c19-2d17a64c8b0c None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75623) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 14:35:57 devstack sudo[76819]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 16 14:35:57 devstack sudo[76819]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 14:35:58 devstack sudo[76819]: pam_unix(sudo:session): session closed for user root Sep 16 14:35:58 devstack cinder-volume[75623]: DEBUG oslo_concurrency.processutils [None req-16af0d3d-76b6-4744-8c19-2d17a64c8b0c None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 1.787s {{(pid=75623) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 14:35:59 devstack cinder-volume[75623]: INFO cinder.volume.manager [None req-16af0d3d-76b6-4744-8c19-2d17a64c8b0c None None] Driver post RPC initialization completed successfully. Sep 16 14:36:09 devstack cinder-volume[75623]: DEBUG dbcounter [-] [75623] Writing DB stats cinder:SELECT=11,cinder:INSERT=1,cinder:UPDATE=1 {{(pid=75623) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Sep 16 14:36:09 devstack cinder-volume[75623]: DEBUG dbcounter [-] [75623] Writing DB stats cinder:SELECT=3,cinder:UPDATE=1 {{(pid=75623) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Sep 16 14:36:12 devstack cinder-volume[75623]: DEBUG oslo_service.periodic_task [None req-32d22f4f-4327-4239-ba1a-e36615b7ed5e None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=75623) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} Sep 16 14:36:12 devstack cinder-volume[75623]: DEBUG cinder.volume.drivers.lvm [None req-32d22f4f-4327-4239-ba1a-e36615b7ed5e None None] Updating volume stats {{(pid=75623) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:227}} Sep 16 14:36:12 devstack cinder-volume[75623]: DEBUG oslo_concurrency.processutils [None req-32d22f4f-4327-4239-ba1a-e36615b7ed5e None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=75623) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 14:36:12 devstack sudo[77116]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Sep 16 14:36:12 devstack sudo[77116]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 14:36:14 devstack sudo[77116]: pam_unix(sudo:session): session closed for user root Sep 16 14:36:14 devstack cinder-volume[75623]: DEBUG oslo_concurrency.processutils [None req-32d22f4f-4327-4239-ba1a-e36615b7ed5e None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 1.896s {{(pid=75623) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 14:36:14 devstack cinder-volume[75623]: DEBUG oslo_concurrency.processutils [None req-32d22f4f-4327-4239-ba1a-e36615b7ed5e None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75623) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 14:36:14 devstack sudo[77192]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 16 14:36:14 devstack sudo[77192]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 14:36:16 devstack sudo[77192]: pam_unix(sudo:session): session closed for user root Sep 16 14:36:16 devstack cinder-volume[75623]: DEBUG oslo_concurrency.processutils [None req-32d22f4f-4327-4239-ba1a-e36615b7ed5e None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 1.933s {{(pid=75623) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 14:36:16 devstack cinder-volume[75623]: DEBUG oslo_concurrency.processutils [None req-32d22f4f-4327-4239-ba1a-e36615b7ed5e None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75623) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 14:36:16 devstack sudo[77304]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Sep 16 14:36:16 devstack sudo[77304]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 14:36:17 devstack sudo[77304]: pam_unix(sudo:session): session closed for user root Sep 16 14:36:18 devstack cinder-volume[75623]: DEBUG oslo_concurrency.processutils [None req-32d22f4f-4327-4239-ba1a-e36615b7ed5e None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 1.924s {{(pid=75623) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 14:36:18 devstack cinder-volume[75623]: DEBUG oslo_concurrency.processutils [None req-32d22f4f-4327-4239-ba1a-e36615b7ed5e None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75623) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 14:36:18 devstack sudo[77404]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 16 14:36:18 devstack sudo[77404]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 14:36:19 devstack sudo[77404]: pam_unix(sudo:session): session closed for user root Sep 16 14:36:19 devstack cinder-volume[75623]: DEBUG oslo_concurrency.processutils [None req-32d22f4f-4327-4239-ba1a-e36615b7ed5e None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 1.907s {{(pid=75623) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 14:36:19 devstack cinder-volume[75623]: DEBUG cinder.manager [None req-32d22f4f-4327-4239-ba1a-e36615b7ed5e None None] Notifying Schedulers of capabilities ... {{(pid=75623) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 16 14:37:12 devstack cinder-volume[75623]: DEBUG oslo_service.periodic_task [None req-32d22f4f-4327-4239-ba1a-e36615b7ed5e None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=75623) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} Sep 16 14:37:12 devstack cinder-volume[75623]: DEBUG cinder.volume.drivers.lvm [None req-32d22f4f-4327-4239-ba1a-e36615b7ed5e None None] Updating volume stats {{(pid=75623) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:227}} Sep 16 14:37:12 devstack cinder-volume[75623]: DEBUG oslo_concurrency.processutils [None req-32d22f4f-4327-4239-ba1a-e36615b7ed5e None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=75623) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 14:37:12 devstack sudo[78207]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Sep 16 14:37:12 devstack sudo[78207]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 14:37:14 devstack sudo[78207]: pam_unix(sudo:session): session closed for user root Sep 16 14:37:14 devstack cinder-volume[75623]: DEBUG oslo_concurrency.processutils [None req-32d22f4f-4327-4239-ba1a-e36615b7ed5e None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 1.936s {{(pid=75623) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 14:37:14 devstack cinder-volume[75623]: DEBUG oslo_concurrency.processutils [None req-32d22f4f-4327-4239-ba1a-e36615b7ed5e None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75623) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 14:37:14 devstack sudo[78212]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 16 14:37:14 devstack sudo[78212]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 14:37:16 devstack sudo[78212]: pam_unix(sudo:session): session closed for user root Sep 16 14:37:16 devstack cinder-volume[75623]: DEBUG oslo_concurrency.processutils [None req-32d22f4f-4327-4239-ba1a-e36615b7ed5e None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 2.100s {{(pid=75623) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 14:37:16 devstack cinder-volume[75623]: DEBUG oslo_concurrency.processutils [None req-32d22f4f-4327-4239-ba1a-e36615b7ed5e None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75623) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 14:37:16 devstack sudo[78218]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Sep 16 14:37:16 devstack sudo[78218]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 14:37:18 devstack sudo[78218]: pam_unix(sudo:session): session closed for user root Sep 16 14:37:18 devstack cinder-volume[75623]: DEBUG oslo_concurrency.processutils [None req-32d22f4f-4327-4239-ba1a-e36615b7ed5e None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 1.887s {{(pid=75623) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 14:37:18 devstack cinder-volume[75623]: DEBUG oslo_concurrency.processutils [None req-32d22f4f-4327-4239-ba1a-e36615b7ed5e None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75623) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 14:37:18 devstack sudo[78222]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 16 14:37:18 devstack sudo[78222]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 14:37:20 devstack sudo[78222]: pam_unix(sudo:session): session closed for user root Sep 16 14:37:20 devstack cinder-volume[75623]: DEBUG oslo_concurrency.processutils [None req-32d22f4f-4327-4239-ba1a-e36615b7ed5e None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 1.903s {{(pid=75623) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 14:37:20 devstack cinder-volume[75623]: DEBUG cinder.manager [None req-32d22f4f-4327-4239-ba1a-e36615b7ed5e None None] Notifying Schedulers of capabilities ... {{(pid=75623) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 16 14:38:09 devstack cinder-volume[75623]: DEBUG dbcounter [-] [75623] Writing DB stats cinder:SELECT=1 {{(pid=75623) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Sep 16 14:38:09 devstack cinder-volume[75623]: DEBUG dbcounter [-] [75623] Writing DB stats cinder:UPDATE=1 {{(pid=75623) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Sep 16 14:38:12 devstack cinder-volume[75623]: DEBUG oslo_service.periodic_task [None req-32d22f4f-4327-4239-ba1a-e36615b7ed5e None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=75623) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} Sep 16 14:38:12 devstack cinder-volume[75623]: DEBUG cinder.volume.drivers.lvm [None req-32d22f4f-4327-4239-ba1a-e36615b7ed5e None None] Updating volume stats {{(pid=75623) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:227}} Sep 16 14:38:12 devstack cinder-volume[75623]: DEBUG oslo_concurrency.processutils [None req-32d22f4f-4327-4239-ba1a-e36615b7ed5e None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=75623) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 14:38:12 devstack sudo[79159]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Sep 16 14:38:12 devstack sudo[79159]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 14:38:14 devstack sudo[79159]: pam_unix(sudo:session): session closed for user root Sep 16 14:38:14 devstack cinder-volume[75623]: DEBUG oslo_concurrency.processutils [None req-32d22f4f-4327-4239-ba1a-e36615b7ed5e None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 1.972s {{(pid=75623) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 14:38:14 devstack cinder-volume[75623]: DEBUG oslo_concurrency.processutils [None req-32d22f4f-4327-4239-ba1a-e36615b7ed5e None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75623) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 14:38:14 devstack sudo[79162]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 16 14:38:14 devstack sudo[79162]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 14:38:16 devstack sudo[79162]: pam_unix(sudo:session): session closed for user root Sep 16 14:38:16 devstack cinder-volume[75623]: DEBUG oslo_concurrency.processutils [None req-32d22f4f-4327-4239-ba1a-e36615b7ed5e None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 1.974s {{(pid=75623) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 14:38:16 devstack cinder-volume[75623]: DEBUG oslo_concurrency.processutils [None req-32d22f4f-4327-4239-ba1a-e36615b7ed5e None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75623) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 14:38:16 devstack sudo[79165]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Sep 16 14:38:16 devstack sudo[79165]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 14:38:18 devstack sudo[79165]: pam_unix(sudo:session): session closed for user root Sep 16 14:38:18 devstack cinder-volume[75623]: DEBUG oslo_concurrency.processutils [None req-32d22f4f-4327-4239-ba1a-e36615b7ed5e None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 1.973s {{(pid=75623) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 14:38:18 devstack cinder-volume[75623]: DEBUG oslo_concurrency.processutils [None req-32d22f4f-4327-4239-ba1a-e36615b7ed5e None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75623) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 14:38:18 devstack sudo[79195]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 16 14:38:18 devstack sudo[79195]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 14:38:20 devstack sudo[79195]: pam_unix(sudo:session): session closed for user root Sep 16 14:38:20 devstack cinder-volume[75623]: DEBUG oslo_concurrency.processutils [None req-32d22f4f-4327-4239-ba1a-e36615b7ed5e None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 1.949s {{(pid=75623) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 14:38:20 devstack cinder-volume[75623]: DEBUG cinder.manager [None req-32d22f4f-4327-4239-ba1a-e36615b7ed5e None None] Notifying Schedulers of capabilities ... {{(pid=75623) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 16 14:39:12 devstack cinder-volume[75623]: DEBUG oslo_service.periodic_task [None req-32d22f4f-4327-4239-ba1a-e36615b7ed5e None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=75623) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} Sep 16 14:39:12 devstack cinder-volume[75623]: DEBUG cinder.volume.drivers.lvm [None req-32d22f4f-4327-4239-ba1a-e36615b7ed5e None None] Updating volume stats {{(pid=75623) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:227}} Sep 16 14:39:12 devstack cinder-volume[75623]: DEBUG oslo_concurrency.processutils [None req-32d22f4f-4327-4239-ba1a-e36615b7ed5e None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=75623) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 14:39:12 devstack sudo[81717]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Sep 16 14:39:12 devstack sudo[81717]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 14:39:14 devstack sudo[81717]: pam_unix(sudo:session): session closed for user root Sep 16 14:39:14 devstack cinder-volume[75623]: DEBUG oslo_concurrency.processutils [None req-32d22f4f-4327-4239-ba1a-e36615b7ed5e None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 1.940s {{(pid=75623) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 14:39:14 devstack cinder-volume[75623]: DEBUG oslo_concurrency.processutils [None req-32d22f4f-4327-4239-ba1a-e36615b7ed5e None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75623) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 14:39:14 devstack sudo[81720]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 16 14:39:14 devstack sudo[81720]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 14:39:16 devstack sudo[81720]: pam_unix(sudo:session): session closed for user root Sep 16 14:39:16 devstack cinder-volume[75623]: DEBUG oslo_concurrency.processutils [None req-32d22f4f-4327-4239-ba1a-e36615b7ed5e None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 1.829s {{(pid=75623) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 14:39:16 devstack cinder-volume[75623]: DEBUG oslo_concurrency.processutils [None req-32d22f4f-4327-4239-ba1a-e36615b7ed5e None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75623) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 14:39:16 devstack sudo[81723]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Sep 16 14:39:16 devstack sudo[81723]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 14:39:17 devstack sudo[81723]: pam_unix(sudo:session): session closed for user root Sep 16 14:39:17 devstack cinder-volume[75623]: DEBUG oslo_concurrency.processutils [None req-32d22f4f-4327-4239-ba1a-e36615b7ed5e None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 1.748s {{(pid=75623) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 14:39:17 devstack cinder-volume[75623]: DEBUG oslo_concurrency.processutils [None req-32d22f4f-4327-4239-ba1a-e36615b7ed5e None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75623) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 14:39:17 devstack sudo[81726]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 16 14:39:17 devstack sudo[81726]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 14:39:19 devstack sudo[81726]: pam_unix(sudo:session): session closed for user root Sep 16 14:39:19 devstack cinder-volume[75623]: DEBUG oslo_concurrency.processutils [None req-32d22f4f-4327-4239-ba1a-e36615b7ed5e None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 1.793s {{(pid=75623) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 14:39:19 devstack cinder-volume[75623]: DEBUG cinder.manager [None req-32d22f4f-4327-4239-ba1a-e36615b7ed5e None None] Notifying Schedulers of capabilities ... {{(pid=75623) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 16 14:40:09 devstack cinder-volume[75623]: DEBUG dbcounter [-] [75623] Writing DB stats cinder:SELECT=1,cinder:UPDATE=1 {{(pid=75623) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Sep 16 14:40:12 devstack cinder-volume[75623]: DEBUG oslo_service.periodic_task [None req-32d22f4f-4327-4239-ba1a-e36615b7ed5e None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=75623) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} Sep 16 14:40:12 devstack cinder-volume[75623]: DEBUG cinder.volume.drivers.lvm [None req-32d22f4f-4327-4239-ba1a-e36615b7ed5e None None] Updating volume stats {{(pid=75623) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:227}} Sep 16 14:40:12 devstack cinder-volume[75623]: DEBUG oslo_concurrency.processutils [None req-32d22f4f-4327-4239-ba1a-e36615b7ed5e None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=75623) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 14:40:12 devstack sudo[82019]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Sep 16 14:40:12 devstack sudo[82019]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 14:40:13 devstack sudo[82019]: pam_unix(sudo:session): session closed for user root Sep 16 14:40:13 devstack cinder-volume[75623]: DEBUG oslo_concurrency.processutils [None req-32d22f4f-4327-4239-ba1a-e36615b7ed5e None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 1.751s {{(pid=75623) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 14:40:13 devstack cinder-volume[75623]: DEBUG oslo_concurrency.processutils [None req-32d22f4f-4327-4239-ba1a-e36615b7ed5e None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75623) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 14:40:14 devstack sudo[82022]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 16 14:40:14 devstack sudo[82022]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 14:40:15 devstack sudo[82022]: pam_unix(sudo:session): session closed for user root Sep 16 14:40:15 devstack cinder-volume[75623]: DEBUG oslo_concurrency.processutils [None req-32d22f4f-4327-4239-ba1a-e36615b7ed5e None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 1.820s {{(pid=75623) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 14:40:15 devstack cinder-volume[75623]: DEBUG oslo_concurrency.processutils [None req-32d22f4f-4327-4239-ba1a-e36615b7ed5e None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75623) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 14:40:15 devstack sudo[82025]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Sep 16 14:40:15 devstack sudo[82025]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 14:40:17 devstack sudo[82025]: pam_unix(sudo:session): session closed for user root Sep 16 14:40:17 devstack cinder-volume[75623]: DEBUG oslo_concurrency.processutils [None req-32d22f4f-4327-4239-ba1a-e36615b7ed5e None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 1.783s {{(pid=75623) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 14:40:17 devstack cinder-volume[75623]: DEBUG oslo_concurrency.processutils [None req-32d22f4f-4327-4239-ba1a-e36615b7ed5e None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75623) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 14:40:17 devstack sudo[82032]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 16 14:40:17 devstack sudo[82032]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 14:40:19 devstack sudo[82032]: pam_unix(sudo:session): session closed for user root Sep 16 14:40:19 devstack cinder-volume[75623]: DEBUG oslo_concurrency.processutils [None req-32d22f4f-4327-4239-ba1a-e36615b7ed5e None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 1.953s {{(pid=75623) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 14:40:19 devstack cinder-volume[75623]: DEBUG cinder.manager [None req-32d22f4f-4327-4239-ba1a-e36615b7ed5e None None] Notifying Schedulers of capabilities ... {{(pid=75623) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 16 14:41:12 devstack cinder-volume[75623]: DEBUG oslo_service.periodic_task [None req-32d22f4f-4327-4239-ba1a-e36615b7ed5e None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=75623) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} Sep 16 14:41:12 devstack cinder-volume[75623]: DEBUG cinder.volume.drivers.lvm [None req-32d22f4f-4327-4239-ba1a-e36615b7ed5e None None] Updating volume stats {{(pid=75623) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:227}} Sep 16 14:41:12 devstack cinder-volume[75623]: DEBUG oslo_concurrency.processutils [None req-32d22f4f-4327-4239-ba1a-e36615b7ed5e None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=75623) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 14:41:12 devstack sudo[82708]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Sep 16 14:41:12 devstack sudo[82708]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 14:41:14 devstack sudo[82708]: pam_unix(sudo:session): session closed for user root Sep 16 14:41:14 devstack cinder-volume[75623]: DEBUG oslo_concurrency.processutils [None req-32d22f4f-4327-4239-ba1a-e36615b7ed5e None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 2.671s {{(pid=75623) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 14:41:14 devstack cinder-volume[75623]: DEBUG oslo_concurrency.processutils [None req-32d22f4f-4327-4239-ba1a-e36615b7ed5e None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75623) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 14:41:15 devstack sudo[82744]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 16 14:41:15 devstack sudo[82744]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 14:41:17 devstack sudo[82744]: pam_unix(sudo:session): session closed for user root Sep 16 14:41:17 devstack cinder-volume[75623]: DEBUG oslo_concurrency.processutils [None req-32d22f4f-4327-4239-ba1a-e36615b7ed5e None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 2.391s {{(pid=75623) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 14:41:17 devstack cinder-volume[75623]: DEBUG oslo_concurrency.processutils [None req-32d22f4f-4327-4239-ba1a-e36615b7ed5e None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75623) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 14:41:17 devstack sudo[82776]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Sep 16 14:41:17 devstack sudo[82776]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 14:41:19 devstack sudo[82776]: pam_unix(sudo:session): session closed for user root Sep 16 14:41:19 devstack cinder-volume[75623]: DEBUG oslo_concurrency.processutils [None req-32d22f4f-4327-4239-ba1a-e36615b7ed5e None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 2.136s {{(pid=75623) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 14:41:19 devstack cinder-volume[75623]: DEBUG oslo_concurrency.processutils [None req-32d22f4f-4327-4239-ba1a-e36615b7ed5e None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75623) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 14:41:19 devstack sudo[82808]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 16 14:41:19 devstack sudo[82808]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 14:41:22 devstack sudo[82808]: pam_unix(sudo:session): session closed for user root Sep 16 14:41:22 devstack cinder-volume[75623]: DEBUG oslo_concurrency.processutils [None req-32d22f4f-4327-4239-ba1a-e36615b7ed5e None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 2.873s {{(pid=75623) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 14:41:22 devstack cinder-volume[75623]: DEBUG cinder.manager [None req-32d22f4f-4327-4239-ba1a-e36615b7ed5e None None] Notifying Schedulers of capabilities ... {{(pid=75623) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 16 14:41:28 devstack cinder-volume[75486]: INFO oslo_service.backend._eventlet.service [None req-7a316aef-88c3-4ae0-9259-a0a05b655104 None None] Caught SIGTERM, stopping children Sep 16 14:41:28 devstack cinder-volume[75486]: DEBUG oslo_concurrency.lockutils [None req-7a316aef-88c3-4ae0-9259-a0a05b655104 None None] Acquiring lock "singleton_lock" {{(pid=75486) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} Sep 16 14:41:28 devstack cinder-volume[75486]: DEBUG oslo_concurrency.lockutils [None req-7a316aef-88c3-4ae0-9259-a0a05b655104 None None] Acquired lock "singleton_lock" {{(pid=75486) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} Sep 16 14:41:28 devstack cinder-volume[75486]: DEBUG oslo_concurrency.lockutils [None req-7a316aef-88c3-4ae0-9259-a0a05b655104 None None] Releasing lock "singleton_lock" {{(pid=75486) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} Sep 16 14:41:28 devstack cinder-volume[75486]: DEBUG oslo_service.backend._eventlet.service [None req-7a316aef-88c3-4ae0-9259-a0a05b655104 None None] Stop services. {{(pid=75486) stop /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/backend/_eventlet/service.py:610}} Sep 16 14:41:28 devstack cinder-volume[75486]: DEBUG oslo_service.backend._eventlet.service [None req-7a316aef-88c3-4ae0-9259-a0a05b655104 None None] Killing children. {{(pid=75486) stop /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/backend/_eventlet/service.py:615}} Sep 16 14:41:28 devstack cinder-volume[75486]: INFO oslo_service.backend._eventlet.service [None req-7a316aef-88c3-4ae0-9259-a0a05b655104 None None] Waiting on 1 children to exit Sep 16 14:41:30 devstack cinder-volume[75623]: DEBUG oslo_concurrency.lockutils [None req-7a316aef-88c3-4ae0-9259-a0a05b655104 None None] Acquiring lock "singleton_lock" {{(pid=75623) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} Sep 16 14:41:30 devstack cinder-volume[75623]: DEBUG oslo_concurrency.lockutils [None req-7a316aef-88c3-4ae0-9259-a0a05b655104 None None] Acquired lock "singleton_lock" {{(pid=75623) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} Sep 16 14:41:30 devstack cinder-volume[75623]: DEBUG oslo_concurrency.lockutils [None req-7a316aef-88c3-4ae0-9259-a0a05b655104 None None] Releasing lock "singleton_lock" {{(pid=75623) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} Sep 16 14:41:30 devstack cinder-volume[75623]: WARNING amqp [None req-7a316aef-88c3-4ae0-9259-a0a05b655104 None None] Received method (60, 30) during closing channel 1. This method will be ignored Sep 16 14:41:30 devstack cinder-volume[75623]: WARNING amqp [None req-7a316aef-88c3-4ae0-9259-a0a05b655104 None None] Received method (60, 30) during closing channel 1. This method will be ignored Sep 16 14:41:30 devstack cinder-volume[75486]: INFO oslo_service.backend._eventlet.service [None req-7a316aef-88c3-4ae0-9259-a0a05b655104 None None] Child 75623 exited with status 0 Sep 16 14:41:49 devstack cinder-volume[83016]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "singleton_lock" {{(pid=83016) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} Sep 16 14:41:49 devstack cinder-volume[83016]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "singleton_lock" {{(pid=83016) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} Sep 16 14:41:49 devstack cinder-volume[83016]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "singleton_lock" {{(pid=83016) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} Sep 16 14:41:52 devstack cinder-volume[83016]: INFO dbcounter [None req-e2ecfc1f-232a-4b06-b530-a5d98f8cbd5c None None] Registered counter for database cinder Sep 16 14:41:52 devstack cinder-volume[83016]: DEBUG oslo_db.sqlalchemy.engines [None req-e2ecfc1f-232a-4b06-b530-a5d98f8cbd5c None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=83016) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.10/site-packages/oslo_db/sqlalchemy/engines.py:397}} Sep 16 14:41:53 devstack cinder-volume[83016]: DEBUG dbcounter [-] [83016] Writer thread running {{(pid=83016) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:102}} Sep 16 14:41:53 devstack cinder-volume[83016]: INFO cinder.rpc [None req-e2ecfc1f-232a-4b06-b530-a5d98f8cbd5c None None] Automatically selected cinder-scheduler objects version 1.39 as minimum service version. Sep 16 14:41:53 devstack cinder-volume[83016]: INFO cinder.rpc [None req-e2ecfc1f-232a-4b06-b530-a5d98f8cbd5c None None] Automatically selected cinder-scheduler RPC version 3.12 as minimum service version. Sep 16 14:41:53 devstack cinder-volume[83016]: DEBUG oslo_db.sqlalchemy.engines [None req-e2ecfc1f-232a-4b06-b530-a5d98f8cbd5c None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=83016) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.10/site-packages/oslo_db/sqlalchemy/engines.py:397}} Sep 16 14:41:53 devstack cinder-volume[83016]: INFO cinder.volume.manager [None req-e2ecfc1f-232a-4b06-b530-a5d98f8cbd5c None None] Determined volume DB was empty at startup. Sep 16 14:41:53 devstack cinder-volume[83016]: DEBUG cinder.volume.manager [None req-e2ecfc1f-232a-4b06-b530-a5d98f8cbd5c None None] Cinder Volume DB check: vol_db_empty=True {{(pid=83016) __init__ /opt/stack/cinder/cinder/volume/manager.py:288}} Sep 16 14:41:53 devstack cinder-volume[83016]: INFO cinder.volume.manager [None req-e2ecfc1f-232a-4b06-b530-a5d98f8cbd5c None None] Service not found for updating active_backend_id, assuming default for driver init. Sep 16 14:41:53 devstack cinder-volume[83016]: WARNING stevedore.named [None req-e2ecfc1f-232a-4b06-b530-a5d98f8cbd5c None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Sep 16 14:41:53 devstack cinder-volume[83016]: WARNING castellan.key_manager [None req-e2ecfc1f-232a-4b06-b530-a5d98f8cbd5c None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Sep 16 14:41:53 devstack cinder-volume[83016]: WARNING cinder.keymgr.conf_key_mgr [None req-e2ecfc1f-232a-4b06-b530-a5d98f8cbd5c None None] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Sep 16 14:41:53 devstack cinder-volume[83016]: INFO cinder.volume.manager [None req-e2ecfc1f-232a-4b06-b530-a5d98f8cbd5c None None] Image-volume cache disabled for host devstack@QuobyteHD. Sep 16 14:41:53 devstack cinder-volume[83016]: DEBUG oslo_db.sqlalchemy.engines [None req-e2ecfc1f-232a-4b06-b530-a5d98f8cbd5c None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=83016) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.10/site-packages/oslo_db/sqlalchemy/engines.py:397}} Sep 16 14:41:54 devstack cinder-volume[83016]: INFO oslo_service.backend._eventlet.service [None req-e2ecfc1f-232a-4b06-b530-a5d98f8cbd5c None None] Starting 1 workers Sep 16 14:41:54 devstack cinder-volume[83016]: DEBUG oslo_service.backend._eventlet.service [None req-e2ecfc1f-232a-4b06-b530-a5d98f8cbd5c None None] Started child 83259 {{(pid=83016) _start_child /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/backend/_eventlet/service.py:490}} Sep 16 14:41:54 devstack cinder-volume[83016]: DEBUG oslo_service.backend._eventlet.service [None req-e2ecfc1f-232a-4b06-b530-a5d98f8cbd5c None None] Full set of CONF: {{(pid=83016) wait /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/backend/_eventlet/service.py:564}} Sep 16 14:41:54 devstack cinder-volume[83016]: DEBUG oslo_service.backend._eventlet.service [None req-e2ecfc1f-232a-4b06-b530-a5d98f8cbd5c None None] ******************************************************************************** {{(pid=83016) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2804}} Sep 16 14:41:54 devstack cinder-volume[83016]: DEBUG oslo_service.backend._eventlet.service [None req-e2ecfc1f-232a-4b06-b530-a5d98f8cbd5c None None] Configuration options gathered from: {{(pid=83016) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2805}} Sep 16 14:41:54 devstack cinder-volume[83016]: DEBUG oslo_service.backend._eventlet.service [None req-e2ecfc1f-232a-4b06-b530-a5d98f8cbd5c None None] command line args: ['--config-file', '/etc/cinder/cinder.conf'] {{(pid=83016) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2806}} Sep 16 14:41:54 devstack cinder-volume[83016]: DEBUG oslo_service.backend._eventlet.service [None req-e2ecfc1f-232a-4b06-b530-a5d98f8cbd5c None None] config files: ['/etc/cinder/cinder.conf'] {{(pid=83016) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2807}} Sep 16 14:41:54 devstack cinder-volume[83016]: DEBUG oslo_service.backend._eventlet.service [None req-e2ecfc1f-232a-4b06-b530-a5d98f8cbd5c None None] ================================================================================ {{(pid=83016) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2809}} Sep 16 14:41:54 devstack cinder-volume[83016]: DEBUG oslo_service.backend._eventlet.service [None req-e2ecfc1f-232a-4b06-b530-a5d98f8cbd5c None None] allow_availability_zone_fallback = False {{(pid=83016) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 16 14:41:54 devstack cinder-volume[83016]: DEBUG oslo_service.backend._eventlet.service [None req-e2ecfc1f-232a-4b06-b530-a5d98f8cbd5c None None] allow_compression_on_image_upload = False {{(pid=83016) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 16 14:41:54 devstack cinder-volume[83016]: DEBUG oslo_service.backend._eventlet.service [None req-e2ecfc1f-232a-4b06-b530-a5d98f8cbd5c None None] allowed_direct_url_schemes = [] {{(pid=83016) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 16 14:41:54 devstack cinder-volume[83016]: DEBUG oslo_service.backend._eventlet.service [None req-e2ecfc1f-232a-4b06-b530-a5d98f8cbd5c None None] api_rate_limit = True {{(pid=83016) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 16 14:41:54 devstack cinder-volume[83016]: DEBUG oslo_service.backend._eventlet.service [None req-e2ecfc1f-232a-4b06-b530-a5d98f8cbd5c None None] auth_strategy = keystone {{(pid=83016) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 16 14:41:54 devstack cinder-volume[83016]: DEBUG oslo_service.backend._eventlet.service [None req-e2ecfc1f-232a-4b06-b530-a5d98f8cbd5c None None] backend_availability_zone = None {{(pid=83016) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 16 14:41:54 devstack cinder-volume[83016]: DEBUG oslo_service.backend._eventlet.service [None req-e2ecfc1f-232a-4b06-b530-a5d98f8cbd5c None None] backend_host = None {{(pid=83016) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 16 14:41:54 devstack cinder-volume[83016]: DEBUG oslo_service.backend._eventlet.service [None req-e2ecfc1f-232a-4b06-b530-a5d98f8cbd5c None None] backend_name = None {{(pid=83016) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 16 14:41:54 devstack cinder-volume[83016]: DEBUG oslo_service.backend._eventlet.service [None req-e2ecfc1f-232a-4b06-b530-a5d98f8cbd5c None None] backend_stats_polling_interval = 60 {{(pid=83016) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 16 14:41:54 devstack cinder-volume[83016]: DEBUG oslo_service.backend._eventlet.service [None req-e2ecfc1f-232a-4b06-b530-a5d98f8cbd5c None None] backup_api_class = cinder.backup.api.API {{(pid=83016) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 16 14:41:54 devstack cinder-volume[83016]: DEBUG oslo_service.backend._eventlet.service [None req-e2ecfc1f-232a-4b06-b530-a5d98f8cbd5c None None] backup_manager = cinder.backup.manager.BackupManager {{(pid=83016) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 16 14:41:54 devstack cinder-volume[83016]: DEBUG oslo_service.backend._eventlet.service [None req-e2ecfc1f-232a-4b06-b530-a5d98f8cbd5c None None] backup_name_template = backup-%s {{(pid=83016) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 16 14:41:54 devstack cinder-volume[83016]: DEBUG oslo_service.backend._eventlet.service [None req-e2ecfc1f-232a-4b06-b530-a5d98f8cbd5c None None] backup_use_same_host = False {{(pid=83016) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 16 14:41:54 devstack cinder-volume[83016]: DEBUG oslo_service.backend._eventlet.service [None req-e2ecfc1f-232a-4b06-b530-a5d98f8cbd5c None None] backup_use_temp_snapshot = False {{(pid=83016) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 16 14:41:54 devstack cinder-volume[83016]: DEBUG oslo_service.backend._eventlet.service [None req-e2ecfc1f-232a-4b06-b530-a5d98f8cbd5c None None] chap_password = **** {{(pid=83016) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 16 14:41:54 devstack cinder-volume[83259]: INFO cinder.service [-] Starting cinder-volume node (version 26.1.0) Sep 16 14:41:54 devstack cinder-volume[83016]: DEBUG oslo_service.backend._eventlet.service [None req-e2ecfc1f-232a-4b06-b530-a5d98f8cbd5c None None] chap_username = {{(pid=83016) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 16 14:41:54 devstack cinder-volume[83016]: DEBUG oslo_service.backend._eventlet.service [None req-e2ecfc1f-232a-4b06-b530-a5d98f8cbd5c None None] chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=83016) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 16 14:41:54 devstack cinder-volume[83016]: DEBUG oslo_service.backend._eventlet.service [None req-e2ecfc1f-232a-4b06-b530-a5d98f8cbd5c None None] cinder_internal_tenant_project_id = 9b7315773d9c426f8ff8ef3b9460cf4d {{(pid=83016) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 16 14:41:54 devstack cinder-volume[83016]: DEBUG oslo_service.backend._eventlet.service [None req-e2ecfc1f-232a-4b06-b530-a5d98f8cbd5c None None] cinder_internal_tenant_user_id = 73df27e14439482e83497ba46b8b1082 {{(pid=83016) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 16 14:41:54 devstack cinder-volume[83016]: DEBUG oslo_service.backend._eventlet.service [None req-e2ecfc1f-232a-4b06-b530-a5d98f8cbd5c None None] cluster = None {{(pid=83016) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 16 14:41:54 devstack cinder-volume[83016]: DEBUG oslo_service.backend._eventlet.service [None req-e2ecfc1f-232a-4b06-b530-a5d98f8cbd5c None None] compression_format = gzip {{(pid=83016) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 16 14:41:54 devstack cinder-volume[83016]: DEBUG oslo_service.backend._eventlet.service [None req-e2ecfc1f-232a-4b06-b530-a5d98f8cbd5c None None] compute_api_class = cinder.compute.nova.API {{(pid=83016) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 16 14:41:54 devstack cinder-volume[83016]: DEBUG oslo_service.backend._eventlet.service [None req-e2ecfc1f-232a-4b06-b530-a5d98f8cbd5c None None] config_dir = [] {{(pid=83016) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 16 14:41:54 devstack cinder-volume[83016]: DEBUG oslo_service.backend._eventlet.service [None req-e2ecfc1f-232a-4b06-b530-a5d98f8cbd5c None None] config_file = ['/etc/cinder/cinder.conf'] {{(pid=83016) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 16 14:41:54 devstack cinder-volume[83016]: DEBUG oslo_service.backend._eventlet.service [None req-e2ecfc1f-232a-4b06-b530-a5d98f8cbd5c None None] config_source = [] {{(pid=83016) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 16 14:41:54 devstack cinder-volume[83016]: DEBUG oslo_service.backend._eventlet.service [None req-e2ecfc1f-232a-4b06-b530-a5d98f8cbd5c None None] consistencygroup_api_class = cinder.consistencygroup.api.API {{(pid=83016) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 16 14:41:54 devstack cinder-volume[83016]: DEBUG oslo_service.backend._eventlet.service [None req-e2ecfc1f-232a-4b06-b530-a5d98f8cbd5c None None] control_exchange = openstack {{(pid=83016) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 16 14:41:54 devstack cinder-volume[83016]: DEBUG oslo_service.backend._eventlet.service [None req-e2ecfc1f-232a-4b06-b530-a5d98f8cbd5c None None] debug = True {{(pid=83016) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 16 14:41:54 devstack cinder-volume[83016]: DEBUG oslo_service.backend._eventlet.service [None req-e2ecfc1f-232a-4b06-b530-a5d98f8cbd5c None None] default_availability_zone = None {{(pid=83016) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 16 14:41:54 devstack cinder-volume[83016]: DEBUG oslo_service.backend._eventlet.service [None req-e2ecfc1f-232a-4b06-b530-a5d98f8cbd5c None None] default_group_type = None {{(pid=83016) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 16 14:41:54 devstack cinder-volume[83016]: DEBUG oslo_service.backend._eventlet.service [None req-e2ecfc1f-232a-4b06-b530-a5d98f8cbd5c None None] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO'] {{(pid=83016) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 16 14:41:54 devstack cinder-volume[83016]: DEBUG oslo_service.backend._eventlet.service [None req-e2ecfc1f-232a-4b06-b530-a5d98f8cbd5c None None] default_volume_type = QuobyteHD {{(pid=83016) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 16 14:41:54 devstack cinder-volume[83016]: DEBUG oslo_service.backend._eventlet.service [None req-e2ecfc1f-232a-4b06-b530-a5d98f8cbd5c None None] driver_client_cert = None {{(pid=83016) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 16 14:41:54 devstack cinder-volume[83016]: DEBUG oslo_service.backend._eventlet.service [None req-e2ecfc1f-232a-4b06-b530-a5d98f8cbd5c None None] driver_client_cert_key = None {{(pid=83016) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 16 14:41:54 devstack cinder-volume[83016]: DEBUG oslo_service.backend._eventlet.service [None req-e2ecfc1f-232a-4b06-b530-a5d98f8cbd5c None None] driver_data_namespace = None {{(pid=83016) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 16 14:41:54 devstack cinder-volume[83016]: DEBUG oslo_service.backend._eventlet.service [None req-e2ecfc1f-232a-4b06-b530-a5d98f8cbd5c None None] driver_ssl_cert_path = None {{(pid=83016) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 16 14:41:54 devstack cinder-volume[83016]: DEBUG oslo_service.backend._eventlet.service [None req-e2ecfc1f-232a-4b06-b530-a5d98f8cbd5c None None] driver_ssl_cert_verify = False {{(pid=83016) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 16 14:41:54 devstack cinder-volume[83016]: DEBUG oslo_service.backend._eventlet.service [None req-e2ecfc1f-232a-4b06-b530-a5d98f8cbd5c None None] driver_use_ssl = False {{(pid=83016) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 16 14:41:54 devstack cinder-volume[83016]: DEBUG oslo_service.backend._eventlet.service [None req-e2ecfc1f-232a-4b06-b530-a5d98f8cbd5c None None] enable_new_services = True {{(pid=83016) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 16 14:41:54 devstack cinder-volume[83016]: DEBUG oslo_service.backend._eventlet.service [None req-e2ecfc1f-232a-4b06-b530-a5d98f8cbd5c None None] enable_unsupported_driver = False {{(pid=83016) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 16 14:41:54 devstack cinder-volume[83016]: DEBUG oslo_service.backend._eventlet.service [None req-e2ecfc1f-232a-4b06-b530-a5d98f8cbd5c None None] enabled_backends = ['QuobyteHD'] {{(pid=83016) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 16 14:41:54 devstack cinder-volume[83016]: DEBUG oslo_service.backend._eventlet.service [None req-e2ecfc1f-232a-4b06-b530-a5d98f8cbd5c None None] enforce_multipath_for_image_xfer = False {{(pid=83016) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 16 14:41:54 devstack cinder-volume[83016]: DEBUG oslo_service.backend._eventlet.service [None req-e2ecfc1f-232a-4b06-b530-a5d98f8cbd5c None None] filter_function = None {{(pid=83016) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 16 14:41:54 devstack cinder-volume[83016]: DEBUG oslo_service.backend._eventlet.service [None req-e2ecfc1f-232a-4b06-b530-a5d98f8cbd5c None None] glance_api_insecure = False {{(pid=83016) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 16 14:41:54 devstack cinder-volume[83016]: DEBUG oslo_service.backend._eventlet.service [None req-e2ecfc1f-232a-4b06-b530-a5d98f8cbd5c None None] glance_api_servers = ['http://192.168.122.206/image'] {{(pid=83016) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 16 14:41:54 devstack cinder-volume[83016]: DEBUG oslo_service.backend._eventlet.service [None req-e2ecfc1f-232a-4b06-b530-a5d98f8cbd5c None None] glance_api_ssl_compression = False {{(pid=83016) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 16 14:41:54 devstack cinder-volume[83016]: DEBUG oslo_service.backend._eventlet.service [None req-e2ecfc1f-232a-4b06-b530-a5d98f8cbd5c None None] glance_ca_certificates_file = None {{(pid=83016) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 16 14:41:54 devstack cinder-volume[83016]: DEBUG oslo_service.backend._eventlet.service [None req-e2ecfc1f-232a-4b06-b530-a5d98f8cbd5c None None] glance_catalog_info = image:glance:publicURL {{(pid=83016) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 16 14:41:54 devstack cinder-volume[83016]: DEBUG oslo_service.backend._eventlet.service [None req-e2ecfc1f-232a-4b06-b530-a5d98f8cbd5c None None] glance_certfile = None {{(pid=83016) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 16 14:41:54 devstack cinder-volume[83016]: DEBUG oslo_service.backend._eventlet.service [None req-e2ecfc1f-232a-4b06-b530-a5d98f8cbd5c None None] glance_core_properties = ['checksum', 'container_format', 'disk_format', 'image_name', 'image_id', 'min_disk', 'min_ram', 'name', 'size'] {{(pid=83016) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 16 14:41:54 devstack cinder-volume[83016]: DEBUG oslo_service.backend._eventlet.service [None req-e2ecfc1f-232a-4b06-b530-a5d98f8cbd5c None None] glance_keyfile = None {{(pid=83016) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 16 14:41:54 devstack cinder-volume[83016]: DEBUG oslo_service.backend._eventlet.service [None req-e2ecfc1f-232a-4b06-b530-a5d98f8cbd5c None None] glance_num_retries = 3 {{(pid=83016) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 16 14:41:54 devstack cinder-volume[83016]: DEBUG oslo_service.backend._eventlet.service [None req-e2ecfc1f-232a-4b06-b530-a5d98f8cbd5c None None] glance_request_timeout = None {{(pid=83016) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 16 14:41:54 devstack cinder-volume[83016]: DEBUG oslo_service.backend._eventlet.service [None req-e2ecfc1f-232a-4b06-b530-a5d98f8cbd5c None None] goodness_function = None {{(pid=83016) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 16 14:41:54 devstack cinder-volume[83016]: DEBUG oslo_service.backend._eventlet.service [None req-e2ecfc1f-232a-4b06-b530-a5d98f8cbd5c None None] graceful_shutdown_timeout = 5 {{(pid=83016) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 16 14:41:54 devstack cinder-volume[83016]: DEBUG oslo_service.backend._eventlet.service [None req-e2ecfc1f-232a-4b06-b530-a5d98f8cbd5c None None] group_api_class = cinder.group.api.API {{(pid=83016) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 16 14:41:54 devstack cinder-volume[83016]: DEBUG oslo_service.backend._eventlet.service [None req-e2ecfc1f-232a-4b06-b530-a5d98f8cbd5c None None] host = devstack {{(pid=83016) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 16 14:41:54 devstack cinder-volume[83016]: DEBUG oslo_service.backend._eventlet.service [None req-e2ecfc1f-232a-4b06-b530-a5d98f8cbd5c None None] image_compress_on_upload = True {{(pid=83016) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 16 14:41:54 devstack cinder-volume[83016]: DEBUG oslo_service.backend._eventlet.service [None req-e2ecfc1f-232a-4b06-b530-a5d98f8cbd5c None None] image_conversion_address_space_limit = 1 {{(pid=83016) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 16 14:41:54 devstack cinder-volume[83016]: DEBUG oslo_service.backend._eventlet.service [None req-e2ecfc1f-232a-4b06-b530-a5d98f8cbd5c None None] image_conversion_cpu_limit = 60 {{(pid=83016) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 16 14:41:54 devstack cinder-volume[83016]: DEBUG oslo_service.backend._eventlet.service [None req-e2ecfc1f-232a-4b06-b530-a5d98f8cbd5c None None] image_conversion_dir = /opt/stack/data/cinder/conversion {{(pid=83016) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 16 14:41:54 devstack cinder-volume[83016]: DEBUG oslo_service.backend._eventlet.service [None req-e2ecfc1f-232a-4b06-b530-a5d98f8cbd5c None None] image_conversion_disable = False {{(pid=83016) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 16 14:41:54 devstack cinder-volume[83016]: DEBUG oslo_service.backend._eventlet.service [None req-e2ecfc1f-232a-4b06-b530-a5d98f8cbd5c None None] image_upload_use_cinder_backend = False {{(pid=83016) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 16 14:41:54 devstack cinder-volume[83016]: DEBUG oslo_service.backend._eventlet.service [None req-e2ecfc1f-232a-4b06-b530-a5d98f8cbd5c None None] image_upload_use_internal_tenant = False {{(pid=83016) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 16 14:41:54 devstack cinder-volume[83016]: DEBUG oslo_service.backend._eventlet.service [None req-e2ecfc1f-232a-4b06-b530-a5d98f8cbd5c None None] image_volume_cache_enabled = False {{(pid=83016) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 16 14:41:54 devstack cinder-volume[83016]: DEBUG oslo_service.backend._eventlet.service [None req-e2ecfc1f-232a-4b06-b530-a5d98f8cbd5c None None] image_volume_cache_max_count = 0 {{(pid=83016) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 16 14:41:54 devstack cinder-volume[83016]: DEBUG oslo_service.backend._eventlet.service [None req-e2ecfc1f-232a-4b06-b530-a5d98f8cbd5c None None] image_volume_cache_max_size_gb = 0 {{(pid=83016) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 16 14:41:54 devstack cinder-volume[83016]: DEBUG oslo_service.backend._eventlet.service [None req-e2ecfc1f-232a-4b06-b530-a5d98f8cbd5c None None] init_host_max_objects_retrieval = 0 {{(pid=83016) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 16 14:41:54 devstack cinder-volume[83016]: DEBUG oslo_service.backend._eventlet.service [None req-e2ecfc1f-232a-4b06-b530-a5d98f8cbd5c None None] instance_format = [instance: %(uuid)s] {{(pid=83016) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 16 14:41:54 devstack cinder-volume[83016]: DEBUG oslo_service.backend._eventlet.service [None req-e2ecfc1f-232a-4b06-b530-a5d98f8cbd5c None None] instance_uuid_format = [instance: %(uuid)s] {{(pid=83016) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 16 14:41:54 devstack cinder-volume[83016]: DEBUG oslo_service.backend._eventlet.service [None req-e2ecfc1f-232a-4b06-b530-a5d98f8cbd5c None None] iscsi_iotype = fileio {{(pid=83016) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 16 14:41:54 devstack cinder-volume[83016]: DEBUG oslo_service.backend._eventlet.service [None req-e2ecfc1f-232a-4b06-b530-a5d98f8cbd5c None None] iscsi_target_flags = {{(pid=83016) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 16 14:41:54 devstack cinder-volume[83016]: DEBUG oslo_service.backend._eventlet.service [None req-e2ecfc1f-232a-4b06-b530-a5d98f8cbd5c None None] iscsi_write_cache = on {{(pid=83016) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 16 14:41:54 devstack cinder-volume[83016]: DEBUG oslo_service.backend._eventlet.service [None req-e2ecfc1f-232a-4b06-b530-a5d98f8cbd5c None None] iser_helper = tgtadm {{(pid=83016) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 16 14:41:54 devstack cinder-volume[83016]: DEBUG oslo_service.backend._eventlet.service [None req-e2ecfc1f-232a-4b06-b530-a5d98f8cbd5c None None] iser_ip_address = 192.168.122.206 {{(pid=83016) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 16 14:41:54 devstack cinder-volume[83016]: DEBUG oslo_service.backend._eventlet.service [None req-e2ecfc1f-232a-4b06-b530-a5d98f8cbd5c None None] iser_port = 3260 {{(pid=83016) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 16 14:41:54 devstack cinder-volume[83016]: DEBUG oslo_service.backend._eventlet.service [None req-e2ecfc1f-232a-4b06-b530-a5d98f8cbd5c None None] iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=83016) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 16 14:41:54 devstack cinder-volume[83016]: DEBUG oslo_service.backend._eventlet.service [None req-e2ecfc1f-232a-4b06-b530-a5d98f8cbd5c None None] log_color = False {{(pid=83016) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 16 14:41:54 devstack cinder-volume[83016]: DEBUG oslo_service.backend._eventlet.service [None req-e2ecfc1f-232a-4b06-b530-a5d98f8cbd5c None None] log_config_append = None {{(pid=83016) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 16 14:41:54 devstack cinder-volume[83016]: DEBUG oslo_service.backend._eventlet.service [None req-e2ecfc1f-232a-4b06-b530-a5d98f8cbd5c None None] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=83016) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 16 14:41:54 devstack cinder-volume[83016]: DEBUG oslo_service.backend._eventlet.service [None req-e2ecfc1f-232a-4b06-b530-a5d98f8cbd5c None None] log_dir = None {{(pid=83016) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 16 14:41:54 devstack cinder-volume[83016]: DEBUG oslo_service.backend._eventlet.service [None req-e2ecfc1f-232a-4b06-b530-a5d98f8cbd5c None None] log_file = None {{(pid=83016) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 16 14:41:54 devstack cinder-volume[83016]: DEBUG oslo_service.backend._eventlet.service [None req-e2ecfc1f-232a-4b06-b530-a5d98f8cbd5c None None] log_options = True {{(pid=83016) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 16 14:41:54 devstack cinder-volume[83016]: DEBUG oslo_service.backend._eventlet.service [None req-e2ecfc1f-232a-4b06-b530-a5d98f8cbd5c None None] log_rotate_interval = 1 {{(pid=83016) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 16 14:41:54 devstack cinder-volume[83016]: DEBUG oslo_service.backend._eventlet.service [None req-e2ecfc1f-232a-4b06-b530-a5d98f8cbd5c None None] log_rotate_interval_type = days {{(pid=83016) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 16 14:41:54 devstack cinder-volume[83016]: DEBUG oslo_service.backend._eventlet.service [None req-e2ecfc1f-232a-4b06-b530-a5d98f8cbd5c None None] log_rotation_type = none {{(pid=83016) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 16 14:41:54 devstack cinder-volume[83016]: DEBUG oslo_service.backend._eventlet.service [None req-e2ecfc1f-232a-4b06-b530-a5d98f8cbd5c None None] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=83016) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 16 14:41:54 devstack cinder-volume[83016]: DEBUG oslo_service.backend._eventlet.service [None req-e2ecfc1f-232a-4b06-b530-a5d98f8cbd5c None None] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=83016) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 16 14:41:54 devstack cinder-volume[83016]: DEBUG oslo_service.backend._eventlet.service [None req-e2ecfc1f-232a-4b06-b530-a5d98f8cbd5c None None] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=83016) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 16 14:41:54 devstack cinder-volume[83016]: DEBUG oslo_service.backend._eventlet.service [None req-e2ecfc1f-232a-4b06-b530-a5d98f8cbd5c None None] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=83016) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 16 14:41:54 devstack cinder-volume[83016]: DEBUG oslo_service.backend._eventlet.service [None req-e2ecfc1f-232a-4b06-b530-a5d98f8cbd5c None None] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=83016) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 16 14:41:54 devstack cinder-volume[83016]: DEBUG oslo_service.backend._eventlet.service [None req-e2ecfc1f-232a-4b06-b530-a5d98f8cbd5c None None] max_age = 0 {{(pid=83016) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 16 14:41:54 devstack cinder-volume[83016]: DEBUG oslo_service.backend._eventlet.service [None req-e2ecfc1f-232a-4b06-b530-a5d98f8cbd5c None None] max_logfile_count = 30 {{(pid=83016) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 16 14:41:54 devstack cinder-volume[83016]: DEBUG oslo_service.backend._eventlet.service [None req-e2ecfc1f-232a-4b06-b530-a5d98f8cbd5c None None] max_logfile_size_mb = 200 {{(pid=83016) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 16 14:41:54 devstack cinder-volume[83016]: DEBUG oslo_service.backend._eventlet.service [None req-e2ecfc1f-232a-4b06-b530-a5d98f8cbd5c None None] max_over_subscription_ratio = 20.0 {{(pid=83016) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 16 14:41:54 devstack cinder-volume[83016]: DEBUG oslo_service.backend._eventlet.service [None req-e2ecfc1f-232a-4b06-b530-a5d98f8cbd5c None None] message_reap_interval = 86400 {{(pid=83016) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 16 14:41:54 devstack cinder-volume[83016]: DEBUG oslo_service.backend._eventlet.service [None req-e2ecfc1f-232a-4b06-b530-a5d98f8cbd5c None None] message_ttl = 2592000 {{(pid=83016) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 16 14:41:54 devstack cinder-volume[83016]: DEBUG oslo_service.backend._eventlet.service [None req-e2ecfc1f-232a-4b06-b530-a5d98f8cbd5c None None] migration_create_volume_timeout_secs = 300 {{(pid=83016) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 16 14:41:54 devstack cinder-volume[83016]: DEBUG oslo_service.backend._eventlet.service [None req-e2ecfc1f-232a-4b06-b530-a5d98f8cbd5c None None] monkey_patch = False {{(pid=83016) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 16 14:41:54 devstack cinder-volume[83016]: DEBUG oslo_service.backend._eventlet.service [None req-e2ecfc1f-232a-4b06-b530-a5d98f8cbd5c None None] monkey_patch_modules = [] {{(pid=83016) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 16 14:41:54 devstack cinder-volume[83016]: DEBUG oslo_service.backend._eventlet.service [None req-e2ecfc1f-232a-4b06-b530-a5d98f8cbd5c None None] my_ip = 192.168.122.206 {{(pid=83016) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 16 14:41:54 devstack cinder-volume[83016]: DEBUG oslo_service.backend._eventlet.service [None req-e2ecfc1f-232a-4b06-b530-a5d98f8cbd5c None None] no_snapshot_gb_quota = False {{(pid=83016) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 16 14:41:54 devstack cinder-volume[83016]: DEBUG oslo_service.backend._eventlet.service [None req-e2ecfc1f-232a-4b06-b530-a5d98f8cbd5c None None] num_iser_scan_tries = 3 {{(pid=83016) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 16 14:41:54 devstack cinder-volume[83016]: DEBUG oslo_service.backend._eventlet.service [None req-e2ecfc1f-232a-4b06-b530-a5d98f8cbd5c None None] num_shell_tries = 3 {{(pid=83016) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 16 14:41:54 devstack cinder-volume[83016]: DEBUG oslo_service.backend._eventlet.service [None req-e2ecfc1f-232a-4b06-b530-a5d98f8cbd5c None None] num_volume_device_scan_tries = 3 {{(pid=83016) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 16 14:41:54 devstack cinder-volume[83016]: DEBUG oslo_service.backend._eventlet.service [None req-e2ecfc1f-232a-4b06-b530-a5d98f8cbd5c None None] nvmeof_conn_info_version = 1 {{(pid=83016) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 16 14:41:54 devstack cinder-volume[83016]: DEBUG oslo_service.backend._eventlet.service [None req-e2ecfc1f-232a-4b06-b530-a5d98f8cbd5c None None] nvmet_ns_id = 10 {{(pid=83016) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 16 14:41:54 devstack cinder-volume[83016]: DEBUG oslo_service.backend._eventlet.service [None req-e2ecfc1f-232a-4b06-b530-a5d98f8cbd5c None None] nvmet_port_id = 1 {{(pid=83016) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 16 14:41:54 devstack cinder-volume[83016]: DEBUG oslo_service.backend._eventlet.service [None req-e2ecfc1f-232a-4b06-b530-a5d98f8cbd5c None None] osapi_max_limit = 1000 {{(pid=83016) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 16 14:41:54 devstack cinder-volume[83016]: DEBUG oslo_service.backend._eventlet.service [None req-e2ecfc1f-232a-4b06-b530-a5d98f8cbd5c None None] osapi_volume_ext_list = [] {{(pid=83016) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 16 14:41:54 devstack cinder-volume[83016]: DEBUG oslo_service.backend._eventlet.service [None req-e2ecfc1f-232a-4b06-b530-a5d98f8cbd5c None None] osapi_volume_extension = ['cinder.api.contrib.standard_extensions'] {{(pid=83016) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 16 14:41:54 devstack cinder-volume[83016]: DEBUG oslo_service.backend._eventlet.service [None req-e2ecfc1f-232a-4b06-b530-a5d98f8cbd5c None None] osapi_volume_listen = 0.0.0.0 {{(pid=83016) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 16 14:41:54 devstack cinder-volume[83016]: DEBUG oslo_service.backend._eventlet.service [None req-e2ecfc1f-232a-4b06-b530-a5d98f8cbd5c None None] osapi_volume_listen_port = 8776 {{(pid=83016) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 16 14:41:54 devstack cinder-volume[83016]: DEBUG oslo_service.backend._eventlet.service [None req-e2ecfc1f-232a-4b06-b530-a5d98f8cbd5c None None] osapi_volume_use_ssl = False {{(pid=83016) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 16 14:41:54 devstack cinder-volume[83016]: DEBUG oslo_service.backend._eventlet.service [None req-e2ecfc1f-232a-4b06-b530-a5d98f8cbd5c None None] osapi_volume_workers = 2 {{(pid=83016) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 16 14:41:54 devstack cinder-volume[83016]: DEBUG oslo_service.backend._eventlet.service [None req-e2ecfc1f-232a-4b06-b530-a5d98f8cbd5c None None] per_volume_size_limit = -1 {{(pid=83016) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 16 14:41:54 devstack cinder-volume[83016]: DEBUG oslo_service.backend._eventlet.service [None req-e2ecfc1f-232a-4b06-b530-a5d98f8cbd5c None None] periodic_fuzzy_delay = 60 {{(pid=83016) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 16 14:41:54 devstack cinder-volume[83016]: DEBUG oslo_service.backend._eventlet.service [None req-e2ecfc1f-232a-4b06-b530-a5d98f8cbd5c None None] periodic_interval = 60 {{(pid=83016) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 16 14:41:54 devstack cinder-volume[83016]: DEBUG oslo_service.backend._eventlet.service [None req-e2ecfc1f-232a-4b06-b530-a5d98f8cbd5c None None] project_id_regex = [0-9a-f\-]+ {{(pid=83016) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 16 14:41:54 devstack cinder-volume[83016]: DEBUG oslo_service.backend._eventlet.service [None req-e2ecfc1f-232a-4b06-b530-a5d98f8cbd5c None None] public_endpoint = None {{(pid=83016) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 16 14:41:54 devstack cinder-volume[83016]: DEBUG oslo_service.backend._eventlet.service [None req-e2ecfc1f-232a-4b06-b530-a5d98f8cbd5c None None] publish_errors = False {{(pid=83016) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 16 14:41:54 devstack cinder-volume[83016]: DEBUG oslo_service.backend._eventlet.service [None req-e2ecfc1f-232a-4b06-b530-a5d98f8cbd5c None None] quota_backup_gigabytes = 1000 {{(pid=83016) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 16 14:41:54 devstack cinder-volume[83016]: DEBUG oslo_service.backend._eventlet.service [None req-e2ecfc1f-232a-4b06-b530-a5d98f8cbd5c None None] quota_backups = 10 {{(pid=83016) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 16 14:41:54 devstack cinder-volume[83016]: DEBUG oslo_service.backend._eventlet.service [None req-e2ecfc1f-232a-4b06-b530-a5d98f8cbd5c None None] quota_driver = cinder.quota.DbQuotaDriver {{(pid=83016) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 16 14:41:54 devstack cinder-volume[83016]: DEBUG oslo_service.backend._eventlet.service [None req-e2ecfc1f-232a-4b06-b530-a5d98f8cbd5c None None] quota_gigabytes = 1000 {{(pid=83016) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 16 14:41:54 devstack cinder-volume[83016]: DEBUG oslo_service.backend._eventlet.service [None req-e2ecfc1f-232a-4b06-b530-a5d98f8cbd5c None None] quota_groups = 10 {{(pid=83016) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 16 14:41:54 devstack cinder-volume[83016]: DEBUG oslo_service.backend._eventlet.service [None req-e2ecfc1f-232a-4b06-b530-a5d98f8cbd5c None None] quota_snapshots = 10 {{(pid=83016) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 16 14:41:54 devstack cinder-volume[83016]: DEBUG oslo_service.backend._eventlet.service [None req-e2ecfc1f-232a-4b06-b530-a5d98f8cbd5c None None] quota_volumes = 10 {{(pid=83016) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 16 14:41:54 devstack cinder-volume[83016]: DEBUG oslo_service.backend._eventlet.service [None req-e2ecfc1f-232a-4b06-b530-a5d98f8cbd5c None None] rate_limit_burst = 0 {{(pid=83016) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 16 14:41:54 devstack cinder-volume[83016]: DEBUG oslo_service.backend._eventlet.service [None req-e2ecfc1f-232a-4b06-b530-a5d98f8cbd5c None None] rate_limit_except_level = CRITICAL {{(pid=83016) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 16 14:41:54 devstack cinder-volume[83016]: DEBUG oslo_service.backend._eventlet.service [None req-e2ecfc1f-232a-4b06-b530-a5d98f8cbd5c None None] rate_limit_interval = 0 {{(pid=83016) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 16 14:41:54 devstack cinder-volume[83016]: DEBUG oslo_service.backend._eventlet.service [None req-e2ecfc1f-232a-4b06-b530-a5d98f8cbd5c None None] reinit_driver_count = 3 {{(pid=83016) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 16 14:41:54 devstack cinder-volume[83016]: DEBUG oslo_service.backend._eventlet.service [None req-e2ecfc1f-232a-4b06-b530-a5d98f8cbd5c None None] replication_device = **** {{(pid=83016) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 16 14:41:54 devstack cinder-volume[83016]: DEBUG oslo_service.backend._eventlet.service [None req-e2ecfc1f-232a-4b06-b530-a5d98f8cbd5c None None] report_discard_supported = False {{(pid=83016) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 16 14:41:54 devstack cinder-volume[83016]: DEBUG oslo_service.backend._eventlet.service [None req-e2ecfc1f-232a-4b06-b530-a5d98f8cbd5c None None] report_interval = 120 {{(pid=83016) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 16 14:41:54 devstack cinder-volume[83016]: DEBUG oslo_service.backend._eventlet.service [None req-e2ecfc1f-232a-4b06-b530-a5d98f8cbd5c None None] reservation_clean_interval = 86400 {{(pid=83016) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 16 14:41:54 devstack cinder-volume[83016]: DEBUG oslo_service.backend._eventlet.service [None req-e2ecfc1f-232a-4b06-b530-a5d98f8cbd5c None None] reservation_expire = 86400 {{(pid=83016) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 16 14:41:54 devstack cinder-volume[83016]: DEBUG oslo_service.backend._eventlet.service [None req-e2ecfc1f-232a-4b06-b530-a5d98f8cbd5c None None] reserved_image_namespaces = [] {{(pid=83016) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 16 14:41:54 devstack cinder-volume[83016]: DEBUG oslo_service.backend._eventlet.service [None req-e2ecfc1f-232a-4b06-b530-a5d98f8cbd5c None None] reserved_percentage = 0 {{(pid=83016) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 16 14:41:54 devstack cinder-volume[83016]: DEBUG oslo_service.backend._eventlet.service [None req-e2ecfc1f-232a-4b06-b530-a5d98f8cbd5c None None] resource_query_filters_file = /etc/cinder/resource_filters.json {{(pid=83016) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 16 14:41:54 devstack cinder-volume[83016]: DEBUG oslo_service.backend._eventlet.service [None req-e2ecfc1f-232a-4b06-b530-a5d98f8cbd5c None None] rootwrap_config = /etc/cinder/rootwrap.conf {{(pid=83016) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 16 14:41:54 devstack cinder-volume[83016]: DEBUG oslo_service.backend._eventlet.service [None req-e2ecfc1f-232a-4b06-b530-a5d98f8cbd5c None None] rpc_response_timeout = 120 {{(pid=83016) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 16 14:41:54 devstack cinder-volume[83016]: DEBUG oslo_service.backend._eventlet.service [None req-e2ecfc1f-232a-4b06-b530-a5d98f8cbd5c None None] run_external_periodic_tasks = True {{(pid=83016) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 16 14:41:54 devstack cinder-volume[83016]: DEBUG oslo_service.backend._eventlet.service [None req-e2ecfc1f-232a-4b06-b530-a5d98f8cbd5c None None] scheduler_manager = cinder.scheduler.manager.SchedulerManager {{(pid=83016) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 16 14:41:54 devstack cinder-volume[83016]: DEBUG oslo_service.backend._eventlet.service [None req-e2ecfc1f-232a-4b06-b530-a5d98f8cbd5c None None] scst_target_driver = iscsi {{(pid=83016) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 16 14:41:54 devstack cinder-volume[83016]: DEBUG oslo_service.backend._eventlet.service [None req-e2ecfc1f-232a-4b06-b530-a5d98f8cbd5c None None] scst_target_iqn_name = None {{(pid=83016) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 16 14:41:54 devstack cinder-volume[83016]: DEBUG oslo_service.backend._eventlet.service [None req-e2ecfc1f-232a-4b06-b530-a5d98f8cbd5c None None] service_down_time = 720 {{(pid=83016) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 16 14:41:54 devstack cinder-volume[83016]: DEBUG oslo_service.backend._eventlet.service [None req-e2ecfc1f-232a-4b06-b530-a5d98f8cbd5c None None] shell_completion = None {{(pid=83016) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 16 14:41:54 devstack cinder-volume[83016]: DEBUG oslo_service.backend._eventlet.service [None req-e2ecfc1f-232a-4b06-b530-a5d98f8cbd5c None None] snapshot_name_template = snapshot-%s {{(pid=83016) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 16 14:41:54 devstack cinder-volume[83016]: DEBUG oslo_service.backend._eventlet.service [None req-e2ecfc1f-232a-4b06-b530-a5d98f8cbd5c None None] split_loggers = False {{(pid=83016) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 16 14:41:54 devstack cinder-volume[83016]: DEBUG oslo_service.backend._eventlet.service [None req-e2ecfc1f-232a-4b06-b530-a5d98f8cbd5c None None] state_path = /opt/stack/data/cinder {{(pid=83016) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 16 14:41:54 devstack cinder-volume[83016]: DEBUG oslo_service.backend._eventlet.service [None req-e2ecfc1f-232a-4b06-b530-a5d98f8cbd5c None None] storage_availability_zone = nova {{(pid=83016) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 16 14:41:54 devstack cinder-volume[83016]: DEBUG oslo_service.backend._eventlet.service [None req-e2ecfc1f-232a-4b06-b530-a5d98f8cbd5c None None] storage_protocol = iSCSI {{(pid=83016) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 16 14:41:54 devstack cinder-volume[83016]: DEBUG oslo_service.backend._eventlet.service [None req-e2ecfc1f-232a-4b06-b530-a5d98f8cbd5c None None] syslog_log_facility = LOG_USER {{(pid=83016) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 16 14:41:54 devstack cinder-volume[83016]: DEBUG oslo_service.backend._eventlet.service [None req-e2ecfc1f-232a-4b06-b530-a5d98f8cbd5c None None] target_helper = lioadm {{(pid=83016) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 16 14:41:54 devstack cinder-volume[83016]: DEBUG oslo_service.backend._eventlet.service [None req-e2ecfc1f-232a-4b06-b530-a5d98f8cbd5c None None] target_ip_address = 192.168.122.206 {{(pid=83016) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 16 14:41:54 devstack cinder-volume[83016]: DEBUG oslo_service.backend._eventlet.service [None req-e2ecfc1f-232a-4b06-b530-a5d98f8cbd5c None None] target_port = 3260 {{(pid=83016) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 16 14:41:54 devstack cinder-volume[83016]: DEBUG oslo_service.backend._eventlet.service [None req-e2ecfc1f-232a-4b06-b530-a5d98f8cbd5c None None] target_prefix = iqn.2010-10.org.openstack: {{(pid=83016) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 16 14:41:54 devstack cinder-volume[83016]: DEBUG oslo_service.backend._eventlet.service [None req-e2ecfc1f-232a-4b06-b530-a5d98f8cbd5c None None] target_protocol = iscsi {{(pid=83016) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 16 14:41:54 devstack cinder-volume[83016]: DEBUG oslo_service.backend._eventlet.service [None req-e2ecfc1f-232a-4b06-b530-a5d98f8cbd5c None None] target_secondary_ip_addresses = [] {{(pid=83016) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 16 14:41:54 devstack cinder-volume[83016]: DEBUG oslo_service.backend._eventlet.service [None req-e2ecfc1f-232a-4b06-b530-a5d98f8cbd5c None None] trace_flags = None {{(pid=83016) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 16 14:41:54 devstack cinder-volume[83016]: DEBUG oslo_service.backend._eventlet.service [None req-e2ecfc1f-232a-4b06-b530-a5d98f8cbd5c None None] transfer_api_class = cinder.transfer.api.API {{(pid=83016) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 16 14:41:54 devstack cinder-volume[83016]: DEBUG oslo_service.backend._eventlet.service [None req-e2ecfc1f-232a-4b06-b530-a5d98f8cbd5c None None] transport_url = **** {{(pid=83016) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 16 14:41:54 devstack cinder-volume[83016]: DEBUG oslo_service.backend._eventlet.service [None req-e2ecfc1f-232a-4b06-b530-a5d98f8cbd5c None None] until_refresh = 0 {{(pid=83016) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 16 14:41:54 devstack cinder-volume[83016]: DEBUG oslo_service.backend._eventlet.service [None req-e2ecfc1f-232a-4b06-b530-a5d98f8cbd5c None None] use_chap_auth = False {{(pid=83016) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 16 14:41:54 devstack cinder-volume[83016]: DEBUG oslo_service.backend._eventlet.service [None req-e2ecfc1f-232a-4b06-b530-a5d98f8cbd5c None None] use_default_quota_class = True {{(pid=83016) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 16 14:41:54 devstack cinder-volume[83016]: DEBUG oslo_service.backend._eventlet.service [None req-e2ecfc1f-232a-4b06-b530-a5d98f8cbd5c None None] use_journal = False {{(pid=83016) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 16 14:41:54 devstack cinder-volume[83016]: DEBUG oslo_service.backend._eventlet.service [None req-e2ecfc1f-232a-4b06-b530-a5d98f8cbd5c None None] use_json = False {{(pid=83016) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 16 14:41:54 devstack cinder-volume[83016]: DEBUG oslo_service.backend._eventlet.service [None req-e2ecfc1f-232a-4b06-b530-a5d98f8cbd5c None None] use_multipath_for_image_xfer = False {{(pid=83016) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 16 14:41:54 devstack cinder-volume[83016]: DEBUG oslo_service.backend._eventlet.service [None req-e2ecfc1f-232a-4b06-b530-a5d98f8cbd5c None None] use_stderr = False {{(pid=83016) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 16 14:41:54 devstack cinder-volume[83016]: DEBUG oslo_service.backend._eventlet.service [None req-e2ecfc1f-232a-4b06-b530-a5d98f8cbd5c None None] use_syslog = False {{(pid=83016) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 16 14:41:54 devstack cinder-volume[83016]: DEBUG oslo_service.backend._eventlet.service [None req-e2ecfc1f-232a-4b06-b530-a5d98f8cbd5c None None] verify_glance_signatures = enabled {{(pid=83016) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 16 14:41:54 devstack cinder-volume[83016]: DEBUG oslo_service.backend._eventlet.service [None req-e2ecfc1f-232a-4b06-b530-a5d98f8cbd5c None None] vmdk_allowed_types = ['streamOptimized', 'monolithicSparse'] {{(pid=83016) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 16 14:41:54 devstack cinder-volume[83016]: DEBUG oslo_service.backend._eventlet.service [None req-e2ecfc1f-232a-4b06-b530-a5d98f8cbd5c None None] volume_api_class = cinder.volume.api.API {{(pid=83016) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 16 14:41:54 devstack cinder-volume[83016]: DEBUG oslo_service.backend._eventlet.service [None req-e2ecfc1f-232a-4b06-b530-a5d98f8cbd5c None None] volume_backend_name = None {{(pid=83016) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 16 14:41:54 devstack cinder-volume[83016]: DEBUG oslo_service.backend._eventlet.service [None req-e2ecfc1f-232a-4b06-b530-a5d98f8cbd5c None None] volume_clear = zero {{(pid=83016) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 16 14:41:54 devstack cinder-volume[83016]: DEBUG oslo_service.backend._eventlet.service [None req-e2ecfc1f-232a-4b06-b530-a5d98f8cbd5c None None] volume_clear_ionice = None {{(pid=83016) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 16 14:41:54 devstack cinder-volume[83016]: DEBUG oslo_service.backend._eventlet.service [None req-e2ecfc1f-232a-4b06-b530-a5d98f8cbd5c None None] volume_clear_size = 0 {{(pid=83016) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 16 14:41:54 devstack cinder-volume[83016]: DEBUG oslo_service.backend._eventlet.service [None req-e2ecfc1f-232a-4b06-b530-a5d98f8cbd5c None None] volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=83016) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 16 14:41:54 devstack cinder-volume[83016]: DEBUG oslo_service.backend._eventlet.service [None req-e2ecfc1f-232a-4b06-b530-a5d98f8cbd5c None None] volume_copy_bps_limit = 0 {{(pid=83016) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 16 14:41:54 devstack cinder-volume[83016]: DEBUG oslo_service.backend._eventlet.service [None req-e2ecfc1f-232a-4b06-b530-a5d98f8cbd5c None None] volume_dd_blocksize = 1M {{(pid=83016) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 16 14:41:54 devstack cinder-volume[83016]: DEBUG oslo_service.backend._eventlet.service [None req-e2ecfc1f-232a-4b06-b530-a5d98f8cbd5c None None] volume_manager = cinder.volume.manager.VolumeManager {{(pid=83016) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 16 14:41:54 devstack cinder-volume[83016]: DEBUG oslo_service.backend._eventlet.service [None req-e2ecfc1f-232a-4b06-b530-a5d98f8cbd5c None None] volume_name_template = volume-%s {{(pid=83016) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 16 14:41:54 devstack cinder-volume[83016]: DEBUG oslo_service.backend._eventlet.service [None req-e2ecfc1f-232a-4b06-b530-a5d98f8cbd5c None None] volume_service_inithost_offload = False {{(pid=83016) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 16 14:41:54 devstack cinder-volume[83016]: DEBUG oslo_service.backend._eventlet.service [None req-e2ecfc1f-232a-4b06-b530-a5d98f8cbd5c None None] volume_usage_audit_period = month {{(pid=83016) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 16 14:41:54 devstack cinder-volume[83016]: DEBUG oslo_service.backend._eventlet.service [None req-e2ecfc1f-232a-4b06-b530-a5d98f8cbd5c None None] volumes_dir = /opt/stack/data/cinder/volumes {{(pid=83016) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 16 14:41:54 devstack cinder-volume[83016]: DEBUG oslo_service.backend._eventlet.service [None req-e2ecfc1f-232a-4b06-b530-a5d98f8cbd5c None None] watch_log_file = False {{(pid=83016) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 16 14:41:54 devstack cinder-volume[83016]: DEBUG oslo_service.backend._eventlet.service [None req-e2ecfc1f-232a-4b06-b530-a5d98f8cbd5c None None] zoning_mode = None {{(pid=83016) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 16 14:41:54 devstack cinder-volume[83016]: DEBUG oslo_service.backend._eventlet.service [None req-e2ecfc1f-232a-4b06-b530-a5d98f8cbd5c None None] os_brick.lock_path = /opt/stack/data/cinder {{(pid=83016) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 14:41:54 devstack cinder-volume[83016]: DEBUG oslo_service.backend._eventlet.service [None req-e2ecfc1f-232a-4b06-b530-a5d98f8cbd5c None None] os_brick.wait_mpath_device_attempts = 4 {{(pid=83016) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 14:41:54 devstack cinder-volume[83016]: DEBUG oslo_service.backend._eventlet.service [None req-e2ecfc1f-232a-4b06-b530-a5d98f8cbd5c None None] os_brick.wait_mpath_device_interval = 1 {{(pid=83016) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 14:41:54 devstack cinder-volume[83016]: DEBUG oslo_service.backend._eventlet.service [None req-e2ecfc1f-232a-4b06-b530-a5d98f8cbd5c None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=83016) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 14:41:54 devstack cinder-volume[83016]: DEBUG oslo_service.backend._eventlet.service [None req-e2ecfc1f-232a-4b06-b530-a5d98f8cbd5c None None] oslo_concurrency.disable_process_locking = False {{(pid=83016) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 14:41:54 devstack cinder-volume[83016]: DEBUG oslo_service.backend._eventlet.service [None req-e2ecfc1f-232a-4b06-b530-a5d98f8cbd5c None None] oslo_concurrency.lock_path = /opt/stack/data/cinder {{(pid=83016) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 14:41:54 devstack cinder-volume[83016]: DEBUG oslo_service.backend._eventlet.service [None req-e2ecfc1f-232a-4b06-b530-a5d98f8cbd5c None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=83016) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 14:41:54 devstack cinder-volume[83016]: DEBUG oslo_service.backend._eventlet.service [None req-e2ecfc1f-232a-4b06-b530-a5d98f8cbd5c None None] keystone_authtoken.admin_password = **** {{(pid=83016) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 14:41:54 devstack cinder-volume[83016]: DEBUG oslo_service.backend._eventlet.service [None req-e2ecfc1f-232a-4b06-b530-a5d98f8cbd5c None None] keystone_authtoken.admin_tenant_name = admin {{(pid=83016) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 14:41:54 devstack cinder-volume[83016]: DEBUG oslo_service.backend._eventlet.service [None req-e2ecfc1f-232a-4b06-b530-a5d98f8cbd5c None None] keystone_authtoken.admin_token = **** {{(pid=83016) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 14:41:54 devstack cinder-volume[83016]: DEBUG oslo_service.backend._eventlet.service [None req-e2ecfc1f-232a-4b06-b530-a5d98f8cbd5c None None] keystone_authtoken.admin_user = None {{(pid=83016) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 14:41:54 devstack cinder-volume[83016]: DEBUG oslo_service.backend._eventlet.service [None req-e2ecfc1f-232a-4b06-b530-a5d98f8cbd5c None None] keystone_authtoken.auth_admin_prefix = {{(pid=83016) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 14:41:54 devstack cinder-volume[83016]: DEBUG oslo_service.backend._eventlet.service [None req-e2ecfc1f-232a-4b06-b530-a5d98f8cbd5c None None] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=83016) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 14:41:54 devstack cinder-volume[83016]: DEBUG oslo_service.backend._eventlet.service [None req-e2ecfc1f-232a-4b06-b530-a5d98f8cbd5c None None] keystone_authtoken.auth_port = 35357 {{(pid=83016) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 14:41:54 devstack cinder-volume[83016]: DEBUG oslo_service.backend._eventlet.service [None req-e2ecfc1f-232a-4b06-b530-a5d98f8cbd5c None None] keystone_authtoken.auth_protocol = https {{(pid=83016) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 14:41:54 devstack cinder-volume[83016]: DEBUG oslo_service.backend._eventlet.service [None req-e2ecfc1f-232a-4b06-b530-a5d98f8cbd5c None None] keystone_authtoken.auth_section = None {{(pid=83016) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 14:41:54 devstack cinder-volume[83016]: DEBUG oslo_service.backend._eventlet.service [None req-e2ecfc1f-232a-4b06-b530-a5d98f8cbd5c None None] keystone_authtoken.auth_type = password {{(pid=83016) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 14:41:54 devstack cinder-volume[83016]: DEBUG oslo_service.backend._eventlet.service [None req-e2ecfc1f-232a-4b06-b530-a5d98f8cbd5c None None] keystone_authtoken.auth_uri = None {{(pid=83016) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 14:41:54 devstack cinder-volume[83016]: DEBUG oslo_service.backend._eventlet.service [None req-e2ecfc1f-232a-4b06-b530-a5d98f8cbd5c None None] keystone_authtoken.auth_version = None {{(pid=83016) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 14:41:54 devstack cinder-volume[83016]: DEBUG oslo_service.backend._eventlet.service [None req-e2ecfc1f-232a-4b06-b530-a5d98f8cbd5c None None] keystone_authtoken.cache = None {{(pid=83016) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 14:41:54 devstack cinder-volume[83016]: DEBUG oslo_service.backend._eventlet.service [None req-e2ecfc1f-232a-4b06-b530-a5d98f8cbd5c None None] keystone_authtoken.cafile = /opt/stack/data/ca-bundle.pem {{(pid=83016) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 14:41:54 devstack cinder-volume[83016]: DEBUG oslo_service.backend._eventlet.service [None req-e2ecfc1f-232a-4b06-b530-a5d98f8cbd5c None None] keystone_authtoken.certfile = None {{(pid=83016) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 14:41:54 devstack cinder-volume[83016]: DEBUG oslo_service.backend._eventlet.service [None req-e2ecfc1f-232a-4b06-b530-a5d98f8cbd5c None None] keystone_authtoken.delay_auth_decision = False {{(pid=83016) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 14:41:54 devstack cinder-volume[83016]: DEBUG oslo_service.backend._eventlet.service [None req-e2ecfc1f-232a-4b06-b530-a5d98f8cbd5c None None] keystone_authtoken.enforce_token_bind = permissive {{(pid=83016) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 14:41:54 devstack cinder-volume[83016]: DEBUG oslo_service.backend._eventlet.service [None req-e2ecfc1f-232a-4b06-b530-a5d98f8cbd5c None None] keystone_authtoken.http_connect_timeout = None {{(pid=83016) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 14:41:54 devstack cinder-volume[83016]: DEBUG oslo_service.backend._eventlet.service [None req-e2ecfc1f-232a-4b06-b530-a5d98f8cbd5c None None] keystone_authtoken.http_request_max_retries = 3 {{(pid=83016) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 14:41:54 devstack cinder-volume[83016]: DEBUG oslo_service.backend._eventlet.service [None req-e2ecfc1f-232a-4b06-b530-a5d98f8cbd5c None None] keystone_authtoken.identity_uri = None {{(pid=83016) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 14:41:54 devstack cinder-volume[83016]: DEBUG oslo_service.backend._eventlet.service [None req-e2ecfc1f-232a-4b06-b530-a5d98f8cbd5c None None] keystone_authtoken.include_service_catalog = True {{(pid=83016) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 14:41:54 devstack cinder-volume[83016]: DEBUG oslo_service.backend._eventlet.service [None req-e2ecfc1f-232a-4b06-b530-a5d98f8cbd5c None None] keystone_authtoken.insecure = False {{(pid=83016) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 14:41:54 devstack cinder-volume[83016]: DEBUG oslo_service.backend._eventlet.service [None req-e2ecfc1f-232a-4b06-b530-a5d98f8cbd5c None None] keystone_authtoken.interface = public {{(pid=83016) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 14:41:54 devstack cinder-volume[83016]: DEBUG oslo_service.backend._eventlet.service [None req-e2ecfc1f-232a-4b06-b530-a5d98f8cbd5c None None] keystone_authtoken.keyfile = None {{(pid=83016) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 14:41:54 devstack cinder-volume[83016]: DEBUG oslo_service.backend._eventlet.service [None req-e2ecfc1f-232a-4b06-b530-a5d98f8cbd5c None None] keystone_authtoken.memcache_password = {{(pid=83016) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 14:41:54 devstack cinder-volume[83016]: DEBUG oslo_service.backend._eventlet.service [None req-e2ecfc1f-232a-4b06-b530-a5d98f8cbd5c None None] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=83016) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 14:41:54 devstack cinder-volume[83016]: DEBUG oslo_service.backend._eventlet.service [None req-e2ecfc1f-232a-4b06-b530-a5d98f8cbd5c None None] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=83016) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 14:41:54 devstack cinder-volume[83016]: DEBUG oslo_service.backend._eventlet.service [None req-e2ecfc1f-232a-4b06-b530-a5d98f8cbd5c None None] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=83016) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 14:41:54 devstack cinder-volume[83016]: DEBUG oslo_service.backend._eventlet.service [None req-e2ecfc1f-232a-4b06-b530-a5d98f8cbd5c None None] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=83016) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 14:41:54 devstack cinder-volume[83016]: DEBUG oslo_service.backend._eventlet.service [None req-e2ecfc1f-232a-4b06-b530-a5d98f8cbd5c None None] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=83016) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 14:41:54 devstack cinder-volume[83016]: DEBUG oslo_service.backend._eventlet.service [None req-e2ecfc1f-232a-4b06-b530-a5d98f8cbd5c None None] keystone_authtoken.memcache_sasl_enabled = False {{(pid=83016) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 14:41:54 devstack cinder-volume[83016]: DEBUG oslo_service.backend._eventlet.service [None req-e2ecfc1f-232a-4b06-b530-a5d98f8cbd5c None None] keystone_authtoken.memcache_secret_key = **** {{(pid=83016) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 14:41:54 devstack cinder-volume[83016]: DEBUG oslo_service.backend._eventlet.service [None req-e2ecfc1f-232a-4b06-b530-a5d98f8cbd5c None None] keystone_authtoken.memcache_security_strategy = None {{(pid=83016) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 14:41:54 devstack cinder-volume[83016]: DEBUG oslo_service.backend._eventlet.service [None req-e2ecfc1f-232a-4b06-b530-a5d98f8cbd5c None None] keystone_authtoken.memcache_tls_allowed_ciphers = None {{(pid=83016) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 14:41:54 devstack cinder-volume[83016]: DEBUG oslo_service.backend._eventlet.service [None req-e2ecfc1f-232a-4b06-b530-a5d98f8cbd5c None None] keystone_authtoken.memcache_tls_cafile = None {{(pid=83016) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 14:41:54 devstack cinder-volume[83016]: DEBUG oslo_service.backend._eventlet.service [None req-e2ecfc1f-232a-4b06-b530-a5d98f8cbd5c None None] keystone_authtoken.memcache_tls_certfile = None {{(pid=83016) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 14:41:54 devstack cinder-volume[83016]: DEBUG oslo_service.backend._eventlet.service [None req-e2ecfc1f-232a-4b06-b530-a5d98f8cbd5c None None] keystone_authtoken.memcache_tls_enabled = False {{(pid=83016) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 14:41:54 devstack cinder-volume[83016]: DEBUG oslo_service.backend._eventlet.service [None req-e2ecfc1f-232a-4b06-b530-a5d98f8cbd5c None None] keystone_authtoken.memcache_tls_keyfile = None {{(pid=83016) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 14:41:54 devstack cinder-volume[83016]: DEBUG oslo_service.backend._eventlet.service [None req-e2ecfc1f-232a-4b06-b530-a5d98f8cbd5c None None] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=83016) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 14:41:54 devstack cinder-volume[83016]: DEBUG oslo_service.backend._eventlet.service [None req-e2ecfc1f-232a-4b06-b530-a5d98f8cbd5c None None] keystone_authtoken.memcache_username = {{(pid=83016) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 14:41:54 devstack cinder-volume[83016]: DEBUG oslo_service.backend._eventlet.service [None req-e2ecfc1f-232a-4b06-b530-a5d98f8cbd5c None None] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=83016) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 14:41:54 devstack cinder-volume[83016]: DEBUG oslo_service.backend._eventlet.service [None req-e2ecfc1f-232a-4b06-b530-a5d98f8cbd5c None None] keystone_authtoken.region_name = None {{(pid=83016) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 14:41:54 devstack cinder-volume[83016]: DEBUG oslo_service.backend._eventlet.service [None req-e2ecfc1f-232a-4b06-b530-a5d98f8cbd5c None None] keystone_authtoken.service_token_roles = ['service'] {{(pid=83016) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 14:41:54 devstack cinder-volume[83016]: DEBUG oslo_service.backend._eventlet.service [None req-e2ecfc1f-232a-4b06-b530-a5d98f8cbd5c None None] keystone_authtoken.service_token_roles_required = False {{(pid=83016) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 14:41:54 devstack cinder-volume[83016]: DEBUG oslo_service.backend._eventlet.service [None req-e2ecfc1f-232a-4b06-b530-a5d98f8cbd5c None None] keystone_authtoken.service_type = None {{(pid=83016) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 14:41:54 devstack cinder-volume[83016]: DEBUG oslo_service.backend._eventlet.service [None req-e2ecfc1f-232a-4b06-b530-a5d98f8cbd5c None None] keystone_authtoken.token_cache_time = 300 {{(pid=83016) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 14:41:54 devstack cinder-volume[83016]: DEBUG oslo_service.backend._eventlet.service [None req-e2ecfc1f-232a-4b06-b530-a5d98f8cbd5c None None] keystone_authtoken.www_authenticate_uri = None {{(pid=83016) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 14:41:54 devstack cinder-volume[83016]: DEBUG oslo_service.backend._eventlet.service [None req-e2ecfc1f-232a-4b06-b530-a5d98f8cbd5c None None] cache.backend = dogpile.cache.null {{(pid=83016) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 14:41:54 devstack cinder-volume[83016]: DEBUG oslo_service.backend._eventlet.service [None req-e2ecfc1f-232a-4b06-b530-a5d98f8cbd5c None None] cache.backend_argument = **** {{(pid=83016) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 14:41:54 devstack cinder-volume[83016]: DEBUG oslo_service.backend._eventlet.service [None req-e2ecfc1f-232a-4b06-b530-a5d98f8cbd5c None None] cache.backend_expiration_time = None {{(pid=83016) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 14:41:54 devstack cinder-volume[83016]: DEBUG oslo_service.backend._eventlet.service [None req-e2ecfc1f-232a-4b06-b530-a5d98f8cbd5c None None] cache.config_prefix = cache.oslo {{(pid=83016) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 14:41:54 devstack cinder-volume[83016]: DEBUG oslo_service.backend._eventlet.service [None req-e2ecfc1f-232a-4b06-b530-a5d98f8cbd5c None None] cache.dead_timeout = 60.0 {{(pid=83016) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 14:41:54 devstack cinder-volume[83016]: DEBUG oslo_service.backend._eventlet.service [None req-e2ecfc1f-232a-4b06-b530-a5d98f8cbd5c None None] cache.debug_cache_backend = False {{(pid=83016) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 14:41:54 devstack cinder-volume[83016]: DEBUG oslo_service.backend._eventlet.service [None req-e2ecfc1f-232a-4b06-b530-a5d98f8cbd5c None None] cache.enable_retry_client = False {{(pid=83016) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 14:41:54 devstack cinder-volume[83016]: DEBUG oslo_service.backend._eventlet.service [None req-e2ecfc1f-232a-4b06-b530-a5d98f8cbd5c None None] cache.enable_socket_keepalive = False {{(pid=83016) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 14:41:54 devstack cinder-volume[83016]: DEBUG oslo_service.backend._eventlet.service [None req-e2ecfc1f-232a-4b06-b530-a5d98f8cbd5c None None] cache.enabled = False {{(pid=83016) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 14:41:54 devstack cinder-volume[83016]: DEBUG oslo_service.backend._eventlet.service [None req-e2ecfc1f-232a-4b06-b530-a5d98f8cbd5c None None] cache.enforce_fips_mode = False {{(pid=83016) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 14:41:54 devstack cinder-volume[83016]: DEBUG oslo_service.backend._eventlet.service [None req-e2ecfc1f-232a-4b06-b530-a5d98f8cbd5c None None] cache.expiration_time = 600 {{(pid=83016) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 14:41:54 devstack cinder-volume[83016]: DEBUG oslo_service.backend._eventlet.service [None req-e2ecfc1f-232a-4b06-b530-a5d98f8cbd5c None None] cache.hashclient_retry_attempts = 2 {{(pid=83016) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 14:41:54 devstack cinder-volume[83016]: DEBUG oslo_service.backend._eventlet.service [None req-e2ecfc1f-232a-4b06-b530-a5d98f8cbd5c None None] cache.hashclient_retry_delay = 1.0 {{(pid=83016) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 14:41:54 devstack cinder-volume[83016]: DEBUG oslo_service.backend._eventlet.service [None req-e2ecfc1f-232a-4b06-b530-a5d98f8cbd5c None None] cache.memcache_dead_retry = 300 {{(pid=83016) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 14:41:54 devstack cinder-volume[83016]: DEBUG oslo_service.backend._eventlet.service [None req-e2ecfc1f-232a-4b06-b530-a5d98f8cbd5c None None] cache.memcache_password = **** {{(pid=83016) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 14:41:54 devstack cinder-volume[83016]: DEBUG oslo_service.backend._eventlet.service [None req-e2ecfc1f-232a-4b06-b530-a5d98f8cbd5c None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=83016) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 14:41:54 devstack cinder-volume[83016]: DEBUG oslo_service.backend._eventlet.service [None req-e2ecfc1f-232a-4b06-b530-a5d98f8cbd5c None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=83016) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 14:41:54 devstack cinder-volume[83016]: DEBUG oslo_service.backend._eventlet.service [None req-e2ecfc1f-232a-4b06-b530-a5d98f8cbd5c None None] cache.memcache_pool_maxsize = 10 {{(pid=83016) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 14:41:54 devstack cinder-volume[83016]: DEBUG oslo_service.backend._eventlet.service [None req-e2ecfc1f-232a-4b06-b530-a5d98f8cbd5c None None] cache.memcache_pool_unused_timeout = 60 {{(pid=83016) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 14:41:54 devstack cinder-volume[83016]: DEBUG oslo_service.backend._eventlet.service [None req-e2ecfc1f-232a-4b06-b530-a5d98f8cbd5c None None] cache.memcache_sasl_enabled = False {{(pid=83016) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 14:41:54 devstack cinder-volume[83016]: DEBUG oslo_service.backend._eventlet.service [None req-e2ecfc1f-232a-4b06-b530-a5d98f8cbd5c None None] cache.memcache_servers = ['localhost:11211'] {{(pid=83016) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 14:41:54 devstack cinder-volume[83016]: DEBUG oslo_service.backend._eventlet.service [None req-e2ecfc1f-232a-4b06-b530-a5d98f8cbd5c None None] cache.memcache_socket_timeout = 1.0 {{(pid=83016) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 14:41:54 devstack cinder-volume[83016]: DEBUG oslo_service.backend._eventlet.service [None req-e2ecfc1f-232a-4b06-b530-a5d98f8cbd5c None None] cache.memcache_username = None {{(pid=83016) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 14:41:54 devstack cinder-volume[83016]: DEBUG oslo_service.backend._eventlet.service [None req-e2ecfc1f-232a-4b06-b530-a5d98f8cbd5c None None] cache.proxies = [] {{(pid=83016) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 14:41:54 devstack cinder-volume[83016]: DEBUG oslo_service.backend._eventlet.service [None req-e2ecfc1f-232a-4b06-b530-a5d98f8cbd5c None None] cache.redis_db = 0 {{(pid=83016) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 14:41:54 devstack cinder-volume[83016]: DEBUG oslo_service.backend._eventlet.service [None req-e2ecfc1f-232a-4b06-b530-a5d98f8cbd5c None None] cache.redis_password = **** {{(pid=83016) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 14:41:54 devstack cinder-volume[83016]: DEBUG oslo_service.backend._eventlet.service [None req-e2ecfc1f-232a-4b06-b530-a5d98f8cbd5c None None] cache.redis_sentinel_service_name = mymaster {{(pid=83016) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 14:41:54 devstack cinder-volume[83016]: DEBUG oslo_service.backend._eventlet.service [None req-e2ecfc1f-232a-4b06-b530-a5d98f8cbd5c None None] cache.redis_sentinels = ['localhost:26379'] {{(pid=83016) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 14:41:54 devstack cinder-volume[83016]: DEBUG oslo_service.backend._eventlet.service [None req-e2ecfc1f-232a-4b06-b530-a5d98f8cbd5c None None] cache.redis_server = localhost:6379 {{(pid=83016) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 14:41:54 devstack cinder-volume[83016]: DEBUG oslo_service.backend._eventlet.service [None req-e2ecfc1f-232a-4b06-b530-a5d98f8cbd5c None None] cache.redis_socket_timeout = 1.0 {{(pid=83016) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 14:41:54 devstack cinder-volume[83016]: DEBUG oslo_service.backend._eventlet.service [None req-e2ecfc1f-232a-4b06-b530-a5d98f8cbd5c None None] cache.redis_username = None {{(pid=83016) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 14:41:54 devstack cinder-volume[83016]: DEBUG oslo_service.backend._eventlet.service [None req-e2ecfc1f-232a-4b06-b530-a5d98f8cbd5c None None] cache.retry_attempts = 2 {{(pid=83016) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 14:41:54 devstack cinder-volume[83016]: DEBUG oslo_service.backend._eventlet.service [None req-e2ecfc1f-232a-4b06-b530-a5d98f8cbd5c None None] cache.retry_delay = 0.0 {{(pid=83016) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 14:41:54 devstack cinder-volume[83016]: DEBUG oslo_service.backend._eventlet.service [None req-e2ecfc1f-232a-4b06-b530-a5d98f8cbd5c None None] cache.socket_keepalive_count = 1 {{(pid=83016) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 14:41:54 devstack cinder-volume[83016]: DEBUG oslo_service.backend._eventlet.service [None req-e2ecfc1f-232a-4b06-b530-a5d98f8cbd5c None None] cache.socket_keepalive_idle = 1 {{(pid=83016) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 14:41:54 devstack cinder-volume[83016]: DEBUG oslo_service.backend._eventlet.service [None req-e2ecfc1f-232a-4b06-b530-a5d98f8cbd5c None None] cache.socket_keepalive_interval = 1 {{(pid=83016) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 14:41:54 devstack cinder-volume[83016]: DEBUG oslo_service.backend._eventlet.service [None req-e2ecfc1f-232a-4b06-b530-a5d98f8cbd5c None None] cache.tls_allowed_ciphers = None {{(pid=83016) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 14:41:54 devstack cinder-volume[83016]: DEBUG oslo_service.backend._eventlet.service [None req-e2ecfc1f-232a-4b06-b530-a5d98f8cbd5c None None] cache.tls_cafile = None {{(pid=83016) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 14:41:54 devstack cinder-volume[83016]: DEBUG oslo_service.backend._eventlet.service [None req-e2ecfc1f-232a-4b06-b530-a5d98f8cbd5c None None] cache.tls_certfile = None {{(pid=83016) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 14:41:54 devstack cinder-volume[83016]: DEBUG oslo_service.backend._eventlet.service [None req-e2ecfc1f-232a-4b06-b530-a5d98f8cbd5c None None] cache.tls_enabled = False {{(pid=83016) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 14:41:54 devstack cinder-volume[83016]: DEBUG oslo_service.backend._eventlet.service [None req-e2ecfc1f-232a-4b06-b530-a5d98f8cbd5c None None] cache.tls_keyfile = None {{(pid=83016) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 14:41:54 devstack cinder-volume[83016]: DEBUG oslo_service.backend._eventlet.service [None req-e2ecfc1f-232a-4b06-b530-a5d98f8cbd5c None None] coordination.backend_url = **** {{(pid=83016) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 14:41:54 devstack cinder-volume[83016]: DEBUG oslo_service.backend._eventlet.service [None req-e2ecfc1f-232a-4b06-b530-a5d98f8cbd5c None None] database.asyncio_connection = **** {{(pid=83016) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 14:41:54 devstack cinder-volume[83016]: DEBUG oslo_service.backend._eventlet.service [None req-e2ecfc1f-232a-4b06-b530-a5d98f8cbd5c None None] database.asyncio_slave_connection = **** {{(pid=83016) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 14:41:54 devstack cinder-volume[83016]: DEBUG oslo_service.backend._eventlet.service [None req-e2ecfc1f-232a-4b06-b530-a5d98f8cbd5c None None] database.backend = sqlalchemy {{(pid=83016) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 14:41:54 devstack cinder-volume[83016]: DEBUG oslo_service.backend._eventlet.service [None req-e2ecfc1f-232a-4b06-b530-a5d98f8cbd5c None None] database.connection = **** {{(pid=83016) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 14:41:54 devstack cinder-volume[83016]: DEBUG oslo_service.backend._eventlet.service [None req-e2ecfc1f-232a-4b06-b530-a5d98f8cbd5c None None] database.connection_debug = 0 {{(pid=83016) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 14:41:54 devstack cinder-volume[83016]: DEBUG oslo_service.backend._eventlet.service [None req-e2ecfc1f-232a-4b06-b530-a5d98f8cbd5c None None] database.connection_parameters = {{(pid=83016) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 14:41:54 devstack cinder-volume[83016]: DEBUG oslo_service.backend._eventlet.service [None req-e2ecfc1f-232a-4b06-b530-a5d98f8cbd5c None None] database.connection_recycle_time = 3600 {{(pid=83016) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 14:41:54 devstack cinder-volume[83016]: DEBUG oslo_service.backend._eventlet.service [None req-e2ecfc1f-232a-4b06-b530-a5d98f8cbd5c None None] database.connection_trace = False {{(pid=83016) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 14:41:54 devstack cinder-volume[83016]: DEBUG oslo_service.backend._eventlet.service [None req-e2ecfc1f-232a-4b06-b530-a5d98f8cbd5c None None] database.db_inc_retry_interval = True {{(pid=83016) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 14:41:54 devstack cinder-volume[83016]: DEBUG oslo_service.backend._eventlet.service [None req-e2ecfc1f-232a-4b06-b530-a5d98f8cbd5c None None] database.db_max_retries = 20 {{(pid=83016) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 14:41:54 devstack cinder-volume[83016]: DEBUG oslo_service.backend._eventlet.service [None req-e2ecfc1f-232a-4b06-b530-a5d98f8cbd5c None None] database.db_max_retry_interval = 10 {{(pid=83016) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 14:41:54 devstack cinder-volume[83016]: DEBUG oslo_service.backend._eventlet.service [None req-e2ecfc1f-232a-4b06-b530-a5d98f8cbd5c None None] database.db_retry_interval = 1 {{(pid=83016) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 14:41:54 devstack cinder-volume[83016]: DEBUG oslo_service.backend._eventlet.service [None req-e2ecfc1f-232a-4b06-b530-a5d98f8cbd5c None None] database.max_overflow = 50 {{(pid=83016) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 14:41:54 devstack cinder-volume[83016]: DEBUG oslo_service.backend._eventlet.service [None req-e2ecfc1f-232a-4b06-b530-a5d98f8cbd5c None None] database.max_pool_size = 5 {{(pid=83016) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 14:41:54 devstack cinder-volume[83016]: DEBUG oslo_service.backend._eventlet.service [None req-e2ecfc1f-232a-4b06-b530-a5d98f8cbd5c None None] database.max_retries = 10 {{(pid=83016) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 14:41:54 devstack cinder-volume[83016]: DEBUG oslo_service.backend._eventlet.service [None req-e2ecfc1f-232a-4b06-b530-a5d98f8cbd5c None None] database.mysql_sql_mode = TRADITIONAL {{(pid=83016) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 14:41:54 devstack cinder-volume[83016]: DEBUG oslo_service.backend._eventlet.service [None req-e2ecfc1f-232a-4b06-b530-a5d98f8cbd5c None None] database.mysql_wsrep_sync_wait = None {{(pid=83016) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 14:41:54 devstack cinder-volume[83016]: DEBUG oslo_service.backend._eventlet.service [None req-e2ecfc1f-232a-4b06-b530-a5d98f8cbd5c None None] database.pool_timeout = None {{(pid=83016) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 14:41:54 devstack cinder-volume[83016]: DEBUG oslo_service.backend._eventlet.service [None req-e2ecfc1f-232a-4b06-b530-a5d98f8cbd5c None None] database.retry_interval = 10 {{(pid=83016) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 14:41:54 devstack cinder-volume[83016]: DEBUG oslo_service.backend._eventlet.service [None req-e2ecfc1f-232a-4b06-b530-a5d98f8cbd5c None None] database.slave_connection = **** {{(pid=83016) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 14:41:54 devstack cinder-volume[83016]: DEBUG oslo_service.backend._eventlet.service [None req-e2ecfc1f-232a-4b06-b530-a5d98f8cbd5c None None] database.sqlite_synchronous = True {{(pid=83016) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 14:41:54 devstack cinder-volume[83016]: DEBUG oslo_service.backend._eventlet.service [None req-e2ecfc1f-232a-4b06-b530-a5d98f8cbd5c None None] database.use_db_reconnect = False {{(pid=83016) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 14:41:54 devstack cinder-volume[83016]: DEBUG oslo_service.backend._eventlet.service [None req-e2ecfc1f-232a-4b06-b530-a5d98f8cbd5c None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=83016) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 14:41:54 devstack cinder-volume[83016]: DEBUG oslo_service.backend._eventlet.service [None req-e2ecfc1f-232a-4b06-b530-a5d98f8cbd5c None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=83016) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 14:41:54 devstack cinder-volume[83016]: DEBUG oslo_service.backend._eventlet.service [None req-e2ecfc1f-232a-4b06-b530-a5d98f8cbd5c None None] oslo_messaging_metrics.metrics_process_name = {{(pid=83016) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 14:41:54 devstack cinder-volume[83016]: DEBUG oslo_service.backend._eventlet.service [None req-e2ecfc1f-232a-4b06-b530-a5d98f8cbd5c None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=83016) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 14:41:54 devstack cinder-volume[83016]: DEBUG oslo_service.backend._eventlet.service [None req-e2ecfc1f-232a-4b06-b530-a5d98f8cbd5c None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=83016) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 14:41:54 devstack cinder-volume[83016]: DEBUG oslo_service.backend._eventlet.service [None req-e2ecfc1f-232a-4b06-b530-a5d98f8cbd5c None None] profiler.connection_string = messaging:// {{(pid=83016) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 14:41:54 devstack cinder-volume[83016]: DEBUG oslo_service.backend._eventlet.service [None req-e2ecfc1f-232a-4b06-b530-a5d98f8cbd5c None None] profiler.enabled = False {{(pid=83016) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 14:41:54 devstack cinder-volume[83016]: DEBUG oslo_service.backend._eventlet.service [None req-e2ecfc1f-232a-4b06-b530-a5d98f8cbd5c None None] profiler.es_doc_type = notification {{(pid=83016) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 14:41:54 devstack cinder-volume[83016]: DEBUG oslo_service.backend._eventlet.service [None req-e2ecfc1f-232a-4b06-b530-a5d98f8cbd5c None None] profiler.es_scroll_size = 10000 {{(pid=83016) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 14:41:54 devstack cinder-volume[83016]: DEBUG oslo_service.backend._eventlet.service [None req-e2ecfc1f-232a-4b06-b530-a5d98f8cbd5c None None] profiler.es_scroll_time = 2m {{(pid=83016) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 14:41:54 devstack cinder-volume[83016]: DEBUG oslo_service.backend._eventlet.service [None req-e2ecfc1f-232a-4b06-b530-a5d98f8cbd5c None None] profiler.filter_error_trace = False {{(pid=83016) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 14:41:54 devstack cinder-volume[83016]: DEBUG oslo_service.backend._eventlet.service [None req-e2ecfc1f-232a-4b06-b530-a5d98f8cbd5c None None] profiler.hmac_keys = **** {{(pid=83016) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 14:41:54 devstack cinder-volume[83016]: DEBUG oslo_service.backend._eventlet.service [None req-e2ecfc1f-232a-4b06-b530-a5d98f8cbd5c None None] profiler.sentinel_service_name = mymaster {{(pid=83016) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 14:41:54 devstack cinder-volume[83016]: DEBUG oslo_service.backend._eventlet.service [None req-e2ecfc1f-232a-4b06-b530-a5d98f8cbd5c None None] profiler.socket_timeout = 0.1 {{(pid=83016) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 14:41:54 devstack cinder-volume[83016]: DEBUG oslo_service.backend._eventlet.service [None req-e2ecfc1f-232a-4b06-b530-a5d98f8cbd5c None None] profiler.trace_requests = False {{(pid=83016) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 14:41:54 devstack cinder-volume[83016]: DEBUG oslo_service.backend._eventlet.service [None req-e2ecfc1f-232a-4b06-b530-a5d98f8cbd5c None None] profiler.trace_sqlalchemy = False {{(pid=83016) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 14:41:54 devstack cinder-volume[83016]: DEBUG oslo_service.backend._eventlet.service [None req-e2ecfc1f-232a-4b06-b530-a5d98f8cbd5c None None] profiler_jaeger.process_tags = {} {{(pid=83016) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 14:41:54 devstack cinder-volume[83016]: DEBUG oslo_service.backend._eventlet.service [None req-e2ecfc1f-232a-4b06-b530-a5d98f8cbd5c None None] profiler_jaeger.service_name_prefix = None {{(pid=83016) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 14:41:54 devstack cinder-volume[83016]: DEBUG oslo_service.backend._eventlet.service [None req-e2ecfc1f-232a-4b06-b530-a5d98f8cbd5c None None] profiler_otlp.service_name_prefix = None {{(pid=83016) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 14:41:54 devstack cinder-volume[83016]: DEBUG oslo_service.backend._eventlet.service [None req-e2ecfc1f-232a-4b06-b530-a5d98f8cbd5c None None] oslo_policy.enforce_new_defaults = False {{(pid=83016) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 14:41:54 devstack cinder-volume[83016]: WARNING oslo_config.cfg [None req-e2ecfc1f-232a-4b06-b530-a5d98f8cbd5c None None] Deprecated: Option "enforce_scope" from group "oslo_policy" is deprecated for removal (This configuration was added temporarily to facilitate a smooth transition to the new RBAC. OpenStack will always enforce scope checks. This configuration option is deprecated and will be removed in the 2025.2 cycle.). Its value may be silently ignored in the future. Sep 16 14:41:54 devstack cinder-volume[83016]: DEBUG oslo_service.backend._eventlet.service [None req-e2ecfc1f-232a-4b06-b530-a5d98f8cbd5c None None] oslo_policy.enforce_scope = False {{(pid=83016) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 14:41:54 devstack cinder-volume[83016]: DEBUG oslo_service.backend._eventlet.service [None req-e2ecfc1f-232a-4b06-b530-a5d98f8cbd5c None None] oslo_policy.policy_default_rule = default {{(pid=83016) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 14:41:54 devstack cinder-volume[83016]: DEBUG oslo_service.backend._eventlet.service [None req-e2ecfc1f-232a-4b06-b530-a5d98f8cbd5c None None] oslo_policy.policy_dirs = ['policy.d'] {{(pid=83016) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 14:41:54 devstack cinder-volume[83016]: DEBUG oslo_service.backend._eventlet.service [None req-e2ecfc1f-232a-4b06-b530-a5d98f8cbd5c None None] oslo_policy.policy_file = policy.yaml {{(pid=83016) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 14:41:54 devstack cinder-volume[83016]: DEBUG oslo_service.backend._eventlet.service [None req-e2ecfc1f-232a-4b06-b530-a5d98f8cbd5c None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=83016) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 14:41:54 devstack cinder-volume[83016]: DEBUG oslo_service.backend._eventlet.service [None req-e2ecfc1f-232a-4b06-b530-a5d98f8cbd5c None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=83016) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 14:41:54 devstack cinder-volume[83016]: DEBUG oslo_service.backend._eventlet.service [None req-e2ecfc1f-232a-4b06-b530-a5d98f8cbd5c None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=83016) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 14:41:54 devstack cinder-volume[83016]: DEBUG oslo_service.backend._eventlet.service [None req-e2ecfc1f-232a-4b06-b530-a5d98f8cbd5c None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=83016) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 14:41:54 devstack cinder-volume[83016]: DEBUG oslo_service.backend._eventlet.service [None req-e2ecfc1f-232a-4b06-b530-a5d98f8cbd5c None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=83016) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 14:41:54 devstack cinder-volume[83016]: DEBUG oslo_service.backend._eventlet.service [None req-e2ecfc1f-232a-4b06-b530-a5d98f8cbd5c None None] oslo_policy.remote_timeout = 60.0 {{(pid=83016) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 14:41:54 devstack cinder-volume[83016]: DEBUG oslo_service.backend._eventlet.service [None req-e2ecfc1f-232a-4b06-b530-a5d98f8cbd5c None None] privsep_osbrick.capabilities = [21, 2] {{(pid=83016) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 14:41:54 devstack cinder-volume[83016]: DEBUG oslo_service.backend._eventlet.service [None req-e2ecfc1f-232a-4b06-b530-a5d98f8cbd5c None None] privsep_osbrick.group = None {{(pid=83016) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 14:41:54 devstack cinder-volume[83016]: DEBUG oslo_service.backend._eventlet.service [None req-e2ecfc1f-232a-4b06-b530-a5d98f8cbd5c None None] privsep_osbrick.helper_command = None {{(pid=83016) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 14:41:54 devstack cinder-volume[83016]: DEBUG oslo_service.backend._eventlet.service [None req-e2ecfc1f-232a-4b06-b530-a5d98f8cbd5c None None] privsep_osbrick.log_daemon_traceback = False {{(pid=83016) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 14:41:54 devstack cinder-volume[83016]: DEBUG oslo_service.backend._eventlet.service [None req-e2ecfc1f-232a-4b06-b530-a5d98f8cbd5c None None] privsep_osbrick.logger_name = os_brick.privileged {{(pid=83016) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 14:41:54 devstack cinder-volume[83016]: DEBUG oslo_service.backend._eventlet.service [None req-e2ecfc1f-232a-4b06-b530-a5d98f8cbd5c None None] privsep_osbrick.thread_pool_size = 3 {{(pid=83016) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 14:41:54 devstack cinder-volume[83016]: DEBUG oslo_service.backend._eventlet.service [None req-e2ecfc1f-232a-4b06-b530-a5d98f8cbd5c None None] privsep_osbrick.user = None {{(pid=83016) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 14:41:54 devstack cinder-volume[83016]: DEBUG oslo_service.backend._eventlet.service [None req-e2ecfc1f-232a-4b06-b530-a5d98f8cbd5c None None] cinder_sys_admin.capabilities = [0, 1, 2, 3, 12, 21] {{(pid=83016) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 14:41:54 devstack cinder-volume[83016]: DEBUG oslo_service.backend._eventlet.service [None req-e2ecfc1f-232a-4b06-b530-a5d98f8cbd5c None None] cinder_sys_admin.group = None {{(pid=83016) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 14:41:54 devstack cinder-volume[83016]: DEBUG oslo_service.backend._eventlet.service [None req-e2ecfc1f-232a-4b06-b530-a5d98f8cbd5c None None] cinder_sys_admin.helper_command = None {{(pid=83016) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 14:41:54 devstack cinder-volume[83016]: DEBUG oslo_service.backend._eventlet.service [None req-e2ecfc1f-232a-4b06-b530-a5d98f8cbd5c None None] cinder_sys_admin.log_daemon_traceback = False {{(pid=83016) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 14:41:54 devstack cinder-volume[83016]: DEBUG oslo_service.backend._eventlet.service [None req-e2ecfc1f-232a-4b06-b530-a5d98f8cbd5c None None] cinder_sys_admin.logger_name = oslo_privsep.daemon {{(pid=83016) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 14:41:54 devstack cinder-volume[83016]: DEBUG oslo_service.backend._eventlet.service [None req-e2ecfc1f-232a-4b06-b530-a5d98f8cbd5c None None] cinder_sys_admin.thread_pool_size = 3 {{(pid=83016) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 14:41:54 devstack cinder-volume[83016]: DEBUG oslo_service.backend._eventlet.service [None req-e2ecfc1f-232a-4b06-b530-a5d98f8cbd5c None None] cinder_sys_admin.user = None {{(pid=83016) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 14:41:54 devstack cinder-volume[83016]: DEBUG oslo_service.backend._eventlet.service [None req-e2ecfc1f-232a-4b06-b530-a5d98f8cbd5c None None] service_user.auth_section = None {{(pid=83016) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 14:41:54 devstack cinder-volume[83016]: DEBUG oslo_service.backend._eventlet.service [None req-e2ecfc1f-232a-4b06-b530-a5d98f8cbd5c None None] service_user.auth_type = password {{(pid=83016) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 14:41:54 devstack cinder-volume[83016]: DEBUG oslo_service.backend._eventlet.service [None req-e2ecfc1f-232a-4b06-b530-a5d98f8cbd5c None None] service_user.cafile = /opt/stack/data/ca-bundle.pem {{(pid=83016) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 14:41:54 devstack cinder-volume[83016]: DEBUG oslo_service.backend._eventlet.service [None req-e2ecfc1f-232a-4b06-b530-a5d98f8cbd5c None None] service_user.certfile = None {{(pid=83016) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 14:41:54 devstack cinder-volume[83016]: DEBUG oslo_service.backend._eventlet.service [None req-e2ecfc1f-232a-4b06-b530-a5d98f8cbd5c None None] service_user.collect_timing = False {{(pid=83016) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 14:41:54 devstack cinder-volume[83016]: DEBUG oslo_service.backend._eventlet.service [None req-e2ecfc1f-232a-4b06-b530-a5d98f8cbd5c None None] service_user.insecure = False {{(pid=83016) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 14:41:54 devstack cinder-volume[83016]: DEBUG oslo_service.backend._eventlet.service [None req-e2ecfc1f-232a-4b06-b530-a5d98f8cbd5c None None] service_user.keyfile = None {{(pid=83016) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 14:41:54 devstack cinder-volume[83016]: DEBUG oslo_service.backend._eventlet.service [None req-e2ecfc1f-232a-4b06-b530-a5d98f8cbd5c None None] service_user.send_service_user_token = True {{(pid=83016) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 14:41:54 devstack cinder-volume[83016]: DEBUG oslo_service.backend._eventlet.service [None req-e2ecfc1f-232a-4b06-b530-a5d98f8cbd5c None None] service_user.split_loggers = False {{(pid=83016) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 14:41:54 devstack cinder-volume[83016]: DEBUG oslo_service.backend._eventlet.service [None req-e2ecfc1f-232a-4b06-b530-a5d98f8cbd5c None None] service_user.timeout = None {{(pid=83016) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 14:41:54 devstack cinder-volume[83016]: DEBUG oslo_service.backend._eventlet.service [None req-e2ecfc1f-232a-4b06-b530-a5d98f8cbd5c None None] glance.auth_section = None {{(pid=83016) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 14:41:54 devstack cinder-volume[83016]: DEBUG oslo_service.backend._eventlet.service [None req-e2ecfc1f-232a-4b06-b530-a5d98f8cbd5c None None] glance.auth_type = password {{(pid=83016) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 14:41:54 devstack cinder-volume[83016]: DEBUG oslo_service.backend._eventlet.service [None req-e2ecfc1f-232a-4b06-b530-a5d98f8cbd5c None None] glance.cafile = /opt/stack/data/ca-bundle.pem {{(pid=83016) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 14:41:54 devstack cinder-volume[83016]: DEBUG oslo_service.backend._eventlet.service [None req-e2ecfc1f-232a-4b06-b530-a5d98f8cbd5c None None] glance.certfile = None {{(pid=83016) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 14:41:54 devstack cinder-volume[83016]: DEBUG oslo_service.backend._eventlet.service [None req-e2ecfc1f-232a-4b06-b530-a5d98f8cbd5c None None] glance.collect_timing = False {{(pid=83016) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 14:41:54 devstack cinder-volume[83016]: DEBUG oslo_service.backend._eventlet.service [None req-e2ecfc1f-232a-4b06-b530-a5d98f8cbd5c None None] glance.insecure = False {{(pid=83016) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 14:41:54 devstack cinder-volume[83016]: DEBUG oslo_service.backend._eventlet.service [None req-e2ecfc1f-232a-4b06-b530-a5d98f8cbd5c None None] glance.keyfile = None {{(pid=83016) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 14:41:54 devstack cinder-volume[83016]: DEBUG oslo_service.backend._eventlet.service [None req-e2ecfc1f-232a-4b06-b530-a5d98f8cbd5c None None] glance.split_loggers = False {{(pid=83016) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 14:41:54 devstack cinder-volume[83016]: DEBUG oslo_service.backend._eventlet.service [None req-e2ecfc1f-232a-4b06-b530-a5d98f8cbd5c None None] glance.timeout = None {{(pid=83016) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 14:41:54 devstack cinder-volume[83016]: DEBUG oslo_service.backend._eventlet.service [None req-e2ecfc1f-232a-4b06-b530-a5d98f8cbd5c None None] backend_defaults.backend_availability_zone = None {{(pid=83016) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 14:41:54 devstack cinder-volume[83016]: DEBUG oslo_service.backend._eventlet.service [None req-e2ecfc1f-232a-4b06-b530-a5d98f8cbd5c None None] backend_defaults.backend_native_threads_pool_size = 20 {{(pid=83016) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 14:41:54 devstack cinder-volume[83016]: DEBUG oslo_service.backend._eventlet.service [None req-e2ecfc1f-232a-4b06-b530-a5d98f8cbd5c None None] backend_defaults.backup_use_temp_snapshot = False {{(pid=83016) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 14:41:54 devstack cinder-volume[83016]: DEBUG oslo_service.backend._eventlet.service [None req-e2ecfc1f-232a-4b06-b530-a5d98f8cbd5c None None] backend_defaults.chap_password = **** {{(pid=83016) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 14:41:54 devstack cinder-volume[83016]: DEBUG oslo_service.backend._eventlet.service [None req-e2ecfc1f-232a-4b06-b530-a5d98f8cbd5c None None] backend_defaults.chap_username = {{(pid=83016) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 14:41:54 devstack cinder-volume[83016]: DEBUG oslo_service.backend._eventlet.service [None req-e2ecfc1f-232a-4b06-b530-a5d98f8cbd5c None None] backend_defaults.chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=83016) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 14:41:54 devstack cinder-volume[83016]: DEBUG oslo_service.backend._eventlet.service [None req-e2ecfc1f-232a-4b06-b530-a5d98f8cbd5c None None] backend_defaults.driver_client_cert = None {{(pid=83016) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 14:41:54 devstack cinder-volume[83016]: DEBUG oslo_service.backend._eventlet.service [None req-e2ecfc1f-232a-4b06-b530-a5d98f8cbd5c None None] backend_defaults.driver_client_cert_key = None {{(pid=83016) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 14:41:54 devstack cinder-volume[83016]: DEBUG oslo_service.backend._eventlet.service [None req-e2ecfc1f-232a-4b06-b530-a5d98f8cbd5c None None] backend_defaults.driver_data_namespace = None {{(pid=83016) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 14:41:54 devstack cinder-volume[83016]: DEBUG oslo_service.backend._eventlet.service [None req-e2ecfc1f-232a-4b06-b530-a5d98f8cbd5c None None] backend_defaults.driver_ssl_cert_path = None {{(pid=83016) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 14:41:54 devstack cinder-volume[83016]: DEBUG oslo_service.backend._eventlet.service [None req-e2ecfc1f-232a-4b06-b530-a5d98f8cbd5c None None] backend_defaults.driver_ssl_cert_verify = False {{(pid=83016) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 14:41:54 devstack cinder-volume[83016]: DEBUG oslo_service.backend._eventlet.service [None req-e2ecfc1f-232a-4b06-b530-a5d98f8cbd5c None None] backend_defaults.driver_use_ssl = False {{(pid=83016) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 14:41:54 devstack cinder-volume[83016]: DEBUG oslo_service.backend._eventlet.service [None req-e2ecfc1f-232a-4b06-b530-a5d98f8cbd5c None None] backend_defaults.enable_unsupported_driver = False {{(pid=83016) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 14:41:54 devstack cinder-volume[83016]: DEBUG oslo_service.backend._eventlet.service [None req-e2ecfc1f-232a-4b06-b530-a5d98f8cbd5c None None] backend_defaults.enforce_multipath_for_image_xfer = False {{(pid=83016) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 14:41:54 devstack cinder-volume[83016]: DEBUG oslo_service.backend._eventlet.service [None req-e2ecfc1f-232a-4b06-b530-a5d98f8cbd5c None None] backend_defaults.extra_capabilities = {} {{(pid=83016) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 14:41:54 devstack cinder-volume[83016]: DEBUG oslo_service.backend._eventlet.service [None req-e2ecfc1f-232a-4b06-b530-a5d98f8cbd5c None None] backend_defaults.filter_function = None {{(pid=83016) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 14:41:54 devstack cinder-volume[83016]: DEBUG oslo_service.backend._eventlet.service [None req-e2ecfc1f-232a-4b06-b530-a5d98f8cbd5c None None] backend_defaults.goodness_function = None {{(pid=83016) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 14:41:54 devstack cinder-volume[83016]: DEBUG oslo_service.backend._eventlet.service [None req-e2ecfc1f-232a-4b06-b530-a5d98f8cbd5c None None] backend_defaults.image_upload_use_cinder_backend = False {{(pid=83016) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 14:41:54 devstack cinder-volume[83016]: DEBUG oslo_service.backend._eventlet.service [None req-e2ecfc1f-232a-4b06-b530-a5d98f8cbd5c None None] backend_defaults.image_upload_use_internal_tenant = False {{(pid=83016) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 14:41:54 devstack cinder-volume[83016]: DEBUG oslo_service.backend._eventlet.service [None req-e2ecfc1f-232a-4b06-b530-a5d98f8cbd5c None None] backend_defaults.image_volume_cache_enabled = False {{(pid=83016) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 14:41:54 devstack cinder-volume[83016]: DEBUG oslo_service.backend._eventlet.service [None req-e2ecfc1f-232a-4b06-b530-a5d98f8cbd5c None None] backend_defaults.image_volume_cache_max_count = 0 {{(pid=83016) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 14:41:54 devstack cinder-volume[83016]: DEBUG oslo_service.backend._eventlet.service [None req-e2ecfc1f-232a-4b06-b530-a5d98f8cbd5c None None] backend_defaults.image_volume_cache_max_size_gb = 0 {{(pid=83016) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 14:41:54 devstack cinder-volume[83016]: DEBUG oslo_service.backend._eventlet.service [None req-e2ecfc1f-232a-4b06-b530-a5d98f8cbd5c None None] backend_defaults.iscsi_iotype = fileio {{(pid=83016) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 14:41:54 devstack cinder-volume[83016]: DEBUG oslo_service.backend._eventlet.service [None req-e2ecfc1f-232a-4b06-b530-a5d98f8cbd5c None None] backend_defaults.iscsi_target_flags = {{(pid=83016) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 14:41:54 devstack cinder-volume[83016]: DEBUG oslo_service.backend._eventlet.service [None req-e2ecfc1f-232a-4b06-b530-a5d98f8cbd5c None None] backend_defaults.iscsi_write_cache = on {{(pid=83016) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 14:41:54 devstack cinder-volume[83016]: DEBUG oslo_service.backend._eventlet.service [None req-e2ecfc1f-232a-4b06-b530-a5d98f8cbd5c None None] backend_defaults.iser_helper = tgtadm {{(pid=83016) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 14:41:54 devstack cinder-volume[83016]: DEBUG oslo_service.backend._eventlet.service [None req-e2ecfc1f-232a-4b06-b530-a5d98f8cbd5c None None] backend_defaults.iser_ip_address = 192.168.122.206 {{(pid=83016) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 14:41:54 devstack cinder-volume[83016]: DEBUG oslo_service.backend._eventlet.service [None req-e2ecfc1f-232a-4b06-b530-a5d98f8cbd5c None None] backend_defaults.iser_port = 3260 {{(pid=83016) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 14:41:54 devstack cinder-volume[83016]: DEBUG oslo_service.backend._eventlet.service [None req-e2ecfc1f-232a-4b06-b530-a5d98f8cbd5c None None] backend_defaults.iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=83016) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 14:41:54 devstack cinder-volume[83016]: DEBUG oslo_service.backend._eventlet.service [None req-e2ecfc1f-232a-4b06-b530-a5d98f8cbd5c None None] backend_defaults.max_over_subscription_ratio = 20.0 {{(pid=83016) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 14:41:54 devstack cinder-volume[83016]: DEBUG oslo_service.backend._eventlet.service [None req-e2ecfc1f-232a-4b06-b530-a5d98f8cbd5c None None] backend_defaults.nas_host = {{(pid=83016) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 14:41:54 devstack cinder-volume[83016]: DEBUG oslo_service.backend._eventlet.service [None req-e2ecfc1f-232a-4b06-b530-a5d98f8cbd5c None None] backend_defaults.nas_login = admin {{(pid=83016) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 14:41:54 devstack cinder-volume[83016]: DEBUG oslo_service.backend._eventlet.service [None req-e2ecfc1f-232a-4b06-b530-a5d98f8cbd5c None None] backend_defaults.nas_mount_options = None {{(pid=83016) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 14:41:54 devstack cinder-volume[83016]: DEBUG oslo_service.backend._eventlet.service [None req-e2ecfc1f-232a-4b06-b530-a5d98f8cbd5c None None] backend_defaults.nas_password = **** {{(pid=83016) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 14:41:54 devstack cinder-volume[83016]: DEBUG oslo_service.backend._eventlet.service [None req-e2ecfc1f-232a-4b06-b530-a5d98f8cbd5c None None] backend_defaults.nas_private_key = {{(pid=83016) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 14:41:54 devstack cinder-volume[83016]: DEBUG oslo_service.backend._eventlet.service [None req-e2ecfc1f-232a-4b06-b530-a5d98f8cbd5c None None] backend_defaults.nas_secure_file_operations = auto {{(pid=83016) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 14:41:54 devstack cinder-volume[83016]: DEBUG oslo_service.backend._eventlet.service [None req-e2ecfc1f-232a-4b06-b530-a5d98f8cbd5c None None] backend_defaults.nas_secure_file_permissions = auto {{(pid=83016) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 14:41:54 devstack cinder-volume[83016]: DEBUG oslo_service.backend._eventlet.service [None req-e2ecfc1f-232a-4b06-b530-a5d98f8cbd5c None None] backend_defaults.nas_share_path = {{(pid=83016) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 14:41:54 devstack cinder-volume[83016]: DEBUG oslo_service.backend._eventlet.service [None req-e2ecfc1f-232a-4b06-b530-a5d98f8cbd5c None None] backend_defaults.nas_ssh_port = 22 {{(pid=83016) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 14:41:54 devstack cinder-volume[83016]: DEBUG oslo_service.backend._eventlet.service [None req-e2ecfc1f-232a-4b06-b530-a5d98f8cbd5c None None] backend_defaults.nas_volume_prov_type = thin {{(pid=83016) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 14:41:54 devstack cinder-volume[83016]: DEBUG oslo_service.backend._eventlet.service [None req-e2ecfc1f-232a-4b06-b530-a5d98f8cbd5c None None] backend_defaults.num_iser_scan_tries = 3 {{(pid=83016) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 14:41:54 devstack cinder-volume[83016]: DEBUG oslo_service.backend._eventlet.service [None req-e2ecfc1f-232a-4b06-b530-a5d98f8cbd5c None None] backend_defaults.num_shell_tries = 3 {{(pid=83016) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 14:41:54 devstack cinder-volume[83016]: DEBUG oslo_service.backend._eventlet.service [None req-e2ecfc1f-232a-4b06-b530-a5d98f8cbd5c None None] backend_defaults.num_volume_device_scan_tries = 3 {{(pid=83016) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 14:41:54 devstack cinder-volume[83016]: DEBUG oslo_service.backend._eventlet.service [None req-e2ecfc1f-232a-4b06-b530-a5d98f8cbd5c None None] backend_defaults.nvmeof_conn_info_version = 1 {{(pid=83016) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 14:41:54 devstack cinder-volume[83016]: DEBUG oslo_service.backend._eventlet.service [None req-e2ecfc1f-232a-4b06-b530-a5d98f8cbd5c None None] backend_defaults.nvmet_ns_id = 10 {{(pid=83016) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 14:41:54 devstack cinder-volume[83016]: DEBUG oslo_service.backend._eventlet.service [None req-e2ecfc1f-232a-4b06-b530-a5d98f8cbd5c None None] backend_defaults.nvmet_port_id = 1 {{(pid=83016) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 14:41:54 devstack cinder-volume[83016]: DEBUG oslo_service.backend._eventlet.service [None req-e2ecfc1f-232a-4b06-b530-a5d98f8cbd5c None None] backend_defaults.quobyte_client_cfg = None {{(pid=83016) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 14:41:54 devstack cinder-volume[83016]: DEBUG oslo_service.backend._eventlet.service [None req-e2ecfc1f-232a-4b06-b530-a5d98f8cbd5c None None] backend_defaults.quobyte_mount_point_base = /opt/stack/data/cinder/mnt {{(pid=83016) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 14:41:54 devstack cinder-volume[83016]: DEBUG oslo_service.backend._eventlet.service [None req-e2ecfc1f-232a-4b06-b530-a5d98f8cbd5c None None] backend_defaults.quobyte_overlay_volumes = False {{(pid=83016) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 14:41:54 devstack cinder-volume[83016]: DEBUG oslo_service.backend._eventlet.service [None req-e2ecfc1f-232a-4b06-b530-a5d98f8cbd5c None None] backend_defaults.quobyte_qcow2_volumes = True {{(pid=83016) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 14:41:54 devstack cinder-volume[83016]: DEBUG oslo_service.backend._eventlet.service [None req-e2ecfc1f-232a-4b06-b530-a5d98f8cbd5c None None] backend_defaults.quobyte_sparsed_volumes = True {{(pid=83016) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 14:41:54 devstack cinder-volume[83016]: DEBUG oslo_service.backend._eventlet.service [None req-e2ecfc1f-232a-4b06-b530-a5d98f8cbd5c None None] backend_defaults.quobyte_volume_from_snapshot_cache = False {{(pid=83016) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 14:41:54 devstack cinder-volume[83016]: DEBUG oslo_service.backend._eventlet.service [None req-e2ecfc1f-232a-4b06-b530-a5d98f8cbd5c None None] backend_defaults.quobyte_volume_url = None {{(pid=83016) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 14:41:54 devstack cinder-volume[83016]: DEBUG oslo_service.backend._eventlet.service [None req-e2ecfc1f-232a-4b06-b530-a5d98f8cbd5c None None] backend_defaults.replication_device = **** {{(pid=83016) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 14:41:54 devstack cinder-volume[83016]: DEBUG oslo_service.backend._eventlet.service [None req-e2ecfc1f-232a-4b06-b530-a5d98f8cbd5c None None] backend_defaults.report_discard_supported = False {{(pid=83016) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 14:41:54 devstack cinder-volume[83016]: DEBUG oslo_service.backend._eventlet.service [None req-e2ecfc1f-232a-4b06-b530-a5d98f8cbd5c None None] backend_defaults.reserved_percentage = 0 {{(pid=83016) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 14:41:54 devstack cinder-volume[83016]: DEBUG oslo_service.backend._eventlet.service [None req-e2ecfc1f-232a-4b06-b530-a5d98f8cbd5c None None] backend_defaults.scst_target_driver = iscsi {{(pid=83016) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 14:41:54 devstack cinder-volume[83016]: DEBUG oslo_service.backend._eventlet.service [None req-e2ecfc1f-232a-4b06-b530-a5d98f8cbd5c None None] backend_defaults.scst_target_iqn_name = None {{(pid=83016) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 14:41:54 devstack cinder-volume[83016]: DEBUG oslo_service.backend._eventlet.service [None req-e2ecfc1f-232a-4b06-b530-a5d98f8cbd5c None None] backend_defaults.storage_protocol = iSCSI {{(pid=83016) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 14:41:54 devstack cinder-volume[83016]: DEBUG oslo_service.backend._eventlet.service [None req-e2ecfc1f-232a-4b06-b530-a5d98f8cbd5c None None] backend_defaults.suppress_requests_ssl_warnings = False {{(pid=83016) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 14:41:54 devstack cinder-volume[83016]: DEBUG oslo_service.backend._eventlet.service [None req-e2ecfc1f-232a-4b06-b530-a5d98f8cbd5c None None] backend_defaults.target_helper = tgtadm {{(pid=83016) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 14:41:54 devstack cinder-volume[83016]: DEBUG oslo_service.backend._eventlet.service [None req-e2ecfc1f-232a-4b06-b530-a5d98f8cbd5c None None] backend_defaults.target_ip_address = 192.168.122.206 {{(pid=83016) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 14:41:54 devstack cinder-volume[83016]: DEBUG oslo_service.backend._eventlet.service [None req-e2ecfc1f-232a-4b06-b530-a5d98f8cbd5c None None] backend_defaults.target_port = 3260 {{(pid=83016) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 14:41:54 devstack cinder-volume[83016]: DEBUG oslo_service.backend._eventlet.service [None req-e2ecfc1f-232a-4b06-b530-a5d98f8cbd5c None None] backend_defaults.target_prefix = iqn.2010-10.org.openstack: {{(pid=83016) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 14:41:54 devstack cinder-volume[83016]: DEBUG oslo_service.backend._eventlet.service [None req-e2ecfc1f-232a-4b06-b530-a5d98f8cbd5c None None] backend_defaults.target_protocol = iscsi {{(pid=83016) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 14:41:54 devstack cinder-volume[83016]: DEBUG oslo_service.backend._eventlet.service [None req-e2ecfc1f-232a-4b06-b530-a5d98f8cbd5c None None] backend_defaults.target_secondary_ip_addresses = [] {{(pid=83016) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 14:41:54 devstack cinder-volume[83016]: DEBUG oslo_service.backend._eventlet.service [None req-e2ecfc1f-232a-4b06-b530-a5d98f8cbd5c None None] backend_defaults.trace_flags = None {{(pid=83016) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 14:41:54 devstack cinder-volume[83016]: DEBUG oslo_service.backend._eventlet.service [None req-e2ecfc1f-232a-4b06-b530-a5d98f8cbd5c None None] backend_defaults.unique_fqdn_network = True {{(pid=83016) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 14:41:54 devstack cinder-volume[83016]: DEBUG oslo_service.backend._eventlet.service [None req-e2ecfc1f-232a-4b06-b530-a5d98f8cbd5c None None] backend_defaults.use_chap_auth = False {{(pid=83016) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 14:41:54 devstack cinder-volume[83016]: DEBUG oslo_service.backend._eventlet.service [None req-e2ecfc1f-232a-4b06-b530-a5d98f8cbd5c None None] backend_defaults.use_multipath_for_image_xfer = False {{(pid=83016) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 14:41:54 devstack cinder-volume[83016]: DEBUG oslo_service.backend._eventlet.service [None req-e2ecfc1f-232a-4b06-b530-a5d98f8cbd5c None None] backend_defaults.volume_backend_name = None {{(pid=83016) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 14:41:54 devstack cinder-volume[83016]: DEBUG oslo_service.backend._eventlet.service [None req-e2ecfc1f-232a-4b06-b530-a5d98f8cbd5c None None] backend_defaults.volume_clear = zero {{(pid=83016) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 14:41:54 devstack cinder-volume[83016]: DEBUG oslo_service.backend._eventlet.service [None req-e2ecfc1f-232a-4b06-b530-a5d98f8cbd5c None None] backend_defaults.volume_clear_ionice = None {{(pid=83016) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 14:41:54 devstack cinder-volume[83016]: DEBUG oslo_service.backend._eventlet.service [None req-e2ecfc1f-232a-4b06-b530-a5d98f8cbd5c None None] backend_defaults.volume_clear_size = 0 {{(pid=83016) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 14:41:54 devstack cinder-volume[83016]: DEBUG oslo_service.backend._eventlet.service [None req-e2ecfc1f-232a-4b06-b530-a5d98f8cbd5c None None] backend_defaults.volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=83016) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 14:41:54 devstack cinder-volume[83016]: DEBUG oslo_service.backend._eventlet.service [None req-e2ecfc1f-232a-4b06-b530-a5d98f8cbd5c None None] backend_defaults.volume_copy_bps_limit = 0 {{(pid=83016) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 14:41:54 devstack cinder-volume[83016]: DEBUG oslo_service.backend._eventlet.service [None req-e2ecfc1f-232a-4b06-b530-a5d98f8cbd5c None None] backend_defaults.volume_dd_blocksize = 1M {{(pid=83016) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 14:41:54 devstack cinder-volume[83016]: DEBUG oslo_service.backend._eventlet.service [None req-e2ecfc1f-232a-4b06-b530-a5d98f8cbd5c None None] backend_defaults.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=83016) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 14:41:54 devstack cinder-volume[83016]: DEBUG oslo_service.backend._eventlet.service [None req-e2ecfc1f-232a-4b06-b530-a5d98f8cbd5c None None] backend_defaults.volumes_dir = /opt/stack/data/cinder/volumes {{(pid=83016) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 14:41:54 devstack cinder-volume[83016]: DEBUG oslo_service.backend._eventlet.service [None req-e2ecfc1f-232a-4b06-b530-a5d98f8cbd5c None None] oslo_reports.file_event_handler = None {{(pid=83016) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 14:41:54 devstack cinder-volume[83016]: DEBUG oslo_service.backend._eventlet.service [None req-e2ecfc1f-232a-4b06-b530-a5d98f8cbd5c None None] oslo_reports.file_event_handler_interval = 1 {{(pid=83016) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 14:41:54 devstack cinder-volume[83016]: DEBUG oslo_service.backend._eventlet.service [None req-e2ecfc1f-232a-4b06-b530-a5d98f8cbd5c None None] oslo_reports.log_dir = None {{(pid=83016) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 14:41:54 devstack cinder-volume[83016]: DEBUG oslo_service.backend._eventlet.service [None req-e2ecfc1f-232a-4b06-b530-a5d98f8cbd5c None None] QuobyteHD.backend_availability_zone = None {{(pid=83016) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 14:41:54 devstack cinder-volume[83016]: DEBUG oslo_service.backend._eventlet.service [None req-e2ecfc1f-232a-4b06-b530-a5d98f8cbd5c None None] QuobyteHD.backend_host = None {{(pid=83016) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 14:41:54 devstack cinder-volume[83016]: DEBUG oslo_service.backend._eventlet.service [None req-e2ecfc1f-232a-4b06-b530-a5d98f8cbd5c None None] QuobyteHD.backend_native_threads_pool_size = None {{(pid=83016) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 14:41:54 devstack cinder-volume[83016]: DEBUG oslo_service.backend._eventlet.service [None req-e2ecfc1f-232a-4b06-b530-a5d98f8cbd5c None None] QuobyteHD.backup_use_temp_snapshot = None {{(pid=83016) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 14:41:54 devstack cinder-volume[83016]: DEBUG oslo_service.backend._eventlet.service [None req-e2ecfc1f-232a-4b06-b530-a5d98f8cbd5c None None] QuobyteHD.chap_password = **** {{(pid=83016) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 14:41:54 devstack cinder-volume[83016]: DEBUG oslo_service.backend._eventlet.service [None req-e2ecfc1f-232a-4b06-b530-a5d98f8cbd5c None None] QuobyteHD.chap_username = None {{(pid=83016) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 14:41:54 devstack cinder-volume[83016]: DEBUG oslo_service.backend._eventlet.service [None req-e2ecfc1f-232a-4b06-b530-a5d98f8cbd5c None None] QuobyteHD.chiscsi_conf = None {{(pid=83016) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 14:41:54 devstack cinder-volume[83016]: DEBUG oslo_service.backend._eventlet.service [None req-e2ecfc1f-232a-4b06-b530-a5d98f8cbd5c None None] QuobyteHD.driver_client_cert = None {{(pid=83016) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 14:41:54 devstack cinder-volume[83016]: DEBUG oslo_service.backend._eventlet.service [None req-e2ecfc1f-232a-4b06-b530-a5d98f8cbd5c None None] QuobyteHD.driver_client_cert_key = None {{(pid=83016) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 14:41:54 devstack cinder-volume[83016]: DEBUG oslo_service.backend._eventlet.service [None req-e2ecfc1f-232a-4b06-b530-a5d98f8cbd5c None None] QuobyteHD.driver_data_namespace = None {{(pid=83016) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 14:41:54 devstack cinder-volume[83016]: DEBUG oslo_service.backend._eventlet.service [None req-e2ecfc1f-232a-4b06-b530-a5d98f8cbd5c None None] QuobyteHD.driver_ssl_cert_path = None {{(pid=83016) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 14:41:54 devstack cinder-volume[83016]: DEBUG oslo_service.backend._eventlet.service [None req-e2ecfc1f-232a-4b06-b530-a5d98f8cbd5c None None] QuobyteHD.driver_ssl_cert_verify = None {{(pid=83016) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 14:41:54 devstack cinder-volume[83016]: DEBUG oslo_service.backend._eventlet.service [None req-e2ecfc1f-232a-4b06-b530-a5d98f8cbd5c None None] QuobyteHD.driver_use_ssl = None {{(pid=83016) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 14:41:54 devstack cinder-volume[83016]: DEBUG oslo_service.backend._eventlet.service [None req-e2ecfc1f-232a-4b06-b530-a5d98f8cbd5c None None] QuobyteHD.enable_unsupported_driver = True {{(pid=83016) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 14:41:54 devstack cinder-volume[83016]: DEBUG oslo_service.backend._eventlet.service [None req-e2ecfc1f-232a-4b06-b530-a5d98f8cbd5c None None] QuobyteHD.enforce_multipath_for_image_xfer = None {{(pid=83016) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 14:41:54 devstack cinder-volume[83016]: DEBUG oslo_service.backend._eventlet.service [None req-e2ecfc1f-232a-4b06-b530-a5d98f8cbd5c None None] QuobyteHD.extra_capabilities = None {{(pid=83016) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 14:41:54 devstack cinder-volume[83016]: DEBUG oslo_service.backend._eventlet.service [None req-e2ecfc1f-232a-4b06-b530-a5d98f8cbd5c None None] QuobyteHD.filter_function = None {{(pid=83016) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 14:41:54 devstack cinder-volume[83016]: DEBUG oslo_service.backend._eventlet.service [None req-e2ecfc1f-232a-4b06-b530-a5d98f8cbd5c None None] QuobyteHD.goodness_function = None {{(pid=83016) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 14:41:54 devstack cinder-volume[83016]: DEBUG oslo_service.backend._eventlet.service [None req-e2ecfc1f-232a-4b06-b530-a5d98f8cbd5c None None] QuobyteHD.image_upload_use_cinder_backend = None {{(pid=83016) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 14:41:54 devstack cinder-volume[83016]: DEBUG oslo_service.backend._eventlet.service [None req-e2ecfc1f-232a-4b06-b530-a5d98f8cbd5c None None] QuobyteHD.image_upload_use_internal_tenant = None {{(pid=83016) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 14:41:54 devstack cinder-volume[83016]: DEBUG oslo_service.backend._eventlet.service [None req-e2ecfc1f-232a-4b06-b530-a5d98f8cbd5c None None] QuobyteHD.image_volume_cache_enabled = None {{(pid=83016) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 14:41:54 devstack cinder-volume[83016]: DEBUG oslo_service.backend._eventlet.service [None req-e2ecfc1f-232a-4b06-b530-a5d98f8cbd5c None None] QuobyteHD.image_volume_cache_max_count = None {{(pid=83016) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 14:41:54 devstack cinder-volume[83016]: DEBUG oslo_service.backend._eventlet.service [None req-e2ecfc1f-232a-4b06-b530-a5d98f8cbd5c None None] QuobyteHD.image_volume_cache_max_size_gb = None {{(pid=83016) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 14:41:54 devstack cinder-volume[83016]: DEBUG oslo_service.backend._eventlet.service [None req-e2ecfc1f-232a-4b06-b530-a5d98f8cbd5c None None] QuobyteHD.iscsi_iotype = None {{(pid=83016) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 14:41:54 devstack cinder-volume[83016]: DEBUG oslo_service.backend._eventlet.service [None req-e2ecfc1f-232a-4b06-b530-a5d98f8cbd5c None None] QuobyteHD.iscsi_target_flags = None {{(pid=83016) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 14:41:54 devstack cinder-volume[83016]: DEBUG oslo_service.backend._eventlet.service [None req-e2ecfc1f-232a-4b06-b530-a5d98f8cbd5c None None] QuobyteHD.iscsi_write_cache = None {{(pid=83016) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 14:41:54 devstack cinder-volume[83016]: DEBUG oslo_service.backend._eventlet.service [None req-e2ecfc1f-232a-4b06-b530-a5d98f8cbd5c None None] QuobyteHD.iser_helper = None {{(pid=83016) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 14:41:54 devstack cinder-volume[83016]: DEBUG oslo_service.backend._eventlet.service [None req-e2ecfc1f-232a-4b06-b530-a5d98f8cbd5c None None] QuobyteHD.iser_ip_address = None {{(pid=83016) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 14:41:54 devstack cinder-volume[83016]: DEBUG oslo_service.backend._eventlet.service [None req-e2ecfc1f-232a-4b06-b530-a5d98f8cbd5c None None] QuobyteHD.iser_port = None {{(pid=83016) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 14:41:54 devstack cinder-volume[83016]: DEBUG oslo_service.backend._eventlet.service [None req-e2ecfc1f-232a-4b06-b530-a5d98f8cbd5c None None] QuobyteHD.iser_target_prefix = None {{(pid=83016) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 14:41:54 devstack cinder-volume[83016]: DEBUG oslo_service.backend._eventlet.service [None req-e2ecfc1f-232a-4b06-b530-a5d98f8cbd5c None None] QuobyteHD.max_over_subscription_ratio = None {{(pid=83016) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 14:41:54 devstack cinder-volume[83016]: DEBUG oslo_service.backend._eventlet.service [None req-e2ecfc1f-232a-4b06-b530-a5d98f8cbd5c None None] QuobyteHD.nas_host = None {{(pid=83016) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 14:41:54 devstack cinder-volume[83016]: DEBUG oslo_service.backend._eventlet.service [None req-e2ecfc1f-232a-4b06-b530-a5d98f8cbd5c None None] QuobyteHD.nas_login = None {{(pid=83016) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 14:41:54 devstack cinder-volume[83016]: DEBUG oslo_service.backend._eventlet.service [None req-e2ecfc1f-232a-4b06-b530-a5d98f8cbd5c None None] QuobyteHD.nas_mount_options = None {{(pid=83016) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 14:41:54 devstack cinder-volume[83016]: DEBUG oslo_service.backend._eventlet.service [None req-e2ecfc1f-232a-4b06-b530-a5d98f8cbd5c None None] QuobyteHD.nas_password = **** {{(pid=83016) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 14:41:54 devstack cinder-volume[83016]: DEBUG oslo_service.backend._eventlet.service [None req-e2ecfc1f-232a-4b06-b530-a5d98f8cbd5c None None] QuobyteHD.nas_private_key = None {{(pid=83016) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 14:41:54 devstack cinder-volume[83016]: DEBUG oslo_service.backend._eventlet.service [None req-e2ecfc1f-232a-4b06-b530-a5d98f8cbd5c None None] QuobyteHD.nas_secure_file_operations = true {{(pid=83016) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 14:41:54 devstack cinder-volume[83016]: DEBUG oslo_service.backend._eventlet.service [None req-e2ecfc1f-232a-4b06-b530-a5d98f8cbd5c None None] QuobyteHD.nas_secure_file_permissions = true {{(pid=83016) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 14:41:54 devstack cinder-volume[83016]: DEBUG oslo_service.backend._eventlet.service [None req-e2ecfc1f-232a-4b06-b530-a5d98f8cbd5c None None] QuobyteHD.nas_share_path = None {{(pid=83016) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 14:41:54 devstack cinder-volume[83016]: DEBUG oslo_service.backend._eventlet.service [None req-e2ecfc1f-232a-4b06-b530-a5d98f8cbd5c None None] QuobyteHD.nas_ssh_port = None {{(pid=83016) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 14:41:54 devstack cinder-volume[83016]: DEBUG oslo_service.backend._eventlet.service [None req-e2ecfc1f-232a-4b06-b530-a5d98f8cbd5c None None] QuobyteHD.nas_volume_prov_type = None {{(pid=83016) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 14:41:54 devstack cinder-volume[83016]: DEBUG oslo_service.backend._eventlet.service [None req-e2ecfc1f-232a-4b06-b530-a5d98f8cbd5c None None] QuobyteHD.num_iser_scan_tries = None {{(pid=83016) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 14:41:54 devstack cinder-volume[83016]: DEBUG oslo_service.backend._eventlet.service [None req-e2ecfc1f-232a-4b06-b530-a5d98f8cbd5c None None] QuobyteHD.num_shell_tries = None {{(pid=83016) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 14:41:54 devstack cinder-volume[83016]: DEBUG oslo_service.backend._eventlet.service [None req-e2ecfc1f-232a-4b06-b530-a5d98f8cbd5c None None] QuobyteHD.num_volume_device_scan_tries = None {{(pid=83016) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 14:41:54 devstack cinder-volume[83016]: DEBUG oslo_service.backend._eventlet.service [None req-e2ecfc1f-232a-4b06-b530-a5d98f8cbd5c None None] QuobyteHD.nvmeof_conn_info_version = None {{(pid=83016) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 14:41:54 devstack cinder-volume[83016]: DEBUG oslo_service.backend._eventlet.service [None req-e2ecfc1f-232a-4b06-b530-a5d98f8cbd5c None None] QuobyteHD.nvmet_ns_id = None {{(pid=83016) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 14:41:54 devstack cinder-volume[83016]: DEBUG oslo_service.backend._eventlet.service [None req-e2ecfc1f-232a-4b06-b530-a5d98f8cbd5c None None] QuobyteHD.nvmet_port_id = None {{(pid=83016) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 14:41:54 devstack cinder-volume[83016]: DEBUG oslo_service.backend._eventlet.service [None req-e2ecfc1f-232a-4b06-b530-a5d98f8cbd5c None None] QuobyteHD.quobyte_client_cfg = /etc/quobyte/client-cinder.cfg {{(pid=83016) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 14:41:54 devstack cinder-volume[83016]: DEBUG oslo_service.backend._eventlet.service [None req-e2ecfc1f-232a-4b06-b530-a5d98f8cbd5c None None] QuobyteHD.quobyte_mount_point_base = None {{(pid=83016) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 14:41:54 devstack cinder-volume[83016]: DEBUG oslo_service.backend._eventlet.service [None req-e2ecfc1f-232a-4b06-b530-a5d98f8cbd5c None None] QuobyteHD.quobyte_overlay_volumes = None {{(pid=83016) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 14:41:54 devstack cinder-volume[83016]: DEBUG oslo_service.backend._eventlet.service [None req-e2ecfc1f-232a-4b06-b530-a5d98f8cbd5c None None] QuobyteHD.quobyte_qcow2_volumes = None {{(pid=83016) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 14:41:54 devstack cinder-volume[83016]: DEBUG oslo_service.backend._eventlet.service [None req-e2ecfc1f-232a-4b06-b530-a5d98f8cbd5c None None] QuobyteHD.quobyte_sparsed_volumes = None {{(pid=83016) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 14:41:54 devstack cinder-volume[83016]: DEBUG oslo_service.backend._eventlet.service [None req-e2ecfc1f-232a-4b06-b530-a5d98f8cbd5c None None] QuobyteHD.quobyte_volume_from_snapshot_cache = None {{(pid=83016) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 14:41:54 devstack cinder-volume[83259]: WARNING cinder.volume.volume_utils [-] Volume driver (QuobyteDriver 1.2) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 16 14:41:54 devstack cinder-volume[83016]: DEBUG oslo_service.backend._eventlet.service [None req-e2ecfc1f-232a-4b06-b530-a5d98f8cbd5c None None] QuobyteHD.quobyte_volume_url = quobyte://10.10.41.181/cinder-vol-61f585ac-f8e2-4d19-a890-7ebc2726cc72 {{(pid=83016) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 14:41:54 devstack cinder-volume[83016]: DEBUG oslo_service.backend._eventlet.service [None req-e2ecfc1f-232a-4b06-b530-a5d98f8cbd5c None None] QuobyteHD.replication_device = **** {{(pid=83016) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 14:41:54 devstack cinder-volume[83016]: DEBUG oslo_service.backend._eventlet.service [None req-e2ecfc1f-232a-4b06-b530-a5d98f8cbd5c None None] QuobyteHD.report_discard_supported = None {{(pid=83016) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 14:41:54 devstack cinder-volume[83016]: DEBUG oslo_service.backend._eventlet.service [None req-e2ecfc1f-232a-4b06-b530-a5d98f8cbd5c None None] QuobyteHD.reserved_percentage = None {{(pid=83016) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 14:41:54 devstack cinder-volume[83016]: DEBUG oslo_service.backend._eventlet.service [None req-e2ecfc1f-232a-4b06-b530-a5d98f8cbd5c None None] QuobyteHD.scst_target_driver = None {{(pid=83016) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 14:41:54 devstack cinder-volume[83016]: DEBUG oslo_service.backend._eventlet.service [None req-e2ecfc1f-232a-4b06-b530-a5d98f8cbd5c None None] QuobyteHD.scst_target_iqn_name = None {{(pid=83016) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 14:41:54 devstack cinder-volume[83016]: DEBUG oslo_service.backend._eventlet.service [None req-e2ecfc1f-232a-4b06-b530-a5d98f8cbd5c None None] QuobyteHD.storage_protocol = None {{(pid=83016) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 14:41:54 devstack cinder-volume[83016]: DEBUG oslo_service.backend._eventlet.service [None req-e2ecfc1f-232a-4b06-b530-a5d98f8cbd5c None None] QuobyteHD.suppress_requests_ssl_warnings = None {{(pid=83016) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 14:41:54 devstack cinder-volume[83016]: DEBUG oslo_service.backend._eventlet.service [None req-e2ecfc1f-232a-4b06-b530-a5d98f8cbd5c None None] QuobyteHD.target_helper = None {{(pid=83016) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 14:41:54 devstack cinder-volume[83016]: DEBUG oslo_service.backend._eventlet.service [None req-e2ecfc1f-232a-4b06-b530-a5d98f8cbd5c None None] QuobyteHD.target_ip_address = None {{(pid=83016) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 14:41:54 devstack cinder-volume[83016]: DEBUG oslo_service.backend._eventlet.service [None req-e2ecfc1f-232a-4b06-b530-a5d98f8cbd5c None None] QuobyteHD.target_port = None {{(pid=83016) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 14:41:54 devstack cinder-volume[83016]: DEBUG oslo_service.backend._eventlet.service [None req-e2ecfc1f-232a-4b06-b530-a5d98f8cbd5c None None] QuobyteHD.target_prefix = None {{(pid=83016) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 14:41:54 devstack cinder-volume[83016]: DEBUG oslo_service.backend._eventlet.service [None req-e2ecfc1f-232a-4b06-b530-a5d98f8cbd5c None None] QuobyteHD.target_protocol = None {{(pid=83016) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 14:41:54 devstack cinder-volume[83016]: DEBUG oslo_service.backend._eventlet.service [None req-e2ecfc1f-232a-4b06-b530-a5d98f8cbd5c None None] QuobyteHD.target_secondary_ip_addresses = None {{(pid=83016) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 14:41:54 devstack cinder-volume[83016]: DEBUG oslo_service.backend._eventlet.service [None req-e2ecfc1f-232a-4b06-b530-a5d98f8cbd5c None None] QuobyteHD.trace_flags = None {{(pid=83016) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 14:41:54 devstack cinder-volume[83016]: DEBUG oslo_service.backend._eventlet.service [None req-e2ecfc1f-232a-4b06-b530-a5d98f8cbd5c None None] QuobyteHD.unique_fqdn_network = None {{(pid=83016) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 14:41:54 devstack cinder-volume[83016]: DEBUG oslo_service.backend._eventlet.service [None req-e2ecfc1f-232a-4b06-b530-a5d98f8cbd5c None None] QuobyteHD.use_chap_auth = None {{(pid=83016) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 14:41:54 devstack cinder-volume[83016]: DEBUG oslo_service.backend._eventlet.service [None req-e2ecfc1f-232a-4b06-b530-a5d98f8cbd5c None None] QuobyteHD.use_multipath_for_image_xfer = None {{(pid=83016) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 14:41:54 devstack cinder-volume[83016]: DEBUG oslo_service.backend._eventlet.service [None req-e2ecfc1f-232a-4b06-b530-a5d98f8cbd5c None None] QuobyteHD.volume_backend_name = QuobyteHD {{(pid=83016) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 14:41:54 devstack cinder-volume[83016]: DEBUG oslo_service.backend._eventlet.service [None req-e2ecfc1f-232a-4b06-b530-a5d98f8cbd5c None None] QuobyteHD.volume_clear = None {{(pid=83016) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 14:41:54 devstack cinder-volume[83016]: DEBUG oslo_service.backend._eventlet.service [None req-e2ecfc1f-232a-4b06-b530-a5d98f8cbd5c None None] QuobyteHD.volume_clear_ionice = None {{(pid=83016) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 14:41:54 devstack cinder-volume[83016]: DEBUG oslo_service.backend._eventlet.service [None req-e2ecfc1f-232a-4b06-b530-a5d98f8cbd5c None None] QuobyteHD.volume_clear_size = None {{(pid=83016) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 14:41:54 devstack cinder-volume[83016]: DEBUG oslo_service.backend._eventlet.service [None req-e2ecfc1f-232a-4b06-b530-a5d98f8cbd5c None None] QuobyteHD.volume_copy_blkio_cgroup_name = None {{(pid=83016) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 14:41:54 devstack cinder-volume[83016]: DEBUG oslo_service.backend._eventlet.service [None req-e2ecfc1f-232a-4b06-b530-a5d98f8cbd5c None None] QuobyteHD.volume_copy_bps_limit = None {{(pid=83016) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 14:41:54 devstack cinder-volume[83016]: DEBUG oslo_service.backend._eventlet.service [None req-e2ecfc1f-232a-4b06-b530-a5d98f8cbd5c None None] QuobyteHD.volume_dd_blocksize = None {{(pid=83016) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 14:41:54 devstack cinder-volume[83016]: DEBUG oslo_service.backend._eventlet.service [None req-e2ecfc1f-232a-4b06-b530-a5d98f8cbd5c None None] QuobyteHD.volume_driver = cinder.volume.drivers.quobyte.QuobyteDriver {{(pid=83016) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 14:41:54 devstack cinder-volume[83016]: DEBUG oslo_service.backend._eventlet.service [None req-e2ecfc1f-232a-4b06-b530-a5d98f8cbd5c None None] QuobyteHD.volumes_dir = None {{(pid=83016) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 14:41:54 devstack cinder-volume[83016]: DEBUG oslo_service.backend._eventlet.service [None req-e2ecfc1f-232a-4b06-b530-a5d98f8cbd5c None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=83016) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 14:41:54 devstack cinder-volume[83016]: DEBUG oslo_service.backend._eventlet.service [None req-e2ecfc1f-232a-4b06-b530-a5d98f8cbd5c None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=83016) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 14:41:54 devstack cinder-volume[83016]: DEBUG oslo_service.backend._eventlet.service [None req-e2ecfc1f-232a-4b06-b530-a5d98f8cbd5c None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=83016) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 14:41:54 devstack cinder-volume[83016]: DEBUG oslo_service.backend._eventlet.service [None req-e2ecfc1f-232a-4b06-b530-a5d98f8cbd5c None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=83016) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 14:41:54 devstack cinder-volume[83016]: DEBUG oslo_service.backend._eventlet.service [None req-e2ecfc1f-232a-4b06-b530-a5d98f8cbd5c None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=83016) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 14:41:54 devstack cinder-volume[83016]: DEBUG oslo_service.backend._eventlet.service [None req-e2ecfc1f-232a-4b06-b530-a5d98f8cbd5c None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=83016) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 14:41:54 devstack cinder-volume[83016]: DEBUG oslo_service.backend._eventlet.service [None req-e2ecfc1f-232a-4b06-b530-a5d98f8cbd5c None None] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=83016) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 14:41:54 devstack cinder-volume[83016]: DEBUG oslo_service.backend._eventlet.service [None req-e2ecfc1f-232a-4b06-b530-a5d98f8cbd5c None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=83016) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 14:41:54 devstack cinder-volume[83016]: DEBUG oslo_service.backend._eventlet.service [None req-e2ecfc1f-232a-4b06-b530-a5d98f8cbd5c None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=83016) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 14:41:54 devstack cinder-volume[83016]: DEBUG oslo_service.backend._eventlet.service [None req-e2ecfc1f-232a-4b06-b530-a5d98f8cbd5c None None] oslo_messaging_rabbit.hostname = devstack {{(pid=83016) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 14:41:54 devstack cinder-volume[83016]: DEBUG oslo_service.backend._eventlet.service [None req-e2ecfc1f-232a-4b06-b530-a5d98f8cbd5c None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=83016) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 14:41:54 devstack cinder-volume[83016]: DEBUG oslo_service.backend._eventlet.service [None req-e2ecfc1f-232a-4b06-b530-a5d98f8cbd5c None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=83016) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 14:41:54 devstack cinder-volume[83016]: DEBUG oslo_service.backend._eventlet.service [None req-e2ecfc1f-232a-4b06-b530-a5d98f8cbd5c None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=83016) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 14:41:54 devstack cinder-volume[83016]: DEBUG oslo_service.backend._eventlet.service [None req-e2ecfc1f-232a-4b06-b530-a5d98f8cbd5c None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=83016) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 14:41:54 devstack cinder-volume[83016]: DEBUG oslo_service.backend._eventlet.service [None req-e2ecfc1f-232a-4b06-b530-a5d98f8cbd5c None None] oslo_messaging_rabbit.kombu_reconnect_splay = 0.0 {{(pid=83016) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 14:41:54 devstack cinder-volume[83016]: DEBUG oslo_service.backend._eventlet.service [None req-e2ecfc1f-232a-4b06-b530-a5d98f8cbd5c None None] oslo_messaging_rabbit.processname = cinder-volume {{(pid=83016) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 14:41:54 devstack cinder-volume[83016]: DEBUG oslo_service.backend._eventlet.service [None req-e2ecfc1f-232a-4b06-b530-a5d98f8cbd5c None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=83016) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 14:41:54 devstack cinder-volume[83016]: DEBUG oslo_service.backend._eventlet.service [None req-e2ecfc1f-232a-4b06-b530-a5d98f8cbd5c None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=83016) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 14:41:54 devstack cinder-volume[83016]: DEBUG oslo_service.backend._eventlet.service [None req-e2ecfc1f-232a-4b06-b530-a5d98f8cbd5c None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=83016) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 14:41:54 devstack cinder-volume[83016]: DEBUG oslo_service.backend._eventlet.service [None req-e2ecfc1f-232a-4b06-b530-a5d98f8cbd5c None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=83016) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 14:41:54 devstack cinder-volume[83016]: DEBUG oslo_service.backend._eventlet.service [None req-e2ecfc1f-232a-4b06-b530-a5d98f8cbd5c None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=83016) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 14:41:54 devstack cinder-volume[83016]: DEBUG oslo_service.backend._eventlet.service [None req-e2ecfc1f-232a-4b06-b530-a5d98f8cbd5c None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=83016) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 14:41:54 devstack cinder-volume[83016]: DEBUG oslo_service.backend._eventlet.service [None req-e2ecfc1f-232a-4b06-b530-a5d98f8cbd5c None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=83016) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 14:41:54 devstack cinder-volume[83016]: DEBUG oslo_service.backend._eventlet.service [None req-e2ecfc1f-232a-4b06-b530-a5d98f8cbd5c None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=83016) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 14:41:54 devstack cinder-volume[83016]: DEBUG oslo_service.backend._eventlet.service [None req-e2ecfc1f-232a-4b06-b530-a5d98f8cbd5c None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=83016) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 14:41:54 devstack cinder-volume[83016]: DEBUG oslo_service.backend._eventlet.service [None req-e2ecfc1f-232a-4b06-b530-a5d98f8cbd5c None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=83016) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 14:41:54 devstack cinder-volume[83016]: DEBUG oslo_service.backend._eventlet.service [None req-e2ecfc1f-232a-4b06-b530-a5d98f8cbd5c None None] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=83016) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 14:41:54 devstack cinder-volume[83016]: DEBUG oslo_service.backend._eventlet.service [None req-e2ecfc1f-232a-4b06-b530-a5d98f8cbd5c None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=83016) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 14:41:54 devstack cinder-volume[83016]: DEBUG oslo_service.backend._eventlet.service [None req-e2ecfc1f-232a-4b06-b530-a5d98f8cbd5c None None] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=83016) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 14:41:54 devstack cinder-volume[83016]: DEBUG oslo_service.backend._eventlet.service [None req-e2ecfc1f-232a-4b06-b530-a5d98f8cbd5c None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=83016) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 14:41:54 devstack cinder-volume[83016]: DEBUG oslo_service.backend._eventlet.service [None req-e2ecfc1f-232a-4b06-b530-a5d98f8cbd5c None None] oslo_messaging_rabbit.ssl = False {{(pid=83016) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 14:41:54 devstack cinder-volume[83016]: DEBUG oslo_service.backend._eventlet.service [None req-e2ecfc1f-232a-4b06-b530-a5d98f8cbd5c None None] oslo_messaging_rabbit.ssl_ca_file = {{(pid=83016) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 14:41:54 devstack cinder-volume[83016]: DEBUG oslo_service.backend._eventlet.service [None req-e2ecfc1f-232a-4b06-b530-a5d98f8cbd5c None None] oslo_messaging_rabbit.ssl_cert_file = {{(pid=83016) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 14:41:54 devstack cinder-volume[83016]: DEBUG oslo_service.backend._eventlet.service [None req-e2ecfc1f-232a-4b06-b530-a5d98f8cbd5c None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=83016) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 14:41:54 devstack cinder-volume[83016]: DEBUG oslo_service.backend._eventlet.service [None req-e2ecfc1f-232a-4b06-b530-a5d98f8cbd5c None None] oslo_messaging_rabbit.ssl_key_file = {{(pid=83016) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 14:41:54 devstack cinder-volume[83016]: DEBUG oslo_service.backend._eventlet.service [None req-e2ecfc1f-232a-4b06-b530-a5d98f8cbd5c None None] oslo_messaging_rabbit.ssl_version = {{(pid=83016) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 14:41:54 devstack cinder-volume[83016]: DEBUG oslo_service.backend._eventlet.service [None req-e2ecfc1f-232a-4b06-b530-a5d98f8cbd5c None None] oslo_messaging_rabbit.use_queue_manager = False {{(pid=83016) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 14:41:54 devstack cinder-volume[83016]: DEBUG oslo_service.backend._eventlet.service [None req-e2ecfc1f-232a-4b06-b530-a5d98f8cbd5c None None] oslo_messaging_notifications.driver = [] {{(pid=83016) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 14:41:54 devstack cinder-volume[83016]: DEBUG oslo_service.backend._eventlet.service [None req-e2ecfc1f-232a-4b06-b530-a5d98f8cbd5c None None] oslo_messaging_notifications.retry = -1 {{(pid=83016) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 14:41:54 devstack cinder-volume[83016]: DEBUG oslo_service.backend._eventlet.service [None req-e2ecfc1f-232a-4b06-b530-a5d98f8cbd5c None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=83016) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 14:41:54 devstack cinder-volume[83016]: DEBUG oslo_service.backend._eventlet.service [None req-e2ecfc1f-232a-4b06-b530-a5d98f8cbd5c None None] oslo_messaging_notifications.transport_url = **** {{(pid=83016) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 14:41:54 devstack cinder-volume[83016]: DEBUG oslo_service.backend._eventlet.service [None req-e2ecfc1f-232a-4b06-b530-a5d98f8cbd5c None None] key_manager.backend = cinder.keymgr.conf_key_mgr.ConfKeyManager {{(pid=83016) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 14:41:54 devstack cinder-volume[83259]: INFO cinder.volume.manager [None req-2ee7d6ac-a7cb-43d6-95f8-4cfab34a71f0 None None] Starting volume driver QuobyteDriver (1.2) Sep 16 14:41:54 devstack cinder-volume[83016]: DEBUG oslo_service.backend._eventlet.service [None req-e2ecfc1f-232a-4b06-b530-a5d98f8cbd5c None None] key_manager.fixed_key = **** {{(pid=83016) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 14:41:54 devstack cinder-volume[83016]: DEBUG oslo_service.backend._eventlet.service [None req-e2ecfc1f-232a-4b06-b530-a5d98f8cbd5c None None] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=83016) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 14:41:54 devstack cinder-volume[83016]: DEBUG oslo_service.backend._eventlet.service [None req-e2ecfc1f-232a-4b06-b530-a5d98f8cbd5c None None] barbican.barbican_api_version = None {{(pid=83016) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 14:41:54 devstack cinder-volume[83016]: DEBUG oslo_service.backend._eventlet.service [None req-e2ecfc1f-232a-4b06-b530-a5d98f8cbd5c None None] barbican.barbican_endpoint = None {{(pid=83016) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 14:41:54 devstack cinder-volume[83016]: DEBUG oslo_service.backend._eventlet.service [None req-e2ecfc1f-232a-4b06-b530-a5d98f8cbd5c None None] barbican.barbican_endpoint_type = public {{(pid=83016) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 14:41:54 devstack cinder-volume[83016]: DEBUG oslo_service.backend._eventlet.service [None req-e2ecfc1f-232a-4b06-b530-a5d98f8cbd5c None None] barbican.barbican_region_name = None {{(pid=83016) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 14:41:54 devstack cinder-volume[83016]: DEBUG oslo_service.backend._eventlet.service [None req-e2ecfc1f-232a-4b06-b530-a5d98f8cbd5c None None] barbican.cafile = None {{(pid=83016) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 14:41:54 devstack cinder-volume[83016]: DEBUG oslo_service.backend._eventlet.service [None req-e2ecfc1f-232a-4b06-b530-a5d98f8cbd5c None None] barbican.certfile = None {{(pid=83016) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 14:41:54 devstack cinder-volume[83016]: DEBUG oslo_service.backend._eventlet.service [None req-e2ecfc1f-232a-4b06-b530-a5d98f8cbd5c None None] barbican.collect_timing = False {{(pid=83016) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 14:41:54 devstack cinder-volume[83016]: DEBUG oslo_service.backend._eventlet.service [None req-e2ecfc1f-232a-4b06-b530-a5d98f8cbd5c None None] barbican.insecure = False {{(pid=83016) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 14:41:54 devstack cinder-volume[83016]: DEBUG oslo_service.backend._eventlet.service [None req-e2ecfc1f-232a-4b06-b530-a5d98f8cbd5c None None] barbican.keyfile = None {{(pid=83016) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 14:41:54 devstack cinder-volume[83016]: DEBUG oslo_service.backend._eventlet.service [None req-e2ecfc1f-232a-4b06-b530-a5d98f8cbd5c None None] barbican.number_of_retries = 60 {{(pid=83016) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 14:41:54 devstack cinder-volume[83259]: DEBUG cinder.volume.drivers.remotefs [None req-2ee7d6ac-a7cb-43d6-95f8-4cfab34a71f0 None None] NAS config: {'nas_secure_file_permissions': 'true', 'nas_secure_file_operations': 'true'} {{(pid=83259) do_setup /opt/stack/cinder/cinder/volume/drivers/remotefs.py:223}} Sep 16 14:41:54 devstack cinder-volume[83016]: DEBUG oslo_service.backend._eventlet.service [None req-e2ecfc1f-232a-4b06-b530-a5d98f8cbd5c None None] barbican.retry_delay = 1 {{(pid=83016) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 14:41:54 devstack cinder-volume[83016]: DEBUG oslo_service.backend._eventlet.service [None req-e2ecfc1f-232a-4b06-b530-a5d98f8cbd5c None None] barbican.send_service_user_token = False {{(pid=83016) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 14:41:54 devstack cinder-volume[83016]: DEBUG oslo_service.backend._eventlet.service [None req-e2ecfc1f-232a-4b06-b530-a5d98f8cbd5c None None] barbican.split_loggers = False {{(pid=83016) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 14:41:54 devstack cinder-volume[83016]: DEBUG oslo_service.backend._eventlet.service [None req-e2ecfc1f-232a-4b06-b530-a5d98f8cbd5c None None] barbican.timeout = None {{(pid=83016) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 14:41:54 devstack cinder-volume[83016]: DEBUG oslo_service.backend._eventlet.service [None req-e2ecfc1f-232a-4b06-b530-a5d98f8cbd5c None None] barbican.verify_ssl = True {{(pid=83016) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 14:41:54 devstack cinder-volume[83016]: DEBUG oslo_service.backend._eventlet.service [None req-e2ecfc1f-232a-4b06-b530-a5d98f8cbd5c None None] barbican.verify_ssl_path = None {{(pid=83016) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 14:41:54 devstack cinder-volume[83016]: DEBUG oslo_service.backend._eventlet.service [None req-e2ecfc1f-232a-4b06-b530-a5d98f8cbd5c None None] barbican_service_user.auth_section = None {{(pid=83016) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 14:41:54 devstack cinder-volume[83016]: DEBUG oslo_service.backend._eventlet.service [None req-e2ecfc1f-232a-4b06-b530-a5d98f8cbd5c None None] barbican_service_user.auth_type = None {{(pid=83016) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 14:41:54 devstack cinder-volume[83016]: DEBUG oslo_service.backend._eventlet.service [None req-e2ecfc1f-232a-4b06-b530-a5d98f8cbd5c None None] barbican_service_user.cafile = None {{(pid=83016) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 14:41:54 devstack cinder-volume[83016]: DEBUG oslo_service.backend._eventlet.service [None req-e2ecfc1f-232a-4b06-b530-a5d98f8cbd5c None None] barbican_service_user.certfile = None {{(pid=83016) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 14:41:54 devstack cinder-volume[83016]: DEBUG oslo_service.backend._eventlet.service [None req-e2ecfc1f-232a-4b06-b530-a5d98f8cbd5c None None] barbican_service_user.collect_timing = False {{(pid=83016) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 14:41:54 devstack cinder-volume[83016]: DEBUG oslo_service.backend._eventlet.service [None req-e2ecfc1f-232a-4b06-b530-a5d98f8cbd5c None None] barbican_service_user.insecure = False {{(pid=83016) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 14:41:54 devstack cinder-volume[83016]: DEBUG oslo_service.backend._eventlet.service [None req-e2ecfc1f-232a-4b06-b530-a5d98f8cbd5c None None] barbican_service_user.keyfile = None {{(pid=83016) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 14:41:54 devstack cinder-volume[83016]: DEBUG oslo_service.backend._eventlet.service [None req-e2ecfc1f-232a-4b06-b530-a5d98f8cbd5c None None] barbican_service_user.split_loggers = False {{(pid=83016) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 14:41:54 devstack cinder-volume[83016]: DEBUG oslo_service.backend._eventlet.service [None req-e2ecfc1f-232a-4b06-b530-a5d98f8cbd5c None None] barbican_service_user.timeout = None {{(pid=83016) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 14:41:54 devstack cinder-volume[83016]: DEBUG oslo_service.backend._eventlet.service [None req-e2ecfc1f-232a-4b06-b530-a5d98f8cbd5c None None] vault.approle_role_id = **** {{(pid=83016) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 14:41:54 devstack cinder-volume[83016]: DEBUG oslo_service.backend._eventlet.service [None req-e2ecfc1f-232a-4b06-b530-a5d98f8cbd5c None None] vault.approle_secret_id = **** {{(pid=83016) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 14:41:54 devstack cinder-volume[83016]: DEBUG oslo_service.backend._eventlet.service [None req-e2ecfc1f-232a-4b06-b530-a5d98f8cbd5c None None] vault.kv_mountpoint = secret {{(pid=83016) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 14:41:54 devstack cinder-volume[83016]: DEBUG oslo_service.backend._eventlet.service [None req-e2ecfc1f-232a-4b06-b530-a5d98f8cbd5c None None] vault.kv_path = None {{(pid=83016) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 14:41:54 devstack cinder-volume[83016]: DEBUG oslo_service.backend._eventlet.service [None req-e2ecfc1f-232a-4b06-b530-a5d98f8cbd5c None None] vault.kv_version = 2 {{(pid=83016) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 14:41:54 devstack cinder-volume[83016]: DEBUG oslo_service.backend._eventlet.service [None req-e2ecfc1f-232a-4b06-b530-a5d98f8cbd5c None None] vault.namespace = None {{(pid=83016) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 14:41:54 devstack cinder-volume[83016]: DEBUG oslo_service.backend._eventlet.service [None req-e2ecfc1f-232a-4b06-b530-a5d98f8cbd5c None None] vault.root_token_id = **** {{(pid=83016) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 14:41:54 devstack cinder-volume[83016]: DEBUG oslo_service.backend._eventlet.service [None req-e2ecfc1f-232a-4b06-b530-a5d98f8cbd5c None None] vault.ssl_ca_crt_file = None {{(pid=83016) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 14:41:54 devstack cinder-volume[83016]: DEBUG oslo_service.backend._eventlet.service [None req-e2ecfc1f-232a-4b06-b530-a5d98f8cbd5c None None] vault.timeout = 60.0 {{(pid=83016) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 14:41:54 devstack cinder-volume[83016]: DEBUG oslo_service.backend._eventlet.service [None req-e2ecfc1f-232a-4b06-b530-a5d98f8cbd5c None None] vault.use_ssl = False {{(pid=83016) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 14:41:54 devstack cinder-volume[83016]: DEBUG oslo_service.backend._eventlet.service [None req-e2ecfc1f-232a-4b06-b530-a5d98f8cbd5c None None] vault.vault_url = http://127.0.0.1:8200 {{(pid=83016) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 14:41:54 devstack cinder-volume[83016]: DEBUG oslo_service.backend._eventlet.service [None req-e2ecfc1f-232a-4b06-b530-a5d98f8cbd5c None None] ******************************************************************************** {{(pid=83016) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2828}} Sep 16 14:41:55 devstack cinder-volume[83259]: DEBUG cinder.volume.drivers.quobyte [None req-2ee7d6ac-a7cb-43d6-95f8-4cfab34a71f0 None None] nas_secure_file_* settings are true (ownership) and true (permissions). {{(pid=83259) set_nas_security_options /opt/stack/cinder/cinder/volume/drivers/quobyte.py:310}} Sep 16 14:41:55 devstack cinder-volume[83259]: INFO cinder.volume.drivers.quobyte [None req-2ee7d6ac-a7cb-43d6-95f8-4cfab34a71f0 None None] The NAS file operations will be run as non privileged user in secure mode. Please ensure your libvirtd settings have been configured accordingly (see section 'OpenStack' in the Quobyte Manual. Sep 16 14:41:55 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [None req-2ee7d6ac-a7cb-43d6-95f8-4cfab34a71f0 None None] Running cmd (subprocess): mount.quobyte {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 14:41:55 devstack quobyte-client[83284]: Reading configuration file: /etc/quobyte/client.cfg Sep 16 14:41:55 devstack quobyte-client[83284]: Invalid parameters found, error: missing mount point. Sep 16 14:41:55 devstack quobyte-client[83284]: Quobyte logging to journald, you can use 'journalctl QUOBYTE_MOUNTPOINT=' to display the log. Sep 16 14:41:55 devstack quobyte-client[83284]: Failed to parse all commandline parameters, please use -h/--help to see available options. Sep 16 14:41:55 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [None req-2ee7d6ac-a7cb-43d6-95f8-4cfab34a71f0 None None] CMD "mount.quobyte" returned: 1 in 0.412s {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 14:41:55 devstack cinder-volume[83259]: DEBUG oslo_concurrency.lockutils [None req-2ee7d6ac-a7cb-43d6-95f8-4cfab34a71f0 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83259) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 16 14:41:55 devstack cinder-volume[83259]: DEBUG oslo_concurrency.lockutils [None req-2ee7d6ac-a7cb-43d6-95f8-4cfab34a71f0 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.008s {{(pid=83259) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 16 14:41:55 devstack cinder-volume[83259]: DEBUG cinder.volume.drivers.quobyte [None req-2ee7d6ac-a7cb-43d6-95f8-4cfab34a71f0 None None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-61f585ac-f8e2-4d19-a890-7ebc2726cc72': None} {{(pid=83259) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:639}} Sep 16 14:41:55 devstack cinder-volume[83259]: INFO cinder.volume.drivers.quobyte [None req-2ee7d6ac-a7cb-43d6-95f8-4cfab34a71f0 None None] Mounting volume: 10.10.41.181/cinder-vol-61f585ac-f8e2-4d19-a890-7ebc2726cc72 ... Sep 16 14:41:55 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [None req-2ee7d6ac-a7cb-43d6-95f8-4cfab34a71f0 None None] Running cmd (subprocess): mount.quobyte --disable-xattrs 10.10.41.181/cinder-vol-61f585ac-f8e2-4d19-a890-7ebc2726cc72 /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c -c /etc/quobyte/client-cinder.cfg {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 14:41:56 devstack quobyte-client[83285]: Reading configuration file: /etc/quobyte/client-cinder.cfg Sep 16 14:41:56 devstack quobyte-client[83285]: Reading configuration file: /etc/quobyte/client.cfg Sep 16 14:41:56 devstack quobyte-client[83285]: Quobyte logging to journald, you can use 'journalctl QUOBYTE_MOUNTPOINT=/opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c' to display the log. Sep 16 14:41:56 devstack quobyte-client[83286]: OptimizeSystemPlacement: Increasing priority of client. If your workload does not perform well, please disable the process placement heuristic (remove --enable_process_placement_heuristic). Sep 16 14:41:56 devstack quobyte-client[83286]: mount.quobyte 3.25 (4fbbd59204) Sep 16 14:41:56 devstack quobyte-client[83286]: Client UUID: mGR1tA3i-DXwP-fEWp-SZP1-2ZyE9GXSFO6Y Sep 16 14:41:56 devstack quobyte-client[83286]: Registry: osci01.corp.quobyte.com:7861 Sep 16 14:41:56 devstack quobyte-client[83286]: Volume: cinder-vol-61f585ac-f8e2-4d19-a890-7ebc2726cc72 Sep 16 14:41:56 devstack quobyte-client[83286]: FUSE version: 316 Sep 16 14:41:56 devstack quobyte-client[83286]: Breakpad initialized (dumping to /home/quobyte/.quobyte/minidumps) Sep 16 14:41:56 devstack quobyte-client[83286]: Could not set oom_score_adj to default value: Failed to set oom_score_adj -700: 13: Permission denied Sep 16 14:41:56 devstack quobyte-client[83286]: Setting total object cache size to 3352297472 bytes Sep 16 14:41:56 devstack quobyte-client[83286]: Using FUSE low-level API Sep 16 14:41:56 devstack quobyte-client[83286]: Caching of uid/gid to user/group name mappings is enabled Sep 16 14:41:56 devstack quobyte-client[83286]: Setting up sockets network client, connect timeout (s): 2 linger timeout (s): 1200 request timeout granularity (s): 10 Sep 16 14:41:56 devstack quobyte-client[83286]: Your limit for concurrently opened files ("ulimit -n") is set to 2048. This is too low for the Quobyte client to function properly, and should be set to at least 16384. You can use ulimit, change the system settings or try to use the limit-nofile= option when trying to mount using /etc/fstab. Sep 16 14:41:56 devstack quobyte-client[83286]: HTTP server started on port 55000 Sep 16 14:41:56 devstack quobyte-client[83286]: Caching mappings from uid/gid to user/group name and group membership temporarily. Sep 16 14:41:56 devstack quobyte-client[83286]: Mount point /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c established Sep 16 14:41:56 devstack quobyte-client[83286]: TimeSync is running and remote sync every 60 seconds Sep 16 14:41:56 devstack quobyte-client[83286]: Resolving 'registry:' with default 10.10.41.181:7861 Sep 16 14:41:56 devstack quobyte-client[83286]: Resolving 'registry:' with default 10.10.41.181:7861 Sep 16 14:41:56 devstack quobyte-client[83286]: Opening volume cinder-vol-61f585ac-f8e2-4d19-a890-7ebc2726cc72 (87712ffe-8a69-446d-9ed6-4430c7ee9792) Sep 16 14:41:56 devstack quobyte-client[83286]: Setting metadata cache size to 500000 based on available system memory of 16 GiB Sep 16 14:41:56 devstack quobyte-client[83286]: Resolving 'registry:' with default 10.10.41.181:7861 Sep 16 14:41:56 devstack quobyte-client[83286]: Failed to invalidate inode: 38: Function not implemented Sep 16 14:41:56 devstack quobyte-client[83286]: Resolving 'registry:' with default 10.10.41.181:7861 Sep 16 14:41:56 devstack quobyte-client[83286]: Automatic minidump upload enabled by global system configuration Sep 16 14:41:56 devstack quobyte-client[83286]: Announcing HTTP status server address 172.24.4.1 Sep 16 14:41:56 devstack quobyte-client[83286]: Registered as service (uuid mGR1tA3i-DXwP-fEWp-SZP1-2ZyE9GXSFO6Y) Sep 16 14:41:56 devstack quobyte-client[83286]: Quobyte Client running as pid 83286 Sep 16 14:41:56 devstack quobyte-client[83286]: FUSE announces support for async read, posix locks, atomic O_TRUNC, export support, don't mask, splice write, splice move, splice read, flock, directory ioctl, auto invalidate data, readdir plus, readdir plus auto, async direct IO, writeback cache, no open support, parallel dirops, posix acl, handle killpriv, handle killpriv2 Sep 16 14:41:56 devstack quobyte-client[83286]: FUSE capabilities enabled: async read, posix locks, atomic O_TRUNC, don't mask, flock, readdir plus, async direct IO, posix acl Sep 16 14:41:56 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [None req-2ee7d6ac-a7cb-43d6-95f8-4cfab34a71f0 None None] CMD "mount.quobyte --disable-xattrs 10.10.41.181/cinder-vol-61f585ac-f8e2-4d19-a890-7ebc2726cc72 /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c -c /etc/quobyte/client-cinder.cfg" returned: 0 in 0.649s {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 14:41:56 devstack cinder-volume[83259]: INFO cinder.volume.drivers.quobyte [None req-2ee7d6ac-a7cb-43d6-95f8-4cfab34a71f0 None None] Mounting volume: 10.10.41.181/cinder-vol-61f585ac-f8e2-4d19-a890-7ebc2726cc72 succeeded Sep 16 14:41:56 devstack cinder-volume[83259]: DEBUG cinder.volume.drivers.quobyte [None req-2ee7d6ac-a7cb-43d6-95f8-4cfab34a71f0 None None] Available shares ['10.10.41.181/cinder-vol-61f585ac-f8e2-4d19-a890-7ebc2726cc72'] {{(pid=83259) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:669}} Sep 16 14:41:56 devstack cinder-volume[83259]: DEBUG oslo_concurrency.lockutils [None req-2ee7d6ac-a7cb-43d6-95f8-4cfab34a71f0 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.720s {{(pid=83259) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 16 14:41:56 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [None req-2ee7d6ac-a7cb-43d6-95f8-4cfab34a71f0 None None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 14:41:56 devstack quobyte-client[83286]: Resolving 'registry:' with default 10.10.41.181:7861 Sep 16 14:41:56 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [None req-2ee7d6ac-a7cb-43d6-95f8-4cfab34a71f0 None None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c" returned: 0 in 0.098s {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 14:41:56 devstack cinder-volume[83259]: INFO cinder.volume.driver [None req-2ee7d6ac-a7cb-43d6-95f8-4cfab34a71f0 None None] Driver hasn't implemented _init_vendor_properties() Sep 16 14:41:56 devstack cinder-volume[83259]: DEBUG cinder.volume.driver [None req-2ee7d6ac-a7cb-43d6-95f8-4cfab34a71f0 None None] Initialized capabilities list: {'volume_backend_name': 'Quobyte', 'vendor_name': 'Open Source', 'driver_version': '1.2', 'storage_protocol': 'quobyte', 'total_capacity_gb': 924.9134750366211, 'free_capacity_gb': 924.9134750366211, 'reserved_percentage': 0, 'QoS_support': False, 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=83259) init_capabilities /opt/stack/cinder/cinder/volume/driver.py:860}} Sep 16 14:41:56 devstack cinder-volume[83259]: DEBUG oslo_db.sqlalchemy.engines [None req-2ee7d6ac-a7cb-43d6-95f8-4cfab34a71f0 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=83259) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.10/site-packages/oslo_db/sqlalchemy/engines.py:397}} Sep 16 14:41:57 devstack cinder-volume[83259]: DEBUG dbcounter [-] [83259] Writer thread running {{(pid=83259) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:102}} Sep 16 14:41:57 devstack cinder-volume[83259]: DEBUG cinder.db.sqlalchemy.api [None req-2ee7d6ac-a7cb-43d6-95f8-4cfab34a71f0 None None] Building query based on filter {{(pid=83259) _process_snaps_filters /opt/stack/cinder/cinder/db/sqlalchemy/api.py:3917}} Sep 16 14:41:57 devstack cinder-volume[83259]: DEBUG cinder.image.image_utils [None req-2ee7d6ac-a7cb-43d6-95f8-4cfab34a71f0 None None] Configuration image_conversion_dir is None or the path doesn't exist. {{(pid=83259) cleanup_temporary_file /opt/stack/cinder/cinder/image/image_utils.py:1266}} Sep 16 14:41:57 devstack cinder-volume[83259]: INFO cinder.keymgr.migration [None req-87572966-fa5a-4262-af18-6488395112e0 None None] Not migrating encryption keys because the ConfKeyManager is still in use. Sep 16 14:41:57 devstack cinder-volume[83259]: DEBUG oslo_concurrency.lockutils [None req-2ee7d6ac-a7cb-43d6-95f8-4cfab34a71f0 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83259) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 16 14:41:57 devstack cinder-volume[83259]: DEBUG oslo_concurrency.lockutils [None req-2ee7d6ac-a7cb-43d6-95f8-4cfab34a71f0 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=83259) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 16 14:41:57 devstack cinder-volume[83259]: DEBUG cinder.volume.drivers.quobyte [None req-2ee7d6ac-a7cb-43d6-95f8-4cfab34a71f0 None None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-61f585ac-f8e2-4d19-a890-7ebc2726cc72': None} {{(pid=83259) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:639}} Sep 16 14:41:57 devstack cinder-volume[83259]: DEBUG cinder.volume.drivers.quobyte [None req-2ee7d6ac-a7cb-43d6-95f8-4cfab34a71f0 None None] Available shares ['10.10.41.181/cinder-vol-61f585ac-f8e2-4d19-a890-7ebc2726cc72'] {{(pid=83259) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:669}} Sep 16 14:41:57 devstack cinder-volume[83259]: DEBUG oslo_concurrency.lockutils [None req-2ee7d6ac-a7cb-43d6-95f8-4cfab34a71f0 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=83259) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 16 14:41:57 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [None req-2ee7d6ac-a7cb-43d6-95f8-4cfab34a71f0 None None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 14:41:57 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [None req-2ee7d6ac-a7cb-43d6-95f8-4cfab34a71f0 None None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c" returned: 0 in 0.086s {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 14:41:57 devstack cinder-volume[83259]: DEBUG cinder.manager [None req-2ee7d6ac-a7cb-43d6-95f8-4cfab34a71f0 None None] Notifying Schedulers of capabilities ... {{(pid=83259) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 16 14:41:57 devstack cinder-volume[83259]: INFO cinder.volume.manager [None req-2ee7d6ac-a7cb-43d6-95f8-4cfab34a71f0 None None] Driver initialization completed successfully. Sep 16 14:41:57 devstack cinder-volume[83259]: INFO cinder.manager [None req-2ee7d6ac-a7cb-43d6-95f8-4cfab34a71f0 None None] Initiating service 3 cleanup Sep 16 14:41:57 devstack cinder-volume[83259]: INFO cinder.manager [None req-2ee7d6ac-a7cb-43d6-95f8-4cfab34a71f0 None None] Service 3 cleanup completed. Sep 16 14:41:57 devstack cinder-volume[83259]: DEBUG cinder.service [None req-2ee7d6ac-a7cb-43d6-95f8-4cfab34a71f0 None None] Creating RPC server for service cinder-volume {{(pid=83259) start /opt/stack/cinder/cinder/service.py:239}} Sep 16 14:41:57 devstack cinder-volume[83259]: DEBUG cinder.service [None req-2ee7d6ac-a7cb-43d6-95f8-4cfab34a71f0 None None] Pinning object versions for RPC server serializer to 1.39 {{(pid=83259) start /opt/stack/cinder/cinder/service.py:245}} Sep 16 14:41:57 devstack cinder-volume[83259]: INFO cinder.volume.manager [None req-2ee7d6ac-a7cb-43d6-95f8-4cfab34a71f0 None None] Initializing RPC dependent components of volume driver QuobyteDriver (1.2) Sep 16 14:41:57 devstack cinder-volume[83259]: WARNING cinder.volume.volume_utils [None req-2ee7d6ac-a7cb-43d6-95f8-4cfab34a71f0 None None] Volume driver (QuobyteDriver 1.2) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 16 14:41:57 devstack cinder-volume[83259]: WARNING cinder.volume.volume_utils [None req-2ee7d6ac-a7cb-43d6-95f8-4cfab34a71f0 None None] Volume driver (QuobyteDriver 1.2) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 16 14:41:57 devstack cinder-volume[83259]: DEBUG oslo_concurrency.lockutils [None req-2ee7d6ac-a7cb-43d6-95f8-4cfab34a71f0 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83259) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 16 14:41:57 devstack cinder-volume[83259]: DEBUG oslo_concurrency.lockutils [None req-2ee7d6ac-a7cb-43d6-95f8-4cfab34a71f0 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=83259) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 16 14:41:57 devstack cinder-volume[83259]: DEBUG cinder.volume.drivers.quobyte [None req-2ee7d6ac-a7cb-43d6-95f8-4cfab34a71f0 None None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-61f585ac-f8e2-4d19-a890-7ebc2726cc72': None} {{(pid=83259) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:639}} Sep 16 14:41:57 devstack cinder-volume[83259]: DEBUG cinder.volume.drivers.quobyte [None req-2ee7d6ac-a7cb-43d6-95f8-4cfab34a71f0 None None] Available shares ['10.10.41.181/cinder-vol-61f585ac-f8e2-4d19-a890-7ebc2726cc72'] {{(pid=83259) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:669}} Sep 16 14:41:57 devstack cinder-volume[83259]: DEBUG oslo_concurrency.lockutils [None req-2ee7d6ac-a7cb-43d6-95f8-4cfab34a71f0 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=83259) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 16 14:41:57 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [None req-2ee7d6ac-a7cb-43d6-95f8-4cfab34a71f0 None None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 14:41:58 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [None req-2ee7d6ac-a7cb-43d6-95f8-4cfab34a71f0 None None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c" returned: 0 in 0.112s {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 14:41:58 devstack cinder-volume[83259]: INFO cinder.volume.manager [None req-2ee7d6ac-a7cb-43d6-95f8-4cfab34a71f0 None None] Driver post RPC initialization completed successfully. Sep 16 14:41:59 devstack quobyte-client[83286]: Resolving 'registry:' with default 10.10.41.181:7861 Sep 16 14:42:04 devstack cinder-volume[83016]: DEBUG dbcounter [-] [83016] Writing DB stats cinder:SELECT=6,cinder:INSERT=1,cinder:UPDATE=2 {{(pid=83016) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Sep 16 14:42:07 devstack cinder-volume[83259]: DEBUG dbcounter [-] [83259] Writing DB stats cinder:SELECT=8,cinder:INSERT=1,cinder:UPDATE=2 {{(pid=83259) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Sep 16 14:42:08 devstack cinder-volume[83259]: DEBUG dbcounter [-] [83259] Writing DB stats cinder:SELECT=4,cinder:UPDATE=1 {{(pid=83259) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Sep 16 14:43:13 devstack cinder-volume[83259]: WARNING cinder.volume.volume_utils [None req-786dee0c-1893-47f5-add7-6e440b2c7b1e tempest-VolumesAssistedSnapshotsTest-1220102166 None] Volume driver (QuobyteDriver 1.2) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 16 14:43:13 devstack cinder-volume[83259]: DEBUG cinder.volume.flows.manager.create_volume [None req-786dee0c-1893-47f5-add7-6e440b2c7b1e tempest-VolumesAssistedSnapshotsTest-1220102166 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#Quobyte'], 'hosts': ['devstack@QuobyteHD#Quobyte']} {{(pid=83259) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1387}} Sep 16 14:43:14 devstack cinder-volume[83259]: DEBUG cinder.volume.manager [None req-786dee0c-1893-47f5-add7-6e440b2c7b1e tempest-VolumesAssistedSnapshotsTest-1220102166 None] Flow 'volume_create_manager' (429bdc4e-146d-473c-a65c-1d4d68c3259d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83259) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 16 14:43:14 devstack cinder-volume[83259]: DEBUG cinder.volume.manager [None req-786dee0c-1893-47f5-add7-6e440b2c7b1e tempest-VolumesAssistedSnapshotsTest-1220102166 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d9a4f28b-1f4f-4679-945b-d0f98a1bad03) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83259) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 14:43:14 devstack cinder-volume[83259]: DEBUG cinder.volume.manager [None req-786dee0c-1893-47f5-add7-6e440b2c7b1e tempest-VolumesAssistedSnapshotsTest-1220102166 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d9a4f28b-1f4f-4679-945b-d0f98a1bad03) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-16T12:43:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesAssistedSnapshotsTest-volume-95514622',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#Quobyte',id=a6caaadc-cbc3-4e99-9def-a99686435d51,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ec34e33b8bc24639a501cf546b7a978e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-16T12:43:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-16T12:43:14Z,use_quota=True,user_id='3a270233fdd046e89a0b45af1d02c62c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(485ead50-3df8-4d76-8d34-a4db136c980a),volume_type_id=485ead50-3df8-4d76-8d34-a4db136c980a)' {{(pid=83259) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 14:43:14 devstack cinder-volume[83259]: DEBUG cinder.volume.manager [None req-786dee0c-1893-47f5-add7-6e440b2c7b1e tempest-VolumesAssistedSnapshotsTest-1220102166 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bd61cec9-4a14-4837-90bd-2dbff218cd9a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83259) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 14:43:14 devstack cinder-volume[83259]: DEBUG cinder.volume.manager [None req-786dee0c-1893-47f5-add7-6e440b2c7b1e tempest-VolumesAssistedSnapshotsTest-1220102166 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bd61cec9-4a14-4837-90bd-2dbff218cd9a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83259) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 14:43:14 devstack cinder-volume[83259]: DEBUG cinder.volume.manager [None req-786dee0c-1893-47f5-add7-6e440b2c7b1e tempest-VolumesAssistedSnapshotsTest-1220102166 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (76f34e84-c098-463c-8717-dfef2fd9c707) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83259) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 14:43:14 devstack cinder-volume[83259]: DEBUG cinder.volume.manager [None req-786dee0c-1893-47f5-add7-6e440b2c7b1e tempest-VolumesAssistedSnapshotsTest-1220102166 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (76f34e84-c098-463c-8717-dfef2fd9c707) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a6caaadc-cbc3-4e99-9def-a99686435d51', 'volume_name': 'volume-a6caaadc-cbc3-4e99-9def-a99686435d51', 'volume_size': 1}' {{(pid=83259) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 14:43:14 devstack cinder-volume[83259]: DEBUG cinder.volume.manager [None req-786dee0c-1893-47f5-add7-6e440b2c7b1e tempest-VolumesAssistedSnapshotsTest-1220102166 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8b242502-b76b-4ca0-a04e-82a943d56078) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83259) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 14:43:14 devstack cinder-volume[83259]: DEBUG cinder.volume.manager [None req-786dee0c-1893-47f5-add7-6e440b2c7b1e tempest-VolumesAssistedSnapshotsTest-1220102166 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8b242502-b76b-4ca0-a04e-82a943d56078) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83259) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 14:43:14 devstack cinder-volume[83259]: DEBUG cinder.volume.manager [None req-786dee0c-1893-47f5-add7-6e440b2c7b1e tempest-VolumesAssistedSnapshotsTest-1220102166 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3dcc2029-b07d-4059-9812-6fdb1b4c6bbf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83259) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 14:43:14 devstack cinder-volume[83259]: INFO cinder.volume.flows.manager.create_volume [None req-786dee0c-1893-47f5-add7-6e440b2c7b1e tempest-VolumesAssistedSnapshotsTest-1220102166 None] Volume a6caaadc-cbc3-4e99-9def-a99686435d51: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a6caaadc-cbc3-4e99-9def-a99686435d51', 'volume_size': 1} Sep 16 14:43:14 devstack cinder-volume[83259]: DEBUG oslo_concurrency.lockutils [None req-786dee0c-1893-47f5-add7-6e440b2c7b1e tempest-VolumesAssistedSnapshotsTest-1220102166 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83259) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 16 14:43:14 devstack cinder-volume[83259]: DEBUG oslo_concurrency.lockutils [None req-786dee0c-1893-47f5-add7-6e440b2c7b1e tempest-VolumesAssistedSnapshotsTest-1220102166 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=83259) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 16 14:43:14 devstack cinder-volume[83259]: DEBUG cinder.volume.drivers.quobyte [None req-786dee0c-1893-47f5-add7-6e440b2c7b1e tempest-VolumesAssistedSnapshotsTest-1220102166 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-16T12:43:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesAssistedSnapshotsTest-volume-95514622',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#Quobyte',id=a6caaadc-cbc3-4e99-9def-a99686435d51,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ec34e33b8bc24639a501cf546b7a978e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-16T12:43:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-16T12:43:14Z,use_quota=True,user_id='3a270233fdd046e89a0b45af1d02c62c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(485ead50-3df8-4d76-8d34-a4db136c980a),volume_type_id=485ead50-3df8-4d76-8d34-a4db136c980a)}" {{(pid=83259) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Sep 16 14:43:14 devstack cinder-volume[83259]: DEBUG cinder.volume.drivers.remotefs [None req-786dee0c-1893-47f5-add7-6e440b2c7b1e tempest-VolumesAssistedSnapshotsTest-1220102166 None] Creating volume a6caaadc-cbc3-4e99-9def-a99686435d51 {{(pid=83259) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}} Sep 16 14:43:14 devstack cinder-volume[83259]: DEBUG oslo_concurrency.lockutils [None req-786dee0c-1893-47f5-add7-6e440b2c7b1e tempest-VolumesAssistedSnapshotsTest-1220102166 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83259) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 16 14:43:14 devstack cinder-volume[83259]: DEBUG oslo_concurrency.lockutils [None req-786dee0c-1893-47f5-add7-6e440b2c7b1e tempest-VolumesAssistedSnapshotsTest-1220102166 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83259) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 16 14:43:14 devstack cinder-volume[83259]: DEBUG cinder.volume.drivers.quobyte [None req-786dee0c-1893-47f5-add7-6e440b2c7b1e tempest-VolumesAssistedSnapshotsTest-1220102166 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-61f585ac-f8e2-4d19-a890-7ebc2726cc72': None} {{(pid=83259) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:639}} Sep 16 14:43:14 devstack cinder-volume[83259]: DEBUG cinder.volume.drivers.quobyte [None req-786dee0c-1893-47f5-add7-6e440b2c7b1e tempest-VolumesAssistedSnapshotsTest-1220102166 None] Available shares ['10.10.41.181/cinder-vol-61f585ac-f8e2-4d19-a890-7ebc2726cc72'] {{(pid=83259) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:669}} Sep 16 14:43:14 devstack cinder-volume[83259]: DEBUG oslo_concurrency.lockutils [None req-786dee0c-1893-47f5-add7-6e440b2c7b1e tempest-VolumesAssistedSnapshotsTest-1220102166 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.023s {{(pid=83259) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 16 14:43:14 devstack cinder-volume[83259]: DEBUG cinder.volume.drivers.quobyte [None req-786dee0c-1893-47f5-add7-6e440b2c7b1e tempest-VolumesAssistedSnapshotsTest-1220102166 None] Selected 10.10.41.181/cinder-vol-61f585ac-f8e2-4d19-a890-7ebc2726cc72 as target Quobyte volume. {{(pid=83259) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:690}} Sep 16 14:43:14 devstack cinder-volume[83259]: INFO cinder.volume.drivers.remotefs [None req-786dee0c-1893-47f5-add7-6e440b2c7b1e tempest-VolumesAssistedSnapshotsTest-1220102166 None] casted to 10.10.41.181/cinder-vol-61f585ac-f8e2-4d19-a890-7ebc2726cc72 Sep 16 14:43:14 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [None req-786dee0c-1893-47f5-add7-6e440b2c7b1e tempest-VolumesAssistedSnapshotsTest-1220102166 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c/volume-a6caaadc-cbc3-4e99-9def-a99686435d51 1073741824 {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 14:43:14 devstack quobyte-client[83286]: System call of process 83561 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 16 14:43:15 devstack quobyte-client[83286]: The server volume:87712ffe-8a69-446d-9ed6-4430c7ee9792@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=87712ffe-8a69-446d-9ed6-4430c7ee9792, inode=2, name=volume-a6caaadc-cbc3-4e99-9def-a99686435d51, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.206), requestorAccessMask=0 Sep 16 14:43:15 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [None req-786dee0c-1893-47f5-add7-6e440b2c7b1e tempest-VolumesAssistedSnapshotsTest-1220102166 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c/volume-a6caaadc-cbc3-4e99-9def-a99686435d51 1073741824" returned: 0 in 1.478s {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 14:43:15 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [None req-786dee0c-1893-47f5-add7-6e440b2c7b1e tempest-VolumesAssistedSnapshotsTest-1220102166 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c/volume-a6caaadc-cbc3-4e99-9def-a99686435d51 {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 14:43:15 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [None req-786dee0c-1893-47f5-add7-6e440b2c7b1e tempest-VolumesAssistedSnapshotsTest-1220102166 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c/volume-a6caaadc-cbc3-4e99-9def-a99686435d51" returned: 0 in 0.067s {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 14:43:15 devstack cinder-volume[83259]: DEBUG cinder.volume.drivers.quobyte [None req-786dee0c-1893-47f5-add7-6e440b2c7b1e tempest-VolumesAssistedSnapshotsTest-1220102166 None] <== create_volume: return (1624ms) {'provider_location': '10.10.41.181/cinder-vol-61f585ac-f8e2-4d19-a890-7ebc2726cc72'} {{(pid=83259) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Sep 16 14:43:15 devstack cinder-volume[83259]: DEBUG oslo_concurrency.lockutils [None req-786dee0c-1893-47f5-add7-6e440b2c7b1e tempest-VolumesAssistedSnapshotsTest-1220102166 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.645s {{(pid=83259) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 16 14:43:16 devstack cinder-volume[83259]: DEBUG cinder.volume.manager [None req-786dee0c-1893-47f5-add7-6e440b2c7b1e tempest-VolumesAssistedSnapshotsTest-1220102166 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3dcc2029-b07d-4059-9812-6fdb1b4c6bbf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a6caaadc-cbc3-4e99-9def-a99686435d51', 'volume_size': 1}' {{(pid=83259) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 14:43:16 devstack cinder-volume[83259]: DEBUG cinder.volume.manager [None req-786dee0c-1893-47f5-add7-6e440b2c7b1e tempest-VolumesAssistedSnapshotsTest-1220102166 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (82378a91-64e9-4cc5-b5dc-3378cf85c17c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83259) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 14:43:16 devstack cinder-volume[83259]: INFO cinder.volume.flows.manager.create_volume [None req-786dee0c-1893-47f5-add7-6e440b2c7b1e tempest-VolumesAssistedSnapshotsTest-1220102166 None] Volume volume-a6caaadc-cbc3-4e99-9def-a99686435d51 (a6caaadc-cbc3-4e99-9def-a99686435d51): created successfully Sep 16 14:43:16 devstack cinder-volume[83259]: DEBUG cinder.volume.manager [None req-786dee0c-1893-47f5-add7-6e440b2c7b1e tempest-VolumesAssistedSnapshotsTest-1220102166 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (82378a91-64e9-4cc5-b5dc-3378cf85c17c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83259) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 14:43:16 devstack cinder-volume[83259]: DEBUG cinder.volume.manager [None req-786dee0c-1893-47f5-add7-6e440b2c7b1e tempest-VolumesAssistedSnapshotsTest-1220102166 None] Flow 'volume_create_manager' (429bdc4e-146d-473c-a65c-1d4d68c3259d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83259) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 16 14:43:16 devstack cinder-volume[83259]: INFO cinder.volume.manager [None req-786dee0c-1893-47f5-add7-6e440b2c7b1e tempest-VolumesAssistedSnapshotsTest-1220102166 None] Created volume successfully. Sep 16 14:43:26 devstack cinder-volume[83259]: DEBUG dbcounter [-] [83259] Writing DB stats cinder:SELECT=2,cinder:UPDATE=1 {{(pid=83259) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Sep 16 14:43:26 devstack cinder-volume[83259]: DEBUG dbcounter [-] [83259] Writing DB stats cinder:UPDATE=3,cinder:DELETE=1 {{(pid=83259) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Sep 16 14:43:44 devstack cinder-volume[83259]: DEBUG oslo_service.periodic_task [None req-050ec8a1-6ffd-499d-95ad-d548a84437e2 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=83259) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} Sep 16 14:43:44 devstack cinder-volume[83259]: DEBUG oslo_concurrency.lockutils [None req-050ec8a1-6ffd-499d-95ad-d548a84437e2 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83259) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 16 14:43:44 devstack cinder-volume[83259]: DEBUG oslo_concurrency.lockutils [None req-050ec8a1-6ffd-499d-95ad-d548a84437e2 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=83259) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 16 14:43:44 devstack cinder-volume[83259]: DEBUG cinder.volume.drivers.quobyte [None req-050ec8a1-6ffd-499d-95ad-d548a84437e2 None None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-61f585ac-f8e2-4d19-a890-7ebc2726cc72': None} {{(pid=83259) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:639}} Sep 16 14:43:44 devstack cinder-volume[83259]: DEBUG cinder.volume.drivers.quobyte [None req-050ec8a1-6ffd-499d-95ad-d548a84437e2 None None] Available shares ['10.10.41.181/cinder-vol-61f585ac-f8e2-4d19-a890-7ebc2726cc72'] {{(pid=83259) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:669}} Sep 16 14:43:44 devstack cinder-volume[83259]: DEBUG oslo_concurrency.lockutils [None req-050ec8a1-6ffd-499d-95ad-d548a84437e2 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=83259) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 16 14:43:44 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [None req-050ec8a1-6ffd-499d-95ad-d548a84437e2 None None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 14:43:44 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [None req-050ec8a1-6ffd-499d-95ad-d548a84437e2 None None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c" returned: 0 in 0.133s {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 14:43:44 devstack cinder-volume[83259]: DEBUG cinder.manager [None req-050ec8a1-6ffd-499d-95ad-d548a84437e2 None None] Notifying Schedulers of capabilities ... {{(pid=83259) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 16 14:44:05 devstack cinder-volume[83259]: WARNING cinder.volume.volume_utils [None req-94cef8ac-27b4-4880-835d-3904adf60377 tempest-VolumesAdminNegativeTest-1628073823 None] Volume driver (QuobyteDriver 1.2) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 16 14:44:05 devstack cinder-volume[83259]: DEBUG cinder.volume.flows.manager.create_volume [None req-94cef8ac-27b4-4880-835d-3904adf60377 tempest-VolumesAdminNegativeTest-1628073823 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#Quobyte'], 'hosts': ['devstack@QuobyteHD#Quobyte']} {{(pid=83259) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1387}} Sep 16 14:44:05 devstack cinder-volume[83259]: DEBUG cinder.volume.manager [None req-94cef8ac-27b4-4880-835d-3904adf60377 tempest-VolumesAdminNegativeTest-1628073823 None] Flow 'volume_create_manager' (ac68211f-240a-40c7-bec9-a91f3ffce4f9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83259) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 16 14:44:05 devstack cinder-volume[83259]: DEBUG cinder.volume.manager [None req-94cef8ac-27b4-4880-835d-3904adf60377 tempest-VolumesAdminNegativeTest-1628073823 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a091f34d-6673-4576-a821-e7134d36c146) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83259) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 14:44:05 devstack cinder-volume[83259]: DEBUG cinder.volume.manager [None req-94cef8ac-27b4-4880-835d-3904adf60377 tempest-VolumesAdminNegativeTest-1628073823 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a091f34d-6673-4576-a821-e7134d36c146) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-16T12:44:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesAdminNegativeTest-volume-1562999720',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#Quobyte',id=a264c06f-ff22-43a2-99fb-d4f632bfbb02,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d53cf3eec404436dad5fbce1898216fb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-16T12:44:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-16T12:44:05Z,use_quota=True,user_id='e13793b7cad54b9d81ad354f77c8b37e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(485ead50-3df8-4d76-8d34-a4db136c980a),volume_type_id=485ead50-3df8-4d76-8d34-a4db136c980a)' {{(pid=83259) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 14:44:05 devstack cinder-volume[83259]: DEBUG cinder.volume.manager [None req-94cef8ac-27b4-4880-835d-3904adf60377 tempest-VolumesAdminNegativeTest-1628073823 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (13db13ac-cf63-4e6d-928c-058c9caae31e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83259) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 14:44:05 devstack cinder-volume[83259]: DEBUG cinder.volume.manager [None req-94cef8ac-27b4-4880-835d-3904adf60377 tempest-VolumesAdminNegativeTest-1628073823 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (13db13ac-cf63-4e6d-928c-058c9caae31e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83259) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 14:44:05 devstack cinder-volume[83259]: DEBUG cinder.volume.manager [None req-94cef8ac-27b4-4880-835d-3904adf60377 tempest-VolumesAdminNegativeTest-1628073823 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5297ae2c-8abe-4733-9719-3c46a257b0ea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83259) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 14:44:06 devstack cinder-volume[83259]: DEBUG cinder.volume.manager [None req-94cef8ac-27b4-4880-835d-3904adf60377 tempest-VolumesAdminNegativeTest-1628073823 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5297ae2c-8abe-4733-9719-3c46a257b0ea) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a264c06f-ff22-43a2-99fb-d4f632bfbb02', 'volume_name': 'volume-a264c06f-ff22-43a2-99fb-d4f632bfbb02', 'volume_size': 1}' {{(pid=83259) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 14:44:06 devstack cinder-volume[83259]: DEBUG cinder.volume.manager [None req-94cef8ac-27b4-4880-835d-3904adf60377 tempest-VolumesAdminNegativeTest-1628073823 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (aab9eabb-fd43-4cbe-82e6-531f1ff9953c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83259) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 14:44:06 devstack cinder-volume[83259]: DEBUG cinder.volume.manager [None req-94cef8ac-27b4-4880-835d-3904adf60377 tempest-VolumesAdminNegativeTest-1628073823 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (aab9eabb-fd43-4cbe-82e6-531f1ff9953c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83259) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 14:44:06 devstack cinder-volume[83259]: DEBUG cinder.volume.manager [None req-94cef8ac-27b4-4880-835d-3904adf60377 tempest-VolumesAdminNegativeTest-1628073823 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1749a37c-cecb-4968-b2e6-970a042a7ce1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83259) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 14:44:06 devstack cinder-volume[83259]: INFO cinder.volume.flows.manager.create_volume [None req-94cef8ac-27b4-4880-835d-3904adf60377 tempest-VolumesAdminNegativeTest-1628073823 None] Volume a264c06f-ff22-43a2-99fb-d4f632bfbb02: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a264c06f-ff22-43a2-99fb-d4f632bfbb02', 'volume_size': 1} Sep 16 14:44:06 devstack cinder-volume[83259]: DEBUG oslo_concurrency.lockutils [None req-94cef8ac-27b4-4880-835d-3904adf60377 tempest-VolumesAdminNegativeTest-1628073823 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83259) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 16 14:44:06 devstack cinder-volume[83259]: DEBUG oslo_concurrency.lockutils [None req-94cef8ac-27b4-4880-835d-3904adf60377 tempest-VolumesAdminNegativeTest-1628073823 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.007s {{(pid=83259) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 16 14:44:06 devstack cinder-volume[83259]: DEBUG cinder.volume.drivers.quobyte [None req-94cef8ac-27b4-4880-835d-3904adf60377 tempest-VolumesAdminNegativeTest-1628073823 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-16T12:44:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesAdminNegativeTest-volume-1562999720',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#Quobyte',id=a264c06f-ff22-43a2-99fb-d4f632bfbb02,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d53cf3eec404436dad5fbce1898216fb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-16T12:44:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-16T12:44:05Z,use_quota=True,user_id='e13793b7cad54b9d81ad354f77c8b37e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(485ead50-3df8-4d76-8d34-a4db136c980a),volume_type_id=485ead50-3df8-4d76-8d34-a4db136c980a)}" {{(pid=83259) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Sep 16 14:44:06 devstack cinder-volume[83259]: DEBUG cinder.volume.drivers.remotefs [None req-94cef8ac-27b4-4880-835d-3904adf60377 tempest-VolumesAdminNegativeTest-1628073823 None] Creating volume a264c06f-ff22-43a2-99fb-d4f632bfbb02 {{(pid=83259) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}} Sep 16 14:44:06 devstack cinder-volume[83259]: DEBUG oslo_concurrency.lockutils [None req-94cef8ac-27b4-4880-835d-3904adf60377 tempest-VolumesAdminNegativeTest-1628073823 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83259) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 16 14:44:06 devstack cinder-volume[83259]: DEBUG oslo_concurrency.lockutils [None req-94cef8ac-27b4-4880-835d-3904adf60377 tempest-VolumesAdminNegativeTest-1628073823 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83259) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 16 14:44:06 devstack cinder-volume[83259]: DEBUG cinder.volume.drivers.quobyte [None req-94cef8ac-27b4-4880-835d-3904adf60377 tempest-VolumesAdminNegativeTest-1628073823 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-61f585ac-f8e2-4d19-a890-7ebc2726cc72': None} {{(pid=83259) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:639}} Sep 16 14:44:06 devstack cinder-volume[83259]: DEBUG cinder.volume.drivers.quobyte [None req-94cef8ac-27b4-4880-835d-3904adf60377 tempest-VolumesAdminNegativeTest-1628073823 None] Available shares ['10.10.41.181/cinder-vol-61f585ac-f8e2-4d19-a890-7ebc2726cc72'] {{(pid=83259) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:669}} Sep 16 14:44:06 devstack cinder-volume[83259]: DEBUG oslo_concurrency.lockutils [None req-94cef8ac-27b4-4880-835d-3904adf60377 tempest-VolumesAdminNegativeTest-1628073823 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.024s {{(pid=83259) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 16 14:44:06 devstack cinder-volume[83259]: DEBUG cinder.volume.drivers.quobyte [None req-94cef8ac-27b4-4880-835d-3904adf60377 tempest-VolumesAdminNegativeTest-1628073823 None] Selected 10.10.41.181/cinder-vol-61f585ac-f8e2-4d19-a890-7ebc2726cc72 as target Quobyte volume. {{(pid=83259) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:690}} Sep 16 14:44:06 devstack cinder-volume[83259]: INFO cinder.volume.drivers.remotefs [None req-94cef8ac-27b4-4880-835d-3904adf60377 tempest-VolumesAdminNegativeTest-1628073823 None] casted to 10.10.41.181/cinder-vol-61f585ac-f8e2-4d19-a890-7ebc2726cc72 Sep 16 14:44:06 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [None req-94cef8ac-27b4-4880-835d-3904adf60377 tempest-VolumesAdminNegativeTest-1628073823 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c/volume-a264c06f-ff22-43a2-99fb-d4f632bfbb02 1073741824 {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 14:44:06 devstack quobyte-client[83286]: System call of process 84232 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 16 14:44:06 devstack quobyte-client[83286]: The server volume:87712ffe-8a69-446d-9ed6-4430c7ee9792@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=87712ffe-8a69-446d-9ed6-4430c7ee9792, inode=3, name=volume-a264c06f-ff22-43a2-99fb-d4f632bfbb02, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.206), requestorAccessMask=0 Sep 16 14:44:07 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [None req-94cef8ac-27b4-4880-835d-3904adf60377 tempest-VolumesAdminNegativeTest-1628073823 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c/volume-a264c06f-ff22-43a2-99fb-d4f632bfbb02 1073741824" returned: 0 in 1.649s {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 14:44:07 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [None req-94cef8ac-27b4-4880-835d-3904adf60377 tempest-VolumesAdminNegativeTest-1628073823 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c/volume-a264c06f-ff22-43a2-99fb-d4f632bfbb02 {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 14:44:08 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [None req-94cef8ac-27b4-4880-835d-3904adf60377 tempest-VolumesAdminNegativeTest-1628073823 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c/volume-a264c06f-ff22-43a2-99fb-d4f632bfbb02" returned: 0 in 0.569s {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 14:44:08 devstack cinder-volume[83259]: DEBUG cinder.volume.drivers.quobyte [None req-94cef8ac-27b4-4880-835d-3904adf60377 tempest-VolumesAdminNegativeTest-1628073823 None] <== create_volume: return (2558ms) {'provider_location': '10.10.41.181/cinder-vol-61f585ac-f8e2-4d19-a890-7ebc2726cc72'} {{(pid=83259) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Sep 16 14:44:08 devstack cinder-volume[83259]: DEBUG oslo_concurrency.lockutils [None req-94cef8ac-27b4-4880-835d-3904adf60377 tempest-VolumesAdminNegativeTest-1628073823 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.666s {{(pid=83259) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 16 14:44:09 devstack cinder-volume[83259]: DEBUG cinder.volume.manager [None req-94cef8ac-27b4-4880-835d-3904adf60377 tempest-VolumesAdminNegativeTest-1628073823 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1749a37c-cecb-4968-b2e6-970a042a7ce1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a264c06f-ff22-43a2-99fb-d4f632bfbb02', 'volume_size': 1}' {{(pid=83259) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 14:44:10 devstack cinder-volume[83259]: DEBUG cinder.volume.manager [None req-94cef8ac-27b4-4880-835d-3904adf60377 tempest-VolumesAdminNegativeTest-1628073823 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (19130407-6082-4cc8-ab13-df28ebf33243) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83259) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 14:44:10 devstack cinder-volume[83259]: INFO cinder.volume.flows.manager.create_volume [None req-94cef8ac-27b4-4880-835d-3904adf60377 tempest-VolumesAdminNegativeTest-1628073823 None] Volume volume-a264c06f-ff22-43a2-99fb-d4f632bfbb02 (a264c06f-ff22-43a2-99fb-d4f632bfbb02): created successfully Sep 16 14:44:10 devstack cinder-volume[83259]: DEBUG cinder.volume.manager [None req-94cef8ac-27b4-4880-835d-3904adf60377 tempest-VolumesAdminNegativeTest-1628073823 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (19130407-6082-4cc8-ab13-df28ebf33243) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83259) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 14:44:10 devstack cinder-volume[83259]: DEBUG cinder.volume.manager [None req-94cef8ac-27b4-4880-835d-3904adf60377 tempest-VolumesAdminNegativeTest-1628073823 None] Flow 'volume_create_manager' (ac68211f-240a-40c7-bec9-a91f3ffce4f9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83259) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 16 14:44:10 devstack cinder-volume[83259]: INFO cinder.volume.manager [None req-94cef8ac-27b4-4880-835d-3904adf60377 tempest-VolumesAdminNegativeTest-1628073823 None] Created volume successfully. Sep 16 14:44:13 devstack cinder-volume[83259]: DEBUG cinder.coordination [None req-52782abc-64a7-451e-9365-0fd040de734c tempest-VolumesAdminNegativeTest-1628073823 None] Acquiring lock "cinder-a264c06f-ff22-43a2-99fb-d4f632bfbb02-delete_volume" by "delete_volume" {{(pid=83259) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 16 14:44:14 devstack cinder-volume[83259]: DEBUG cinder.coordination [None req-52782abc-64a7-451e-9365-0fd040de734c tempest-VolumesAdminNegativeTest-1628073823 None] Lock "cinder-a264c06f-ff22-43a2-99fb-d4f632bfbb02-delete_volume" acquired by "delete_volume" :: waited 0.057s {{(pid=83259) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 16 14:44:14 devstack cinder-volume[83259]: WARNING cinder.volume.volume_utils [None req-52782abc-64a7-451e-9365-0fd040de734c tempest-VolumesAdminNegativeTest-1628073823 None] Volume driver (QuobyteDriver 1.2) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 16 14:44:14 devstack cinder-volume[83259]: DEBUG cinder.coordination [None req-52782abc-64a7-451e-9365-0fd040de734c tempest-VolumesAdminNegativeTest-1628073823 None] Acquiring lock "cinder-quobyte-a264c06f-ff22-43a2-99fb-d4f632bfbb02" by "delete_volume" {{(pid=83259) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 16 14:44:14 devstack cinder-volume[83259]: DEBUG cinder.coordination [None req-52782abc-64a7-451e-9365-0fd040de734c tempest-VolumesAdminNegativeTest-1628073823 None] Lock "cinder-quobyte-a264c06f-ff22-43a2-99fb-d4f632bfbb02" acquired by "delete_volume" :: waited 0.047s {{(pid=83259) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 16 14:44:14 devstack cinder-volume[83259]: INFO oslo.privsep.daemon [None req-52782abc-64a7-451e-9365-0fd040de734c tempest-VolumesAdminNegativeTest-1628073823 None] Running privsep helper: ['sudo', 'cinder-rootwrap', '/etc/cinder/rootwrap.conf', 'privsep-helper', '--config-file', '/etc/cinder/cinder.conf', '--privsep_context', 'cinder.privsep.sys_admin_pctxt', '--privsep_sock_path', '/tmp/tmp87nken4q/privsep.sock'] Sep 16 14:44:15 devstack sudo[84264]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf privsep-helper --config-file /etc/cinder/cinder.conf --privsep_context cinder.privsep.sys_admin_pctxt --privsep_sock_path /tmp/tmp87nken4q/privsep.sock Sep 16 14:44:15 devstack sudo[84264]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 14:44:24 devstack cinder-volume[83259]: DEBUG dbcounter [-] [83259] Writing DB stats cinder:UPDATE=5,cinder:SELECT=1 {{(pid=83259) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Sep 16 14:44:24 devstack cinder-volume[83259]: DEBUG dbcounter [-] [83259] Writing DB stats cinder:SELECT=4,cinder:UPDATE=1,cinder:DELETE=1 {{(pid=83259) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Sep 16 14:44:32 devstack sudo[84264]: pam_unix(sudo:session): session closed for user root Sep 16 14:44:32 devstack cinder-volume[83259]: INFO oslo.privsep.daemon [None req-52782abc-64a7-451e-9365-0fd040de734c tempest-VolumesAdminNegativeTest-1628073823 None] Spawned new privsep daemon via rootwrap Sep 16 14:44:32 devstack cinder-volume[83259]: DEBUG oslo.privsep.daemon [None req-52782abc-64a7-451e-9365-0fd040de734c tempest-VolumesAdminNegativeTest-1628073823 None] Accepted privsep connection to /tmp/tmp87nken4q/privsep.sock {{(pid=83259) __init__ /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:377}} Sep 16 14:44:32 devstack cinder-volume[83259]: INFO oslo.privsep.daemon [-] privsep daemon starting Sep 16 14:44:32 devstack cinder-volume[83259]: INFO oslo.privsep.daemon [-] privsep process running with uid/gid: 0/0 Sep 16 14:44:32 devstack cinder-volume[83259]: INFO oslo.privsep.daemon [-] privsep process running with capabilities (eff/prm/inh): CAP_CHOWN|CAP_DAC_OVERRIDE|CAP_DAC_READ_SEARCH|CAP_FOWNER|CAP_NET_ADMIN|CAP_SYS_ADMIN/CAP_CHOWN|CAP_DAC_OVERRIDE|CAP_DAC_READ_SEARCH|CAP_FOWNER|CAP_NET_ADMIN|CAP_SYS_ADMIN/none Sep 16 14:44:32 devstack cinder-volume[83259]: INFO oslo.privsep.daemon [-] privsep daemon running as pid 84312 Sep 16 14:44:32 devstack cinder-volume[83259]: DEBUG oslo.privsep.daemon [-] privsep: reply[39fe5ac5-d739-4fa9-aeb6-e075e8862528]: (2,) {{(pid=84312) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 16 14:44:33 devstack cinder-volume[83259]: DEBUG oslo.privsep.daemon [-] privsep: reply[bcb23ea7-14a1-4248-9f75-042644d28a2a]: (4, 'qcow2') {{(pid=84312) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 16 14:44:33 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [None req-52782abc-64a7-451e-9365-0fd040de734c tempest-VolumesAdminNegativeTest-1628073823 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c/volume-a264c06f-ff22-43a2-99fb-d4f632bfbb02 {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 14:44:34 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [None req-52782abc-64a7-451e-9365-0fd040de734c tempest-VolumesAdminNegativeTest-1628073823 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c/volume-a264c06f-ff22-43a2-99fb-d4f632bfbb02" returned: 0 in 0.992s {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 14:44:34 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [None req-52782abc-64a7-451e-9365-0fd040de734c tempest-VolumesAdminNegativeTest-1628073823 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c/volume-a264c06f-ff22-43a2-99fb-d4f632bfbb02 {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 14:44:34 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [None req-52782abc-64a7-451e-9365-0fd040de734c tempest-VolumesAdminNegativeTest-1628073823 None] CMD "rm -f /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c/volume-a264c06f-ff22-43a2-99fb-d4f632bfbb02" returned: 0 in 0.226s {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 14:44:34 devstack cinder-volume[83259]: DEBUG cinder.coordination [None req-52782abc-64a7-451e-9365-0fd040de734c tempest-VolumesAdminNegativeTest-1628073823 None] Lock "cinder-quobyte-a264c06f-ff22-43a2-99fb-d4f632bfbb02" released by "delete_volume" :: held 20.213s {{(pid=83259) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 16 14:44:35 devstack cinder-volume[83259]: WARNING cinder.quota [None req-52782abc-64a7-451e-9365-0fd040de734c tempest-VolumesAdminNegativeTest-1628073823 None] Deprecated: Default quota for resource: volumes_QuobyteHD is set by the default quota flag: quota_volumes_QuobyteHD, it is now deprecated. Please use the default quota class for default quota. Sep 16 14:44:35 devstack cinder-volume[83259]: WARNING cinder.quota [None req-52782abc-64a7-451e-9365-0fd040de734c tempest-VolumesAdminNegativeTest-1628073823 None] Deprecated: Default quota for resource: gigabytes_QuobyteHD is set by the default quota flag: quota_gigabytes_QuobyteHD, it is now deprecated. Please use the default quota class for default quota. Sep 16 14:44:35 devstack cinder-volume[83259]: DEBUG cinder.quota [None req-52782abc-64a7-451e-9365-0fd040de734c tempest-VolumesAdminNegativeTest-1628073823 None] Created reservations ['e3e7f39b-8b72-476e-882b-99e27e6b34d5', 'a1821b29-5b15-42e1-a49f-5ae2ac3c8eb2', 'f69bfd5d-f8d8-4c0f-a646-ab96a3cea2da', 'd06292fc-963b-4619-b77f-1b41c4a16f8c'] {{(pid=83259) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 16 14:44:36 devstack cinder-volume[83259]: DEBUG oslo_concurrency.lockutils [None req-52782abc-64a7-451e-9365-0fd040de734c tempest-VolumesAdminNegativeTest-1628073823 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83259) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 16 14:44:36 devstack cinder-volume[83259]: DEBUG oslo_concurrency.lockutils [None req-52782abc-64a7-451e-9365-0fd040de734c tempest-VolumesAdminNegativeTest-1628073823 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=83259) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 16 14:44:36 devstack cinder-volume[83259]: DEBUG cinder.volume.drivers.quobyte [None req-52782abc-64a7-451e-9365-0fd040de734c tempest-VolumesAdminNegativeTest-1628073823 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-61f585ac-f8e2-4d19-a890-7ebc2726cc72': None} {{(pid=83259) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:639}} Sep 16 14:44:36 devstack cinder-volume[83259]: DEBUG cinder.volume.drivers.quobyte [None req-52782abc-64a7-451e-9365-0fd040de734c tempest-VolumesAdminNegativeTest-1628073823 None] Available shares ['10.10.41.181/cinder-vol-61f585ac-f8e2-4d19-a890-7ebc2726cc72'] {{(pid=83259) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:669}} Sep 16 14:44:36 devstack cinder-volume[83259]: DEBUG oslo_concurrency.lockutils [None req-52782abc-64a7-451e-9365-0fd040de734c tempest-VolumesAdminNegativeTest-1628073823 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=83259) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 16 14:44:36 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [None req-52782abc-64a7-451e-9365-0fd040de734c tempest-VolumesAdminNegativeTest-1628073823 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 14:44:37 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [None req-52782abc-64a7-451e-9365-0fd040de734c tempest-VolumesAdminNegativeTest-1628073823 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c" returned: 0 in 0.474s {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 14:44:37 devstack cinder-volume[83259]: DEBUG cinder.manager [None req-52782abc-64a7-451e-9365-0fd040de734c tempest-VolumesAdminNegativeTest-1628073823 None] Notifying Schedulers of capabilities ... {{(pid=83259) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 16 14:44:37 devstack cinder-volume[83259]: INFO cinder.volume.manager [None req-52782abc-64a7-451e-9365-0fd040de734c tempest-VolumesAdminNegativeTest-1628073823 None] Deleted volume successfully. Sep 16 14:44:38 devstack cinder-volume[83259]: DEBUG cinder.coordination [None req-52782abc-64a7-451e-9365-0fd040de734c tempest-VolumesAdminNegativeTest-1628073823 None] Lock "cinder-a264c06f-ff22-43a2-99fb-d4f632bfbb02-delete_volume" released by "delete_volume" :: held 23.950s {{(pid=83259) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 16 14:44:44 devstack cinder-volume[83259]: DEBUG oslo_service.periodic_task [None req-050ec8a1-6ffd-499d-95ad-d548a84437e2 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=83259) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} Sep 16 14:44:44 devstack cinder-volume[83259]: DEBUG oslo_concurrency.lockutils [None req-050ec8a1-6ffd-499d-95ad-d548a84437e2 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83259) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 16 14:44:44 devstack cinder-volume[83259]: DEBUG oslo_concurrency.lockutils [None req-050ec8a1-6ffd-499d-95ad-d548a84437e2 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83259) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 16 14:44:44 devstack cinder-volume[83259]: DEBUG cinder.volume.drivers.quobyte [None req-050ec8a1-6ffd-499d-95ad-d548a84437e2 None None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-61f585ac-f8e2-4d19-a890-7ebc2726cc72': None} {{(pid=83259) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:639}} Sep 16 14:44:44 devstack cinder-volume[83259]: DEBUG cinder.volume.drivers.quobyte [None req-050ec8a1-6ffd-499d-95ad-d548a84437e2 None None] Available shares ['10.10.41.181/cinder-vol-61f585ac-f8e2-4d19-a890-7ebc2726cc72'] {{(pid=83259) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:669}} Sep 16 14:44:44 devstack cinder-volume[83259]: DEBUG oslo_concurrency.lockutils [None req-050ec8a1-6ffd-499d-95ad-d548a84437e2 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.027s {{(pid=83259) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 16 14:44:44 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [None req-050ec8a1-6ffd-499d-95ad-d548a84437e2 None None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 14:44:44 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [None req-050ec8a1-6ffd-499d-95ad-d548a84437e2 None None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c" returned: 0 in 0.231s {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 14:44:44 devstack cinder-volume[83259]: DEBUG cinder.manager [None req-050ec8a1-6ffd-499d-95ad-d548a84437e2 None None] Notifying Schedulers of capabilities ... {{(pid=83259) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 16 14:44:46 devstack cinder-volume[83259]: DEBUG dbcounter [-] [83259] Writing DB stats cinder:SELECT=5,cinder:INSERT=2,cinder:UPDATE=10 {{(pid=83259) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Sep 16 14:44:47 devstack cinder-volume[83259]: DEBUG dbcounter [-] [83259] Writing DB stats cinder:SELECT=3,cinder:INSERT=2,cinder:UPDATE=5,cinder:DELETE=1 {{(pid=83259) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Sep 16 14:45:29 devstack cinder-volume[83259]: WARNING cinder.volume.volume_utils [None req-7d627ff1-50b1-467c-9c0b-97c3e58e8f68 tempest-AttachSCSIVolumeTestJSON-640954424 None] Volume driver (QuobyteDriver 1.2) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 16 14:45:29 devstack cinder-volume[83259]: DEBUG cinder.volume.flows.manager.create_volume [None req-7d627ff1-50b1-467c-9c0b-97c3e58e8f68 tempest-AttachSCSIVolumeTestJSON-640954424 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#Quobyte'], 'hosts': ['devstack@QuobyteHD#Quobyte']} {{(pid=83259) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1387}} Sep 16 14:45:29 devstack cinder-volume[83259]: DEBUG cinder.volume.manager [None req-7d627ff1-50b1-467c-9c0b-97c3e58e8f68 tempest-AttachSCSIVolumeTestJSON-640954424 None] Flow 'volume_create_manager' (8643b74e-3dcb-49c9-aa89-50705096acaa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83259) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 16 14:45:29 devstack cinder-volume[83259]: DEBUG cinder.volume.manager [None req-7d627ff1-50b1-467c-9c0b-97c3e58e8f68 tempest-AttachSCSIVolumeTestJSON-640954424 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (246b78e4-c9b1-4b1e-ba6d-25178c976075) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83259) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 14:45:29 devstack cinder-volume[83259]: DEBUG cinder.volume.manager [None req-7d627ff1-50b1-467c-9c0b-97c3e58e8f68 tempest-AttachSCSIVolumeTestJSON-640954424 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (246b78e4-c9b1-4b1e-ba6d-25178c976075) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-16T12:45:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachSCSIVolumeTestJSON-volume-531461491',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#Quobyte',id=6d7580de-ec51-4e8a-9ee4-d1a4d315f32d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='331fcad6b3c8462eb954759f7767c21a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-16T12:45:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-16T12:45:29Z,use_quota=True,user_id='8e804a89e12848cfb1a84491fbcf1900',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(485ead50-3df8-4d76-8d34-a4db136c980a),volume_type_id=485ead50-3df8-4d76-8d34-a4db136c980a)' {{(pid=83259) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 14:45:29 devstack cinder-volume[83259]: DEBUG cinder.volume.manager [None req-7d627ff1-50b1-467c-9c0b-97c3e58e8f68 tempest-AttachSCSIVolumeTestJSON-640954424 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bfa3dfa8-e7a2-4ca0-8560-1d5e9ee92473) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83259) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 14:45:29 devstack cinder-volume[83259]: DEBUG cinder.volume.manager [None req-7d627ff1-50b1-467c-9c0b-97c3e58e8f68 tempest-AttachSCSIVolumeTestJSON-640954424 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bfa3dfa8-e7a2-4ca0-8560-1d5e9ee92473) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83259) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 14:45:29 devstack cinder-volume[83259]: DEBUG cinder.volume.manager [None req-7d627ff1-50b1-467c-9c0b-97c3e58e8f68 tempest-AttachSCSIVolumeTestJSON-640954424 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (91ae4603-c57f-455e-a02d-36aa1a9d6e24) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83259) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 14:45:29 devstack cinder-volume[83259]: DEBUG cinder.volume.manager [None req-7d627ff1-50b1-467c-9c0b-97c3e58e8f68 tempest-AttachSCSIVolumeTestJSON-640954424 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (91ae4603-c57f-455e-a02d-36aa1a9d6e24) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6d7580de-ec51-4e8a-9ee4-d1a4d315f32d', 'volume_name': 'volume-6d7580de-ec51-4e8a-9ee4-d1a4d315f32d', 'volume_size': 1}' {{(pid=83259) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 14:45:29 devstack cinder-volume[83259]: DEBUG cinder.volume.manager [None req-7d627ff1-50b1-467c-9c0b-97c3e58e8f68 tempest-AttachSCSIVolumeTestJSON-640954424 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (607d68f8-967b-4cef-a588-4b6bc3541c82) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83259) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 14:45:29 devstack cinder-volume[83259]: DEBUG cinder.volume.manager [None req-7d627ff1-50b1-467c-9c0b-97c3e58e8f68 tempest-AttachSCSIVolumeTestJSON-640954424 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (607d68f8-967b-4cef-a588-4b6bc3541c82) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83259) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 14:45:29 devstack cinder-volume[83259]: DEBUG cinder.volume.manager [None req-7d627ff1-50b1-467c-9c0b-97c3e58e8f68 tempest-AttachSCSIVolumeTestJSON-640954424 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fb4ae12c-1f4b-4054-89c0-0466a87cc76e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83259) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 14:45:29 devstack cinder-volume[83259]: INFO cinder.volume.flows.manager.create_volume [None req-7d627ff1-50b1-467c-9c0b-97c3e58e8f68 tempest-AttachSCSIVolumeTestJSON-640954424 None] Volume 6d7580de-ec51-4e8a-9ee4-d1a4d315f32d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6d7580de-ec51-4e8a-9ee4-d1a4d315f32d', 'volume_size': 1} Sep 16 14:45:29 devstack cinder-volume[83259]: DEBUG oslo_concurrency.lockutils [None req-7d627ff1-50b1-467c-9c0b-97c3e58e8f68 tempest-AttachSCSIVolumeTestJSON-640954424 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83259) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 16 14:45:29 devstack cinder-volume[83259]: DEBUG oslo_concurrency.lockutils [None req-7d627ff1-50b1-467c-9c0b-97c3e58e8f68 tempest-AttachSCSIVolumeTestJSON-640954424 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.005s {{(pid=83259) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 16 14:45:29 devstack cinder-volume[83259]: DEBUG cinder.volume.drivers.quobyte [None req-7d627ff1-50b1-467c-9c0b-97c3e58e8f68 tempest-AttachSCSIVolumeTestJSON-640954424 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-16T12:45:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachSCSIVolumeTestJSON-volume-531461491',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#Quobyte',id=6d7580de-ec51-4e8a-9ee4-d1a4d315f32d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='331fcad6b3c8462eb954759f7767c21a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-16T12:45:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-16T12:45:29Z,use_quota=True,user_id='8e804a89e12848cfb1a84491fbcf1900',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(485ead50-3df8-4d76-8d34-a4db136c980a),volume_type_id=485ead50-3df8-4d76-8d34-a4db136c980a)}" {{(pid=83259) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Sep 16 14:45:29 devstack cinder-volume[83259]: DEBUG cinder.volume.drivers.remotefs [None req-7d627ff1-50b1-467c-9c0b-97c3e58e8f68 tempest-AttachSCSIVolumeTestJSON-640954424 None] Creating volume 6d7580de-ec51-4e8a-9ee4-d1a4d315f32d {{(pid=83259) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}} Sep 16 14:45:29 devstack cinder-volume[83259]: DEBUG oslo_concurrency.lockutils [None req-7d627ff1-50b1-467c-9c0b-97c3e58e8f68 tempest-AttachSCSIVolumeTestJSON-640954424 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83259) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 16 14:45:29 devstack cinder-volume[83259]: DEBUG oslo_concurrency.lockutils [None req-7d627ff1-50b1-467c-9c0b-97c3e58e8f68 tempest-AttachSCSIVolumeTestJSON-640954424 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83259) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 16 14:45:29 devstack cinder-volume[83259]: DEBUG cinder.volume.drivers.quobyte [None req-7d627ff1-50b1-467c-9c0b-97c3e58e8f68 tempest-AttachSCSIVolumeTestJSON-640954424 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-61f585ac-f8e2-4d19-a890-7ebc2726cc72': None} {{(pid=83259) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:639}} Sep 16 14:45:29 devstack cinder-volume[83259]: DEBUG cinder.volume.drivers.quobyte [None req-7d627ff1-50b1-467c-9c0b-97c3e58e8f68 tempest-AttachSCSIVolumeTestJSON-640954424 None] Available shares ['10.10.41.181/cinder-vol-61f585ac-f8e2-4d19-a890-7ebc2726cc72'] {{(pid=83259) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:669}} Sep 16 14:45:29 devstack cinder-volume[83259]: DEBUG oslo_concurrency.lockutils [None req-7d627ff1-50b1-467c-9c0b-97c3e58e8f68 tempest-AttachSCSIVolumeTestJSON-640954424 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=83259) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 16 14:45:29 devstack cinder-volume[83259]: DEBUG cinder.volume.drivers.quobyte [None req-7d627ff1-50b1-467c-9c0b-97c3e58e8f68 tempest-AttachSCSIVolumeTestJSON-640954424 None] Selected 10.10.41.181/cinder-vol-61f585ac-f8e2-4d19-a890-7ebc2726cc72 as target Quobyte volume. {{(pid=83259) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:690}} Sep 16 14:45:29 devstack cinder-volume[83259]: INFO cinder.volume.drivers.remotefs [None req-7d627ff1-50b1-467c-9c0b-97c3e58e8f68 tempest-AttachSCSIVolumeTestJSON-640954424 None] casted to 10.10.41.181/cinder-vol-61f585ac-f8e2-4d19-a890-7ebc2726cc72 Sep 16 14:45:29 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [None req-7d627ff1-50b1-467c-9c0b-97c3e58e8f68 tempest-AttachSCSIVolumeTestJSON-640954424 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c/volume-6d7580de-ec51-4e8a-9ee4-d1a4d315f32d 1073741824 {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 14:45:30 devstack quobyte-client[83286]: System call of process 84547 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 16 14:45:30 devstack quobyte-client[83286]: The server volume:87712ffe-8a69-446d-9ed6-4430c7ee9792@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=87712ffe-8a69-446d-9ed6-4430c7ee9792, inode=4, name=volume-6d7580de-ec51-4e8a-9ee4-d1a4d315f32d, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.206), requestorAccessMask=0 Sep 16 14:45:30 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [None req-7d627ff1-50b1-467c-9c0b-97c3e58e8f68 tempest-AttachSCSIVolumeTestJSON-640954424 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c/volume-6d7580de-ec51-4e8a-9ee4-d1a4d315f32d 1073741824" returned: 0 in 0.887s {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 14:45:30 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [None req-7d627ff1-50b1-467c-9c0b-97c3e58e8f68 tempest-AttachSCSIVolumeTestJSON-640954424 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c/volume-6d7580de-ec51-4e8a-9ee4-d1a4d315f32d {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 14:45:31 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [None req-7d627ff1-50b1-467c-9c0b-97c3e58e8f68 tempest-AttachSCSIVolumeTestJSON-640954424 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c/volume-6d7580de-ec51-4e8a-9ee4-d1a4d315f32d" returned: 0 in 0.220s {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 14:45:31 devstack cinder-volume[83259]: DEBUG cinder.volume.drivers.quobyte [None req-7d627ff1-50b1-467c-9c0b-97c3e58e8f68 tempest-AttachSCSIVolumeTestJSON-640954424 None] <== create_volume: return (1286ms) {'provider_location': '10.10.41.181/cinder-vol-61f585ac-f8e2-4d19-a890-7ebc2726cc72'} {{(pid=83259) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Sep 16 14:45:31 devstack cinder-volume[83259]: DEBUG oslo_concurrency.lockutils [None req-7d627ff1-50b1-467c-9c0b-97c3e58e8f68 tempest-AttachSCSIVolumeTestJSON-640954424 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.304s {{(pid=83259) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 16 14:45:31 devstack cinder-volume[83259]: DEBUG cinder.volume.manager [None req-7d627ff1-50b1-467c-9c0b-97c3e58e8f68 tempest-AttachSCSIVolumeTestJSON-640954424 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fb4ae12c-1f4b-4054-89c0-0466a87cc76e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6d7580de-ec51-4e8a-9ee4-d1a4d315f32d', 'volume_size': 1}' {{(pid=83259) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 14:45:31 devstack cinder-volume[83259]: DEBUG cinder.volume.manager [None req-7d627ff1-50b1-467c-9c0b-97c3e58e8f68 tempest-AttachSCSIVolumeTestJSON-640954424 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1e9a370b-0d06-4931-b1bf-2cc6302c7400) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83259) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 14:45:31 devstack cinder-volume[83259]: INFO cinder.volume.flows.manager.create_volume [None req-7d627ff1-50b1-467c-9c0b-97c3e58e8f68 tempest-AttachSCSIVolumeTestJSON-640954424 None] Volume volume-6d7580de-ec51-4e8a-9ee4-d1a4d315f32d (6d7580de-ec51-4e8a-9ee4-d1a4d315f32d): created successfully Sep 16 14:45:31 devstack cinder-volume[83259]: DEBUG cinder.volume.manager [None req-7d627ff1-50b1-467c-9c0b-97c3e58e8f68 tempest-AttachSCSIVolumeTestJSON-640954424 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1e9a370b-0d06-4931-b1bf-2cc6302c7400) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83259) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 14:45:31 devstack cinder-volume[83259]: DEBUG cinder.volume.manager [None req-7d627ff1-50b1-467c-9c0b-97c3e58e8f68 tempest-AttachSCSIVolumeTestJSON-640954424 None] Flow 'volume_create_manager' (8643b74e-3dcb-49c9-aa89-50705096acaa) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83259) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 16 14:45:31 devstack cinder-volume[83259]: INFO cinder.volume.manager [None req-7d627ff1-50b1-467c-9c0b-97c3e58e8f68 tempest-AttachSCSIVolumeTestJSON-640954424 None] Created volume successfully. Sep 16 14:45:41 devstack cinder-volume[83259]: DEBUG dbcounter [-] [83259] Writing DB stats cinder:SELECT=1,cinder:UPDATE=3 {{(pid=83259) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Sep 16 14:45:41 devstack cinder-volume[83259]: DEBUG dbcounter [-] [83259] Writing DB stats cinder:SELECT=1,cinder:UPDATE=1,cinder:DELETE=1 {{(pid=83259) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Sep 16 14:45:44 devstack cinder-volume[83259]: DEBUG oslo_service.periodic_task [None req-050ec8a1-6ffd-499d-95ad-d548a84437e2 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=83259) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} Sep 16 14:45:44 devstack cinder-volume[83259]: DEBUG oslo_concurrency.lockutils [None req-050ec8a1-6ffd-499d-95ad-d548a84437e2 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83259) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 16 14:45:44 devstack cinder-volume[83259]: DEBUG oslo_concurrency.lockutils [None req-050ec8a1-6ffd-499d-95ad-d548a84437e2 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83259) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 16 14:45:44 devstack cinder-volume[83259]: DEBUG cinder.volume.drivers.quobyte [None req-050ec8a1-6ffd-499d-95ad-d548a84437e2 None None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-61f585ac-f8e2-4d19-a890-7ebc2726cc72': None} {{(pid=83259) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:639}} Sep 16 14:45:44 devstack cinder-volume[83259]: DEBUG cinder.volume.drivers.quobyte [None req-050ec8a1-6ffd-499d-95ad-d548a84437e2 None None] Available shares ['10.10.41.181/cinder-vol-61f585ac-f8e2-4d19-a890-7ebc2726cc72'] {{(pid=83259) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:669}} Sep 16 14:45:44 devstack cinder-volume[83259]: DEBUG oslo_concurrency.lockutils [None req-050ec8a1-6ffd-499d-95ad-d548a84437e2 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=83259) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 16 14:45:44 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [None req-050ec8a1-6ffd-499d-95ad-d548a84437e2 None None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 14:45:44 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [None req-050ec8a1-6ffd-499d-95ad-d548a84437e2 None None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c" returned: 0 in 0.284s {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 14:45:44 devstack cinder-volume[83259]: DEBUG cinder.manager [None req-050ec8a1-6ffd-499d-95ad-d548a84437e2 None None] Notifying Schedulers of capabilities ... {{(pid=83259) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 16 14:45:44 devstack cinder-volume[83259]: DEBUG oslo_concurrency.lockutils [req-833531b1-2ac4-4db0-8689-a04df2f869a0 req-6a0eff9e-61cb-41ec-bc35-9c5d770d9e7f tempest-AttachSCSIVolumeTestJSON-640954424 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=83259) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 16 14:45:44 devstack cinder-volume[83259]: DEBUG oslo_concurrency.lockutils [req-833531b1-2ac4-4db0-8689-a04df2f869a0 req-6a0eff9e-61cb-41ec-bc35-9c5d770d9e7f tempest-AttachSCSIVolumeTestJSON-640954424 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.003s {{(pid=83259) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 16 14:45:44 devstack cinder-volume[83259]: DEBUG oslo.privsep.daemon [-] privsep: reply[d60809cb-bce5-4bb9-9d03-a34dbfb508dd]: (4, 'qcow2') {{(pid=84312) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 16 14:45:44 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [req-833531b1-2ac4-4db0-8689-a04df2f869a0 req-6a0eff9e-61cb-41ec-bc35-9c5d770d9e7f tempest-AttachSCSIVolumeTestJSON-640954424 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c/volume-6d7580de-ec51-4e8a-9ee4-d1a4d315f32d {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 14:45:45 devstack cinder-volume[83259]: DEBUG oslo_concurrency.lockutils [req-651274cf-7343-49cd-8861-54fc695cc296 req-1968d3bf-862c-4363-a144-37878708835b tempest-VolumesAssistedSnapshotsTest-1220102166 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=83259) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 16 14:45:45 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [req-833531b1-2ac4-4db0-8689-a04df2f869a0 req-6a0eff9e-61cb-41ec-bc35-9c5d770d9e7f tempest-AttachSCSIVolumeTestJSON-640954424 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c/volume-6d7580de-ec51-4e8a-9ee4-d1a4d315f32d" returned: 0 in 0.435s {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 14:45:45 devstack cinder-volume[83259]: DEBUG oslo_concurrency.lockutils [req-833531b1-2ac4-4db0-8689-a04df2f869a0 req-6a0eff9e-61cb-41ec-bc35-9c5d770d9e7f tempest-AttachSCSIVolumeTestJSON-640954424 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.476s {{(pid=83259) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 16 14:45:45 devstack cinder-volume[83259]: DEBUG oslo_concurrency.lockutils [req-651274cf-7343-49cd-8861-54fc695cc296 req-1968d3bf-862c-4363-a144-37878708835b tempest-VolumesAssistedSnapshotsTest-1220102166 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.322s {{(pid=83259) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 16 14:45:45 devstack cinder-volume[83259]: DEBUG oslo.privsep.daemon [-] privsep: reply[19cb3dcb-02e6-4dc1-9dee-af97d6acfe43]: (4, 'qcow2') {{(pid=84312) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 16 14:45:45 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [req-651274cf-7343-49cd-8861-54fc695cc296 req-1968d3bf-862c-4363-a144-37878708835b tempest-VolumesAssistedSnapshotsTest-1220102166 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c/volume-a6caaadc-cbc3-4e99-9def-a99686435d51 {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 14:45:45 devstack cinder-volume[83259]: DEBUG cinder.volume.manager [req-833531b1-2ac4-4db0-8689-a04df2f869a0 req-6a0eff9e-61cb-41ec-bc35-9c5d770d9e7f tempest-AttachSCSIVolumeTestJSON-640954424 None] Connection info returned from driver {'export': '10.10.41.181/cinder-vol-61f585ac-f8e2-4d19-a890-7ebc2726cc72', 'name': 'volume-6d7580de-ec51-4e8a-9ee4-d1a4d315f32d', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '04650b29-d0de-43dd-a893-64a3f06ded9f', 'enforce_multipath': True} {{(pid=83259) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4891}} Sep 16 14:45:45 devstack cinder-volume[83259]: WARNING cinder.volume.volume_utils [req-833531b1-2ac4-4db0-8689-a04df2f869a0 req-6a0eff9e-61cb-41ec-bc35-9c5d770d9e7f tempest-AttachSCSIVolumeTestJSON-640954424 None] Volume driver (QuobyteDriver 1.2) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 16 14:45:46 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [req-651274cf-7343-49cd-8861-54fc695cc296 req-1968d3bf-862c-4363-a144-37878708835b tempest-VolumesAssistedSnapshotsTest-1220102166 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c/volume-a6caaadc-cbc3-4e99-9def-a99686435d51" returned: 0 in 0.597s {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 14:45:46 devstack cinder-volume[83259]: DEBUG oslo_concurrency.lockutils [req-651274cf-7343-49cd-8861-54fc695cc296 req-1968d3bf-862c-4363-a144-37878708835b tempest-VolumesAssistedSnapshotsTest-1220102166 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.701s {{(pid=83259) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 16 14:45:46 devstack cinder-volume[83259]: INFO cinder.volume.manager [req-833531b1-2ac4-4db0-8689-a04df2f869a0 req-6a0eff9e-61cb-41ec-bc35-9c5d770d9e7f tempest-AttachSCSIVolumeTestJSON-640954424 None] attachment_update completed successfully. Sep 16 14:45:46 devstack cinder-volume[83259]: DEBUG cinder.volume.manager [req-651274cf-7343-49cd-8861-54fc695cc296 req-1968d3bf-862c-4363-a144-37878708835b tempest-VolumesAssistedSnapshotsTest-1220102166 None] Connection info returned from driver {'export': '10.10.41.181/cinder-vol-61f585ac-f8e2-4d19-a890-7ebc2726cc72', 'name': 'volume-a6caaadc-cbc3-4e99-9def-a99686435d51', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '776544f9-4922-40b3-aa44-2c2190fb3fd7', 'enforce_multipath': True} {{(pid=83259) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4891}} Sep 16 14:45:46 devstack cinder-volume[83259]: WARNING cinder.volume.volume_utils [req-651274cf-7343-49cd-8861-54fc695cc296 req-1968d3bf-862c-4363-a144-37878708835b tempest-VolumesAssistedSnapshotsTest-1220102166 None] Volume driver (QuobyteDriver 1.2) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 16 14:45:46 devstack cinder-volume[83259]: INFO cinder.volume.manager [req-651274cf-7343-49cd-8861-54fc695cc296 req-1968d3bf-862c-4363-a144-37878708835b tempest-VolumesAssistedSnapshotsTest-1220102166 None] attachment_update completed successfully. Sep 16 14:45:56 devstack cinder-volume[83259]: DEBUG dbcounter [-] [83259] Writing DB stats cinder:SELECT=10,cinder:UPDATE=3 {{(pid=83259) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Sep 16 14:45:56 devstack cinder-volume[83259]: DEBUG dbcounter [-] [83259] Writing DB stats cinder:SELECT=12,cinder:UPDATE=3 {{(pid=83259) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Sep 16 14:46:04 devstack cinder-volume[83259]: WARNING cinder.volume.volume_utils [None req-481188eb-780c-4e40-b9f0-b6c797cb1bb6 tempest-DeleteServersTestJSON-376024838 None] Volume driver (QuobyteDriver 1.2) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 16 14:46:04 devstack cinder-volume[83259]: DEBUG cinder.volume.flows.manager.create_volume [None req-481188eb-780c-4e40-b9f0-b6c797cb1bb6 tempest-DeleteServersTestJSON-376024838 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#Quobyte'], 'hosts': ['devstack@QuobyteHD#Quobyte']} {{(pid=83259) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1387}} Sep 16 14:46:05 devstack cinder-volume[83259]: DEBUG cinder.volume.manager [None req-481188eb-780c-4e40-b9f0-b6c797cb1bb6 tempest-DeleteServersTestJSON-376024838 None] Flow 'volume_create_manager' (cf05bebb-0802-4d39-8949-887ac2a023ce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83259) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 16 14:46:05 devstack cinder-volume[83259]: DEBUG cinder.volume.manager [None req-481188eb-780c-4e40-b9f0-b6c797cb1bb6 tempest-DeleteServersTestJSON-376024838 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4f5fe45d-7f87-42f6-8a9d-0095f142cb14) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83259) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 14:46:05 devstack cinder-volume[83259]: DEBUG cinder.volume.manager [None req-481188eb-780c-4e40-b9f0-b6c797cb1bb6 tempest-DeleteServersTestJSON-376024838 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4f5fe45d-7f87-42f6-8a9d-0095f142cb14) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-16T12:46:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-DeleteServersTestJSON-volume-230154405',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#Quobyte',id=c178bc11-b7ea-43ad-9e73-a245cbc179c8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bf9313834d2540aca5b6264162363217',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-16T12:46:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-16T12:46:05Z,use_quota=True,user_id='719a515433bf41509acb9b3b6f808309',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(485ead50-3df8-4d76-8d34-a4db136c980a),volume_type_id=485ead50-3df8-4d76-8d34-a4db136c980a)' {{(pid=83259) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 14:46:05 devstack cinder-volume[83259]: DEBUG cinder.volume.manager [None req-481188eb-780c-4e40-b9f0-b6c797cb1bb6 tempest-DeleteServersTestJSON-376024838 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9800a4fd-7c05-46b5-b314-c55dcc1b8683) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83259) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 14:46:05 devstack cinder-volume[83259]: DEBUG cinder.volume.manager [None req-481188eb-780c-4e40-b9f0-b6c797cb1bb6 tempest-DeleteServersTestJSON-376024838 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9800a4fd-7c05-46b5-b314-c55dcc1b8683) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83259) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 14:46:05 devstack cinder-volume[83259]: DEBUG cinder.volume.manager [None req-481188eb-780c-4e40-b9f0-b6c797cb1bb6 tempest-DeleteServersTestJSON-376024838 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (958418c9-b72b-4d94-8869-1412803328b5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83259) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 14:46:05 devstack cinder-volume[83259]: DEBUG cinder.volume.manager [None req-481188eb-780c-4e40-b9f0-b6c797cb1bb6 tempest-DeleteServersTestJSON-376024838 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (958418c9-b72b-4d94-8869-1412803328b5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c178bc11-b7ea-43ad-9e73-a245cbc179c8', 'volume_name': 'volume-c178bc11-b7ea-43ad-9e73-a245cbc179c8', 'volume_size': 1}' {{(pid=83259) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 14:46:05 devstack cinder-volume[83259]: DEBUG cinder.volume.manager [None req-481188eb-780c-4e40-b9f0-b6c797cb1bb6 tempest-DeleteServersTestJSON-376024838 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (387184af-e60b-4622-a399-a758aa0abd90) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83259) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 14:46:05 devstack cinder-volume[83259]: DEBUG cinder.volume.manager [None req-481188eb-780c-4e40-b9f0-b6c797cb1bb6 tempest-DeleteServersTestJSON-376024838 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (387184af-e60b-4622-a399-a758aa0abd90) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83259) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 14:46:05 devstack cinder-volume[83259]: DEBUG cinder.volume.manager [None req-481188eb-780c-4e40-b9f0-b6c797cb1bb6 tempest-DeleteServersTestJSON-376024838 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c018c0c4-3cf3-441a-b34d-d49b99c4eee1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83259) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 14:46:05 devstack cinder-volume[83259]: INFO cinder.volume.flows.manager.create_volume [None req-481188eb-780c-4e40-b9f0-b6c797cb1bb6 tempest-DeleteServersTestJSON-376024838 None] Volume c178bc11-b7ea-43ad-9e73-a245cbc179c8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c178bc11-b7ea-43ad-9e73-a245cbc179c8', 'volume_size': 1} Sep 16 14:46:05 devstack cinder-volume[83259]: DEBUG oslo_concurrency.lockutils [None req-481188eb-780c-4e40-b9f0-b6c797cb1bb6 tempest-DeleteServersTestJSON-376024838 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83259) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 16 14:46:05 devstack cinder-volume[83259]: DEBUG oslo_concurrency.lockutils [None req-481188eb-780c-4e40-b9f0-b6c797cb1bb6 tempest-DeleteServersTestJSON-376024838 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=83259) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 16 14:46:05 devstack cinder-volume[83259]: DEBUG cinder.volume.drivers.quobyte [None req-481188eb-780c-4e40-b9f0-b6c797cb1bb6 tempest-DeleteServersTestJSON-376024838 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-16T12:46:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-DeleteServersTestJSON-volume-230154405',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#Quobyte',id=c178bc11-b7ea-43ad-9e73-a245cbc179c8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bf9313834d2540aca5b6264162363217',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-16T12:46:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-16T12:46:05Z,use_quota=True,user_id='719a515433bf41509acb9b3b6f808309',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(485ead50-3df8-4d76-8d34-a4db136c980a),volume_type_id=485ead50-3df8-4d76-8d34-a4db136c980a)}" {{(pid=83259) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Sep 16 14:46:05 devstack cinder-volume[83259]: DEBUG cinder.volume.drivers.remotefs [None req-481188eb-780c-4e40-b9f0-b6c797cb1bb6 tempest-DeleteServersTestJSON-376024838 None] Creating volume c178bc11-b7ea-43ad-9e73-a245cbc179c8 {{(pid=83259) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}} Sep 16 14:46:05 devstack cinder-volume[83259]: DEBUG oslo_concurrency.lockutils [None req-481188eb-780c-4e40-b9f0-b6c797cb1bb6 tempest-DeleteServersTestJSON-376024838 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83259) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 16 14:46:05 devstack cinder-volume[83259]: DEBUG oslo_concurrency.lockutils [None req-481188eb-780c-4e40-b9f0-b6c797cb1bb6 tempest-DeleteServersTestJSON-376024838 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83259) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 16 14:46:05 devstack cinder-volume[83259]: DEBUG cinder.volume.drivers.quobyte [None req-481188eb-780c-4e40-b9f0-b6c797cb1bb6 tempest-DeleteServersTestJSON-376024838 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-61f585ac-f8e2-4d19-a890-7ebc2726cc72': None} {{(pid=83259) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:639}} Sep 16 14:46:05 devstack cinder-volume[83259]: DEBUG cinder.volume.drivers.quobyte [None req-481188eb-780c-4e40-b9f0-b6c797cb1bb6 tempest-DeleteServersTestJSON-376024838 None] Available shares ['10.10.41.181/cinder-vol-61f585ac-f8e2-4d19-a890-7ebc2726cc72'] {{(pid=83259) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:669}} Sep 16 14:46:05 devstack cinder-volume[83259]: DEBUG oslo_concurrency.lockutils [None req-481188eb-780c-4e40-b9f0-b6c797cb1bb6 tempest-DeleteServersTestJSON-376024838 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.022s {{(pid=83259) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 16 14:46:05 devstack cinder-volume[83259]: DEBUG cinder.volume.drivers.quobyte [None req-481188eb-780c-4e40-b9f0-b6c797cb1bb6 tempest-DeleteServersTestJSON-376024838 None] Selected 10.10.41.181/cinder-vol-61f585ac-f8e2-4d19-a890-7ebc2726cc72 as target Quobyte volume. {{(pid=83259) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:690}} Sep 16 14:46:05 devstack cinder-volume[83259]: INFO cinder.volume.drivers.remotefs [None req-481188eb-780c-4e40-b9f0-b6c797cb1bb6 tempest-DeleteServersTestJSON-376024838 None] casted to 10.10.41.181/cinder-vol-61f585ac-f8e2-4d19-a890-7ebc2726cc72 Sep 16 14:46:05 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [None req-481188eb-780c-4e40-b9f0-b6c797cb1bb6 tempest-DeleteServersTestJSON-376024838 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c/volume-c178bc11-b7ea-43ad-9e73-a245cbc179c8 1073741824 {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 14:46:05 devstack quobyte-client[83286]: System call of process 85155 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 16 14:46:05 devstack quobyte-client[83286]: The server volume:87712ffe-8a69-446d-9ed6-4430c7ee9792@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=87712ffe-8a69-446d-9ed6-4430c7ee9792, inode=5, name=volume-c178bc11-b7ea-43ad-9e73-a245cbc179c8, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.206), requestorAccessMask=0 Sep 16 14:46:06 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [None req-481188eb-780c-4e40-b9f0-b6c797cb1bb6 tempest-DeleteServersTestJSON-376024838 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c/volume-c178bc11-b7ea-43ad-9e73-a245cbc179c8 1073741824" returned: 0 in 0.722s {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 14:46:06 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [None req-481188eb-780c-4e40-b9f0-b6c797cb1bb6 tempest-DeleteServersTestJSON-376024838 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c/volume-c178bc11-b7ea-43ad-9e73-a245cbc179c8 {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 14:46:06 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [None req-481188eb-780c-4e40-b9f0-b6c797cb1bb6 tempest-DeleteServersTestJSON-376024838 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c/volume-c178bc11-b7ea-43ad-9e73-a245cbc179c8" returned: 0 in 0.095s {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 14:46:06 devstack cinder-volume[83259]: DEBUG cinder.volume.drivers.quobyte [None req-481188eb-780c-4e40-b9f0-b6c797cb1bb6 tempest-DeleteServersTestJSON-376024838 None] <== create_volume: return (900ms) {'provider_location': '10.10.41.181/cinder-vol-61f585ac-f8e2-4d19-a890-7ebc2726cc72'} {{(pid=83259) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Sep 16 14:46:06 devstack cinder-volume[83259]: DEBUG oslo_concurrency.lockutils [None req-481188eb-780c-4e40-b9f0-b6c797cb1bb6 tempest-DeleteServersTestJSON-376024838 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.911s {{(pid=83259) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 16 14:46:06 devstack cinder-volume[83259]: DEBUG cinder.volume.manager [None req-481188eb-780c-4e40-b9f0-b6c797cb1bb6 tempest-DeleteServersTestJSON-376024838 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c018c0c4-3cf3-441a-b34d-d49b99c4eee1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c178bc11-b7ea-43ad-9e73-a245cbc179c8', 'volume_size': 1}' {{(pid=83259) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 14:46:06 devstack cinder-volume[83259]: DEBUG cinder.volume.manager [None req-481188eb-780c-4e40-b9f0-b6c797cb1bb6 tempest-DeleteServersTestJSON-376024838 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9b5a2fa8-88c4-4d89-b06d-1b7e470db781) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83259) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 14:46:06 devstack cinder-volume[83259]: INFO cinder.volume.flows.manager.create_volume [None req-481188eb-780c-4e40-b9f0-b6c797cb1bb6 tempest-DeleteServersTestJSON-376024838 None] Volume volume-c178bc11-b7ea-43ad-9e73-a245cbc179c8 (c178bc11-b7ea-43ad-9e73-a245cbc179c8): created successfully Sep 16 14:46:06 devstack cinder-volume[83259]: DEBUG cinder.volume.manager [None req-481188eb-780c-4e40-b9f0-b6c797cb1bb6 tempest-DeleteServersTestJSON-376024838 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9b5a2fa8-88c4-4d89-b06d-1b7e470db781) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83259) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 14:46:06 devstack cinder-volume[83259]: DEBUG cinder.volume.manager [None req-481188eb-780c-4e40-b9f0-b6c797cb1bb6 tempest-DeleteServersTestJSON-376024838 None] Flow 'volume_create_manager' (cf05bebb-0802-4d39-8949-887ac2a023ce) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83259) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 16 14:46:06 devstack cinder-volume[83259]: INFO cinder.volume.manager [None req-481188eb-780c-4e40-b9f0-b6c797cb1bb6 tempest-DeleteServersTestJSON-376024838 None] Created volume successfully. Sep 16 14:46:11 devstack cinder-volume[83259]: DEBUG oslo_concurrency.lockutils [req-2b35277c-55d9-4b07-b5e5-ce1a723b2224 req-46f3d26f-8647-4bd7-9fd2-ff8f9be319b7 tempest-DeleteServersTestJSON-376024838 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=83259) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 16 14:46:11 devstack cinder-volume[83259]: DEBUG oslo_concurrency.lockutils [req-2b35277c-55d9-4b07-b5e5-ce1a723b2224 req-46f3d26f-8647-4bd7-9fd2-ff8f9be319b7 tempest-DeleteServersTestJSON-376024838 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.004s {{(pid=83259) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 16 14:46:11 devstack cinder-volume[83259]: DEBUG oslo.privsep.daemon [-] privsep: reply[03a9d6e8-87e3-4edf-af81-fb800f796670]: (4, 'qcow2') {{(pid=84312) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 16 14:46:11 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [req-2b35277c-55d9-4b07-b5e5-ce1a723b2224 req-46f3d26f-8647-4bd7-9fd2-ff8f9be319b7 tempest-DeleteServersTestJSON-376024838 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c/volume-c178bc11-b7ea-43ad-9e73-a245cbc179c8 {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 14:46:11 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [req-2b35277c-55d9-4b07-b5e5-ce1a723b2224 req-46f3d26f-8647-4bd7-9fd2-ff8f9be319b7 tempest-DeleteServersTestJSON-376024838 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c/volume-c178bc11-b7ea-43ad-9e73-a245cbc179c8" returned: 0 in 0.554s {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 14:46:11 devstack cinder-volume[83259]: DEBUG oslo_concurrency.lockutils [req-2b35277c-55d9-4b07-b5e5-ce1a723b2224 req-46f3d26f-8647-4bd7-9fd2-ff8f9be319b7 tempest-DeleteServersTestJSON-376024838 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.608s {{(pid=83259) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 16 14:46:12 devstack cinder-volume[83259]: DEBUG cinder.volume.manager [req-2b35277c-55d9-4b07-b5e5-ce1a723b2224 req-46f3d26f-8647-4bd7-9fd2-ff8f9be319b7 tempest-DeleteServersTestJSON-376024838 None] Connection info returned from driver {'export': '10.10.41.181/cinder-vol-61f585ac-f8e2-4d19-a890-7ebc2726cc72', 'name': 'volume-c178bc11-b7ea-43ad-9e73-a245cbc179c8', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '8bfad31f-b8c9-45b8-9dce-5dff76b88269', 'enforce_multipath': True} {{(pid=83259) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4891}} Sep 16 14:46:12 devstack cinder-volume[83259]: WARNING cinder.volume.volume_utils [req-2b35277c-55d9-4b07-b5e5-ce1a723b2224 req-46f3d26f-8647-4bd7-9fd2-ff8f9be319b7 tempest-DeleteServersTestJSON-376024838 None] Volume driver (QuobyteDriver 1.2) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 16 14:46:12 devstack cinder-volume[83259]: INFO cinder.volume.manager [req-2b35277c-55d9-4b07-b5e5-ce1a723b2224 req-46f3d26f-8647-4bd7-9fd2-ff8f9be319b7 tempest-DeleteServersTestJSON-376024838 None] attachment_update completed successfully. Sep 16 14:46:19 devstack cinder-volume[83259]: WARNING cinder.volume.volume_utils [req-fade617b-5450-45b1-8f69-d53d427790a2 req-476ca07b-d739-4598-94f5-dca6307f584f tempest-AttachSCSIVolumeTestJSON-640954424 None] Volume driver (QuobyteDriver 1.2) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 16 14:46:20 devstack cinder-volume[83259]: WARNING cinder.volume.volume_utils [req-fade617b-5450-45b1-8f69-d53d427790a2 req-476ca07b-d739-4598-94f5-dca6307f584f tempest-AttachSCSIVolumeTestJSON-640954424 None] Volume driver (QuobyteDriver 1.2) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 16 14:46:20 devstack cinder-volume[83259]: INFO cinder.volume.manager [req-fade617b-5450-45b1-8f69-d53d427790a2 req-476ca07b-d739-4598-94f5-dca6307f584f tempest-AttachSCSIVolumeTestJSON-640954424 None] Terminate volume connection completed successfully. Sep 16 14:46:20 devstack cinder-volume[83259]: DEBUG cinder.volume.manager [req-fade617b-5450-45b1-8f69-d53d427790a2 req-476ca07b-d739-4598-94f5-dca6307f584f tempest-AttachSCSIVolumeTestJSON-640954424 None] Deleting attachment 04650b29-d0de-43dd-a893-64a3f06ded9f. {{(pid=83259) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5022}} Sep 16 14:46:21 devstack cinder-volume[83259]: WARNING cinder.volume.volume_utils [req-4adafe52-63e9-43e8-85e9-e39cb3204622 req-cc785490-bc2b-4411-9163-0fb0881939e2 tempest-VolumesAssistedSnapshotsTest-1220102166 None] Volume driver (QuobyteDriver 1.2) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 16 14:46:21 devstack cinder-volume[83259]: WARNING cinder.volume.volume_utils [req-4adafe52-63e9-43e8-85e9-e39cb3204622 req-cc785490-bc2b-4411-9163-0fb0881939e2 tempest-VolumesAssistedSnapshotsTest-1220102166 None] Volume driver (QuobyteDriver 1.2) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 16 14:46:21 devstack cinder-volume[83259]: INFO cinder.volume.manager [req-4adafe52-63e9-43e8-85e9-e39cb3204622 req-cc785490-bc2b-4411-9163-0fb0881939e2 tempest-VolumesAssistedSnapshotsTest-1220102166 None] Terminate volume connection completed successfully. Sep 16 14:46:21 devstack cinder-volume[83259]: DEBUG cinder.volume.manager [req-4adafe52-63e9-43e8-85e9-e39cb3204622 req-cc785490-bc2b-4411-9163-0fb0881939e2 tempest-VolumesAssistedSnapshotsTest-1220102166 None] Deleting attachment 776544f9-4922-40b3-aa44-2c2190fb3fd7. {{(pid=83259) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5022}} Sep 16 14:46:23 devstack cinder-volume[83259]: DEBUG cinder.coordination [None req-07a7dcf0-523c-4b93-81de-ac815a715de8 tempest-VolumesAssistedSnapshotsTest-1220102166 None] Acquiring lock "cinder-a6caaadc-cbc3-4e99-9def-a99686435d51-delete_volume" by "delete_volume" {{(pid=83259) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 16 14:46:23 devstack cinder-volume[83259]: DEBUG cinder.coordination [None req-07a7dcf0-523c-4b93-81de-ac815a715de8 tempest-VolumesAssistedSnapshotsTest-1220102166 None] Lock "cinder-a6caaadc-cbc3-4e99-9def-a99686435d51-delete_volume" acquired by "delete_volume" :: waited 0.242s {{(pid=83259) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 16 14:46:23 devstack cinder-volume[83259]: WARNING cinder.volume.volume_utils [None req-07a7dcf0-523c-4b93-81de-ac815a715de8 tempest-VolumesAssistedSnapshotsTest-1220102166 None] Volume driver (QuobyteDriver 1.2) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 16 14:46:23 devstack cinder-volume[83259]: DEBUG cinder.coordination [None req-07a7dcf0-523c-4b93-81de-ac815a715de8 tempest-VolumesAssistedSnapshotsTest-1220102166 None] Acquiring lock "cinder-quobyte-a6caaadc-cbc3-4e99-9def-a99686435d51" by "delete_volume" {{(pid=83259) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 16 14:46:23 devstack cinder-volume[83259]: DEBUG cinder.coordination [None req-07a7dcf0-523c-4b93-81de-ac815a715de8 tempest-VolumesAssistedSnapshotsTest-1220102166 None] Lock "cinder-quobyte-a6caaadc-cbc3-4e99-9def-a99686435d51" acquired by "delete_volume" :: waited 0.046s {{(pid=83259) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 16 14:46:23 devstack cinder-volume[83259]: DEBUG oslo.privsep.daemon [-] privsep: reply[94465ee2-676d-4088-ab9e-29d623ba5ce0]: (4, 'qcow2') {{(pid=84312) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 16 14:46:23 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [None req-07a7dcf0-523c-4b93-81de-ac815a715de8 tempest-VolumesAssistedSnapshotsTest-1220102166 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c/volume-a6caaadc-cbc3-4e99-9def-a99686435d51 {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 14:46:24 devstack cinder-volume[83259]: WARNING cinder.volume.volume_utils [req-6b330d33-afef-45b1-bb35-cdbf15918c99 req-09f3e4de-a91b-4d66-8398-b7a2d2905ca8 tempest-DeleteServersTestJSON-376024838 None] Volume driver (QuobyteDriver 1.2) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 16 14:46:25 devstack cinder-volume[83259]: WARNING cinder.volume.volume_utils [req-6b330d33-afef-45b1-bb35-cdbf15918c99 req-09f3e4de-a91b-4d66-8398-b7a2d2905ca8 tempest-DeleteServersTestJSON-376024838 None] Volume driver (QuobyteDriver 1.2) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 16 14:46:25 devstack cinder-volume[83259]: INFO cinder.volume.manager [req-6b330d33-afef-45b1-bb35-cdbf15918c99 req-09f3e4de-a91b-4d66-8398-b7a2d2905ca8 tempest-DeleteServersTestJSON-376024838 None] Terminate volume connection completed successfully. Sep 16 14:46:25 devstack cinder-volume[83259]: DEBUG cinder.volume.manager [req-6b330d33-afef-45b1-bb35-cdbf15918c99 req-09f3e4de-a91b-4d66-8398-b7a2d2905ca8 tempest-DeleteServersTestJSON-376024838 None] Deleting attachment 8bfad31f-b8c9-45b8-9dce-5dff76b88269. {{(pid=83259) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5022}} Sep 16 14:46:25 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [None req-07a7dcf0-523c-4b93-81de-ac815a715de8 tempest-VolumesAssistedSnapshotsTest-1220102166 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c/volume-a6caaadc-cbc3-4e99-9def-a99686435d51" returned: 0 in 1.333s {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 14:46:25 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [None req-07a7dcf0-523c-4b93-81de-ac815a715de8 tempest-VolumesAssistedSnapshotsTest-1220102166 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c/volume-a6caaadc-cbc3-4e99-9def-a99686435d51 {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 14:46:25 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [None req-07a7dcf0-523c-4b93-81de-ac815a715de8 tempest-VolumesAssistedSnapshotsTest-1220102166 None] CMD "rm -f /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c/volume-a6caaadc-cbc3-4e99-9def-a99686435d51" returned: 0 in 0.176s {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 14:46:25 devstack cinder-volume[83259]: DEBUG cinder.coordination [None req-07a7dcf0-523c-4b93-81de-ac815a715de8 tempest-VolumesAssistedSnapshotsTest-1220102166 None] Lock "cinder-quobyte-a6caaadc-cbc3-4e99-9def-a99686435d51" released by "delete_volume" :: held 1.689s {{(pid=83259) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 16 14:46:25 devstack cinder-volume[83259]: DEBUG cinder.quota [None req-07a7dcf0-523c-4b93-81de-ac815a715de8 tempest-VolumesAssistedSnapshotsTest-1220102166 None] Created reservations ['d45b3094-7762-4485-baf1-43e4e851b562', 'bf992f23-8413-475c-bf53-89aa554aeb4d', 'd7af388c-0025-44aa-87cd-d3d02d7d42df', 'f6831e25-7dc9-4252-b815-0c6d6406e06d'] {{(pid=83259) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 16 14:46:26 devstack cinder-volume[83259]: DEBUG oslo_concurrency.lockutils [None req-07a7dcf0-523c-4b93-81de-ac815a715de8 tempest-VolumesAssistedSnapshotsTest-1220102166 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83259) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 16 14:46:26 devstack cinder-volume[83259]: DEBUG oslo_concurrency.lockutils [None req-07a7dcf0-523c-4b93-81de-ac815a715de8 tempest-VolumesAssistedSnapshotsTest-1220102166 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=83259) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 16 14:46:26 devstack cinder-volume[83259]: DEBUG cinder.volume.drivers.quobyte [None req-07a7dcf0-523c-4b93-81de-ac815a715de8 tempest-VolumesAssistedSnapshotsTest-1220102166 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-61f585ac-f8e2-4d19-a890-7ebc2726cc72': None} {{(pid=83259) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:639}} Sep 16 14:46:26 devstack cinder-volume[83259]: DEBUG cinder.volume.drivers.quobyte [None req-07a7dcf0-523c-4b93-81de-ac815a715de8 tempest-VolumesAssistedSnapshotsTest-1220102166 None] Available shares ['10.10.41.181/cinder-vol-61f585ac-f8e2-4d19-a890-7ebc2726cc72'] {{(pid=83259) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:669}} Sep 16 14:46:26 devstack cinder-volume[83259]: DEBUG oslo_concurrency.lockutils [None req-07a7dcf0-523c-4b93-81de-ac815a715de8 tempest-VolumesAssistedSnapshotsTest-1220102166 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=83259) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 16 14:46:26 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [None req-07a7dcf0-523c-4b93-81de-ac815a715de8 tempest-VolumesAssistedSnapshotsTest-1220102166 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 14:46:26 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [None req-07a7dcf0-523c-4b93-81de-ac815a715de8 tempest-VolumesAssistedSnapshotsTest-1220102166 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c" returned: 0 in 0.111s {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 14:46:26 devstack cinder-volume[83259]: DEBUG cinder.manager [None req-07a7dcf0-523c-4b93-81de-ac815a715de8 tempest-VolumesAssistedSnapshotsTest-1220102166 None] Notifying Schedulers of capabilities ... {{(pid=83259) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 16 14:46:26 devstack cinder-volume[83259]: INFO cinder.volume.manager [None req-07a7dcf0-523c-4b93-81de-ac815a715de8 tempest-VolumesAssistedSnapshotsTest-1220102166 None] Deleted volume successfully. Sep 16 14:46:26 devstack cinder-volume[83259]: DEBUG cinder.coordination [None req-07a7dcf0-523c-4b93-81de-ac815a715de8 tempest-VolumesAssistedSnapshotsTest-1220102166 None] Lock "cinder-a6caaadc-cbc3-4e99-9def-a99686435d51-delete_volume" released by "delete_volume" :: held 2.861s {{(pid=83259) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 16 14:46:30 devstack cinder-volume[83259]: DEBUG cinder.coordination [None req-9c53be1d-f5c0-48d7-8c9a-7d28b0dd84e7 tempest-DeleteServersTestJSON-376024838 None] Acquiring lock "cinder-c178bc11-b7ea-43ad-9e73-a245cbc179c8-delete_volume" by "delete_volume" {{(pid=83259) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 16 14:46:30 devstack cinder-volume[83259]: DEBUG cinder.coordination [None req-9c53be1d-f5c0-48d7-8c9a-7d28b0dd84e7 tempest-DeleteServersTestJSON-376024838 None] Lock "cinder-c178bc11-b7ea-43ad-9e73-a245cbc179c8-delete_volume" acquired by "delete_volume" :: waited 0.058s {{(pid=83259) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 16 14:46:30 devstack cinder-volume[83259]: WARNING cinder.volume.volume_utils [None req-9c53be1d-f5c0-48d7-8c9a-7d28b0dd84e7 tempest-DeleteServersTestJSON-376024838 None] Volume driver (QuobyteDriver 1.2) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 16 14:46:30 devstack cinder-volume[83259]: DEBUG cinder.coordination [None req-9c53be1d-f5c0-48d7-8c9a-7d28b0dd84e7 tempest-DeleteServersTestJSON-376024838 None] Acquiring lock "cinder-quobyte-c178bc11-b7ea-43ad-9e73-a245cbc179c8" by "delete_volume" {{(pid=83259) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 16 14:46:30 devstack cinder-volume[83259]: DEBUG cinder.coordination [None req-9c53be1d-f5c0-48d7-8c9a-7d28b0dd84e7 tempest-DeleteServersTestJSON-376024838 None] Lock "cinder-quobyte-c178bc11-b7ea-43ad-9e73-a245cbc179c8" acquired by "delete_volume" :: waited 0.017s {{(pid=83259) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 16 14:46:30 devstack cinder-volume[83259]: DEBUG oslo.privsep.daemon [-] privsep: reply[d4cfc8c6-84dc-4caf-b616-f4afad1f97f1]: (4, 'qcow2') {{(pid=84312) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 16 14:46:30 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [None req-9c53be1d-f5c0-48d7-8c9a-7d28b0dd84e7 tempest-DeleteServersTestJSON-376024838 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c/volume-c178bc11-b7ea-43ad-9e73-a245cbc179c8 {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 14:46:30 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [None req-9c53be1d-f5c0-48d7-8c9a-7d28b0dd84e7 tempest-DeleteServersTestJSON-376024838 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c/volume-c178bc11-b7ea-43ad-9e73-a245cbc179c8" returned: 0 in 0.392s {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 14:46:30 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [None req-9c53be1d-f5c0-48d7-8c9a-7d28b0dd84e7 tempest-DeleteServersTestJSON-376024838 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c/volume-c178bc11-b7ea-43ad-9e73-a245cbc179c8 {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 14:46:30 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [None req-9c53be1d-f5c0-48d7-8c9a-7d28b0dd84e7 tempest-DeleteServersTestJSON-376024838 None] CMD "rm -f /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c/volume-c178bc11-b7ea-43ad-9e73-a245cbc179c8" returned: 0 in 0.174s {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 14:46:31 devstack cinder-volume[83259]: DEBUG cinder.coordination [None req-9c53be1d-f5c0-48d7-8c9a-7d28b0dd84e7 tempest-DeleteServersTestJSON-376024838 None] Lock "cinder-quobyte-c178bc11-b7ea-43ad-9e73-a245cbc179c8" released by "delete_volume" :: held 0.734s {{(pid=83259) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 16 14:46:31 devstack cinder-volume[83259]: DEBUG cinder.quota [None req-9c53be1d-f5c0-48d7-8c9a-7d28b0dd84e7 tempest-DeleteServersTestJSON-376024838 None] Created reservations ['4a3c49e7-8a3f-4898-95fc-01185f8a50c1', 'd655d5ad-ba8f-4bca-a199-050311b32491', 'b41d32db-e618-4181-b9b2-88e46af3a866', 'a8aee967-d34e-42fc-b458-059f6a8ec233'] {{(pid=83259) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 16 14:46:31 devstack cinder-volume[83259]: DEBUG oslo_concurrency.lockutils [None req-9c53be1d-f5c0-48d7-8c9a-7d28b0dd84e7 tempest-DeleteServersTestJSON-376024838 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83259) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 16 14:46:31 devstack cinder-volume[83259]: DEBUG oslo_concurrency.lockutils [None req-9c53be1d-f5c0-48d7-8c9a-7d28b0dd84e7 tempest-DeleteServersTestJSON-376024838 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=83259) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 16 14:46:31 devstack cinder-volume[83259]: DEBUG cinder.volume.drivers.quobyte [None req-9c53be1d-f5c0-48d7-8c9a-7d28b0dd84e7 tempest-DeleteServersTestJSON-376024838 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-61f585ac-f8e2-4d19-a890-7ebc2726cc72': None} {{(pid=83259) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:639}} Sep 16 14:46:31 devstack cinder-volume[83259]: DEBUG cinder.volume.drivers.quobyte [None req-9c53be1d-f5c0-48d7-8c9a-7d28b0dd84e7 tempest-DeleteServersTestJSON-376024838 None] Available shares ['10.10.41.181/cinder-vol-61f585ac-f8e2-4d19-a890-7ebc2726cc72'] {{(pid=83259) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:669}} Sep 16 14:46:31 devstack cinder-volume[83259]: DEBUG oslo_concurrency.lockutils [None req-9c53be1d-f5c0-48d7-8c9a-7d28b0dd84e7 tempest-DeleteServersTestJSON-376024838 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=83259) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 16 14:46:31 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [None req-9c53be1d-f5c0-48d7-8c9a-7d28b0dd84e7 tempest-DeleteServersTestJSON-376024838 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 14:46:31 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [None req-9c53be1d-f5c0-48d7-8c9a-7d28b0dd84e7 tempest-DeleteServersTestJSON-376024838 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c" returned: 0 in 0.178s {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 14:46:31 devstack cinder-volume[83259]: DEBUG cinder.manager [None req-9c53be1d-f5c0-48d7-8c9a-7d28b0dd84e7 tempest-DeleteServersTestJSON-376024838 None] Notifying Schedulers of capabilities ... {{(pid=83259) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 16 14:46:31 devstack cinder-volume[83259]: INFO cinder.volume.manager [None req-9c53be1d-f5c0-48d7-8c9a-7d28b0dd84e7 tempest-DeleteServersTestJSON-376024838 None] Deleted volume successfully. Sep 16 14:46:32 devstack cinder-volume[83259]: DEBUG cinder.coordination [None req-9c53be1d-f5c0-48d7-8c9a-7d28b0dd84e7 tempest-DeleteServersTestJSON-376024838 None] Lock "cinder-c178bc11-b7ea-43ad-9e73-a245cbc179c8-delete_volume" released by "delete_volume" :: held 2.049s {{(pid=83259) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 16 14:46:36 devstack cinder-volume[83259]: DEBUG cinder.coordination [None req-105aa9d4-bab8-47bb-8639-9a0c8ce21aec tempest-AttachSCSIVolumeTestJSON-640954424 None] Acquiring lock "cinder-6d7580de-ec51-4e8a-9ee4-d1a4d315f32d-delete_volume" by "delete_volume" {{(pid=83259) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 16 14:46:36 devstack cinder-volume[83259]: DEBUG cinder.coordination [None req-105aa9d4-bab8-47bb-8639-9a0c8ce21aec tempest-AttachSCSIVolumeTestJSON-640954424 None] Lock "cinder-6d7580de-ec51-4e8a-9ee4-d1a4d315f32d-delete_volume" acquired by "delete_volume" :: waited 0.051s {{(pid=83259) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 16 14:46:36 devstack cinder-volume[83259]: WARNING cinder.volume.volume_utils [None req-105aa9d4-bab8-47bb-8639-9a0c8ce21aec tempest-AttachSCSIVolumeTestJSON-640954424 None] Volume driver (QuobyteDriver 1.2) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 16 14:46:36 devstack cinder-volume[83259]: DEBUG cinder.coordination [None req-105aa9d4-bab8-47bb-8639-9a0c8ce21aec tempest-AttachSCSIVolumeTestJSON-640954424 None] Acquiring lock "cinder-quobyte-6d7580de-ec51-4e8a-9ee4-d1a4d315f32d" by "delete_volume" {{(pid=83259) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 16 14:46:36 devstack cinder-volume[83259]: DEBUG cinder.coordination [None req-105aa9d4-bab8-47bb-8639-9a0c8ce21aec tempest-AttachSCSIVolumeTestJSON-640954424 None] Lock "cinder-quobyte-6d7580de-ec51-4e8a-9ee4-d1a4d315f32d" acquired by "delete_volume" :: waited 0.028s {{(pid=83259) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 16 14:46:36 devstack cinder-volume[83259]: DEBUG oslo.privsep.daemon [-] privsep: reply[41d3bad9-2bf6-4515-863f-cd583ac2b184]: (4, 'qcow2') {{(pid=84312) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 16 14:46:36 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [None req-105aa9d4-bab8-47bb-8639-9a0c8ce21aec tempest-AttachSCSIVolumeTestJSON-640954424 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c/volume-6d7580de-ec51-4e8a-9ee4-d1a4d315f32d {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 14:46:37 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [None req-105aa9d4-bab8-47bb-8639-9a0c8ce21aec tempest-AttachSCSIVolumeTestJSON-640954424 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c/volume-6d7580de-ec51-4e8a-9ee4-d1a4d315f32d" returned: 0 in 0.600s {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 14:46:37 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [None req-105aa9d4-bab8-47bb-8639-9a0c8ce21aec tempest-AttachSCSIVolumeTestJSON-640954424 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c/volume-6d7580de-ec51-4e8a-9ee4-d1a4d315f32d {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 14:46:37 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [None req-105aa9d4-bab8-47bb-8639-9a0c8ce21aec tempest-AttachSCSIVolumeTestJSON-640954424 None] CMD "rm -f /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c/volume-6d7580de-ec51-4e8a-9ee4-d1a4d315f32d" returned: 0 in 0.122s {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 14:46:37 devstack cinder-volume[83259]: DEBUG cinder.coordination [None req-105aa9d4-bab8-47bb-8639-9a0c8ce21aec tempest-AttachSCSIVolumeTestJSON-640954424 None] Lock "cinder-quobyte-6d7580de-ec51-4e8a-9ee4-d1a4d315f32d" released by "delete_volume" :: held 0.872s {{(pid=83259) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 16 14:46:38 devstack cinder-volume[83259]: DEBUG cinder.quota [None req-105aa9d4-bab8-47bb-8639-9a0c8ce21aec tempest-AttachSCSIVolumeTestJSON-640954424 None] Created reservations ['6727f6ab-97c6-44b5-a0d8-6c568224819e', 'c302dd53-7cd4-47e7-b09a-326985a85cf6', '2a7d5796-65ca-46c7-b86a-d0f059ff5fb5', '5164e902-a893-47a4-aff5-1c25d9889b25'] {{(pid=83259) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 16 14:46:38 devstack cinder-volume[83259]: DEBUG oslo_concurrency.lockutils [None req-105aa9d4-bab8-47bb-8639-9a0c8ce21aec tempest-AttachSCSIVolumeTestJSON-640954424 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83259) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 16 14:46:38 devstack cinder-volume[83259]: DEBUG oslo_concurrency.lockutils [None req-105aa9d4-bab8-47bb-8639-9a0c8ce21aec tempest-AttachSCSIVolumeTestJSON-640954424 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.005s {{(pid=83259) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 16 14:46:38 devstack cinder-volume[83259]: DEBUG cinder.volume.drivers.quobyte [None req-105aa9d4-bab8-47bb-8639-9a0c8ce21aec tempest-AttachSCSIVolumeTestJSON-640954424 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-61f585ac-f8e2-4d19-a890-7ebc2726cc72': None} {{(pid=83259) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:639}} Sep 16 14:46:38 devstack cinder-volume[83259]: DEBUG cinder.volume.drivers.quobyte [None req-105aa9d4-bab8-47bb-8639-9a0c8ce21aec tempest-AttachSCSIVolumeTestJSON-640954424 None] Available shares ['10.10.41.181/cinder-vol-61f585ac-f8e2-4d19-a890-7ebc2726cc72'] {{(pid=83259) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:669}} Sep 16 14:46:38 devstack cinder-volume[83259]: DEBUG oslo_concurrency.lockutils [None req-105aa9d4-bab8-47bb-8639-9a0c8ce21aec tempest-AttachSCSIVolumeTestJSON-640954424 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=83259) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 16 14:46:38 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [None req-105aa9d4-bab8-47bb-8639-9a0c8ce21aec tempest-AttachSCSIVolumeTestJSON-640954424 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 14:46:38 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [None req-105aa9d4-bab8-47bb-8639-9a0c8ce21aec tempest-AttachSCSIVolumeTestJSON-640954424 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c" returned: 0 in 0.204s {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 14:46:38 devstack cinder-volume[83259]: DEBUG cinder.manager [None req-105aa9d4-bab8-47bb-8639-9a0c8ce21aec tempest-AttachSCSIVolumeTestJSON-640954424 None] Notifying Schedulers of capabilities ... {{(pid=83259) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 16 14:46:38 devstack cinder-volume[83259]: INFO cinder.volume.manager [None req-105aa9d4-bab8-47bb-8639-9a0c8ce21aec tempest-AttachSCSIVolumeTestJSON-640954424 None] Deleted volume successfully. Sep 16 14:46:38 devstack cinder-volume[83259]: DEBUG cinder.coordination [None req-105aa9d4-bab8-47bb-8639-9a0c8ce21aec tempest-AttachSCSIVolumeTestJSON-640954424 None] Lock "cinder-6d7580de-ec51-4e8a-9ee4-d1a4d315f32d-delete_volume" released by "delete_volume" :: held 2.254s {{(pid=83259) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 16 14:46:44 devstack cinder-volume[83259]: DEBUG oslo_service.periodic_task [None req-050ec8a1-6ffd-499d-95ad-d548a84437e2 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=83259) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} Sep 16 14:46:44 devstack cinder-volume[83259]: DEBUG oslo_concurrency.lockutils [None req-050ec8a1-6ffd-499d-95ad-d548a84437e2 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83259) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 16 14:46:44 devstack cinder-volume[83259]: DEBUG oslo_concurrency.lockutils [None req-050ec8a1-6ffd-499d-95ad-d548a84437e2 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=83259) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 16 14:46:44 devstack cinder-volume[83259]: DEBUG cinder.volume.drivers.quobyte [None req-050ec8a1-6ffd-499d-95ad-d548a84437e2 None None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-61f585ac-f8e2-4d19-a890-7ebc2726cc72': None} {{(pid=83259) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:639}} Sep 16 14:46:44 devstack cinder-volume[83259]: DEBUG cinder.volume.drivers.quobyte [None req-050ec8a1-6ffd-499d-95ad-d548a84437e2 None None] Available shares ['10.10.41.181/cinder-vol-61f585ac-f8e2-4d19-a890-7ebc2726cc72'] {{(pid=83259) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:669}} Sep 16 14:46:44 devstack cinder-volume[83259]: DEBUG oslo_concurrency.lockutils [None req-050ec8a1-6ffd-499d-95ad-d548a84437e2 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.032s {{(pid=83259) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 16 14:46:44 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [None req-050ec8a1-6ffd-499d-95ad-d548a84437e2 None None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 14:46:44 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [None req-050ec8a1-6ffd-499d-95ad-d548a84437e2 None None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c" returned: 0 in 0.187s {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 14:46:44 devstack cinder-volume[83259]: DEBUG cinder.manager [None req-050ec8a1-6ffd-499d-95ad-d548a84437e2 None None] Notifying Schedulers of capabilities ... {{(pid=83259) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 16 14:46:48 devstack cinder-volume[83259]: DEBUG dbcounter [-] [83259] Writing DB stats cinder:SELECT=26,cinder:UPDATE=23,cinder:INSERT=7,cinder:DELETE=1 {{(pid=83259) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Sep 16 14:46:48 devstack cinder-volume[83259]: DEBUG dbcounter [-] [83259] Writing DB stats cinder:UPDATE=33,cinder:DELETE=3,cinder:SELECT=24,cinder:INSERT=5 {{(pid=83259) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Sep 16 14:47:31 devstack cinder-volume[83259]: WARNING cinder.volume.volume_utils [None req-d0bf9f1d-3589-4b30-ae9d-0697f2127090 tempest-TaggedBootDevicesTest-180213475 None] Volume driver (QuobyteDriver 1.2) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 16 14:47:31 devstack cinder-volume[83259]: DEBUG cinder.volume.flows.manager.create_volume [None req-d0bf9f1d-3589-4b30-ae9d-0697f2127090 tempest-TaggedBootDevicesTest-180213475 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#Quobyte'], 'hosts': ['devstack@QuobyteHD#Quobyte']} {{(pid=83259) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1387}} Sep 16 14:47:32 devstack cinder-volume[83259]: DEBUG cinder.volume.manager [None req-d0bf9f1d-3589-4b30-ae9d-0697f2127090 tempest-TaggedBootDevicesTest-180213475 None] Flow 'volume_create_manager' (51863104-03fb-4ade-a19a-5ec4dd532bc8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83259) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 16 14:47:32 devstack cinder-volume[83259]: DEBUG cinder.volume.manager [None req-d0bf9f1d-3589-4b30-ae9d-0697f2127090 tempest-TaggedBootDevicesTest-180213475 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4417298b-c32e-45de-8d24-8850a6fa6292) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83259) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 14:47:32 devstack cinder-volume[83259]: DEBUG cinder.volume.manager [None req-d0bf9f1d-3589-4b30-ae9d-0697f2127090 tempest-TaggedBootDevicesTest-180213475 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4417298b-c32e-45de-8d24-8850a6fa6292) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-16T12:47:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TaggedBootDevicesTest-volume-926367880',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#Quobyte',id=ec2a536c-e2a0-4b7d-a9f0-2881b05a353e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='352a05b391ab4c0f999788a9377215c2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-16T12:47:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-16T12:47:32Z,use_quota=True,user_id='049dc319ffbc4dbb83bbde57d57805e6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(485ead50-3df8-4d76-8d34-a4db136c980a),volume_type_id=485ead50-3df8-4d76-8d34-a4db136c980a)' {{(pid=83259) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 14:47:32 devstack cinder-volume[83259]: DEBUG cinder.volume.manager [None req-d0bf9f1d-3589-4b30-ae9d-0697f2127090 tempest-TaggedBootDevicesTest-180213475 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (223ba87e-814b-46a4-87ac-2c3263492d6e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83259) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 14:47:32 devstack cinder-volume[83259]: DEBUG cinder.volume.manager [None req-d0bf9f1d-3589-4b30-ae9d-0697f2127090 tempest-TaggedBootDevicesTest-180213475 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (223ba87e-814b-46a4-87ac-2c3263492d6e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83259) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 14:47:32 devstack cinder-volume[83259]: DEBUG cinder.volume.manager [None req-d0bf9f1d-3589-4b30-ae9d-0697f2127090 tempest-TaggedBootDevicesTest-180213475 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (61a21038-bc96-4509-802a-2fb36e0d4312) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83259) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 14:47:32 devstack cinder-volume[83259]: DEBUG cinder.image.glance [None req-d0bf9f1d-3589-4b30-ae9d-0697f2127090 tempest-TaggedBootDevicesTest-180213475 None] Creating Keystone auth plugin from conf {{(pid=83259) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:128}} Sep 16 14:47:32 devstack cinder-volume[83259]: DEBUG cinder.volume.manager [None req-d0bf9f1d-3589-4b30-ae9d-0697f2127090 tempest-TaggedBootDevicesTest-180213475 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (61a21038-bc96-4509-802a-2fb36e0d4312) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'ec2a536c-e2a0-4b7d-a9f0-2881b05a353e', 'volume_name': 'volume-ec2a536c-e2a0-4b7d-a9f0-2881b05a353e', 'volume_size': 1, 'image_id': '7786237f-0aff-46c8-bcd0-3b9486a0637a', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/7786237f-0aff-46c8-bcd0-3b9486a0637a', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '97738b7ffcbe49cbaad0099563a58435', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '7786237f-0aff-46c8-bcd0-3b9486a0637a', 'created_at': datetime.datetime(2025, 9, 16, 12, 35, 41, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2025, 9, 16, 12, 35, 42, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/7786237f-0aff-46c8-bcd0-3b9486a0637a/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=83259) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 14:47:32 devstack cinder-volume[83259]: DEBUG cinder.volume.manager [None req-d0bf9f1d-3589-4b30-ae9d-0697f2127090 tempest-TaggedBootDevicesTest-180213475 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (14f6fb83-eaca-4f2c-8a0d-5fd5dbb8da57) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83259) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 14:47:32 devstack cinder-volume[83259]: DEBUG cinder.volume.manager [None req-d0bf9f1d-3589-4b30-ae9d-0697f2127090 tempest-TaggedBootDevicesTest-180213475 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (14f6fb83-eaca-4f2c-8a0d-5fd5dbb8da57) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83259) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 14:47:32 devstack cinder-volume[83259]: DEBUG cinder.volume.manager [None req-d0bf9f1d-3589-4b30-ae9d-0697f2127090 tempest-TaggedBootDevicesTest-180213475 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d3072367-88a3-4a87-baee-6e392eb51958) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83259) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 14:47:32 devstack cinder-volume[83259]: INFO cinder.volume.flows.manager.create_volume [None req-d0bf9f1d-3589-4b30-ae9d-0697f2127090 tempest-TaggedBootDevicesTest-180213475 None] Volume ec2a536c-e2a0-4b7d-a9f0-2881b05a353e: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-ec2a536c-e2a0-4b7d-a9f0-2881b05a353e', 'volume_size': 1, 'image_id': '7786237f-0aff-46c8-bcd0-3b9486a0637a', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/7786237f-0aff-46c8-bcd0-3b9486a0637a', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '97738b7ffcbe49cbaad0099563a58435', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '7786237f-0aff-46c8-bcd0-3b9486a0637a', 'created_at': datetime.datetime(2025, 9, 16, 12, 35, 41, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2025, 9, 16, 12, 35, 42, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/7786237f-0aff-46c8-bcd0-3b9486a0637a/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Sep 16 14:47:32 devstack cinder-volume[83259]: DEBUG cinder.volume.flows.manager.create_volume [None req-d0bf9f1d-3589-4b30-ae9d-0697f2127090 tempest-TaggedBootDevicesTest-180213475 None] Cloning ec2a536c-e2a0-4b7d-a9f0-2881b05a353e from image 7786237f-0aff-46c8-bcd0-3b9486a0637a at location (None, [{'url': 'file:///opt/stack/data/glance/images/7786237f-0aff-46c8-bcd0-3b9486a0637a', 'metadata': {}}]). {{(pid=83259) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1085}} Sep 16 14:47:33 devstack cinder-volume[83259]: DEBUG cinder.image.image_utils [None req-d0bf9f1d-3589-4b30-ae9d-0697f2127090 tempest-TaggedBootDevicesTest-180213475 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_7786237f-0aff-46c8-bcd0-3b9486a0637a_w35bxff5devstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=83259) fetch /opt/stack/cinder/cinder/image/image_utils.py:700}} Sep 16 14:47:33 devstack cinder-volume[83259]: INFO cinder.image.image_utils [None req-d0bf9f1d-3589-4b30-ae9d-0697f2127090 tempest-TaggedBootDevicesTest-180213475 None] Image download 20.69 MB at 20.69 MB/s Sep 16 14:47:33 devstack cinder-volume[83259]: DEBUG oslo.privsep.daemon [-] privsep: reply[f13a1e13-f0d9-4bcc-af5b-16f29fd100b2]: (4, 'qcow2') {{(pid=84312) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 16 14:47:33 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [None req-d0bf9f1d-3589-4b30-ae9d-0697f2127090 tempest-TaggedBootDevicesTest-180213475 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_7786237f-0aff-46c8-bcd0-3b9486a0637a_w35bxff5devstack@QuobyteHD {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 14:47:33 devstack sudo[85471]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_7786237f-0aff-46c8-bcd0-3b9486a0637a_w35bxff5devstack@QuobyteHD Sep 16 14:47:33 devstack sudo[85471]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 14:47:35 devstack sudo[85471]: pam_unix(sudo:session): session closed for user root Sep 16 14:47:35 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [None req-d0bf9f1d-3589-4b30-ae9d-0697f2127090 tempest-TaggedBootDevicesTest-180213475 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_7786237f-0aff-46c8-bcd0-3b9486a0637a_w35bxff5devstack@QuobyteHD" returned: 0 in 2.324s {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 14:47:35 devstack cinder-volume[83259]: DEBUG cinder.image.image_utils [None req-d0bf9f1d-3589-4b30-ae9d-0697f2127090 tempest-TaggedBootDevicesTest-180213475 None] Temporary image 7786237f-0aff-46c8-bcd0-3b9486a0637a is fetched for user 049dc319ffbc4dbb83bbde57d57805e6. {{(pid=83259) fetch /opt/stack/cinder/cinder/image/image_utils.py:1399}} Sep 16 14:47:36 devstack cinder-volume[83259]: DEBUG oslo.privsep.daemon [-] privsep: reply[d678e295-9e3a-484d-9274-a48e672c6f33]: (4, 'qcow2') {{(pid=84312) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 16 14:47:36 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [None req-d0bf9f1d-3589-4b30-ae9d-0697f2127090 tempest-TaggedBootDevicesTest-180213475 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_7786237f-0aff-46c8-bcd0-3b9486a0637a_w35bxff5devstack@QuobyteHD {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 14:47:36 devstack sudo[85482]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_7786237f-0aff-46c8-bcd0-3b9486a0637a_w35bxff5devstack@QuobyteHD Sep 16 14:47:36 devstack sudo[85482]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 14:47:39 devstack sudo[85482]: pam_unix(sudo:session): session closed for user root Sep 16 14:47:39 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [None req-d0bf9f1d-3589-4b30-ae9d-0697f2127090 tempest-TaggedBootDevicesTest-180213475 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_7786237f-0aff-46c8-bcd0-3b9486a0637a_w35bxff5devstack@QuobyteHD" returned: 0 in 3.284s {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 14:47:39 devstack cinder-volume[83259]: DEBUG oslo_concurrency.lockutils [None req-d0bf9f1d-3589-4b30-ae9d-0697f2127090 tempest-TaggedBootDevicesTest-180213475 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83259) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 16 14:47:39 devstack cinder-volume[83259]: DEBUG oslo_concurrency.lockutils [None req-d0bf9f1d-3589-4b30-ae9d-0697f2127090 tempest-TaggedBootDevicesTest-180213475 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.022s {{(pid=83259) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 16 14:47:39 devstack cinder-volume[83259]: DEBUG cinder.volume.drivers.quobyte [None req-d0bf9f1d-3589-4b30-ae9d-0697f2127090 tempest-TaggedBootDevicesTest-180213475 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-16T12:47:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TaggedBootDevicesTest-volume-926367880',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#Quobyte',id=ec2a536c-e2a0-4b7d-a9f0-2881b05a353e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='352a05b391ab4c0f999788a9377215c2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-16T12:47:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-16T12:47:32Z,use_quota=True,user_id='049dc319ffbc4dbb83bbde57d57805e6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(485ead50-3df8-4d76-8d34-a4db136c980a),volume_type_id=485ead50-3df8-4d76-8d34-a4db136c980a)}" {{(pid=83259) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Sep 16 14:47:39 devstack cinder-volume[83259]: DEBUG cinder.volume.drivers.remotefs [None req-d0bf9f1d-3589-4b30-ae9d-0697f2127090 tempest-TaggedBootDevicesTest-180213475 None] Creating volume ec2a536c-e2a0-4b7d-a9f0-2881b05a353e {{(pid=83259) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}} Sep 16 14:47:39 devstack cinder-volume[83259]: DEBUG oslo_concurrency.lockutils [None req-d0bf9f1d-3589-4b30-ae9d-0697f2127090 tempest-TaggedBootDevicesTest-180213475 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83259) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 16 14:47:39 devstack cinder-volume[83259]: DEBUG oslo_concurrency.lockutils [None req-d0bf9f1d-3589-4b30-ae9d-0697f2127090 tempest-TaggedBootDevicesTest-180213475 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83259) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 16 14:47:39 devstack cinder-volume[83259]: DEBUG cinder.volume.drivers.quobyte [None req-d0bf9f1d-3589-4b30-ae9d-0697f2127090 tempest-TaggedBootDevicesTest-180213475 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-61f585ac-f8e2-4d19-a890-7ebc2726cc72': None} {{(pid=83259) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:639}} Sep 16 14:47:39 devstack cinder-volume[83259]: DEBUG cinder.volume.drivers.quobyte [None req-d0bf9f1d-3589-4b30-ae9d-0697f2127090 tempest-TaggedBootDevicesTest-180213475 None] Available shares ['10.10.41.181/cinder-vol-61f585ac-f8e2-4d19-a890-7ebc2726cc72'] {{(pid=83259) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:669}} Sep 16 14:47:39 devstack cinder-volume[83259]: DEBUG oslo_concurrency.lockutils [None req-d0bf9f1d-3589-4b30-ae9d-0697f2127090 tempest-TaggedBootDevicesTest-180213475 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.047s {{(pid=83259) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 16 14:47:39 devstack cinder-volume[83259]: DEBUG cinder.volume.drivers.quobyte [None req-d0bf9f1d-3589-4b30-ae9d-0697f2127090 tempest-TaggedBootDevicesTest-180213475 None] Selected 10.10.41.181/cinder-vol-61f585ac-f8e2-4d19-a890-7ebc2726cc72 as target Quobyte volume. {{(pid=83259) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:690}} Sep 16 14:47:39 devstack cinder-volume[83259]: INFO cinder.volume.drivers.remotefs [None req-d0bf9f1d-3589-4b30-ae9d-0697f2127090 tempest-TaggedBootDevicesTest-180213475 None] casted to 10.10.41.181/cinder-vol-61f585ac-f8e2-4d19-a890-7ebc2726cc72 Sep 16 14:47:39 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [None req-d0bf9f1d-3589-4b30-ae9d-0697f2127090 tempest-TaggedBootDevicesTest-180213475 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c/volume-ec2a536c-e2a0-4b7d-a9f0-2881b05a353e 1073741824 {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 14:47:39 devstack quobyte-client[83286]: System call of process 85491 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 16 14:47:39 devstack quobyte-client[83286]: The server volume:87712ffe-8a69-446d-9ed6-4430c7ee9792@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=87712ffe-8a69-446d-9ed6-4430c7ee9792, inode=6, name=volume-ec2a536c-e2a0-4b7d-a9f0-2881b05a353e, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.206), requestorAccessMask=0 Sep 16 14:47:40 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [None req-d0bf9f1d-3589-4b30-ae9d-0697f2127090 tempest-TaggedBootDevicesTest-180213475 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c/volume-ec2a536c-e2a0-4b7d-a9f0-2881b05a353e 1073741824" returned: 0 in 0.602s {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 14:47:40 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [None req-d0bf9f1d-3589-4b30-ae9d-0697f2127090 tempest-TaggedBootDevicesTest-180213475 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c/volume-ec2a536c-e2a0-4b7d-a9f0-2881b05a353e {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 14:47:40 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [None req-d0bf9f1d-3589-4b30-ae9d-0697f2127090 tempest-TaggedBootDevicesTest-180213475 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c/volume-ec2a536c-e2a0-4b7d-a9f0-2881b05a353e" returned: 0 in 0.266s {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 14:47:40 devstack cinder-volume[83259]: DEBUG cinder.volume.drivers.quobyte [None req-d0bf9f1d-3589-4b30-ae9d-0697f2127090 tempest-TaggedBootDevicesTest-180213475 None] <== create_volume: return (1108ms) {'provider_location': '10.10.41.181/cinder-vol-61f585ac-f8e2-4d19-a890-7ebc2726cc72'} {{(pid=83259) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Sep 16 14:47:40 devstack cinder-volume[83259]: DEBUG oslo_concurrency.lockutils [None req-d0bf9f1d-3589-4b30-ae9d-0697f2127090 tempest-TaggedBootDevicesTest-180213475 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.166s {{(pid=83259) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 16 14:47:41 devstack cinder-volume[83259]: DEBUG cinder.volume.volume_utils [None req-d0bf9f1d-3589-4b30-ae9d-0697f2127090 tempest-TaggedBootDevicesTest-180213475 None] Attempting download of 7786237f-0aff-46c8-bcd0-3b9486a0637a ((None, [{'url': 'file:///opt/stack/data/glance/images/7786237f-0aff-46c8-bcd0-3b9486a0637a', 'metadata': {}}])) to volume ec2a536c-e2a0-4b7d-a9f0-2881b05a353e. {{(pid=83259) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1189}} Sep 16 14:47:41 devstack cinder-volume[83259]: DEBUG oslo.privsep.daemon [-] privsep: reply[131b79aa-fbea-42b7-a31d-18d37ffdaad9]: (4, 'raw') {{(pid=84312) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 16 14:47:41 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [None req-d0bf9f1d-3589-4b30-ae9d-0697f2127090 tempest-TaggedBootDevicesTest-180213475 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_7786237f-0aff-46c8-bcd0-3b9486a0637a_jsuswso4 {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 14:47:42 devstack sudo[85502]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_7786237f-0aff-46c8-bcd0-3b9486a0637a_jsuswso4 Sep 16 14:47:42 devstack sudo[85502]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 14:47:44 devstack cinder-volume[83259]: DEBUG oslo_service.periodic_task [None req-050ec8a1-6ffd-499d-95ad-d548a84437e2 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=83259) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} Sep 16 14:47:44 devstack cinder-volume[83259]: DEBUG oslo_concurrency.lockutils [None req-050ec8a1-6ffd-499d-95ad-d548a84437e2 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83259) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 16 14:47:44 devstack cinder-volume[83259]: DEBUG oslo_concurrency.lockutils [None req-050ec8a1-6ffd-499d-95ad-d548a84437e2 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.015s {{(pid=83259) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 16 14:47:44 devstack cinder-volume[83259]: DEBUG cinder.volume.drivers.quobyte [None req-050ec8a1-6ffd-499d-95ad-d548a84437e2 None None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-61f585ac-f8e2-4d19-a890-7ebc2726cc72': None} {{(pid=83259) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:639}} Sep 16 14:47:44 devstack cinder-volume[83259]: DEBUG cinder.volume.drivers.quobyte [None req-050ec8a1-6ffd-499d-95ad-d548a84437e2 None None] Available shares ['10.10.41.181/cinder-vol-61f585ac-f8e2-4d19-a890-7ebc2726cc72'] {{(pid=83259) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:669}} Sep 16 14:47:44 devstack cinder-volume[83259]: DEBUG oslo_concurrency.lockutils [None req-050ec8a1-6ffd-499d-95ad-d548a84437e2 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.091s {{(pid=83259) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 16 14:47:44 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [None req-050ec8a1-6ffd-499d-95ad-d548a84437e2 None None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 14:47:45 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [None req-050ec8a1-6ffd-499d-95ad-d548a84437e2 None None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c" returned: 0 in 0.504s {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 14:47:45 devstack cinder-volume[83259]: DEBUG cinder.manager [None req-050ec8a1-6ffd-499d-95ad-d548a84437e2 None None] Notifying Schedulers of capabilities ... {{(pid=83259) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 16 14:47:46 devstack sudo[85502]: pam_unix(sudo:session): session closed for user root Sep 16 14:47:46 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [None req-d0bf9f1d-3589-4b30-ae9d-0697f2127090 tempest-TaggedBootDevicesTest-180213475 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_7786237f-0aff-46c8-bcd0-3b9486a0637a_jsuswso4" returned: 0 in 5.039s {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 14:47:46 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [None req-d0bf9f1d-3589-4b30-ae9d-0697f2127090 tempest-TaggedBootDevicesTest-180213475 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_7786237f-0aff-46c8-bcd0-3b9486a0637a_jsuswso4 {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 14:47:46 devstack sudo[85545]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_7786237f-0aff-46c8-bcd0-3b9486a0637a_jsuswso4 Sep 16 14:47:46 devstack sudo[85545]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 14:47:49 devstack sudo[85545]: pam_unix(sudo:session): session closed for user root Sep 16 14:47:49 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [None req-d0bf9f1d-3589-4b30-ae9d-0697f2127090 tempest-TaggedBootDevicesTest-180213475 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_7786237f-0aff-46c8-bcd0-3b9486a0637a_jsuswso4" returned: 1 in 2.650s {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 14:47:49 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [None req-d0bf9f1d-3589-4b30-ae9d-0697f2127090 tempest-TaggedBootDevicesTest-180213475 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_7786237f-0aff-46c8-bcd0-3b9486a0637a_jsuswso4' failed. Not Retrying. {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:423}} Sep 16 14:47:49 devstack cinder-volume[83259]: DEBUG oslo.privsep.daemon [-] privsep: reply[c035dc81-43ce-4c42-8b20-2477487e99cb]: (4, 'qcow2') {{(pid=84312) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 16 14:47:49 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [None req-d0bf9f1d-3589-4b30-ae9d-0697f2127090 tempest-TaggedBootDevicesTest-180213475 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_7786237f-0aff-46c8-bcd0-3b9486a0637a_w35bxff5devstack@QuobyteHD {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 14:47:49 devstack sudo[85552]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_7786237f-0aff-46c8-bcd0-3b9486a0637a_w35bxff5devstack@QuobyteHD Sep 16 14:47:49 devstack sudo[85552]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 14:47:50 devstack cinder-volume[83259]: DEBUG dbcounter [-] [83259] Writing DB stats cinder:SELECT=3,cinder:UPDATE=1 {{(pid=83259) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Sep 16 14:47:51 devstack cinder-volume[83259]: DEBUG dbcounter [-] [83259] Writing DB stats cinder:UPDATE=2,cinder:SELECT=1,cinder:INSERT=1 {{(pid=83259) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Sep 16 14:47:52 devstack sudo[85552]: pam_unix(sudo:session): session closed for user root Sep 16 14:47:52 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [None req-d0bf9f1d-3589-4b30-ae9d-0697f2127090 tempest-TaggedBootDevicesTest-180213475 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_7786237f-0aff-46c8-bcd0-3b9486a0637a_w35bxff5devstack@QuobyteHD" returned: 0 in 2.982s {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 14:47:52 devstack cinder-volume[83259]: DEBUG cinder.image.image_utils [None req-d0bf9f1d-3589-4b30-ae9d-0697f2127090 tempest-TaggedBootDevicesTest-180213475 None] 7786237f-0aff-46c8-bcd0-3b9486a0637a was qcow2, converting to qcow2 {{(pid=83259) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1088}} Sep 16 14:47:52 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [None req-d0bf9f1d-3589-4b30-ae9d-0697f2127090 tempest-TaggedBootDevicesTest-180213475 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_7786237f-0aff-46c8-bcd0-3b9486a0637a_w35bxff5devstack@QuobyteHD /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c/volume-ec2a536c-e2a0-4b7d-a9f0-2881b05a353e {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 14:47:52 devstack sudo[85569]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_7786237f-0aff-46c8-bcd0-3b9486a0637a_w35bxff5devstack@QuobyteHD /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c/volume-ec2a536c-e2a0-4b7d-a9f0-2881b05a353e Sep 16 14:47:52 devstack sudo[85569]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 14:47:52 devstack cinder-volume[83259]: WARNING cinder.volume.volume_utils [None req-6962b0df-ad9b-4d54-8da3-eda535cb4970 tempest-TaggedAttachmentsTest-24583051 None] Volume driver (QuobyteDriver 1.2) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 16 14:47:52 devstack cinder-volume[83259]: DEBUG cinder.volume.flows.manager.create_volume [None req-6962b0df-ad9b-4d54-8da3-eda535cb4970 tempest-TaggedAttachmentsTest-24583051 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#Quobyte'], 'hosts': ['devstack@QuobyteHD#Quobyte']} {{(pid=83259) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1387}} Sep 16 14:47:53 devstack cinder-volume[83259]: DEBUG cinder.volume.manager [None req-6962b0df-ad9b-4d54-8da3-eda535cb4970 tempest-TaggedAttachmentsTest-24583051 None] Flow 'volume_create_manager' (1930f89d-2008-49d1-9d06-e758760a028e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83259) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 16 14:47:53 devstack cinder-volume[83259]: DEBUG cinder.volume.manager [None req-6962b0df-ad9b-4d54-8da3-eda535cb4970 tempest-TaggedAttachmentsTest-24583051 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f26e8eef-f66c-453c-b637-2149953e783b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83259) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 14:47:53 devstack cinder-volume[83259]: DEBUG cinder.volume.manager [None req-6962b0df-ad9b-4d54-8da3-eda535cb4970 tempest-TaggedAttachmentsTest-24583051 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f26e8eef-f66c-453c-b637-2149953e783b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-16T12:47:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TaggedAttachmentsTest-volume-1125523284',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#Quobyte',id=c6bf97c0-cd26-424b-aa0e-5d6a38b78b4c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='53ba3da11c894735a924f839f528dc17',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-16T12:47:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-16T12:47:52Z,use_quota=True,user_id='4b135910a7624f13a36a3a4b531a4fa0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(485ead50-3df8-4d76-8d34-a4db136c980a),volume_type_id=485ead50-3df8-4d76-8d34-a4db136c980a)' {{(pid=83259) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 14:47:53 devstack cinder-volume[83259]: DEBUG cinder.volume.manager [None req-6962b0df-ad9b-4d54-8da3-eda535cb4970 tempest-TaggedAttachmentsTest-24583051 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a6a42033-dbc8-4f5a-8753-e46231c93086) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83259) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 14:47:53 devstack cinder-volume[83259]: DEBUG cinder.volume.manager [None req-6962b0df-ad9b-4d54-8da3-eda535cb4970 tempest-TaggedAttachmentsTest-24583051 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a6a42033-dbc8-4f5a-8753-e46231c93086) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83259) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 14:47:53 devstack cinder-volume[83259]: DEBUG cinder.volume.manager [None req-6962b0df-ad9b-4d54-8da3-eda535cb4970 tempest-TaggedAttachmentsTest-24583051 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7744a379-b95b-413d-baed-73ac4c094204) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83259) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 14:47:53 devstack cinder-volume[83259]: DEBUG cinder.volume.manager [None req-6962b0df-ad9b-4d54-8da3-eda535cb4970 tempest-TaggedAttachmentsTest-24583051 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7744a379-b95b-413d-baed-73ac4c094204) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c6bf97c0-cd26-424b-aa0e-5d6a38b78b4c', 'volume_name': 'volume-c6bf97c0-cd26-424b-aa0e-5d6a38b78b4c', 'volume_size': 1}' {{(pid=83259) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 14:47:53 devstack cinder-volume[83259]: DEBUG cinder.volume.manager [None req-6962b0df-ad9b-4d54-8da3-eda535cb4970 tempest-TaggedAttachmentsTest-24583051 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7d8516c6-3362-4570-9f71-59e5b3ea93cc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83259) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 14:47:53 devstack cinder-volume[83259]: DEBUG cinder.volume.manager [None req-6962b0df-ad9b-4d54-8da3-eda535cb4970 tempest-TaggedAttachmentsTest-24583051 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7d8516c6-3362-4570-9f71-59e5b3ea93cc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83259) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 14:47:53 devstack cinder-volume[83259]: DEBUG cinder.volume.manager [None req-6962b0df-ad9b-4d54-8da3-eda535cb4970 tempest-TaggedAttachmentsTest-24583051 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (76601a19-2357-4135-a75d-de9f95e60f2a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83259) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 14:47:53 devstack cinder-volume[83259]: INFO cinder.volume.flows.manager.create_volume [None req-6962b0df-ad9b-4d54-8da3-eda535cb4970 tempest-TaggedAttachmentsTest-24583051 None] Volume c6bf97c0-cd26-424b-aa0e-5d6a38b78b4c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c6bf97c0-cd26-424b-aa0e-5d6a38b78b4c', 'volume_size': 1} Sep 16 14:47:53 devstack cinder-volume[83259]: DEBUG oslo_concurrency.lockutils [None req-6962b0df-ad9b-4d54-8da3-eda535cb4970 tempest-TaggedAttachmentsTest-24583051 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83259) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 16 14:47:53 devstack cinder-volume[83259]: DEBUG oslo_concurrency.lockutils [None req-6962b0df-ad9b-4d54-8da3-eda535cb4970 tempest-TaggedAttachmentsTest-24583051 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.003s {{(pid=83259) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 16 14:47:53 devstack cinder-volume[83259]: DEBUG cinder.volume.drivers.quobyte [None req-6962b0df-ad9b-4d54-8da3-eda535cb4970 tempest-TaggedAttachmentsTest-24583051 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-16T12:47:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TaggedAttachmentsTest-volume-1125523284',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#Quobyte',id=c6bf97c0-cd26-424b-aa0e-5d6a38b78b4c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='53ba3da11c894735a924f839f528dc17',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-16T12:47:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-16T12:47:52Z,use_quota=True,user_id='4b135910a7624f13a36a3a4b531a4fa0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(485ead50-3df8-4d76-8d34-a4db136c980a),volume_type_id=485ead50-3df8-4d76-8d34-a4db136c980a)}" {{(pid=83259) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Sep 16 14:47:53 devstack cinder-volume[83259]: DEBUG cinder.volume.drivers.remotefs [None req-6962b0df-ad9b-4d54-8da3-eda535cb4970 tempest-TaggedAttachmentsTest-24583051 None] Creating volume c6bf97c0-cd26-424b-aa0e-5d6a38b78b4c {{(pid=83259) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}} Sep 16 14:47:53 devstack cinder-volume[83259]: DEBUG oslo_concurrency.lockutils [None req-6962b0df-ad9b-4d54-8da3-eda535cb4970 tempest-TaggedAttachmentsTest-24583051 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83259) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 16 14:47:53 devstack cinder-volume[83259]: DEBUG oslo_concurrency.lockutils [None req-6962b0df-ad9b-4d54-8da3-eda535cb4970 tempest-TaggedAttachmentsTest-24583051 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83259) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 16 14:47:53 devstack cinder-volume[83259]: DEBUG cinder.volume.drivers.quobyte [None req-6962b0df-ad9b-4d54-8da3-eda535cb4970 tempest-TaggedAttachmentsTest-24583051 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-61f585ac-f8e2-4d19-a890-7ebc2726cc72': None} {{(pid=83259) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:639}} Sep 16 14:47:53 devstack cinder-volume[83259]: DEBUG cinder.volume.drivers.quobyte [None req-6962b0df-ad9b-4d54-8da3-eda535cb4970 tempest-TaggedAttachmentsTest-24583051 None] Available shares ['10.10.41.181/cinder-vol-61f585ac-f8e2-4d19-a890-7ebc2726cc72'] {{(pid=83259) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:669}} Sep 16 14:47:53 devstack cinder-volume[83259]: DEBUG oslo_concurrency.lockutils [None req-6962b0df-ad9b-4d54-8da3-eda535cb4970 tempest-TaggedAttachmentsTest-24583051 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=83259) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 16 14:47:53 devstack cinder-volume[83259]: DEBUG cinder.volume.drivers.quobyte [None req-6962b0df-ad9b-4d54-8da3-eda535cb4970 tempest-TaggedAttachmentsTest-24583051 None] Selected 10.10.41.181/cinder-vol-61f585ac-f8e2-4d19-a890-7ebc2726cc72 as target Quobyte volume. {{(pid=83259) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:690}} Sep 16 14:47:53 devstack cinder-volume[83259]: INFO cinder.volume.drivers.remotefs [None req-6962b0df-ad9b-4d54-8da3-eda535cb4970 tempest-TaggedAttachmentsTest-24583051 None] casted to 10.10.41.181/cinder-vol-61f585ac-f8e2-4d19-a890-7ebc2726cc72 Sep 16 14:47:53 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [None req-6962b0df-ad9b-4d54-8da3-eda535cb4970 tempest-TaggedAttachmentsTest-24583051 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c/volume-c6bf97c0-cd26-424b-aa0e-5d6a38b78b4c 1073741824 {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 14:47:53 devstack quobyte-client[83286]: System call of process 85575 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 16 14:47:53 devstack quobyte-client[83286]: The server volume:87712ffe-8a69-446d-9ed6-4430c7ee9792@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=87712ffe-8a69-446d-9ed6-4430c7ee9792, inode=7, name=volume-c6bf97c0-cd26-424b-aa0e-5d6a38b78b4c, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.206), requestorAccessMask=0 Sep 16 14:47:54 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [None req-6962b0df-ad9b-4d54-8da3-eda535cb4970 tempest-TaggedAttachmentsTest-24583051 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c/volume-c6bf97c0-cd26-424b-aa0e-5d6a38b78b4c 1073741824" returned: 0 in 0.766s {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 14:47:54 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [None req-6962b0df-ad9b-4d54-8da3-eda535cb4970 tempest-TaggedAttachmentsTest-24583051 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c/volume-c6bf97c0-cd26-424b-aa0e-5d6a38b78b4c {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 14:47:54 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [None req-6962b0df-ad9b-4d54-8da3-eda535cb4970 tempest-TaggedAttachmentsTest-24583051 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c/volume-c6bf97c0-cd26-424b-aa0e-5d6a38b78b4c" returned: 0 in 0.414s {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 14:47:54 devstack cinder-volume[83259]: DEBUG cinder.volume.drivers.quobyte [None req-6962b0df-ad9b-4d54-8da3-eda535cb4970 tempest-TaggedAttachmentsTest-24583051 None] <== create_volume: return (1514ms) {'provider_location': '10.10.41.181/cinder-vol-61f585ac-f8e2-4d19-a890-7ebc2726cc72'} {{(pid=83259) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Sep 16 14:47:54 devstack cinder-volume[83259]: DEBUG oslo_concurrency.lockutils [None req-6962b0df-ad9b-4d54-8da3-eda535cb4970 tempest-TaggedAttachmentsTest-24583051 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.543s {{(pid=83259) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 16 14:47:55 devstack cinder-volume[83259]: DEBUG cinder.volume.manager [None req-6962b0df-ad9b-4d54-8da3-eda535cb4970 tempest-TaggedAttachmentsTest-24583051 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (76601a19-2357-4135-a75d-de9f95e60f2a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c6bf97c0-cd26-424b-aa0e-5d6a38b78b4c', 'volume_size': 1}' {{(pid=83259) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 14:47:55 devstack cinder-volume[83259]: DEBUG cinder.volume.manager [None req-6962b0df-ad9b-4d54-8da3-eda535cb4970 tempest-TaggedAttachmentsTest-24583051 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (951c282c-146e-48dd-b1be-ed96f281962f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83259) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 14:47:55 devstack cinder-volume[83259]: INFO cinder.volume.flows.manager.create_volume [None req-6962b0df-ad9b-4d54-8da3-eda535cb4970 tempest-TaggedAttachmentsTest-24583051 None] Volume volume-c6bf97c0-cd26-424b-aa0e-5d6a38b78b4c (c6bf97c0-cd26-424b-aa0e-5d6a38b78b4c): created successfully Sep 16 14:47:55 devstack cinder-volume[83259]: DEBUG cinder.volume.manager [None req-6962b0df-ad9b-4d54-8da3-eda535cb4970 tempest-TaggedAttachmentsTest-24583051 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (951c282c-146e-48dd-b1be-ed96f281962f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83259) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 14:47:55 devstack cinder-volume[83259]: DEBUG cinder.volume.manager [None req-6962b0df-ad9b-4d54-8da3-eda535cb4970 tempest-TaggedAttachmentsTest-24583051 None] Flow 'volume_create_manager' (1930f89d-2008-49d1-9d06-e758760a028e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83259) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 16 14:47:55 devstack cinder-volume[83259]: INFO cinder.volume.manager [None req-6962b0df-ad9b-4d54-8da3-eda535cb4970 tempest-TaggedAttachmentsTest-24583051 None] Created volume successfully. Sep 16 14:47:58 devstack sudo[85569]: pam_unix(sudo:session): session closed for user root Sep 16 14:47:58 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [None req-d0bf9f1d-3589-4b30-ae9d-0697f2127090 tempest-TaggedBootDevicesTest-180213475 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_7786237f-0aff-46c8-bcd0-3b9486a0637a_w35bxff5devstack@QuobyteHD /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c/volume-ec2a536c-e2a0-4b7d-a9f0-2881b05a353e" returned: 0 in 6.653s {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 14:47:58 devstack cinder-volume[83259]: DEBUG cinder.image.image_utils [None req-d0bf9f1d-3589-4b30-ae9d-0697f2127090 tempest-TaggedBootDevicesTest-180213475 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_7786237f-0aff-46c8-bcd0-3b9486a0637a_w35bxff5devstack@QuobyteHD, size 112.00 MB, duration 6.66 sec, destination /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c/volume-ec2a536c-e2a0-4b7d-a9f0-2881b05a353e {{(pid=83259) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:501}} Sep 16 14:47:58 devstack cinder-volume[83259]: INFO cinder.image.image_utils [None req-d0bf9f1d-3589-4b30-ae9d-0697f2127090 tempest-TaggedBootDevicesTest-180213475 None] Converted 112.00 MB image at 16.81 MB/s Sep 16 14:47:58 devstack cinder-volume[83259]: DEBUG oslo.privsep.daemon [-] privsep: reply[6d4579f5-656a-4769-a294-21664890b806]: (4, 'qcow2') {{(pid=84312) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 16 14:47:58 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [None req-d0bf9f1d-3589-4b30-ae9d-0697f2127090 tempest-TaggedBootDevicesTest-180213475 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c/volume-ec2a536c-e2a0-4b7d-a9f0-2881b05a353e {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 14:47:59 devstack quobyte-client[83286]: System call of process 85647 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 16 14:47:59 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [None req-d0bf9f1d-3589-4b30-ae9d-0697f2127090 tempest-TaggedBootDevicesTest-180213475 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c/volume-ec2a536c-e2a0-4b7d-a9f0-2881b05a353e" returned: 0 in 0.844s {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 14:47:59 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [None req-d0bf9f1d-3589-4b30-ae9d-0697f2127090 tempest-TaggedBootDevicesTest-180213475 None] Running cmd (subprocess): qemu-img resize /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c/volume-ec2a536c-e2a0-4b7d-a9f0-2881b05a353e 1G {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 14:48:00 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [None req-d0bf9f1d-3589-4b30-ae9d-0697f2127090 tempest-TaggedBootDevicesTest-180213475 None] CMD "qemu-img resize /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c/volume-ec2a536c-e2a0-4b7d-a9f0-2881b05a353e 1G" returned: 0 in 0.355s {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 14:48:00 devstack cinder-volume[83259]: DEBUG cinder.volume.volume_utils [None req-d0bf9f1d-3589-4b30-ae9d-0697f2127090 tempest-TaggedBootDevicesTest-180213475 None] Downloaded image 7786237f-0aff-46c8-bcd0-3b9486a0637a ((None, [{'url': 'file:///opt/stack/data/glance/images/7786237f-0aff-46c8-bcd0-3b9486a0637a', 'metadata': {}}])) to volume ec2a536c-e2a0-4b7d-a9f0-2881b05a353e successfully. {{(pid=83259) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1234}} Sep 16 14:48:00 devstack cinder-volume[83259]: DEBUG cinder.image.image_utils [None req-d0bf9f1d-3589-4b30-ae9d-0697f2127090 tempest-TaggedBootDevicesTest-180213475 None] Temporary image 7786237f-0aff-46c8-bcd0-3b9486a0637a for user 049dc319ffbc4dbb83bbde57d57805e6 is deleted. {{(pid=83259) fetch /opt/stack/cinder/cinder/image/image_utils.py:1403}} Sep 16 14:48:00 devstack cinder-volume[83259]: DEBUG cinder.volume.volume_utils [None req-d0bf9f1d-3589-4b30-ae9d-0697f2127090 tempest-TaggedBootDevicesTest-180213475 None] Marking volume ec2a536c-e2a0-4b7d-a9f0-2881b05a353e as bootable. {{(pid=83259) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1138}} Sep 16 14:48:00 devstack cinder-volume[83259]: DEBUG cinder.volume.flows.manager.create_volume [None req-d0bf9f1d-3589-4b30-ae9d-0697f2127090 tempest-TaggedBootDevicesTest-180213475 None] Copying metadata from image 7786237f-0aff-46c8-bcd0-3b9486a0637a to ec2a536c-e2a0-4b7d-a9f0-2881b05a353e. {{(pid=83259) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Sep 16 14:48:00 devstack cinder-volume[83259]: DEBUG cinder.volume.flows.manager.create_volume [None req-d0bf9f1d-3589-4b30-ae9d-0697f2127090 tempest-TaggedBootDevicesTest-180213475 None] Creating volume glance metadata for volume ec2a536c-e2a0-4b7d-a9f0-2881b05a353e backed by image 7786237f-0aff-46c8-bcd0-3b9486a0637a with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': '7786237f-0aff-46c8-bcd0-3b9486a0637a', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=83259) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Sep 16 14:48:01 devstack cinder-volume[83259]: DEBUG cinder.volume.manager [None req-d0bf9f1d-3589-4b30-ae9d-0697f2127090 tempest-TaggedBootDevicesTest-180213475 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d3072367-88a3-4a87-baee-6e392eb51958) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ec2a536c-e2a0-4b7d-a9f0-2881b05a353e', 'volume_size': 1, 'image_id': '7786237f-0aff-46c8-bcd0-3b9486a0637a', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/7786237f-0aff-46c8-bcd0-3b9486a0637a', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '97738b7ffcbe49cbaad0099563a58435', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '7786237f-0aff-46c8-bcd0-3b9486a0637a', 'created_at': datetime.datetime(2025, 9, 16, 12, 35, 41, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2025, 9, 16, 12, 35, 42, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/7786237f-0aff-46c8-bcd0-3b9486a0637a/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=83259) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 14:48:01 devstack cinder-volume[83259]: DEBUG cinder.volume.manager [None req-d0bf9f1d-3589-4b30-ae9d-0697f2127090 tempest-TaggedBootDevicesTest-180213475 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7fcb6cf3-5508-4136-bf3d-0f5e52a24b48) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83259) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 14:48:01 devstack cinder-volume[83259]: INFO cinder.volume.flows.manager.create_volume [None req-d0bf9f1d-3589-4b30-ae9d-0697f2127090 tempest-TaggedBootDevicesTest-180213475 None] Volume volume-ec2a536c-e2a0-4b7d-a9f0-2881b05a353e (ec2a536c-e2a0-4b7d-a9f0-2881b05a353e): created successfully Sep 16 14:48:01 devstack cinder-volume[83259]: DEBUG cinder.volume.manager [None req-d0bf9f1d-3589-4b30-ae9d-0697f2127090 tempest-TaggedBootDevicesTest-180213475 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7fcb6cf3-5508-4136-bf3d-0f5e52a24b48) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83259) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 14:48:01 devstack cinder-volume[83259]: DEBUG cinder.volume.manager [None req-d0bf9f1d-3589-4b30-ae9d-0697f2127090 tempest-TaggedBootDevicesTest-180213475 None] Flow 'volume_create_manager' (51863104-03fb-4ade-a19a-5ec4dd532bc8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83259) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 16 14:48:01 devstack cinder-volume[83259]: INFO cinder.volume.manager [None req-d0bf9f1d-3589-4b30-ae9d-0697f2127090 tempest-TaggedBootDevicesTest-180213475 None] Created volume successfully. Sep 16 14:48:04 devstack cinder-volume[83259]: WARNING cinder.volume.volume_utils [None req-5c4fae31-cec3-4594-be57-1ef3db50b51d tempest-TaggedBootDevicesTest-180213475 None] Volume driver (QuobyteDriver 1.2) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 16 14:48:04 devstack cinder-volume[83259]: DEBUG cinder.volume.flows.manager.create_volume [None req-5c4fae31-cec3-4594-be57-1ef3db50b51d tempest-TaggedBootDevicesTest-180213475 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#Quobyte'], 'hosts': ['devstack@QuobyteHD#Quobyte']} {{(pid=83259) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1387}} Sep 16 14:48:05 devstack cinder-volume[83259]: DEBUG cinder.volume.manager [None req-5c4fae31-cec3-4594-be57-1ef3db50b51d tempest-TaggedBootDevicesTest-180213475 None] Flow 'volume_create_manager' (cfe2e826-8d6b-42d0-ae1b-05d7c728efb0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83259) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 16 14:48:05 devstack cinder-volume[83259]: DEBUG cinder.volume.manager [None req-5c4fae31-cec3-4594-be57-1ef3db50b51d tempest-TaggedBootDevicesTest-180213475 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ddfdc509-8710-4720-9447-3241208ae4c2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83259) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 14:48:05 devstack cinder-volume[83259]: DEBUG cinder.volume.manager [None req-5c4fae31-cec3-4594-be57-1ef3db50b51d tempest-TaggedBootDevicesTest-180213475 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ddfdc509-8710-4720-9447-3241208ae4c2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-16T12:48:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TaggedBootDevicesTest-volume-835693335',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#Quobyte',id=d0d76867-45a4-40e6-ad6c-563c035b9afa,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='352a05b391ab4c0f999788a9377215c2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-16T12:48:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-16T12:48:05Z,use_quota=True,user_id='049dc319ffbc4dbb83bbde57d57805e6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(485ead50-3df8-4d76-8d34-a4db136c980a),volume_type_id=485ead50-3df8-4d76-8d34-a4db136c980a)' {{(pid=83259) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 14:48:05 devstack cinder-volume[83259]: DEBUG cinder.volume.manager [None req-5c4fae31-cec3-4594-be57-1ef3db50b51d tempest-TaggedBootDevicesTest-180213475 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (eb6263e7-3a92-4ca9-9407-dbcb424872d2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83259) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 14:48:05 devstack cinder-volume[83259]: DEBUG cinder.volume.manager [None req-5c4fae31-cec3-4594-be57-1ef3db50b51d tempest-TaggedBootDevicesTest-180213475 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (eb6263e7-3a92-4ca9-9407-dbcb424872d2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83259) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 14:48:05 devstack cinder-volume[83259]: DEBUG cinder.volume.manager [None req-5c4fae31-cec3-4594-be57-1ef3db50b51d tempest-TaggedBootDevicesTest-180213475 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (33ef82cc-310f-45cb-bee1-d9f2c5ae1cab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83259) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 14:48:05 devstack cinder-volume[83259]: DEBUG cinder.volume.manager [None req-5c4fae31-cec3-4594-be57-1ef3db50b51d tempest-TaggedBootDevicesTest-180213475 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (33ef82cc-310f-45cb-bee1-d9f2c5ae1cab) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd0d76867-45a4-40e6-ad6c-563c035b9afa', 'volume_name': 'volume-d0d76867-45a4-40e6-ad6c-563c035b9afa', 'volume_size': 1}' {{(pid=83259) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 14:48:05 devstack cinder-volume[83259]: DEBUG cinder.volume.manager [None req-5c4fae31-cec3-4594-be57-1ef3db50b51d tempest-TaggedBootDevicesTest-180213475 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (40b781fd-8673-4ade-af43-08e3cbe34faa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83259) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 14:48:05 devstack cinder-volume[83259]: DEBUG cinder.volume.manager [None req-5c4fae31-cec3-4594-be57-1ef3db50b51d tempest-TaggedBootDevicesTest-180213475 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (40b781fd-8673-4ade-af43-08e3cbe34faa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83259) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 14:48:05 devstack cinder-volume[83259]: DEBUG cinder.volume.manager [None req-5c4fae31-cec3-4594-be57-1ef3db50b51d tempest-TaggedBootDevicesTest-180213475 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (91374cbd-233b-4c12-9e1f-52e7614ba9ad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83259) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 14:48:05 devstack cinder-volume[83259]: INFO cinder.volume.flows.manager.create_volume [None req-5c4fae31-cec3-4594-be57-1ef3db50b51d tempest-TaggedBootDevicesTest-180213475 None] Volume d0d76867-45a4-40e6-ad6c-563c035b9afa: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d0d76867-45a4-40e6-ad6c-563c035b9afa', 'volume_size': 1} Sep 16 14:48:05 devstack cinder-volume[83259]: DEBUG oslo_concurrency.lockutils [None req-5c4fae31-cec3-4594-be57-1ef3db50b51d tempest-TaggedBootDevicesTest-180213475 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83259) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 16 14:48:05 devstack cinder-volume[83259]: DEBUG oslo_concurrency.lockutils [None req-5c4fae31-cec3-4594-be57-1ef3db50b51d tempest-TaggedBootDevicesTest-180213475 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.003s {{(pid=83259) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 16 14:48:05 devstack cinder-volume[83259]: DEBUG cinder.volume.drivers.quobyte [None req-5c4fae31-cec3-4594-be57-1ef3db50b51d tempest-TaggedBootDevicesTest-180213475 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-16T12:48:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TaggedBootDevicesTest-volume-835693335',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#Quobyte',id=d0d76867-45a4-40e6-ad6c-563c035b9afa,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='352a05b391ab4c0f999788a9377215c2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-16T12:48:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-16T12:48:05Z,use_quota=True,user_id='049dc319ffbc4dbb83bbde57d57805e6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(485ead50-3df8-4d76-8d34-a4db136c980a),volume_type_id=485ead50-3df8-4d76-8d34-a4db136c980a)}" {{(pid=83259) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Sep 16 14:48:05 devstack cinder-volume[83259]: DEBUG cinder.volume.drivers.remotefs [None req-5c4fae31-cec3-4594-be57-1ef3db50b51d tempest-TaggedBootDevicesTest-180213475 None] Creating volume d0d76867-45a4-40e6-ad6c-563c035b9afa {{(pid=83259) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}} Sep 16 14:48:05 devstack cinder-volume[83259]: DEBUG oslo_concurrency.lockutils [None req-5c4fae31-cec3-4594-be57-1ef3db50b51d tempest-TaggedBootDevicesTest-180213475 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83259) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 16 14:48:05 devstack cinder-volume[83259]: DEBUG oslo_concurrency.lockutils [None req-5c4fae31-cec3-4594-be57-1ef3db50b51d tempest-TaggedBootDevicesTest-180213475 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83259) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 16 14:48:05 devstack cinder-volume[83259]: DEBUG cinder.volume.drivers.quobyte [None req-5c4fae31-cec3-4594-be57-1ef3db50b51d tempest-TaggedBootDevicesTest-180213475 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-61f585ac-f8e2-4d19-a890-7ebc2726cc72': None} {{(pid=83259) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:639}} Sep 16 14:48:05 devstack cinder-volume[83259]: DEBUG cinder.volume.drivers.quobyte [None req-5c4fae31-cec3-4594-be57-1ef3db50b51d tempest-TaggedBootDevicesTest-180213475 None] Available shares ['10.10.41.181/cinder-vol-61f585ac-f8e2-4d19-a890-7ebc2726cc72'] {{(pid=83259) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:669}} Sep 16 14:48:05 devstack cinder-volume[83259]: DEBUG oslo_concurrency.lockutils [None req-5c4fae31-cec3-4594-be57-1ef3db50b51d tempest-TaggedBootDevicesTest-180213475 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=83259) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 16 14:48:05 devstack cinder-volume[83259]: DEBUG cinder.volume.drivers.quobyte [None req-5c4fae31-cec3-4594-be57-1ef3db50b51d tempest-TaggedBootDevicesTest-180213475 None] Selected 10.10.41.181/cinder-vol-61f585ac-f8e2-4d19-a890-7ebc2726cc72 as target Quobyte volume. {{(pid=83259) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:690}} Sep 16 14:48:05 devstack cinder-volume[83259]: INFO cinder.volume.drivers.remotefs [None req-5c4fae31-cec3-4594-be57-1ef3db50b51d tempest-TaggedBootDevicesTest-180213475 None] casted to 10.10.41.181/cinder-vol-61f585ac-f8e2-4d19-a890-7ebc2726cc72 Sep 16 14:48:05 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [None req-5c4fae31-cec3-4594-be57-1ef3db50b51d tempest-TaggedBootDevicesTest-180213475 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c/volume-d0d76867-45a4-40e6-ad6c-563c035b9afa 1073741824 {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 14:48:05 devstack quobyte-client[83286]: The server volume:87712ffe-8a69-446d-9ed6-4430c7ee9792@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=87712ffe-8a69-446d-9ed6-4430c7ee9792, inode=8, name=volume-d0d76867-45a4-40e6-ad6c-563c035b9afa, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.206), requestorAccessMask=0 Sep 16 14:48:06 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [None req-5c4fae31-cec3-4594-be57-1ef3db50b51d tempest-TaggedBootDevicesTest-180213475 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c/volume-d0d76867-45a4-40e6-ad6c-563c035b9afa 1073741824" returned: 0 in 0.506s {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 14:48:06 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [None req-5c4fae31-cec3-4594-be57-1ef3db50b51d tempest-TaggedBootDevicesTest-180213475 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c/volume-d0d76867-45a4-40e6-ad6c-563c035b9afa {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 14:48:06 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [None req-5c4fae31-cec3-4594-be57-1ef3db50b51d tempest-TaggedBootDevicesTest-180213475 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c/volume-d0d76867-45a4-40e6-ad6c-563c035b9afa" returned: 0 in 0.116s {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 14:48:06 devstack cinder-volume[83259]: DEBUG cinder.volume.drivers.quobyte [None req-5c4fae31-cec3-4594-be57-1ef3db50b51d tempest-TaggedBootDevicesTest-180213475 None] <== create_volume: return (704ms) {'provider_location': '10.10.41.181/cinder-vol-61f585ac-f8e2-4d19-a890-7ebc2726cc72'} {{(pid=83259) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Sep 16 14:48:06 devstack cinder-volume[83259]: DEBUG oslo_concurrency.lockutils [None req-5c4fae31-cec3-4594-be57-1ef3db50b51d tempest-TaggedBootDevicesTest-180213475 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.731s {{(pid=83259) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 16 14:48:06 devstack cinder-volume[83259]: DEBUG cinder.volume.manager [None req-5c4fae31-cec3-4594-be57-1ef3db50b51d tempest-TaggedBootDevicesTest-180213475 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (91374cbd-233b-4c12-9e1f-52e7614ba9ad) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d0d76867-45a4-40e6-ad6c-563c035b9afa', 'volume_size': 1}' {{(pid=83259) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 14:48:06 devstack cinder-volume[83259]: DEBUG cinder.volume.manager [None req-5c4fae31-cec3-4594-be57-1ef3db50b51d tempest-TaggedBootDevicesTest-180213475 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d69142f5-a698-4470-b91d-bf9e2660d373) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83259) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 14:48:06 devstack cinder-volume[83259]: INFO cinder.volume.flows.manager.create_volume [None req-5c4fae31-cec3-4594-be57-1ef3db50b51d tempest-TaggedBootDevicesTest-180213475 None] Volume volume-d0d76867-45a4-40e6-ad6c-563c035b9afa (d0d76867-45a4-40e6-ad6c-563c035b9afa): created successfully Sep 16 14:48:06 devstack cinder-volume[83259]: DEBUG cinder.volume.manager [None req-5c4fae31-cec3-4594-be57-1ef3db50b51d tempest-TaggedBootDevicesTest-180213475 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d69142f5-a698-4470-b91d-bf9e2660d373) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83259) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 14:48:06 devstack cinder-volume[83259]: DEBUG cinder.volume.manager [None req-5c4fae31-cec3-4594-be57-1ef3db50b51d tempest-TaggedBootDevicesTest-180213475 None] Flow 'volume_create_manager' (cfe2e826-8d6b-42d0-ae1b-05d7c728efb0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83259) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 16 14:48:06 devstack cinder-volume[83259]: INFO cinder.volume.manager [None req-5c4fae31-cec3-4594-be57-1ef3db50b51d tempest-TaggedBootDevicesTest-180213475 None] Created volume successfully. Sep 16 14:48:07 devstack cinder-volume[83259]: WARNING cinder.volume.volume_utils [None req-9d860498-7a37-4fa2-9a12-9cf5b840727a tempest-TaggedBootDevicesTest-180213475 None] Volume driver (QuobyteDriver 1.2) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 16 14:48:08 devstack cinder-volume[83259]: DEBUG cinder.volume.flows.manager.create_volume [None req-9d860498-7a37-4fa2-9a12-9cf5b840727a tempest-TaggedBootDevicesTest-180213475 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#Quobyte'], 'hosts': ['devstack@QuobyteHD#Quobyte']} {{(pid=83259) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1387}} Sep 16 14:48:08 devstack cinder-volume[83259]: DEBUG cinder.volume.manager [None req-9d860498-7a37-4fa2-9a12-9cf5b840727a tempest-TaggedBootDevicesTest-180213475 None] Flow 'volume_create_manager' (098dde64-e28f-46ad-956e-421677572f7b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83259) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 16 14:48:08 devstack cinder-volume[83259]: DEBUG cinder.volume.manager [None req-9d860498-7a37-4fa2-9a12-9cf5b840727a tempest-TaggedBootDevicesTest-180213475 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2ab39f2b-8bd8-4b1a-81fd-9c399715c859) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83259) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 14:48:08 devstack cinder-volume[83259]: DEBUG cinder.volume.manager [None req-9d860498-7a37-4fa2-9a12-9cf5b840727a tempest-TaggedBootDevicesTest-180213475 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2ab39f2b-8bd8-4b1a-81fd-9c399715c859) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-16T12:48:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TaggedBootDevicesTest-volume-211760516',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#Quobyte',id=fa446bc6-198a-4e3d-a763-3f3f738af519,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='352a05b391ab4c0f999788a9377215c2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-16T12:48:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-16T12:48:08Z,use_quota=True,user_id='049dc319ffbc4dbb83bbde57d57805e6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(485ead50-3df8-4d76-8d34-a4db136c980a),volume_type_id=485ead50-3df8-4d76-8d34-a4db136c980a)' {{(pid=83259) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 14:48:08 devstack cinder-volume[83259]: DEBUG cinder.volume.manager [None req-9d860498-7a37-4fa2-9a12-9cf5b840727a tempest-TaggedBootDevicesTest-180213475 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0aaa635c-b861-4779-86f9-e7196c82daff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83259) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 14:48:08 devstack cinder-volume[83259]: DEBUG cinder.volume.manager [None req-9d860498-7a37-4fa2-9a12-9cf5b840727a tempest-TaggedBootDevicesTest-180213475 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0aaa635c-b861-4779-86f9-e7196c82daff) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83259) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 14:48:08 devstack cinder-volume[83259]: DEBUG cinder.volume.manager [None req-9d860498-7a37-4fa2-9a12-9cf5b840727a tempest-TaggedBootDevicesTest-180213475 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b8a328a8-e856-44f1-8ee2-2c0b20723167) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83259) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 14:48:08 devstack cinder-volume[83259]: DEBUG cinder.volume.manager [None req-9d860498-7a37-4fa2-9a12-9cf5b840727a tempest-TaggedBootDevicesTest-180213475 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b8a328a8-e856-44f1-8ee2-2c0b20723167) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'fa446bc6-198a-4e3d-a763-3f3f738af519', 'volume_name': 'volume-fa446bc6-198a-4e3d-a763-3f3f738af519', 'volume_size': 1}' {{(pid=83259) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 14:48:08 devstack cinder-volume[83259]: DEBUG cinder.volume.manager [None req-9d860498-7a37-4fa2-9a12-9cf5b840727a tempest-TaggedBootDevicesTest-180213475 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1c3f7f32-eab7-419f-8691-0e25314e2549) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83259) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 14:48:08 devstack cinder-volume[83259]: DEBUG cinder.volume.manager [None req-9d860498-7a37-4fa2-9a12-9cf5b840727a tempest-TaggedBootDevicesTest-180213475 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1c3f7f32-eab7-419f-8691-0e25314e2549) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83259) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 14:48:08 devstack cinder-volume[83259]: DEBUG cinder.volume.manager [None req-9d860498-7a37-4fa2-9a12-9cf5b840727a tempest-TaggedBootDevicesTest-180213475 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (63e71c15-a6de-4588-aeaf-7027276f7cc7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83259) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 14:48:08 devstack cinder-volume[83259]: INFO cinder.volume.flows.manager.create_volume [None req-9d860498-7a37-4fa2-9a12-9cf5b840727a tempest-TaggedBootDevicesTest-180213475 None] Volume fa446bc6-198a-4e3d-a763-3f3f738af519: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-fa446bc6-198a-4e3d-a763-3f3f738af519', 'volume_size': 1} Sep 16 14:48:08 devstack cinder-volume[83259]: DEBUG oslo_concurrency.lockutils [None req-9d860498-7a37-4fa2-9a12-9cf5b840727a tempest-TaggedBootDevicesTest-180213475 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83259) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 16 14:48:08 devstack cinder-volume[83259]: DEBUG oslo_concurrency.lockutils [None req-9d860498-7a37-4fa2-9a12-9cf5b840727a tempest-TaggedBootDevicesTest-180213475 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.003s {{(pid=83259) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 16 14:48:08 devstack cinder-volume[83259]: DEBUG cinder.volume.drivers.quobyte [None req-9d860498-7a37-4fa2-9a12-9cf5b840727a tempest-TaggedBootDevicesTest-180213475 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-16T12:48:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TaggedBootDevicesTest-volume-211760516',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#Quobyte',id=fa446bc6-198a-4e3d-a763-3f3f738af519,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='352a05b391ab4c0f999788a9377215c2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-16T12:48:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-16T12:48:08Z,use_quota=True,user_id='049dc319ffbc4dbb83bbde57d57805e6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(485ead50-3df8-4d76-8d34-a4db136c980a),volume_type_id=485ead50-3df8-4d76-8d34-a4db136c980a)}" {{(pid=83259) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Sep 16 14:48:08 devstack cinder-volume[83259]: DEBUG cinder.volume.drivers.remotefs [None req-9d860498-7a37-4fa2-9a12-9cf5b840727a tempest-TaggedBootDevicesTest-180213475 None] Creating volume fa446bc6-198a-4e3d-a763-3f3f738af519 {{(pid=83259) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}} Sep 16 14:48:08 devstack cinder-volume[83259]: DEBUG oslo_concurrency.lockutils [None req-9d860498-7a37-4fa2-9a12-9cf5b840727a tempest-TaggedBootDevicesTest-180213475 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83259) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 16 14:48:08 devstack cinder-volume[83259]: DEBUG oslo_concurrency.lockutils [None req-9d860498-7a37-4fa2-9a12-9cf5b840727a tempest-TaggedBootDevicesTest-180213475 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83259) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 16 14:48:08 devstack cinder-volume[83259]: DEBUG cinder.volume.drivers.quobyte [None req-9d860498-7a37-4fa2-9a12-9cf5b840727a tempest-TaggedBootDevicesTest-180213475 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-61f585ac-f8e2-4d19-a890-7ebc2726cc72': None} {{(pid=83259) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:639}} Sep 16 14:48:08 devstack cinder-volume[83259]: DEBUG cinder.volume.drivers.quobyte [None req-9d860498-7a37-4fa2-9a12-9cf5b840727a tempest-TaggedBootDevicesTest-180213475 None] Available shares ['10.10.41.181/cinder-vol-61f585ac-f8e2-4d19-a890-7ebc2726cc72'] {{(pid=83259) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:669}} Sep 16 14:48:08 devstack cinder-volume[83259]: DEBUG oslo_concurrency.lockutils [None req-9d860498-7a37-4fa2-9a12-9cf5b840727a tempest-TaggedBootDevicesTest-180213475 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=83259) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 16 14:48:08 devstack cinder-volume[83259]: DEBUG cinder.volume.drivers.quobyte [None req-9d860498-7a37-4fa2-9a12-9cf5b840727a tempest-TaggedBootDevicesTest-180213475 None] Selected 10.10.41.181/cinder-vol-61f585ac-f8e2-4d19-a890-7ebc2726cc72 as target Quobyte volume. {{(pid=83259) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:690}} Sep 16 14:48:08 devstack cinder-volume[83259]: INFO cinder.volume.drivers.remotefs [None req-9d860498-7a37-4fa2-9a12-9cf5b840727a tempest-TaggedBootDevicesTest-180213475 None] casted to 10.10.41.181/cinder-vol-61f585ac-f8e2-4d19-a890-7ebc2726cc72 Sep 16 14:48:08 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [None req-9d860498-7a37-4fa2-9a12-9cf5b840727a tempest-TaggedBootDevicesTest-180213475 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c/volume-fa446bc6-198a-4e3d-a763-3f3f738af519 1073741824 {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 14:48:08 devstack quobyte-client[83286]: System call of process 85674 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 16 14:48:08 devstack quobyte-client[83286]: The server volume:87712ffe-8a69-446d-9ed6-4430c7ee9792@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=87712ffe-8a69-446d-9ed6-4430c7ee9792, inode=9, name=volume-fa446bc6-198a-4e3d-a763-3f3f738af519, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.206), requestorAccessMask=0 Sep 16 14:48:08 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [None req-9d860498-7a37-4fa2-9a12-9cf5b840727a tempest-TaggedBootDevicesTest-180213475 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c/volume-fa446bc6-198a-4e3d-a763-3f3f738af519 1073741824" returned: 0 in 0.544s {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 14:48:08 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [None req-9d860498-7a37-4fa2-9a12-9cf5b840727a tempest-TaggedBootDevicesTest-180213475 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c/volume-fa446bc6-198a-4e3d-a763-3f3f738af519 {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 14:48:09 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [None req-9d860498-7a37-4fa2-9a12-9cf5b840727a tempest-TaggedBootDevicesTest-180213475 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c/volume-fa446bc6-198a-4e3d-a763-3f3f738af519" returned: 0 in 0.248s {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 14:48:09 devstack cinder-volume[83259]: DEBUG cinder.volume.drivers.quobyte [None req-9d860498-7a37-4fa2-9a12-9cf5b840727a tempest-TaggedBootDevicesTest-180213475 None] <== create_volume: return (892ms) {'provider_location': '10.10.41.181/cinder-vol-61f585ac-f8e2-4d19-a890-7ebc2726cc72'} {{(pid=83259) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Sep 16 14:48:09 devstack cinder-volume[83259]: DEBUG oslo_concurrency.lockutils [None req-9d860498-7a37-4fa2-9a12-9cf5b840727a tempest-TaggedBootDevicesTest-180213475 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.907s {{(pid=83259) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 16 14:48:09 devstack cinder-volume[83259]: DEBUG cinder.volume.manager [None req-9d860498-7a37-4fa2-9a12-9cf5b840727a tempest-TaggedBootDevicesTest-180213475 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (63e71c15-a6de-4588-aeaf-7027276f7cc7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-fa446bc6-198a-4e3d-a763-3f3f738af519', 'volume_size': 1}' {{(pid=83259) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 14:48:09 devstack cinder-volume[83259]: DEBUG cinder.volume.manager [None req-9d860498-7a37-4fa2-9a12-9cf5b840727a tempest-TaggedBootDevicesTest-180213475 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (05339247-93f1-4a0b-aa59-65604ddbba77) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83259) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 14:48:09 devstack cinder-volume[83259]: INFO cinder.volume.flows.manager.create_volume [None req-9d860498-7a37-4fa2-9a12-9cf5b840727a tempest-TaggedBootDevicesTest-180213475 None] Volume volume-fa446bc6-198a-4e3d-a763-3f3f738af519 (fa446bc6-198a-4e3d-a763-3f3f738af519): created successfully Sep 16 14:48:09 devstack cinder-volume[83259]: DEBUG cinder.volume.manager [None req-9d860498-7a37-4fa2-9a12-9cf5b840727a tempest-TaggedBootDevicesTest-180213475 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (05339247-93f1-4a0b-aa59-65604ddbba77) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83259) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 14:48:09 devstack cinder-volume[83259]: DEBUG cinder.volume.manager [None req-9d860498-7a37-4fa2-9a12-9cf5b840727a tempest-TaggedBootDevicesTest-180213475 None] Flow 'volume_create_manager' (098dde64-e28f-46ad-956e-421677572f7b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83259) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 16 14:48:09 devstack cinder-volume[83259]: INFO cinder.volume.manager [None req-9d860498-7a37-4fa2-9a12-9cf5b840727a tempest-TaggedBootDevicesTest-180213475 None] Created volume successfully. Sep 16 14:48:19 devstack cinder-volume[83259]: DEBUG dbcounter [-] [83259] Writing DB stats cinder:SELECT=10,cinder:UPDATE=8,cinder:INSERT=7,cinder:DELETE=1 {{(pid=83259) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Sep 16 14:48:19 devstack cinder-volume[83259]: DEBUG dbcounter [-] [83259] Writing DB stats cinder:UPDATE=9,cinder:DELETE=3,cinder:SELECT=10,cinder:INSERT=5 {{(pid=83259) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Sep 16 14:48:44 devstack cinder-volume[83259]: DEBUG oslo_service.periodic_task [None req-050ec8a1-6ffd-499d-95ad-d548a84437e2 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=83259) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} Sep 16 14:48:44 devstack cinder-volume[83259]: DEBUG oslo_concurrency.lockutils [None req-050ec8a1-6ffd-499d-95ad-d548a84437e2 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83259) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 16 14:48:44 devstack cinder-volume[83259]: DEBUG oslo_concurrency.lockutils [None req-050ec8a1-6ffd-499d-95ad-d548a84437e2 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.005s {{(pid=83259) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 16 14:48:44 devstack cinder-volume[83259]: DEBUG cinder.volume.drivers.quobyte [None req-050ec8a1-6ffd-499d-95ad-d548a84437e2 None None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-61f585ac-f8e2-4d19-a890-7ebc2726cc72': None} {{(pid=83259) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:639}} Sep 16 14:48:44 devstack cinder-volume[83259]: DEBUG cinder.volume.drivers.quobyte [None req-050ec8a1-6ffd-499d-95ad-d548a84437e2 None None] Available shares ['10.10.41.181/cinder-vol-61f585ac-f8e2-4d19-a890-7ebc2726cc72'] {{(pid=83259) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:669}} Sep 16 14:48:44 devstack cinder-volume[83259]: DEBUG oslo_concurrency.lockutils [None req-050ec8a1-6ffd-499d-95ad-d548a84437e2 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.035s {{(pid=83259) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 16 14:48:44 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [None req-050ec8a1-6ffd-499d-95ad-d548a84437e2 None None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 14:48:45 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [None req-050ec8a1-6ffd-499d-95ad-d548a84437e2 None None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c" returned: 0 in 0.370s {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 14:48:45 devstack cinder-volume[83259]: DEBUG cinder.manager [None req-050ec8a1-6ffd-499d-95ad-d548a84437e2 None None] Notifying Schedulers of capabilities ... {{(pid=83259) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 16 14:48:51 devstack cinder-volume[83259]: DEBUG oslo_concurrency.lockutils [req-c458ee41-ca6a-4526-8b10-17bace515597 req-bfd09e96-3e53-4173-a1dd-2e3eb9aca770 tempest-TaggedBootDevicesTest-180213475 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=83259) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 16 14:48:51 devstack cinder-volume[83259]: DEBUG oslo_concurrency.lockutils [req-c458ee41-ca6a-4526-8b10-17bace515597 req-bfd09e96-3e53-4173-a1dd-2e3eb9aca770 tempest-TaggedBootDevicesTest-180213475 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.008s {{(pid=83259) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 16 14:48:51 devstack cinder-volume[83259]: DEBUG oslo.privsep.daemon [-] privsep: reply[88a0ba88-3ca7-4029-9c52-6b92dfdd4f4d]: (4, 'qcow2') {{(pid=84312) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 16 14:48:51 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [req-c458ee41-ca6a-4526-8b10-17bace515597 req-bfd09e96-3e53-4173-a1dd-2e3eb9aca770 tempest-TaggedBootDevicesTest-180213475 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c/volume-ec2a536c-e2a0-4b7d-a9f0-2881b05a353e {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 14:48:52 devstack quobyte-client[83286]: System call of process 85936 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 16 14:48:53 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [req-c458ee41-ca6a-4526-8b10-17bace515597 req-bfd09e96-3e53-4173-a1dd-2e3eb9aca770 tempest-TaggedBootDevicesTest-180213475 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c/volume-ec2a536c-e2a0-4b7d-a9f0-2881b05a353e" returned: 0 in 1.858s {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 14:48:53 devstack cinder-volume[83259]: DEBUG oslo_concurrency.lockutils [req-c458ee41-ca6a-4526-8b10-17bace515597 req-bfd09e96-3e53-4173-a1dd-2e3eb9aca770 tempest-TaggedBootDevicesTest-180213475 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 2.068s {{(pid=83259) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 16 14:48:53 devstack cinder-volume[83259]: DEBUG cinder.volume.manager [req-c458ee41-ca6a-4526-8b10-17bace515597 req-bfd09e96-3e53-4173-a1dd-2e3eb9aca770 tempest-TaggedBootDevicesTest-180213475 None] Connection info returned from driver {'export': '10.10.41.181/cinder-vol-61f585ac-f8e2-4d19-a890-7ebc2726cc72', 'name': 'volume-ec2a536c-e2a0-4b7d-a9f0-2881b05a353e', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'ef93ce29-e159-491f-83e7-765dfe13ab38', 'enforce_multipath': True} {{(pid=83259) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4891}} Sep 16 14:48:53 devstack cinder-volume[83259]: WARNING cinder.volume.volume_utils [req-c458ee41-ca6a-4526-8b10-17bace515597 req-bfd09e96-3e53-4173-a1dd-2e3eb9aca770 tempest-TaggedBootDevicesTest-180213475 None] Volume driver (QuobyteDriver 1.2) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 16 14:48:54 devstack cinder-volume[83259]: INFO cinder.volume.manager [req-c458ee41-ca6a-4526-8b10-17bace515597 req-bfd09e96-3e53-4173-a1dd-2e3eb9aca770 tempest-TaggedBootDevicesTest-180213475 None] attachment_update completed successfully. Sep 16 14:49:04 devstack cinder-volume[83259]: DEBUG dbcounter [-] [83259] Writing DB stats cinder:SELECT=6,cinder:UPDATE=3 {{(pid=83259) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Sep 16 14:49:04 devstack cinder-volume[83259]: DEBUG dbcounter [-] [83259] Writing DB stats cinder:SELECT=5 {{(pid=83259) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Sep 16 14:49:04 devstack cinder-volume[83259]: DEBUG oslo_concurrency.lockutils [req-c458ee41-ca6a-4526-8b10-17bace515597 req-792209a5-939a-46d8-83dd-737498ee707b tempest-TaggedBootDevicesTest-180213475 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=83259) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 16 14:49:04 devstack cinder-volume[83259]: DEBUG oslo_concurrency.lockutils [req-c458ee41-ca6a-4526-8b10-17bace515597 req-792209a5-939a-46d8-83dd-737498ee707b tempest-TaggedBootDevicesTest-180213475 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.017s {{(pid=83259) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 16 14:49:04 devstack cinder-volume[83259]: DEBUG oslo.privsep.daemon [-] privsep: reply[b1d3ea87-8017-4b68-8d7c-6b0401174629]: (4, 'qcow2') {{(pid=84312) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 16 14:49:04 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [req-c458ee41-ca6a-4526-8b10-17bace515597 req-792209a5-939a-46d8-83dd-737498ee707b tempest-TaggedBootDevicesTest-180213475 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c/volume-d0d76867-45a4-40e6-ad6c-563c035b9afa {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 14:49:08 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [req-c458ee41-ca6a-4526-8b10-17bace515597 req-792209a5-939a-46d8-83dd-737498ee707b tempest-TaggedBootDevicesTest-180213475 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c/volume-d0d76867-45a4-40e6-ad6c-563c035b9afa" returned: 0 in 3.361s {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 14:49:08 devstack cinder-volume[83259]: DEBUG oslo_concurrency.lockutils [req-c458ee41-ca6a-4526-8b10-17bace515597 req-792209a5-939a-46d8-83dd-737498ee707b tempest-TaggedBootDevicesTest-180213475 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 3.736s {{(pid=83259) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 16 14:49:10 devstack cinder-volume[83259]: DEBUG cinder.volume.manager [req-c458ee41-ca6a-4526-8b10-17bace515597 req-792209a5-939a-46d8-83dd-737498ee707b tempest-TaggedBootDevicesTest-180213475 None] Connection info returned from driver {'export': '10.10.41.181/cinder-vol-61f585ac-f8e2-4d19-a890-7ebc2726cc72', 'name': 'volume-d0d76867-45a4-40e6-ad6c-563c035b9afa', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'a0a5a5c6-dd78-4880-9591-45002cdce802', 'enforce_multipath': True} {{(pid=83259) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4891}} Sep 16 14:49:10 devstack cinder-volume[83259]: WARNING cinder.volume.volume_utils [req-c458ee41-ca6a-4526-8b10-17bace515597 req-792209a5-939a-46d8-83dd-737498ee707b tempest-TaggedBootDevicesTest-180213475 None] Volume driver (QuobyteDriver 1.2) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 16 14:49:11 devstack cinder-volume[83259]: INFO cinder.volume.manager [req-c458ee41-ca6a-4526-8b10-17bace515597 req-792209a5-939a-46d8-83dd-737498ee707b tempest-TaggedBootDevicesTest-180213475 None] attachment_update completed successfully. Sep 16 14:49:18 devstack cinder-volume[83259]: DEBUG oslo_concurrency.lockutils [req-c458ee41-ca6a-4526-8b10-17bace515597 req-2632af44-89f6-485f-ae6a-c8f135cf75e8 tempest-TaggedBootDevicesTest-180213475 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=83259) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 16 14:49:18 devstack cinder-volume[83259]: DEBUG oslo_concurrency.lockutils [req-c458ee41-ca6a-4526-8b10-17bace515597 req-2632af44-89f6-485f-ae6a-c8f135cf75e8 tempest-TaggedBootDevicesTest-180213475 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.024s {{(pid=83259) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 16 14:49:19 devstack cinder-volume[83259]: DEBUG oslo.privsep.daemon [-] privsep: reply[11694152-cb88-41fd-87ad-fca07bc37585]: (4, 'qcow2') {{(pid=84312) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 16 14:49:19 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [req-c458ee41-ca6a-4526-8b10-17bace515597 req-2632af44-89f6-485f-ae6a-c8f135cf75e8 tempest-TaggedBootDevicesTest-180213475 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c/volume-fa446bc6-198a-4e3d-a763-3f3f738af519 {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 14:49:20 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [req-c458ee41-ca6a-4526-8b10-17bace515597 req-2632af44-89f6-485f-ae6a-c8f135cf75e8 tempest-TaggedBootDevicesTest-180213475 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c/volume-fa446bc6-198a-4e3d-a763-3f3f738af519" returned: 0 in 1.594s {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 14:49:20 devstack cinder-volume[83259]: DEBUG oslo_concurrency.lockutils [req-c458ee41-ca6a-4526-8b10-17bace515597 req-2632af44-89f6-485f-ae6a-c8f135cf75e8 tempest-TaggedBootDevicesTest-180213475 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 1.943s {{(pid=83259) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 16 14:49:21 devstack cinder-volume[83259]: DEBUG cinder.volume.manager [req-c458ee41-ca6a-4526-8b10-17bace515597 req-2632af44-89f6-485f-ae6a-c8f135cf75e8 tempest-TaggedBootDevicesTest-180213475 None] Connection info returned from driver {'export': '10.10.41.181/cinder-vol-61f585ac-f8e2-4d19-a890-7ebc2726cc72', 'name': 'volume-fa446bc6-198a-4e3d-a763-3f3f738af519', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '8c84cf10-8bfb-4332-8250-7bea04bba878', 'enforce_multipath': True} {{(pid=83259) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4891}} Sep 16 14:49:21 devstack cinder-volume[83259]: WARNING cinder.volume.volume_utils [req-c458ee41-ca6a-4526-8b10-17bace515597 req-2632af44-89f6-485f-ae6a-c8f135cf75e8 tempest-TaggedBootDevicesTest-180213475 None] Volume driver (QuobyteDriver 1.2) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 16 14:49:22 devstack cinder-volume[83259]: INFO cinder.volume.manager [req-c458ee41-ca6a-4526-8b10-17bace515597 req-2632af44-89f6-485f-ae6a-c8f135cf75e8 tempest-TaggedBootDevicesTest-180213475 None] attachment_update completed successfully. Sep 16 14:49:24 devstack cinder-volume[83259]: WARNING cinder.volume.volume_utils [None req-27f1b499-3e91-42ae-a2a9-732ada6c271d tempest-ServersNegativeTestJSON-540995332 None] Volume driver (QuobyteDriver 1.2) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 16 14:49:24 devstack cinder-volume[83259]: DEBUG cinder.volume.flows.manager.create_volume [None req-27f1b499-3e91-42ae-a2a9-732ada6c271d tempest-ServersNegativeTestJSON-540995332 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#Quobyte'], 'hosts': ['devstack@QuobyteHD#Quobyte']} {{(pid=83259) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1387}} Sep 16 14:49:24 devstack cinder-volume[83259]: DEBUG cinder.volume.manager [None req-27f1b499-3e91-42ae-a2a9-732ada6c271d tempest-ServersNegativeTestJSON-540995332 None] Flow 'volume_create_manager' (73c67f5a-9d93-4e39-a27c-a7ebd271eca1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83259) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 16 14:49:24 devstack cinder-volume[83259]: DEBUG cinder.volume.manager [None req-27f1b499-3e91-42ae-a2a9-732ada6c271d tempest-ServersNegativeTestJSON-540995332 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d105cccd-a98a-4674-9d74-10625a287e2b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83259) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 14:49:25 devstack cinder-volume[83259]: DEBUG cinder.volume.manager [None req-27f1b499-3e91-42ae-a2a9-732ada6c271d tempest-ServersNegativeTestJSON-540995332 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d105cccd-a98a-4674-9d74-10625a287e2b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-16T12:49:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-1087950749',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#Quobyte',id=958d794e-b389-465f-bba5-3e5bd4a39925,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='49cc4ad55cf44129b8365eab6ea4750d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-16T12:49:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-16T12:49:24Z,use_quota=True,user_id='fa866679b852442f9ed997c9c13eeedd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(485ead50-3df8-4d76-8d34-a4db136c980a),volume_type_id=485ead50-3df8-4d76-8d34-a4db136c980a)' {{(pid=83259) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 14:49:25 devstack cinder-volume[83259]: DEBUG cinder.volume.manager [None req-27f1b499-3e91-42ae-a2a9-732ada6c271d tempest-ServersNegativeTestJSON-540995332 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (be42c7da-ed59-4df5-9ecd-dadbe6950491) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83259) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 14:49:25 devstack cinder-volume[83259]: DEBUG cinder.volume.manager [None req-27f1b499-3e91-42ae-a2a9-732ada6c271d tempest-ServersNegativeTestJSON-540995332 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (be42c7da-ed59-4df5-9ecd-dadbe6950491) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83259) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 14:49:25 devstack cinder-volume[83259]: DEBUG cinder.volume.manager [None req-27f1b499-3e91-42ae-a2a9-732ada6c271d tempest-ServersNegativeTestJSON-540995332 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e2016a36-bdeb-4b29-b490-71b985303545) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83259) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 14:49:25 devstack cinder-volume[83259]: DEBUG cinder.volume.manager [None req-27f1b499-3e91-42ae-a2a9-732ada6c271d tempest-ServersNegativeTestJSON-540995332 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e2016a36-bdeb-4b29-b490-71b985303545) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '958d794e-b389-465f-bba5-3e5bd4a39925', 'volume_name': 'volume-958d794e-b389-465f-bba5-3e5bd4a39925', 'volume_size': 1}' {{(pid=83259) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 14:49:25 devstack cinder-volume[83259]: DEBUG cinder.volume.manager [None req-27f1b499-3e91-42ae-a2a9-732ada6c271d tempest-ServersNegativeTestJSON-540995332 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d6e4d32f-ce39-446f-80fd-243abd76f530) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83259) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 14:49:25 devstack cinder-volume[83259]: DEBUG cinder.volume.manager [None req-27f1b499-3e91-42ae-a2a9-732ada6c271d tempest-ServersNegativeTestJSON-540995332 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d6e4d32f-ce39-446f-80fd-243abd76f530) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83259) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 14:49:25 devstack cinder-volume[83259]: DEBUG cinder.volume.manager [None req-27f1b499-3e91-42ae-a2a9-732ada6c271d tempest-ServersNegativeTestJSON-540995332 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (24b802ba-9b1d-4ba9-9adf-1a2849f0a976) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83259) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 14:49:25 devstack cinder-volume[83259]: INFO cinder.volume.flows.manager.create_volume [None req-27f1b499-3e91-42ae-a2a9-732ada6c271d tempest-ServersNegativeTestJSON-540995332 None] Volume 958d794e-b389-465f-bba5-3e5bd4a39925: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-958d794e-b389-465f-bba5-3e5bd4a39925', 'volume_size': 1} Sep 16 14:49:25 devstack cinder-volume[83259]: DEBUG oslo_concurrency.lockutils [None req-27f1b499-3e91-42ae-a2a9-732ada6c271d tempest-ServersNegativeTestJSON-540995332 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83259) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 16 14:49:25 devstack cinder-volume[83259]: DEBUG oslo_concurrency.lockutils [None req-27f1b499-3e91-42ae-a2a9-732ada6c271d tempest-ServersNegativeTestJSON-540995332 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.015s {{(pid=83259) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 16 14:49:25 devstack cinder-volume[83259]: DEBUG cinder.volume.drivers.quobyte [None req-27f1b499-3e91-42ae-a2a9-732ada6c271d tempest-ServersNegativeTestJSON-540995332 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-16T12:49:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-1087950749',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#Quobyte',id=958d794e-b389-465f-bba5-3e5bd4a39925,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='49cc4ad55cf44129b8365eab6ea4750d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-16T12:49:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-16T12:49:24Z,use_quota=True,user_id='fa866679b852442f9ed997c9c13eeedd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(485ead50-3df8-4d76-8d34-a4db136c980a),volume_type_id=485ead50-3df8-4d76-8d34-a4db136c980a)}" {{(pid=83259) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Sep 16 14:49:25 devstack cinder-volume[83259]: DEBUG cinder.volume.drivers.remotefs [None req-27f1b499-3e91-42ae-a2a9-732ada6c271d tempest-ServersNegativeTestJSON-540995332 None] Creating volume 958d794e-b389-465f-bba5-3e5bd4a39925 {{(pid=83259) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}} Sep 16 14:49:25 devstack cinder-volume[83259]: DEBUG oslo_concurrency.lockutils [None req-27f1b499-3e91-42ae-a2a9-732ada6c271d tempest-ServersNegativeTestJSON-540995332 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83259) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 16 14:49:25 devstack cinder-volume[83259]: DEBUG oslo_concurrency.lockutils [None req-27f1b499-3e91-42ae-a2a9-732ada6c271d tempest-ServersNegativeTestJSON-540995332 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83259) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 16 14:49:25 devstack cinder-volume[83259]: DEBUG cinder.volume.drivers.quobyte [None req-27f1b499-3e91-42ae-a2a9-732ada6c271d tempest-ServersNegativeTestJSON-540995332 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-61f585ac-f8e2-4d19-a890-7ebc2726cc72': None} {{(pid=83259) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:639}} Sep 16 14:49:25 devstack cinder-volume[83259]: DEBUG cinder.volume.drivers.quobyte [None req-27f1b499-3e91-42ae-a2a9-732ada6c271d tempest-ServersNegativeTestJSON-540995332 None] Available shares ['10.10.41.181/cinder-vol-61f585ac-f8e2-4d19-a890-7ebc2726cc72'] {{(pid=83259) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:669}} Sep 16 14:49:25 devstack cinder-volume[83259]: DEBUG oslo_concurrency.lockutils [None req-27f1b499-3e91-42ae-a2a9-732ada6c271d tempest-ServersNegativeTestJSON-540995332 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=83259) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 16 14:49:25 devstack cinder-volume[83259]: DEBUG cinder.volume.drivers.quobyte [None req-27f1b499-3e91-42ae-a2a9-732ada6c271d tempest-ServersNegativeTestJSON-540995332 None] Selected 10.10.41.181/cinder-vol-61f585ac-f8e2-4d19-a890-7ebc2726cc72 as target Quobyte volume. {{(pid=83259) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:690}} Sep 16 14:49:25 devstack cinder-volume[83259]: INFO cinder.volume.drivers.remotefs [None req-27f1b499-3e91-42ae-a2a9-732ada6c271d tempest-ServersNegativeTestJSON-540995332 None] casted to 10.10.41.181/cinder-vol-61f585ac-f8e2-4d19-a890-7ebc2726cc72 Sep 16 14:49:25 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [None req-27f1b499-3e91-42ae-a2a9-732ada6c271d tempest-ServersNegativeTestJSON-540995332 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c/volume-958d794e-b389-465f-bba5-3e5bd4a39925 1073741824 {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 14:49:25 devstack quobyte-client[83286]: The server volume:87712ffe-8a69-446d-9ed6-4430c7ee9792@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=87712ffe-8a69-446d-9ed6-4430c7ee9792, inode=10, name=volume-958d794e-b389-465f-bba5-3e5bd4a39925, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.206), requestorAccessMask=0 Sep 16 14:49:26 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [None req-27f1b499-3e91-42ae-a2a9-732ada6c271d tempest-ServersNegativeTestJSON-540995332 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c/volume-958d794e-b389-465f-bba5-3e5bd4a39925 1073741824" returned: 0 in 1.619s {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 14:49:26 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [None req-27f1b499-3e91-42ae-a2a9-732ada6c271d tempest-ServersNegativeTestJSON-540995332 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c/volume-958d794e-b389-465f-bba5-3e5bd4a39925 {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 14:49:27 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [None req-27f1b499-3e91-42ae-a2a9-732ada6c271d tempest-ServersNegativeTestJSON-540995332 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c/volume-958d794e-b389-465f-bba5-3e5bd4a39925" returned: 0 in 0.209s {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 14:49:27 devstack cinder-volume[83259]: DEBUG cinder.volume.drivers.quobyte [None req-27f1b499-3e91-42ae-a2a9-732ada6c271d tempest-ServersNegativeTestJSON-540995332 None] <== create_volume: return (1971ms) {'provider_location': '10.10.41.181/cinder-vol-61f585ac-f8e2-4d19-a890-7ebc2726cc72'} {{(pid=83259) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Sep 16 14:49:27 devstack cinder-volume[83259]: DEBUG oslo_concurrency.lockutils [None req-27f1b499-3e91-42ae-a2a9-732ada6c271d tempest-ServersNegativeTestJSON-540995332 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.005s {{(pid=83259) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 16 14:49:27 devstack cinder-volume[83259]: DEBUG cinder.volume.manager [None req-27f1b499-3e91-42ae-a2a9-732ada6c271d tempest-ServersNegativeTestJSON-540995332 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (24b802ba-9b1d-4ba9-9adf-1a2849f0a976) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-958d794e-b389-465f-bba5-3e5bd4a39925', 'volume_size': 1}' {{(pid=83259) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 14:49:27 devstack cinder-volume[83259]: DEBUG cinder.volume.manager [None req-27f1b499-3e91-42ae-a2a9-732ada6c271d tempest-ServersNegativeTestJSON-540995332 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2090ac03-5d1b-4d50-8c07-e77da64f90f6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83259) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 14:49:27 devstack cinder-volume[83259]: INFO cinder.volume.flows.manager.create_volume [None req-27f1b499-3e91-42ae-a2a9-732ada6c271d tempest-ServersNegativeTestJSON-540995332 None] Volume volume-958d794e-b389-465f-bba5-3e5bd4a39925 (958d794e-b389-465f-bba5-3e5bd4a39925): created successfully Sep 16 14:49:27 devstack cinder-volume[83259]: DEBUG cinder.volume.manager [None req-27f1b499-3e91-42ae-a2a9-732ada6c271d tempest-ServersNegativeTestJSON-540995332 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2090ac03-5d1b-4d50-8c07-e77da64f90f6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83259) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 14:49:27 devstack cinder-volume[83259]: DEBUG cinder.volume.manager [None req-27f1b499-3e91-42ae-a2a9-732ada6c271d tempest-ServersNegativeTestJSON-540995332 None] Flow 'volume_create_manager' (73c67f5a-9d93-4e39-a27c-a7ebd271eca1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83259) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 16 14:49:27 devstack cinder-volume[83259]: INFO cinder.volume.manager [None req-27f1b499-3e91-42ae-a2a9-732ada6c271d tempest-ServersNegativeTestJSON-540995332 None] Created volume successfully. Sep 16 14:49:30 devstack cinder-volume[83259]: WARNING cinder.volume.volume_utils [None req-019fe911-8419-4776-a0e7-7114655108f3 tempest-ServersNegativeTestJSON-540995332 None] Volume driver (QuobyteDriver 1.2) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 16 14:49:30 devstack cinder-volume[83259]: DEBUG cinder.volume.flows.manager.create_volume [None req-019fe911-8419-4776-a0e7-7114655108f3 tempest-ServersNegativeTestJSON-540995332 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#Quobyte'], 'hosts': ['devstack@QuobyteHD#Quobyte']} {{(pid=83259) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1387}} Sep 16 14:49:31 devstack cinder-volume[83259]: DEBUG cinder.volume.manager [None req-019fe911-8419-4776-a0e7-7114655108f3 tempest-ServersNegativeTestJSON-540995332 None] Flow 'volume_create_manager' (da2569f0-3fab-4754-86b0-e5184ea03c46) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83259) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 16 14:49:31 devstack cinder-volume[83259]: DEBUG cinder.volume.manager [None req-019fe911-8419-4776-a0e7-7114655108f3 tempest-ServersNegativeTestJSON-540995332 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9851b118-8be7-4179-9876-492bef638da6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83259) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 14:49:31 devstack cinder-volume[83259]: DEBUG cinder.volume.manager [None req-019fe911-8419-4776-a0e7-7114655108f3 tempest-ServersNegativeTestJSON-540995332 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9851b118-8be7-4179-9876-492bef638da6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-16T12:49:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-744103119',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#Quobyte',id=f0c8454b-420e-47bb-9a64-9d0744903975,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='49cc4ad55cf44129b8365eab6ea4750d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-16T12:49:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-16T12:49:30Z,use_quota=True,user_id='fa866679b852442f9ed997c9c13eeedd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(485ead50-3df8-4d76-8d34-a4db136c980a),volume_type_id=485ead50-3df8-4d76-8d34-a4db136c980a)' {{(pid=83259) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 14:49:31 devstack cinder-volume[83259]: DEBUG cinder.volume.manager [None req-019fe911-8419-4776-a0e7-7114655108f3 tempest-ServersNegativeTestJSON-540995332 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (66a93230-9e76-434d-a53a-c57bc8d3fcc9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83259) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 14:49:31 devstack cinder-volume[83259]: DEBUG cinder.volume.manager [None req-019fe911-8419-4776-a0e7-7114655108f3 tempest-ServersNegativeTestJSON-540995332 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (66a93230-9e76-434d-a53a-c57bc8d3fcc9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83259) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 14:49:31 devstack cinder-volume[83259]: DEBUG cinder.volume.manager [None req-019fe911-8419-4776-a0e7-7114655108f3 tempest-ServersNegativeTestJSON-540995332 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (eeed9a05-7f4d-4770-af3b-9180161cd90c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83259) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 14:49:31 devstack cinder-volume[83259]: DEBUG cinder.volume.manager [None req-019fe911-8419-4776-a0e7-7114655108f3 tempest-ServersNegativeTestJSON-540995332 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (eeed9a05-7f4d-4770-af3b-9180161cd90c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f0c8454b-420e-47bb-9a64-9d0744903975', 'volume_name': 'volume-f0c8454b-420e-47bb-9a64-9d0744903975', 'volume_size': 1}' {{(pid=83259) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 14:49:31 devstack cinder-volume[83259]: DEBUG cinder.volume.manager [None req-019fe911-8419-4776-a0e7-7114655108f3 tempest-ServersNegativeTestJSON-540995332 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c64a880e-ca68-4d79-9293-0c26bc0a76d7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83259) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 14:49:31 devstack cinder-volume[83259]: DEBUG cinder.volume.manager [None req-019fe911-8419-4776-a0e7-7114655108f3 tempest-ServersNegativeTestJSON-540995332 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c64a880e-ca68-4d79-9293-0c26bc0a76d7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83259) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 14:49:31 devstack cinder-volume[83259]: DEBUG cinder.volume.manager [None req-019fe911-8419-4776-a0e7-7114655108f3 tempest-ServersNegativeTestJSON-540995332 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (374b9cc2-f917-4c8b-8f44-cabbaf504489) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83259) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 14:49:31 devstack cinder-volume[83259]: INFO cinder.volume.flows.manager.create_volume [None req-019fe911-8419-4776-a0e7-7114655108f3 tempest-ServersNegativeTestJSON-540995332 None] Volume f0c8454b-420e-47bb-9a64-9d0744903975: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f0c8454b-420e-47bb-9a64-9d0744903975', 'volume_size': 1} Sep 16 14:49:31 devstack cinder-volume[83259]: DEBUG oslo_concurrency.lockutils [None req-019fe911-8419-4776-a0e7-7114655108f3 tempest-ServersNegativeTestJSON-540995332 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83259) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 16 14:49:31 devstack cinder-volume[83259]: DEBUG oslo_concurrency.lockutils [None req-019fe911-8419-4776-a0e7-7114655108f3 tempest-ServersNegativeTestJSON-540995332 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=83259) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 16 14:49:31 devstack cinder-volume[83259]: DEBUG cinder.volume.drivers.quobyte [None req-019fe911-8419-4776-a0e7-7114655108f3 tempest-ServersNegativeTestJSON-540995332 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-16T12:49:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-744103119',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#Quobyte',id=f0c8454b-420e-47bb-9a64-9d0744903975,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='49cc4ad55cf44129b8365eab6ea4750d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-16T12:49:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-16T12:49:30Z,use_quota=True,user_id='fa866679b852442f9ed997c9c13eeedd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(485ead50-3df8-4d76-8d34-a4db136c980a),volume_type_id=485ead50-3df8-4d76-8d34-a4db136c980a)}" {{(pid=83259) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Sep 16 14:49:31 devstack cinder-volume[83259]: DEBUG cinder.volume.drivers.remotefs [None req-019fe911-8419-4776-a0e7-7114655108f3 tempest-ServersNegativeTestJSON-540995332 None] Creating volume f0c8454b-420e-47bb-9a64-9d0744903975 {{(pid=83259) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}} Sep 16 14:49:31 devstack cinder-volume[83259]: DEBUG oslo_concurrency.lockutils [None req-019fe911-8419-4776-a0e7-7114655108f3 tempest-ServersNegativeTestJSON-540995332 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83259) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 16 14:49:31 devstack cinder-volume[83259]: DEBUG oslo_concurrency.lockutils [None req-019fe911-8419-4776-a0e7-7114655108f3 tempest-ServersNegativeTestJSON-540995332 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83259) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 16 14:49:31 devstack cinder-volume[83259]: DEBUG cinder.volume.drivers.quobyte [None req-019fe911-8419-4776-a0e7-7114655108f3 tempest-ServersNegativeTestJSON-540995332 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-61f585ac-f8e2-4d19-a890-7ebc2726cc72': None} {{(pid=83259) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:639}} Sep 16 14:49:31 devstack cinder-volume[83259]: DEBUG cinder.volume.drivers.quobyte [None req-019fe911-8419-4776-a0e7-7114655108f3 tempest-ServersNegativeTestJSON-540995332 None] Available shares ['10.10.41.181/cinder-vol-61f585ac-f8e2-4d19-a890-7ebc2726cc72'] {{(pid=83259) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:669}} Sep 16 14:49:31 devstack cinder-volume[83259]: DEBUG oslo_concurrency.lockutils [None req-019fe911-8419-4776-a0e7-7114655108f3 tempest-ServersNegativeTestJSON-540995332 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.041s {{(pid=83259) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 16 14:49:31 devstack cinder-volume[83259]: DEBUG cinder.volume.drivers.quobyte [None req-019fe911-8419-4776-a0e7-7114655108f3 tempest-ServersNegativeTestJSON-540995332 None] Selected 10.10.41.181/cinder-vol-61f585ac-f8e2-4d19-a890-7ebc2726cc72 as target Quobyte volume. {{(pid=83259) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:690}} Sep 16 14:49:31 devstack cinder-volume[83259]: INFO cinder.volume.drivers.remotefs [None req-019fe911-8419-4776-a0e7-7114655108f3 tempest-ServersNegativeTestJSON-540995332 None] casted to 10.10.41.181/cinder-vol-61f585ac-f8e2-4d19-a890-7ebc2726cc72 Sep 16 14:49:31 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [None req-019fe911-8419-4776-a0e7-7114655108f3 tempest-ServersNegativeTestJSON-540995332 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c/volume-f0c8454b-420e-47bb-9a64-9d0744903975 1073741824 {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 14:49:31 devstack quobyte-client[83286]: The server volume:87712ffe-8a69-446d-9ed6-4430c7ee9792@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=87712ffe-8a69-446d-9ed6-4430c7ee9792, inode=11, name=volume-f0c8454b-420e-47bb-9a64-9d0744903975, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.206), requestorAccessMask=0 Sep 16 14:49:32 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [None req-019fe911-8419-4776-a0e7-7114655108f3 tempest-ServersNegativeTestJSON-540995332 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c/volume-f0c8454b-420e-47bb-9a64-9d0744903975 1073741824" returned: 0 in 0.726s {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 14:49:32 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [None req-019fe911-8419-4776-a0e7-7114655108f3 tempest-ServersNegativeTestJSON-540995332 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c/volume-f0c8454b-420e-47bb-9a64-9d0744903975 {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 14:49:32 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [None req-019fe911-8419-4776-a0e7-7114655108f3 tempest-ServersNegativeTestJSON-540995332 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c/volume-f0c8454b-420e-47bb-9a64-9d0744903975" returned: 0 in 0.249s {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 14:49:32 devstack cinder-volume[83259]: DEBUG cinder.volume.drivers.quobyte [None req-019fe911-8419-4776-a0e7-7114655108f3 tempest-ServersNegativeTestJSON-540995332 None] <== create_volume: return (1106ms) {'provider_location': '10.10.41.181/cinder-vol-61f585ac-f8e2-4d19-a890-7ebc2726cc72'} {{(pid=83259) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Sep 16 14:49:32 devstack cinder-volume[83259]: DEBUG oslo_concurrency.lockutils [None req-019fe911-8419-4776-a0e7-7114655108f3 tempest-ServersNegativeTestJSON-540995332 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.139s {{(pid=83259) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 16 14:49:32 devstack cinder-volume[83259]: DEBUG cinder.volume.manager [None req-019fe911-8419-4776-a0e7-7114655108f3 tempest-ServersNegativeTestJSON-540995332 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (374b9cc2-f917-4c8b-8f44-cabbaf504489) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f0c8454b-420e-47bb-9a64-9d0744903975', 'volume_size': 1}' {{(pid=83259) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 14:49:32 devstack cinder-volume[83259]: DEBUG cinder.volume.manager [None req-019fe911-8419-4776-a0e7-7114655108f3 tempest-ServersNegativeTestJSON-540995332 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (57406b1e-854e-475b-9dbb-302ca2b0a134) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83259) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 14:49:32 devstack cinder-volume[83259]: INFO cinder.volume.flows.manager.create_volume [None req-019fe911-8419-4776-a0e7-7114655108f3 tempest-ServersNegativeTestJSON-540995332 None] Volume volume-f0c8454b-420e-47bb-9a64-9d0744903975 (f0c8454b-420e-47bb-9a64-9d0744903975): created successfully Sep 16 14:49:32 devstack cinder-volume[83259]: DEBUG cinder.volume.manager [None req-019fe911-8419-4776-a0e7-7114655108f3 tempest-ServersNegativeTestJSON-540995332 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (57406b1e-854e-475b-9dbb-302ca2b0a134) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83259) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 14:49:32 devstack cinder-volume[83259]: DEBUG cinder.volume.manager [None req-019fe911-8419-4776-a0e7-7114655108f3 tempest-ServersNegativeTestJSON-540995332 None] Flow 'volume_create_manager' (da2569f0-3fab-4754-86b0-e5184ea03c46) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83259) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 16 14:49:32 devstack cinder-volume[83259]: INFO cinder.volume.manager [None req-019fe911-8419-4776-a0e7-7114655108f3 tempest-ServersNegativeTestJSON-540995332 None] Created volume successfully. Sep 16 14:49:34 devstack cinder-volume[83259]: DEBUG cinder.coordination [None req-e7b9abe7-588c-406a-ab19-a554c949b750 tempest-ServersNegativeTestJSON-540995332 None] Acquiring lock "cinder-f0c8454b-420e-47bb-9a64-9d0744903975-delete_volume" by "delete_volume" {{(pid=83259) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 16 14:49:34 devstack cinder-volume[83259]: DEBUG cinder.coordination [None req-e7b9abe7-588c-406a-ab19-a554c949b750 tempest-ServersNegativeTestJSON-540995332 None] Lock "cinder-f0c8454b-420e-47bb-9a64-9d0744903975-delete_volume" acquired by "delete_volume" :: waited 0.073s {{(pid=83259) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 16 14:49:35 devstack cinder-volume[83259]: WARNING cinder.volume.volume_utils [None req-e7b9abe7-588c-406a-ab19-a554c949b750 tempest-ServersNegativeTestJSON-540995332 None] Volume driver (QuobyteDriver 1.2) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 16 14:49:35 devstack cinder-volume[83259]: DEBUG cinder.coordination [None req-e7b9abe7-588c-406a-ab19-a554c949b750 tempest-ServersNegativeTestJSON-540995332 None] Acquiring lock "cinder-quobyte-f0c8454b-420e-47bb-9a64-9d0744903975" by "delete_volume" {{(pid=83259) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 16 14:49:35 devstack cinder-volume[83259]: DEBUG cinder.coordination [None req-e7b9abe7-588c-406a-ab19-a554c949b750 tempest-ServersNegativeTestJSON-540995332 None] Lock "cinder-quobyte-f0c8454b-420e-47bb-9a64-9d0744903975" acquired by "delete_volume" :: waited 0.015s {{(pid=83259) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 16 14:49:35 devstack cinder-volume[83259]: DEBUG oslo.privsep.daemon [-] privsep: reply[3ff0e3a0-b2ac-4a82-90eb-1c71cf02356d]: (4, 'qcow2') {{(pid=84312) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 16 14:49:35 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [None req-e7b9abe7-588c-406a-ab19-a554c949b750 tempest-ServersNegativeTestJSON-540995332 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c/volume-f0c8454b-420e-47bb-9a64-9d0744903975 {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 14:49:35 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [None req-e7b9abe7-588c-406a-ab19-a554c949b750 tempest-ServersNegativeTestJSON-540995332 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c/volume-f0c8454b-420e-47bb-9a64-9d0744903975" returned: 0 in 0.726s {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 14:49:35 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [None req-e7b9abe7-588c-406a-ab19-a554c949b750 tempest-ServersNegativeTestJSON-540995332 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c/volume-f0c8454b-420e-47bb-9a64-9d0744903975 {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 14:49:36 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [None req-e7b9abe7-588c-406a-ab19-a554c949b750 tempest-ServersNegativeTestJSON-540995332 None] CMD "rm -f /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c/volume-f0c8454b-420e-47bb-9a64-9d0744903975" returned: 0 in 0.167s {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 14:49:36 devstack cinder-volume[83259]: DEBUG cinder.coordination [None req-e7b9abe7-588c-406a-ab19-a554c949b750 tempest-ServersNegativeTestJSON-540995332 None] Lock "cinder-quobyte-f0c8454b-420e-47bb-9a64-9d0744903975" released by "delete_volume" :: held 1.179s {{(pid=83259) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 16 14:49:36 devstack cinder-volume[83259]: DEBUG cinder.quota [None req-e7b9abe7-588c-406a-ab19-a554c949b750 tempest-ServersNegativeTestJSON-540995332 None] Created reservations ['4f868011-bfb4-4387-a321-fd84e3a4b88b', '1bf10a35-778b-44c2-bdf9-bcad3471ec44', 'e8678bad-e794-49c6-bf36-535bf25f2017', '0bdb359d-1219-4d86-86c3-1d69fb329366'] {{(pid=83259) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 16 14:49:36 devstack cinder-volume[83259]: DEBUG oslo_concurrency.lockutils [None req-e7b9abe7-588c-406a-ab19-a554c949b750 tempest-ServersNegativeTestJSON-540995332 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83259) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 16 14:49:36 devstack cinder-volume[83259]: DEBUG oslo_concurrency.lockutils [None req-e7b9abe7-588c-406a-ab19-a554c949b750 tempest-ServersNegativeTestJSON-540995332 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=83259) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 16 14:49:36 devstack cinder-volume[83259]: DEBUG cinder.volume.drivers.quobyte [None req-e7b9abe7-588c-406a-ab19-a554c949b750 tempest-ServersNegativeTestJSON-540995332 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-61f585ac-f8e2-4d19-a890-7ebc2726cc72': None} {{(pid=83259) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:639}} Sep 16 14:49:36 devstack cinder-volume[83259]: DEBUG cinder.volume.drivers.quobyte [None req-e7b9abe7-588c-406a-ab19-a554c949b750 tempest-ServersNegativeTestJSON-540995332 None] Available shares ['10.10.41.181/cinder-vol-61f585ac-f8e2-4d19-a890-7ebc2726cc72'] {{(pid=83259) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:669}} Sep 16 14:49:36 devstack cinder-volume[83259]: DEBUG oslo_concurrency.lockutils [None req-e7b9abe7-588c-406a-ab19-a554c949b750 tempest-ServersNegativeTestJSON-540995332 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=83259) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 16 14:49:36 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [None req-e7b9abe7-588c-406a-ab19-a554c949b750 tempest-ServersNegativeTestJSON-540995332 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 14:49:36 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [None req-e7b9abe7-588c-406a-ab19-a554c949b750 tempest-ServersNegativeTestJSON-540995332 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c" returned: 0 in 0.091s {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 14:49:36 devstack cinder-volume[83259]: DEBUG cinder.manager [None req-e7b9abe7-588c-406a-ab19-a554c949b750 tempest-ServersNegativeTestJSON-540995332 None] Notifying Schedulers of capabilities ... {{(pid=83259) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 16 14:49:36 devstack cinder-volume[83259]: INFO cinder.volume.manager [None req-e7b9abe7-588c-406a-ab19-a554c949b750 tempest-ServersNegativeTestJSON-540995332 None] Deleted volume successfully. Sep 16 14:49:37 devstack cinder-volume[83259]: DEBUG cinder.coordination [None req-e7b9abe7-588c-406a-ab19-a554c949b750 tempest-ServersNegativeTestJSON-540995332 None] Lock "cinder-f0c8454b-420e-47bb-9a64-9d0744903975-delete_volume" released by "delete_volume" :: held 2.156s {{(pid=83259) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 16 14:49:37 devstack cinder-volume[83259]: DEBUG cinder.coordination [None req-772c33e1-edd2-4924-9d47-740ba7e25e52 tempest-ServersNegativeTestJSON-540995332 None] Acquiring lock "cinder-958d794e-b389-465f-bba5-3e5bd4a39925-delete_volume" by "delete_volume" {{(pid=83259) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 16 14:49:37 devstack cinder-volume[83259]: DEBUG cinder.coordination [None req-772c33e1-edd2-4924-9d47-740ba7e25e52 tempest-ServersNegativeTestJSON-540995332 None] Lock "cinder-958d794e-b389-465f-bba5-3e5bd4a39925-delete_volume" acquired by "delete_volume" :: waited 0.083s {{(pid=83259) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 16 14:49:37 devstack cinder-volume[83259]: WARNING cinder.volume.volume_utils [None req-772c33e1-edd2-4924-9d47-740ba7e25e52 tempest-ServersNegativeTestJSON-540995332 None] Volume driver (QuobyteDriver 1.2) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 16 14:49:37 devstack cinder-volume[83259]: DEBUG cinder.coordination [None req-772c33e1-edd2-4924-9d47-740ba7e25e52 tempest-ServersNegativeTestJSON-540995332 None] Acquiring lock "cinder-quobyte-958d794e-b389-465f-bba5-3e5bd4a39925" by "delete_volume" {{(pid=83259) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 16 14:49:37 devstack cinder-volume[83259]: DEBUG cinder.coordination [None req-772c33e1-edd2-4924-9d47-740ba7e25e52 tempest-ServersNegativeTestJSON-540995332 None] Lock "cinder-quobyte-958d794e-b389-465f-bba5-3e5bd4a39925" acquired by "delete_volume" :: waited 0.020s {{(pid=83259) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 16 14:49:37 devstack cinder-volume[83259]: DEBUG oslo.privsep.daemon [-] privsep: reply[71ddfc33-bdb4-44d3-8c30-1d9096ff7c99]: (4, 'qcow2') {{(pid=84312) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 16 14:49:37 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [None req-772c33e1-edd2-4924-9d47-740ba7e25e52 tempest-ServersNegativeTestJSON-540995332 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c/volume-958d794e-b389-465f-bba5-3e5bd4a39925 {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 14:49:38 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [None req-772c33e1-edd2-4924-9d47-740ba7e25e52 tempest-ServersNegativeTestJSON-540995332 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c/volume-958d794e-b389-465f-bba5-3e5bd4a39925" returned: 0 in 0.527s {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 14:49:38 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [None req-772c33e1-edd2-4924-9d47-740ba7e25e52 tempest-ServersNegativeTestJSON-540995332 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c/volume-958d794e-b389-465f-bba5-3e5bd4a39925 {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 14:49:38 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [None req-772c33e1-edd2-4924-9d47-740ba7e25e52 tempest-ServersNegativeTestJSON-540995332 None] CMD "rm -f /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c/volume-958d794e-b389-465f-bba5-3e5bd4a39925" returned: 0 in 0.167s {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 14:49:38 devstack cinder-volume[83259]: DEBUG cinder.coordination [None req-772c33e1-edd2-4924-9d47-740ba7e25e52 tempest-ServersNegativeTestJSON-540995332 None] Lock "cinder-quobyte-958d794e-b389-465f-bba5-3e5bd4a39925" released by "delete_volume" :: held 0.935s {{(pid=83259) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 16 14:49:38 devstack cinder-volume[83259]: DEBUG cinder.quota [None req-772c33e1-edd2-4924-9d47-740ba7e25e52 tempest-ServersNegativeTestJSON-540995332 None] Created reservations ['179475a5-a820-42f9-a6b5-a653396c2324', '5e6e6076-ac36-4f2b-9701-1af5a71b6b1f', '26023a78-e7f5-4fae-9518-158203071a5e', '52a37471-b5d9-4148-9c23-61e570c03c82'] {{(pid=83259) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 16 14:49:39 devstack cinder-volume[83259]: DEBUG oslo_concurrency.lockutils [None req-772c33e1-edd2-4924-9d47-740ba7e25e52 tempest-ServersNegativeTestJSON-540995332 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83259) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 16 14:49:39 devstack cinder-volume[83259]: DEBUG oslo_concurrency.lockutils [None req-772c33e1-edd2-4924-9d47-740ba7e25e52 tempest-ServersNegativeTestJSON-540995332 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.006s {{(pid=83259) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 16 14:49:39 devstack cinder-volume[83259]: DEBUG cinder.volume.drivers.quobyte [None req-772c33e1-edd2-4924-9d47-740ba7e25e52 tempest-ServersNegativeTestJSON-540995332 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-61f585ac-f8e2-4d19-a890-7ebc2726cc72': None} {{(pid=83259) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:639}} Sep 16 14:49:39 devstack cinder-volume[83259]: DEBUG cinder.volume.drivers.quobyte [None req-772c33e1-edd2-4924-9d47-740ba7e25e52 tempest-ServersNegativeTestJSON-540995332 None] Available shares ['10.10.41.181/cinder-vol-61f585ac-f8e2-4d19-a890-7ebc2726cc72'] {{(pid=83259) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:669}} Sep 16 14:49:39 devstack cinder-volume[83259]: DEBUG oslo_concurrency.lockutils [None req-772c33e1-edd2-4924-9d47-740ba7e25e52 tempest-ServersNegativeTestJSON-540995332 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=83259) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 16 14:49:39 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [None req-772c33e1-edd2-4924-9d47-740ba7e25e52 tempest-ServersNegativeTestJSON-540995332 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 14:49:39 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [None req-772c33e1-edd2-4924-9d47-740ba7e25e52 tempest-ServersNegativeTestJSON-540995332 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c" returned: 0 in 0.143s {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 14:49:39 devstack cinder-volume[83259]: DEBUG cinder.manager [None req-772c33e1-edd2-4924-9d47-740ba7e25e52 tempest-ServersNegativeTestJSON-540995332 None] Notifying Schedulers of capabilities ... {{(pid=83259) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 16 14:49:39 devstack cinder-volume[83259]: INFO cinder.volume.manager [None req-772c33e1-edd2-4924-9d47-740ba7e25e52 tempest-ServersNegativeTestJSON-540995332 None] Deleted volume successfully. Sep 16 14:49:39 devstack cinder-volume[83259]: DEBUG cinder.coordination [None req-772c33e1-edd2-4924-9d47-740ba7e25e52 tempest-ServersNegativeTestJSON-540995332 None] Lock "cinder-958d794e-b389-465f-bba5-3e5bd4a39925-delete_volume" released by "delete_volume" :: held 2.211s {{(pid=83259) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 16 14:49:44 devstack cinder-volume[83259]: DEBUG oslo_service.periodic_task [None req-050ec8a1-6ffd-499d-95ad-d548a84437e2 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=83259) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} Sep 16 14:49:44 devstack cinder-volume[83259]: DEBUG oslo_concurrency.lockutils [None req-050ec8a1-6ffd-499d-95ad-d548a84437e2 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83259) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 16 14:49:44 devstack cinder-volume[83259]: DEBUG oslo_concurrency.lockutils [None req-050ec8a1-6ffd-499d-95ad-d548a84437e2 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=83259) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 16 14:49:44 devstack cinder-volume[83259]: DEBUG cinder.volume.drivers.quobyte [None req-050ec8a1-6ffd-499d-95ad-d548a84437e2 None None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-61f585ac-f8e2-4d19-a890-7ebc2726cc72': None} {{(pid=83259) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:639}} Sep 16 14:49:44 devstack cinder-volume[83259]: DEBUG cinder.volume.drivers.quobyte [None req-050ec8a1-6ffd-499d-95ad-d548a84437e2 None None] Available shares ['10.10.41.181/cinder-vol-61f585ac-f8e2-4d19-a890-7ebc2726cc72'] {{(pid=83259) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:669}} Sep 16 14:49:44 devstack cinder-volume[83259]: DEBUG oslo_concurrency.lockutils [None req-050ec8a1-6ffd-499d-95ad-d548a84437e2 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=83259) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 16 14:49:44 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [None req-050ec8a1-6ffd-499d-95ad-d548a84437e2 None None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 14:49:44 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [None req-050ec8a1-6ffd-499d-95ad-d548a84437e2 None None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c" returned: 0 in 0.094s {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 14:49:44 devstack cinder-volume[83259]: DEBUG cinder.manager [None req-050ec8a1-6ffd-499d-95ad-d548a84437e2 None None] Notifying Schedulers of capabilities ... {{(pid=83259) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 16 14:49:49 devstack cinder-volume[83259]: DEBUG dbcounter [-] [83259] Writing DB stats cinder:SELECT=17,cinder:UPDATE=17,cinder:DELETE=2,cinder:INSERT=4 {{(pid=83259) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Sep 16 14:49:49 devstack cinder-volume[83259]: DEBUG dbcounter [-] [83259] Writing DB stats cinder:SELECT=29,cinder:UPDATE=29,cinder:DELETE=2,cinder:INSERT=4 {{(pid=83259) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Sep 16 14:50:09 devstack cinder-volume[83259]: DEBUG dbcounter [-] [83259] Writing DB stats cinder:SELECT=1 {{(pid=83259) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Sep 16 14:50:09 devstack cinder-volume[83259]: DEBUG dbcounter [-] [83259] Writing DB stats cinder:UPDATE=1 {{(pid=83259) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Sep 16 14:50:33 devstack cinder-volume[83259]: DEBUG oslo_concurrency.lockutils [req-3802c1a7-3afb-4618-93a9-e1efc10c957f req-0c00b4ac-2286-4a9f-9b92-2e3a87bfb69c tempest-TaggedAttachmentsTest-24583051 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=83259) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 16 14:50:33 devstack cinder-volume[83259]: DEBUG oslo_concurrency.lockutils [req-3802c1a7-3afb-4618-93a9-e1efc10c957f req-0c00b4ac-2286-4a9f-9b92-2e3a87bfb69c tempest-TaggedAttachmentsTest-24583051 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.010s {{(pid=83259) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 16 14:50:33 devstack cinder-volume[83259]: DEBUG oslo.privsep.daemon [-] privsep: reply[484f636f-8a9e-4d60-b6a3-b1e5c1364a32]: (4, 'qcow2') {{(pid=84312) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 16 14:50:33 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [req-3802c1a7-3afb-4618-93a9-e1efc10c957f req-0c00b4ac-2286-4a9f-9b92-2e3a87bfb69c tempest-TaggedAttachmentsTest-24583051 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c/volume-c6bf97c0-cd26-424b-aa0e-5d6a38b78b4c {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 14:50:34 devstack quobyte-client[83286]: System call of process 87126 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 16 14:50:34 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [req-3802c1a7-3afb-4618-93a9-e1efc10c957f req-0c00b4ac-2286-4a9f-9b92-2e3a87bfb69c tempest-TaggedAttachmentsTest-24583051 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c/volume-c6bf97c0-cd26-424b-aa0e-5d6a38b78b4c" returned: 0 in 1.406s {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 14:50:34 devstack cinder-volume[83259]: DEBUG oslo_concurrency.lockutils [req-3802c1a7-3afb-4618-93a9-e1efc10c957f req-0c00b4ac-2286-4a9f-9b92-2e3a87bfb69c tempest-TaggedAttachmentsTest-24583051 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 1.493s {{(pid=83259) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 16 14:50:35 devstack cinder-volume[83259]: DEBUG cinder.volume.manager [req-3802c1a7-3afb-4618-93a9-e1efc10c957f req-0c00b4ac-2286-4a9f-9b92-2e3a87bfb69c tempest-TaggedAttachmentsTest-24583051 None] Connection info returned from driver {'export': '10.10.41.181/cinder-vol-61f585ac-f8e2-4d19-a890-7ebc2726cc72', 'name': 'volume-c6bf97c0-cd26-424b-aa0e-5d6a38b78b4c', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'a0a2f54e-d775-4081-9fcb-d9282377c966', 'enforce_multipath': True} {{(pid=83259) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4891}} Sep 16 14:50:35 devstack cinder-volume[83259]: WARNING cinder.volume.volume_utils [req-3802c1a7-3afb-4618-93a9-e1efc10c957f req-0c00b4ac-2286-4a9f-9b92-2e3a87bfb69c tempest-TaggedAttachmentsTest-24583051 None] Volume driver (QuobyteDriver 1.2) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 16 14:50:35 devstack cinder-volume[83259]: INFO cinder.volume.manager [req-3802c1a7-3afb-4618-93a9-e1efc10c957f req-0c00b4ac-2286-4a9f-9b92-2e3a87bfb69c tempest-TaggedAttachmentsTest-24583051 None] attachment_update completed successfully. Sep 16 14:50:44 devstack cinder-volume[83259]: DEBUG oslo_service.periodic_task [None req-050ec8a1-6ffd-499d-95ad-d548a84437e2 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=83259) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} Sep 16 14:50:44 devstack cinder-volume[83259]: DEBUG oslo_concurrency.lockutils [None req-050ec8a1-6ffd-499d-95ad-d548a84437e2 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83259) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 16 14:50:44 devstack cinder-volume[83259]: DEBUG oslo_concurrency.lockutils [None req-050ec8a1-6ffd-499d-95ad-d548a84437e2 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=83259) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 16 14:50:44 devstack cinder-volume[83259]: DEBUG cinder.volume.drivers.quobyte [None req-050ec8a1-6ffd-499d-95ad-d548a84437e2 None None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-61f585ac-f8e2-4d19-a890-7ebc2726cc72': None} {{(pid=83259) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:639}} Sep 16 14:50:44 devstack cinder-volume[83259]: DEBUG cinder.volume.drivers.quobyte [None req-050ec8a1-6ffd-499d-95ad-d548a84437e2 None None] Available shares ['10.10.41.181/cinder-vol-61f585ac-f8e2-4d19-a890-7ebc2726cc72'] {{(pid=83259) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:669}} Sep 16 14:50:44 devstack cinder-volume[83259]: DEBUG oslo_concurrency.lockutils [None req-050ec8a1-6ffd-499d-95ad-d548a84437e2 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=83259) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 16 14:50:44 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [None req-050ec8a1-6ffd-499d-95ad-d548a84437e2 None None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 14:50:44 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [None req-050ec8a1-6ffd-499d-95ad-d548a84437e2 None None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c" returned: 0 in 0.210s {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 14:50:44 devstack cinder-volume[83259]: DEBUG cinder.manager [None req-050ec8a1-6ffd-499d-95ad-d548a84437e2 None None] Notifying Schedulers of capabilities ... {{(pid=83259) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 16 14:50:45 devstack cinder-volume[83259]: DEBUG dbcounter [-] [83259] Writing DB stats cinder:SELECT=3 {{(pid=83259) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Sep 16 14:50:45 devstack cinder-volume[83259]: DEBUG dbcounter [-] [83259] Writing DB stats cinder:SELECT=8,cinder:UPDATE=3 {{(pid=83259) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Sep 16 14:51:08 devstack cinder-volume[83259]: WARNING cinder.volume.volume_utils [req-7bfa706f-53bd-41db-be13-bf2b04cbb061 req-803dfbab-d4c8-47c8-b4f6-42d4bbce0a6e tempest-TaggedAttachmentsTest-24583051 None] Volume driver (QuobyteDriver 1.2) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 16 14:51:09 devstack cinder-volume[83259]: WARNING cinder.volume.volume_utils [req-7bfa706f-53bd-41db-be13-bf2b04cbb061 req-803dfbab-d4c8-47c8-b4f6-42d4bbce0a6e tempest-TaggedAttachmentsTest-24583051 None] Volume driver (QuobyteDriver 1.2) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 16 14:51:09 devstack cinder-volume[83259]: INFO cinder.volume.manager [req-7bfa706f-53bd-41db-be13-bf2b04cbb061 req-803dfbab-d4c8-47c8-b4f6-42d4bbce0a6e tempest-TaggedAttachmentsTest-24583051 None] Terminate volume connection completed successfully. Sep 16 14:51:09 devstack cinder-volume[83259]: DEBUG cinder.volume.manager [req-7bfa706f-53bd-41db-be13-bf2b04cbb061 req-803dfbab-d4c8-47c8-b4f6-42d4bbce0a6e tempest-TaggedAttachmentsTest-24583051 None] Deleting attachment a0a2f54e-d775-4081-9fcb-d9282377c966. {{(pid=83259) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5022}} Sep 16 14:51:19 devstack cinder-volume[83259]: DEBUG dbcounter [-] [83259] Writing DB stats cinder:SELECT=1 {{(pid=83259) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Sep 16 14:51:19 devstack cinder-volume[83259]: DEBUG dbcounter [-] [83259] Writing DB stats cinder:SELECT=1 {{(pid=83259) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Sep 16 14:51:44 devstack cinder-volume[83259]: DEBUG oslo_service.periodic_task [None req-050ec8a1-6ffd-499d-95ad-d548a84437e2 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=83259) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} Sep 16 14:51:44 devstack cinder-volume[83259]: DEBUG oslo_concurrency.lockutils [None req-050ec8a1-6ffd-499d-95ad-d548a84437e2 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83259) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 16 14:51:44 devstack cinder-volume[83259]: DEBUG oslo_concurrency.lockutils [None req-050ec8a1-6ffd-499d-95ad-d548a84437e2 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.008s {{(pid=83259) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 16 14:51:44 devstack cinder-volume[83259]: DEBUG cinder.volume.drivers.quobyte [None req-050ec8a1-6ffd-499d-95ad-d548a84437e2 None None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-61f585ac-f8e2-4d19-a890-7ebc2726cc72': None} {{(pid=83259) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:639}} Sep 16 14:51:44 devstack cinder-volume[83259]: DEBUG cinder.volume.drivers.quobyte [None req-050ec8a1-6ffd-499d-95ad-d548a84437e2 None None] Available shares ['10.10.41.181/cinder-vol-61f585ac-f8e2-4d19-a890-7ebc2726cc72'] {{(pid=83259) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:669}} Sep 16 14:51:44 devstack cinder-volume[83259]: DEBUG oslo_concurrency.lockutils [None req-050ec8a1-6ffd-499d-95ad-d548a84437e2 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.034s {{(pid=83259) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 16 14:51:44 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [None req-050ec8a1-6ffd-499d-95ad-d548a84437e2 None None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 14:51:45 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [None req-050ec8a1-6ffd-499d-95ad-d548a84437e2 None None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c" returned: 0 in 0.392s {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 14:51:45 devstack cinder-volume[83259]: DEBUG cinder.manager [None req-050ec8a1-6ffd-499d-95ad-d548a84437e2 None None] Notifying Schedulers of capabilities ... {{(pid=83259) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 16 14:51:59 devstack cinder-volume[83259]: DEBUG cinder.coordination [None req-b5d58a26-c529-492d-b640-972dc90e24e7 tempest-TaggedAttachmentsTest-24583051 None] Acquiring lock "cinder-c6bf97c0-cd26-424b-aa0e-5d6a38b78b4c-delete_volume" by "delete_volume" {{(pid=83259) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 16 14:51:59 devstack cinder-volume[83259]: DEBUG cinder.coordination [None req-b5d58a26-c529-492d-b640-972dc90e24e7 tempest-TaggedAttachmentsTest-24583051 None] Lock "cinder-c6bf97c0-cd26-424b-aa0e-5d6a38b78b4c-delete_volume" acquired by "delete_volume" :: waited 0.806s {{(pid=83259) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 16 14:52:00 devstack cinder-volume[83259]: WARNING cinder.volume.volume_utils [None req-b5d58a26-c529-492d-b640-972dc90e24e7 tempest-TaggedAttachmentsTest-24583051 None] Volume driver (QuobyteDriver 1.2) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 16 14:52:00 devstack cinder-volume[83259]: DEBUG cinder.coordination [None req-b5d58a26-c529-492d-b640-972dc90e24e7 tempest-TaggedAttachmentsTest-24583051 None] Acquiring lock "cinder-quobyte-c6bf97c0-cd26-424b-aa0e-5d6a38b78b4c" by "delete_volume" {{(pid=83259) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 16 14:52:00 devstack cinder-volume[83259]: DEBUG cinder.coordination [None req-b5d58a26-c529-492d-b640-972dc90e24e7 tempest-TaggedAttachmentsTest-24583051 None] Lock "cinder-quobyte-c6bf97c0-cd26-424b-aa0e-5d6a38b78b4c" acquired by "delete_volume" :: waited 0.022s {{(pid=83259) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 16 14:52:00 devstack cinder-volume[83259]: DEBUG oslo.privsep.daemon [-] privsep: reply[aa95874f-488b-4ec8-b91e-7fe2573eeb34]: (4, 'qcow2') {{(pid=84312) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 16 14:52:00 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [None req-b5d58a26-c529-492d-b640-972dc90e24e7 tempest-TaggedAttachmentsTest-24583051 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c/volume-c6bf97c0-cd26-424b-aa0e-5d6a38b78b4c {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 14:52:01 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [None req-b5d58a26-c529-492d-b640-972dc90e24e7 tempest-TaggedAttachmentsTest-24583051 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c/volume-c6bf97c0-cd26-424b-aa0e-5d6a38b78b4c" returned: 0 in 1.326s {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 14:52:01 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [None req-b5d58a26-c529-492d-b640-972dc90e24e7 tempest-TaggedAttachmentsTest-24583051 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c/volume-c6bf97c0-cd26-424b-aa0e-5d6a38b78b4c {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 14:52:02 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [None req-b5d58a26-c529-492d-b640-972dc90e24e7 tempest-TaggedAttachmentsTest-24583051 None] CMD "rm -f /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c/volume-c6bf97c0-cd26-424b-aa0e-5d6a38b78b4c" returned: 0 in 0.303s {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 14:52:02 devstack cinder-volume[83259]: DEBUG cinder.coordination [None req-b5d58a26-c529-492d-b640-972dc90e24e7 tempest-TaggedAttachmentsTest-24583051 None] Lock "cinder-quobyte-c6bf97c0-cd26-424b-aa0e-5d6a38b78b4c" released by "delete_volume" :: held 2.018s {{(pid=83259) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 16 14:52:02 devstack cinder-volume[83259]: DEBUG cinder.quota [None req-b5d58a26-c529-492d-b640-972dc90e24e7 tempest-TaggedAttachmentsTest-24583051 None] Created reservations ['36ee2a88-8e2d-43e0-9af1-3233bfc67118', '7272b721-cbf2-4670-bc6b-f4d8272eeeb9', '4270e805-faf2-4e3b-9c7e-5a8a43237273', '5c424cca-537f-467e-968c-1ac4174cb7fd'] {{(pid=83259) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 16 14:52:03 devstack cinder-volume[83259]: DEBUG oslo_concurrency.lockutils [None req-b5d58a26-c529-492d-b640-972dc90e24e7 tempest-TaggedAttachmentsTest-24583051 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83259) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 16 14:52:03 devstack cinder-volume[83259]: DEBUG oslo_concurrency.lockutils [None req-b5d58a26-c529-492d-b640-972dc90e24e7 tempest-TaggedAttachmentsTest-24583051 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=83259) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 16 14:52:03 devstack cinder-volume[83259]: DEBUG cinder.volume.drivers.quobyte [None req-b5d58a26-c529-492d-b640-972dc90e24e7 tempest-TaggedAttachmentsTest-24583051 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-61f585ac-f8e2-4d19-a890-7ebc2726cc72': None} {{(pid=83259) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:639}} Sep 16 14:52:03 devstack cinder-volume[83259]: DEBUG cinder.volume.drivers.quobyte [None req-b5d58a26-c529-492d-b640-972dc90e24e7 tempest-TaggedAttachmentsTest-24583051 None] Available shares ['10.10.41.181/cinder-vol-61f585ac-f8e2-4d19-a890-7ebc2726cc72'] {{(pid=83259) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:669}} Sep 16 14:52:03 devstack cinder-volume[83259]: DEBUG oslo_concurrency.lockutils [None req-b5d58a26-c529-492d-b640-972dc90e24e7 tempest-TaggedAttachmentsTest-24583051 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=83259) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 16 14:52:03 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [None req-b5d58a26-c529-492d-b640-972dc90e24e7 tempest-TaggedAttachmentsTest-24583051 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 14:52:03 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [None req-b5d58a26-c529-492d-b640-972dc90e24e7 tempest-TaggedAttachmentsTest-24583051 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c" returned: 0 in 0.160s {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 14:52:03 devstack cinder-volume[83259]: DEBUG cinder.manager [None req-b5d58a26-c529-492d-b640-972dc90e24e7 tempest-TaggedAttachmentsTest-24583051 None] Notifying Schedulers of capabilities ... {{(pid=83259) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 16 14:52:03 devstack cinder-volume[83259]: INFO cinder.volume.manager [None req-b5d58a26-c529-492d-b640-972dc90e24e7 tempest-TaggedAttachmentsTest-24583051 None] Deleted volume successfully. Sep 16 14:52:04 devstack cinder-volume[83259]: DEBUG cinder.coordination [None req-b5d58a26-c529-492d-b640-972dc90e24e7 tempest-TaggedAttachmentsTest-24583051 None] Lock "cinder-c6bf97c0-cd26-424b-aa0e-5d6a38b78b4c-delete_volume" released by "delete_volume" :: held 4.379s {{(pid=83259) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 16 14:52:13 devstack cinder-volume[83259]: DEBUG dbcounter [-] [83259] Writing DB stats cinder:UPDATE=10,cinder:SELECT=4 {{(pid=83259) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Sep 16 14:52:14 devstack cinder-volume[83259]: DEBUG dbcounter [-] [83259] Writing DB stats cinder:SELECT=7,cinder:UPDATE=7,cinder:INSERT=4,cinder:DELETE=1 {{(pid=83259) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Sep 16 14:52:17 devstack cinder-volume[83259]: WARNING cinder.volume.volume_utils [req-7b63f93a-6e48-4827-be56-8e62e872bc19 req-46ba2aad-1d67-4c85-85a9-900e12f4ed92 tempest-TaggedBootDevicesTest-180213475 None] Volume driver (QuobyteDriver 1.2) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 16 14:52:17 devstack cinder-volume[83259]: WARNING cinder.volume.volume_utils [req-7b63f93a-6e48-4827-be56-8e62e872bc19 req-46ba2aad-1d67-4c85-85a9-900e12f4ed92 tempest-TaggedBootDevicesTest-180213475 None] Volume driver (QuobyteDriver 1.2) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 16 14:52:17 devstack cinder-volume[83259]: INFO cinder.volume.manager [req-7b63f93a-6e48-4827-be56-8e62e872bc19 req-46ba2aad-1d67-4c85-85a9-900e12f4ed92 tempest-TaggedBootDevicesTest-180213475 None] Terminate volume connection completed successfully. Sep 16 14:52:17 devstack cinder-volume[83259]: DEBUG cinder.volume.manager [req-7b63f93a-6e48-4827-be56-8e62e872bc19 req-46ba2aad-1d67-4c85-85a9-900e12f4ed92 tempest-TaggedBootDevicesTest-180213475 None] Deleting attachment ef93ce29-e159-491f-83e7-765dfe13ab38. {{(pid=83259) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5022}} Sep 16 14:52:18 devstack cinder-volume[83259]: WARNING cinder.volume.volume_utils [req-7b63f93a-6e48-4827-be56-8e62e872bc19 req-352cf7d3-7fc2-4d76-9b6a-c879f607f5d6 tempest-TaggedBootDevicesTest-180213475 None] Volume driver (QuobyteDriver 1.2) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 16 14:52:18 devstack cinder-volume[83259]: WARNING cinder.volume.volume_utils [req-7b63f93a-6e48-4827-be56-8e62e872bc19 req-352cf7d3-7fc2-4d76-9b6a-c879f607f5d6 tempest-TaggedBootDevicesTest-180213475 None] Volume driver (QuobyteDriver 1.2) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 16 14:52:18 devstack cinder-volume[83259]: INFO cinder.volume.manager [req-7b63f93a-6e48-4827-be56-8e62e872bc19 req-352cf7d3-7fc2-4d76-9b6a-c879f607f5d6 tempest-TaggedBootDevicesTest-180213475 None] Terminate volume connection completed successfully. Sep 16 14:52:18 devstack cinder-volume[83259]: DEBUG cinder.volume.manager [req-7b63f93a-6e48-4827-be56-8e62e872bc19 req-352cf7d3-7fc2-4d76-9b6a-c879f607f5d6 tempest-TaggedBootDevicesTest-180213475 None] Deleting attachment a0a5a5c6-dd78-4880-9591-45002cdce802. {{(pid=83259) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5022}} Sep 16 14:52:18 devstack cinder-volume[83259]: WARNING cinder.volume.volume_utils [req-7b63f93a-6e48-4827-be56-8e62e872bc19 req-89d90090-296a-4858-8354-b5b6cfb38d49 tempest-TaggedBootDevicesTest-180213475 None] Volume driver (QuobyteDriver 1.2) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 16 14:52:18 devstack cinder-volume[83259]: WARNING cinder.volume.volume_utils [req-7b63f93a-6e48-4827-be56-8e62e872bc19 req-89d90090-296a-4858-8354-b5b6cfb38d49 tempest-TaggedBootDevicesTest-180213475 None] Volume driver (QuobyteDriver 1.2) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 16 14:52:18 devstack cinder-volume[83259]: INFO cinder.volume.manager [req-7b63f93a-6e48-4827-be56-8e62e872bc19 req-89d90090-296a-4858-8354-b5b6cfb38d49 tempest-TaggedBootDevicesTest-180213475 None] Terminate volume connection completed successfully. Sep 16 14:52:18 devstack cinder-volume[83259]: DEBUG cinder.volume.manager [req-7b63f93a-6e48-4827-be56-8e62e872bc19 req-89d90090-296a-4858-8354-b5b6cfb38d49 tempest-TaggedBootDevicesTest-180213475 None] Deleting attachment 8c84cf10-8bfb-4332-8250-7bea04bba878. {{(pid=83259) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5022}} Sep 16 14:52:24 devstack cinder-volume[83259]: WARNING cinder.volume.volume_utils [None req-0845bfab-72a0-470b-a305-b99e543992ac tempest-AttachVolumeTestJSON-915876093 None] Volume driver (QuobyteDriver 1.2) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 16 14:52:24 devstack cinder-volume[83259]: DEBUG cinder.volume.flows.manager.create_volume [None req-0845bfab-72a0-470b-a305-b99e543992ac tempest-AttachVolumeTestJSON-915876093 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#Quobyte'], 'hosts': ['devstack@QuobyteHD#Quobyte']} {{(pid=83259) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1387}} Sep 16 14:52:24 devstack cinder-volume[83259]: DEBUG cinder.volume.manager [None req-0845bfab-72a0-470b-a305-b99e543992ac tempest-AttachVolumeTestJSON-915876093 None] Flow 'volume_create_manager' (a520cddd-1972-4094-b93e-0dbabceedb08) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83259) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 16 14:52:24 devstack cinder-volume[83259]: DEBUG cinder.volume.manager [None req-0845bfab-72a0-470b-a305-b99e543992ac tempest-AttachVolumeTestJSON-915876093 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (df115a89-b075-4d86-972d-f0f26810c510) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83259) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 14:52:24 devstack cinder-volume[83259]: DEBUG cinder.volume.manager [None req-0845bfab-72a0-470b-a305-b99e543992ac tempest-AttachVolumeTestJSON-915876093 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (df115a89-b075-4d86-972d-f0f26810c510) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-16T12:52:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-1272066644',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#Quobyte',id=4b70d60a-fac5-44f1-a436-23faf8c9767c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='331242ac1f7b4849a722a7ac3f427737',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-16T12:52:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-16T12:52:24Z,use_quota=True,user_id='b8432da90b8b4bd288e28699b0a73a24',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(485ead50-3df8-4d76-8d34-a4db136c980a),volume_type_id=485ead50-3df8-4d76-8d34-a4db136c980a)' {{(pid=83259) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 14:52:24 devstack cinder-volume[83259]: DEBUG cinder.volume.manager [None req-0845bfab-72a0-470b-a305-b99e543992ac tempest-AttachVolumeTestJSON-915876093 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b48ba9af-b20e-496e-9561-c982c36b93cb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83259) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 14:52:24 devstack cinder-volume[83259]: DEBUG cinder.volume.manager [None req-0845bfab-72a0-470b-a305-b99e543992ac tempest-AttachVolumeTestJSON-915876093 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b48ba9af-b20e-496e-9561-c982c36b93cb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83259) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 14:52:24 devstack cinder-volume[83259]: DEBUG cinder.volume.manager [None req-0845bfab-72a0-470b-a305-b99e543992ac tempest-AttachVolumeTestJSON-915876093 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (efb746a6-7983-4839-b9ca-69d0d3ca0528) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83259) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 14:52:24 devstack cinder-volume[83259]: DEBUG cinder.volume.manager [None req-0845bfab-72a0-470b-a305-b99e543992ac tempest-AttachVolumeTestJSON-915876093 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (efb746a6-7983-4839-b9ca-69d0d3ca0528) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4b70d60a-fac5-44f1-a436-23faf8c9767c', 'volume_name': 'volume-4b70d60a-fac5-44f1-a436-23faf8c9767c', 'volume_size': 1}' {{(pid=83259) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 14:52:24 devstack cinder-volume[83259]: DEBUG cinder.volume.manager [None req-0845bfab-72a0-470b-a305-b99e543992ac tempest-AttachVolumeTestJSON-915876093 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bce24b7f-8dfe-4ce3-a1e9-8e314e7b9fce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83259) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 14:52:24 devstack cinder-volume[83259]: DEBUG cinder.volume.manager [None req-0845bfab-72a0-470b-a305-b99e543992ac tempest-AttachVolumeTestJSON-915876093 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bce24b7f-8dfe-4ce3-a1e9-8e314e7b9fce) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83259) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 14:52:24 devstack cinder-volume[83259]: DEBUG cinder.volume.manager [None req-0845bfab-72a0-470b-a305-b99e543992ac tempest-AttachVolumeTestJSON-915876093 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3362d338-357c-4993-ab74-23bd88074e90) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83259) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 14:52:24 devstack cinder-volume[83259]: INFO cinder.volume.flows.manager.create_volume [None req-0845bfab-72a0-470b-a305-b99e543992ac tempest-AttachVolumeTestJSON-915876093 None] Volume 4b70d60a-fac5-44f1-a436-23faf8c9767c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4b70d60a-fac5-44f1-a436-23faf8c9767c', 'volume_size': 1} Sep 16 14:52:24 devstack cinder-volume[83259]: DEBUG oslo_concurrency.lockutils [None req-0845bfab-72a0-470b-a305-b99e543992ac tempest-AttachVolumeTestJSON-915876093 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83259) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 16 14:52:24 devstack cinder-volume[83259]: DEBUG oslo_concurrency.lockutils [None req-0845bfab-72a0-470b-a305-b99e543992ac tempest-AttachVolumeTestJSON-915876093 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=83259) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 16 14:52:24 devstack cinder-volume[83259]: DEBUG cinder.volume.drivers.quobyte [None req-0845bfab-72a0-470b-a305-b99e543992ac tempest-AttachVolumeTestJSON-915876093 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-16T12:52:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-1272066644',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#Quobyte',id=4b70d60a-fac5-44f1-a436-23faf8c9767c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='331242ac1f7b4849a722a7ac3f427737',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-16T12:52:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-16T12:52:24Z,use_quota=True,user_id='b8432da90b8b4bd288e28699b0a73a24',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(485ead50-3df8-4d76-8d34-a4db136c980a),volume_type_id=485ead50-3df8-4d76-8d34-a4db136c980a)}" {{(pid=83259) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Sep 16 14:52:24 devstack cinder-volume[83259]: DEBUG cinder.volume.drivers.remotefs [None req-0845bfab-72a0-470b-a305-b99e543992ac tempest-AttachVolumeTestJSON-915876093 None] Creating volume 4b70d60a-fac5-44f1-a436-23faf8c9767c {{(pid=83259) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}} Sep 16 14:52:24 devstack cinder-volume[83259]: DEBUG oslo_concurrency.lockutils [None req-0845bfab-72a0-470b-a305-b99e543992ac tempest-AttachVolumeTestJSON-915876093 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83259) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 16 14:52:24 devstack cinder-volume[83259]: DEBUG oslo_concurrency.lockutils [None req-0845bfab-72a0-470b-a305-b99e543992ac tempest-AttachVolumeTestJSON-915876093 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83259) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 16 14:52:24 devstack cinder-volume[83259]: DEBUG cinder.volume.drivers.quobyte [None req-0845bfab-72a0-470b-a305-b99e543992ac tempest-AttachVolumeTestJSON-915876093 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-61f585ac-f8e2-4d19-a890-7ebc2726cc72': None} {{(pid=83259) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:639}} Sep 16 14:52:24 devstack cinder-volume[83259]: DEBUG cinder.volume.drivers.quobyte [None req-0845bfab-72a0-470b-a305-b99e543992ac tempest-AttachVolumeTestJSON-915876093 None] Available shares ['10.10.41.181/cinder-vol-61f585ac-f8e2-4d19-a890-7ebc2726cc72'] {{(pid=83259) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:669}} Sep 16 14:52:24 devstack cinder-volume[83259]: DEBUG oslo_concurrency.lockutils [None req-0845bfab-72a0-470b-a305-b99e543992ac tempest-AttachVolumeTestJSON-915876093 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=83259) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 16 14:52:24 devstack cinder-volume[83259]: DEBUG cinder.volume.drivers.quobyte [None req-0845bfab-72a0-470b-a305-b99e543992ac tempest-AttachVolumeTestJSON-915876093 None] Selected 10.10.41.181/cinder-vol-61f585ac-f8e2-4d19-a890-7ebc2726cc72 as target Quobyte volume. {{(pid=83259) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:690}} Sep 16 14:52:24 devstack cinder-volume[83259]: INFO cinder.volume.drivers.remotefs [None req-0845bfab-72a0-470b-a305-b99e543992ac tempest-AttachVolumeTestJSON-915876093 None] casted to 10.10.41.181/cinder-vol-61f585ac-f8e2-4d19-a890-7ebc2726cc72 Sep 16 14:52:24 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [None req-0845bfab-72a0-470b-a305-b99e543992ac tempest-AttachVolumeTestJSON-915876093 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c/volume-4b70d60a-fac5-44f1-a436-23faf8c9767c 1073741824 {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 14:52:25 devstack quobyte-client[83286]: System call of process 87917 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 16 14:52:25 devstack quobyte-client[83286]: The server volume:87712ffe-8a69-446d-9ed6-4430c7ee9792@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=87712ffe-8a69-446d-9ed6-4430c7ee9792, inode=12, name=volume-4b70d60a-fac5-44f1-a436-23faf8c9767c, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.206), requestorAccessMask=0 Sep 16 14:52:25 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [None req-0845bfab-72a0-470b-a305-b99e543992ac tempest-AttachVolumeTestJSON-915876093 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c/volume-4b70d60a-fac5-44f1-a436-23faf8c9767c 1073741824" returned: 0 in 0.676s {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 14:52:25 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [None req-0845bfab-72a0-470b-a305-b99e543992ac tempest-AttachVolumeTestJSON-915876093 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c/volume-4b70d60a-fac5-44f1-a436-23faf8c9767c {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 14:52:25 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [None req-0845bfab-72a0-470b-a305-b99e543992ac tempest-AttachVolumeTestJSON-915876093 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c/volume-4b70d60a-fac5-44f1-a436-23faf8c9767c" returned: 0 in 0.201s {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 14:52:25 devstack cinder-volume[83259]: DEBUG cinder.volume.drivers.quobyte [None req-0845bfab-72a0-470b-a305-b99e543992ac tempest-AttachVolumeTestJSON-915876093 None] <== create_volume: return (996ms) {'provider_location': '10.10.41.181/cinder-vol-61f585ac-f8e2-4d19-a890-7ebc2726cc72'} {{(pid=83259) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Sep 16 14:52:25 devstack cinder-volume[83259]: DEBUG oslo_concurrency.lockutils [None req-0845bfab-72a0-470b-a305-b99e543992ac tempest-AttachVolumeTestJSON-915876093 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.016s {{(pid=83259) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 16 14:52:26 devstack cinder-volume[83259]: DEBUG cinder.volume.manager [None req-0845bfab-72a0-470b-a305-b99e543992ac tempest-AttachVolumeTestJSON-915876093 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3362d338-357c-4993-ab74-23bd88074e90) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4b70d60a-fac5-44f1-a436-23faf8c9767c', 'volume_size': 1}' {{(pid=83259) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 14:52:26 devstack cinder-volume[83259]: DEBUG cinder.volume.manager [None req-0845bfab-72a0-470b-a305-b99e543992ac tempest-AttachVolumeTestJSON-915876093 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4d2d1230-f4cf-46f9-80a3-17482a108ad2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83259) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 14:52:26 devstack cinder-volume[83259]: INFO cinder.volume.flows.manager.create_volume [None req-0845bfab-72a0-470b-a305-b99e543992ac tempest-AttachVolumeTestJSON-915876093 None] Volume volume-4b70d60a-fac5-44f1-a436-23faf8c9767c (4b70d60a-fac5-44f1-a436-23faf8c9767c): created successfully Sep 16 14:52:26 devstack cinder-volume[83259]: DEBUG cinder.volume.manager [None req-0845bfab-72a0-470b-a305-b99e543992ac tempest-AttachVolumeTestJSON-915876093 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4d2d1230-f4cf-46f9-80a3-17482a108ad2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83259) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 14:52:26 devstack cinder-volume[83259]: DEBUG cinder.volume.manager [None req-0845bfab-72a0-470b-a305-b99e543992ac tempest-AttachVolumeTestJSON-915876093 None] Flow 'volume_create_manager' (a520cddd-1972-4094-b93e-0dbabceedb08) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83259) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 16 14:52:26 devstack cinder-volume[83259]: INFO cinder.volume.manager [None req-0845bfab-72a0-470b-a305-b99e543992ac tempest-AttachVolumeTestJSON-915876093 None] Created volume successfully. Sep 16 14:52:31 devstack cinder-volume[83259]: DEBUG cinder.coordination [None req-1b97c22c-1938-4aca-893e-c7cd7532a4cb tempest-TaggedBootDevicesTest-180213475 None] Acquiring lock "cinder-fa446bc6-198a-4e3d-a763-3f3f738af519-delete_volume" by "delete_volume" {{(pid=83259) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 16 14:52:31 devstack cinder-volume[83259]: DEBUG cinder.coordination [None req-1b97c22c-1938-4aca-893e-c7cd7532a4cb tempest-TaggedBootDevicesTest-180213475 None] Lock "cinder-fa446bc6-198a-4e3d-a763-3f3f738af519-delete_volume" acquired by "delete_volume" :: waited 0.051s {{(pid=83259) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 16 14:52:31 devstack cinder-volume[83259]: WARNING cinder.volume.volume_utils [None req-1b97c22c-1938-4aca-893e-c7cd7532a4cb tempest-TaggedBootDevicesTest-180213475 None] Volume driver (QuobyteDriver 1.2) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 16 14:52:31 devstack cinder-volume[83259]: DEBUG cinder.coordination [None req-1b97c22c-1938-4aca-893e-c7cd7532a4cb tempest-TaggedBootDevicesTest-180213475 None] Acquiring lock "cinder-quobyte-fa446bc6-198a-4e3d-a763-3f3f738af519" by "delete_volume" {{(pid=83259) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 16 14:52:31 devstack cinder-volume[83259]: DEBUG cinder.coordination [None req-1b97c22c-1938-4aca-893e-c7cd7532a4cb tempest-TaggedBootDevicesTest-180213475 None] Lock "cinder-quobyte-fa446bc6-198a-4e3d-a763-3f3f738af519" acquired by "delete_volume" :: waited 0.019s {{(pid=83259) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 16 14:52:31 devstack cinder-volume[83259]: DEBUG oslo.privsep.daemon [-] privsep: reply[2a79a7cf-4391-4235-9a3e-9f7bfa655fdb]: (4, 'qcow2') {{(pid=84312) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 16 14:52:31 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [None req-1b97c22c-1938-4aca-893e-c7cd7532a4cb tempest-TaggedBootDevicesTest-180213475 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c/volume-fa446bc6-198a-4e3d-a763-3f3f738af519 {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 14:52:31 devstack cinder-volume[83259]: DEBUG oslo_concurrency.lockutils [req-2e9a1542-8e9f-4815-8e91-5e9cfe5a8c3e req-e3c5dc44-249f-4164-9953-4a7db52bbd9f tempest-AttachVolumeTestJSON-915876093 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=83259) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 16 14:52:31 devstack cinder-volume[83259]: DEBUG oslo_concurrency.lockutils [req-2e9a1542-8e9f-4815-8e91-5e9cfe5a8c3e req-e3c5dc44-249f-4164-9953-4a7db52bbd9f tempest-AttachVolumeTestJSON-915876093 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.021s {{(pid=83259) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 16 14:52:31 devstack cinder-volume[83259]: DEBUG oslo.privsep.daemon [-] privsep: reply[e56f681a-2a40-43cf-96d8-04a629b38649]: (4, 'qcow2') {{(pid=84312) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 16 14:52:31 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [req-2e9a1542-8e9f-4815-8e91-5e9cfe5a8c3e req-e3c5dc44-249f-4164-9953-4a7db52bbd9f tempest-AttachVolumeTestJSON-915876093 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c/volume-4b70d60a-fac5-44f1-a436-23faf8c9767c {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 14:52:32 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [None req-1b97c22c-1938-4aca-893e-c7cd7532a4cb tempest-TaggedBootDevicesTest-180213475 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c/volume-fa446bc6-198a-4e3d-a763-3f3f738af519" returned: 0 in 0.732s {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 14:52:32 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [None req-1b97c22c-1938-4aca-893e-c7cd7532a4cb tempest-TaggedBootDevicesTest-180213475 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c/volume-fa446bc6-198a-4e3d-a763-3f3f738af519 {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 14:52:32 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [None req-1b97c22c-1938-4aca-893e-c7cd7532a4cb tempest-TaggedBootDevicesTest-180213475 None] CMD "rm -f /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c/volume-fa446bc6-198a-4e3d-a763-3f3f738af519" returned: 0 in 0.141s {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 14:52:32 devstack cinder-volume[83259]: DEBUG cinder.coordination [None req-1b97c22c-1938-4aca-893e-c7cd7532a4cb tempest-TaggedBootDevicesTest-180213475 None] Lock "cinder-quobyte-fa446bc6-198a-4e3d-a763-3f3f738af519" released by "delete_volume" :: held 1.130s {{(pid=83259) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 16 14:52:32 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [req-2e9a1542-8e9f-4815-8e91-5e9cfe5a8c3e req-e3c5dc44-249f-4164-9953-4a7db52bbd9f tempest-AttachVolumeTestJSON-915876093 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c/volume-4b70d60a-fac5-44f1-a436-23faf8c9767c" returned: 0 in 0.885s {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 14:52:32 devstack cinder-volume[83259]: DEBUG oslo_concurrency.lockutils [req-2e9a1542-8e9f-4815-8e91-5e9cfe5a8c3e req-e3c5dc44-249f-4164-9953-4a7db52bbd9f tempest-AttachVolumeTestJSON-915876093 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.935s {{(pid=83259) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 16 14:52:32 devstack cinder-volume[83259]: DEBUG cinder.volume.manager [req-2e9a1542-8e9f-4815-8e91-5e9cfe5a8c3e req-e3c5dc44-249f-4164-9953-4a7db52bbd9f tempest-AttachVolumeTestJSON-915876093 None] Connection info returned from driver {'export': '10.10.41.181/cinder-vol-61f585ac-f8e2-4d19-a890-7ebc2726cc72', 'name': 'volume-4b70d60a-fac5-44f1-a436-23faf8c9767c', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'cf7b1b73-23cc-41ee-a96c-fbba3faffbeb', 'enforce_multipath': True} {{(pid=83259) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4891}} Sep 16 14:52:32 devstack cinder-volume[83259]: WARNING cinder.volume.volume_utils [req-2e9a1542-8e9f-4815-8e91-5e9cfe5a8c3e req-e3c5dc44-249f-4164-9953-4a7db52bbd9f tempest-AttachVolumeTestJSON-915876093 None] Volume driver (QuobyteDriver 1.2) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 16 14:52:32 devstack cinder-volume[83259]: DEBUG cinder.quota [None req-1b97c22c-1938-4aca-893e-c7cd7532a4cb tempest-TaggedBootDevicesTest-180213475 None] Created reservations ['4ba8ba83-3618-441c-90c5-9855ef2169a4', 'c1a3a9bb-a0d3-4d72-a09b-4218b60d2694', 'c4e5f25a-b6fc-4ee9-923f-2a00b20f8792', 'e711dfb4-1eec-4c62-930f-996b74ed6d90'] {{(pid=83259) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 16 14:52:32 devstack cinder-volume[83259]: INFO cinder.volume.manager [req-2e9a1542-8e9f-4815-8e91-5e9cfe5a8c3e req-e3c5dc44-249f-4164-9953-4a7db52bbd9f tempest-AttachVolumeTestJSON-915876093 None] attachment_update completed successfully. Sep 16 14:52:32 devstack cinder-volume[83259]: DEBUG oslo_concurrency.lockutils [None req-1b97c22c-1938-4aca-893e-c7cd7532a4cb tempest-TaggedBootDevicesTest-180213475 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83259) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 16 14:52:32 devstack cinder-volume[83259]: DEBUG oslo_concurrency.lockutils [None req-1b97c22c-1938-4aca-893e-c7cd7532a4cb tempest-TaggedBootDevicesTest-180213475 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=83259) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 16 14:52:32 devstack cinder-volume[83259]: DEBUG cinder.volume.drivers.quobyte [None req-1b97c22c-1938-4aca-893e-c7cd7532a4cb tempest-TaggedBootDevicesTest-180213475 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-61f585ac-f8e2-4d19-a890-7ebc2726cc72': None} {{(pid=83259) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:639}} Sep 16 14:52:32 devstack cinder-volume[83259]: DEBUG cinder.volume.drivers.quobyte [None req-1b97c22c-1938-4aca-893e-c7cd7532a4cb tempest-TaggedBootDevicesTest-180213475 None] Available shares ['10.10.41.181/cinder-vol-61f585ac-f8e2-4d19-a890-7ebc2726cc72'] {{(pid=83259) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:669}} Sep 16 14:52:32 devstack cinder-volume[83259]: DEBUG oslo_concurrency.lockutils [None req-1b97c22c-1938-4aca-893e-c7cd7532a4cb tempest-TaggedBootDevicesTest-180213475 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=83259) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 16 14:52:32 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [None req-1b97c22c-1938-4aca-893e-c7cd7532a4cb tempest-TaggedBootDevicesTest-180213475 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 14:52:33 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [None req-1b97c22c-1938-4aca-893e-c7cd7532a4cb tempest-TaggedBootDevicesTest-180213475 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c" returned: 0 in 0.149s {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 14:52:33 devstack cinder-volume[83259]: DEBUG cinder.manager [None req-1b97c22c-1938-4aca-893e-c7cd7532a4cb tempest-TaggedBootDevicesTest-180213475 None] Notifying Schedulers of capabilities ... {{(pid=83259) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 16 14:52:33 devstack cinder-volume[83259]: INFO cinder.volume.manager [None req-1b97c22c-1938-4aca-893e-c7cd7532a4cb tempest-TaggedBootDevicesTest-180213475 None] Deleted volume successfully. Sep 16 14:52:33 devstack cinder-volume[83259]: DEBUG cinder.coordination [None req-ac93b6ef-a2db-4ca7-bd3b-e44f23219e26 tempest-TaggedBootDevicesTest-180213475 None] Acquiring lock "cinder-d0d76867-45a4-40e6-ad6c-563c035b9afa-delete_volume" by "delete_volume" {{(pid=83259) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 16 14:52:33 devstack cinder-volume[83259]: DEBUG cinder.coordination [None req-1b97c22c-1938-4aca-893e-c7cd7532a4cb tempest-TaggedBootDevicesTest-180213475 None] Lock "cinder-fa446bc6-198a-4e3d-a763-3f3f738af519-delete_volume" released by "delete_volume" :: held 2.566s {{(pid=83259) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 16 14:52:33 devstack cinder-volume[83259]: DEBUG cinder.coordination [None req-ac93b6ef-a2db-4ca7-bd3b-e44f23219e26 tempest-TaggedBootDevicesTest-180213475 None] Lock "cinder-d0d76867-45a4-40e6-ad6c-563c035b9afa-delete_volume" acquired by "delete_volume" :: waited 0.155s {{(pid=83259) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 16 14:52:33 devstack cinder-volume[83259]: WARNING cinder.volume.volume_utils [None req-ac93b6ef-a2db-4ca7-bd3b-e44f23219e26 tempest-TaggedBootDevicesTest-180213475 None] Volume driver (QuobyteDriver 1.2) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 16 14:52:33 devstack cinder-volume[83259]: DEBUG cinder.coordination [None req-ac93b6ef-a2db-4ca7-bd3b-e44f23219e26 tempest-TaggedBootDevicesTest-180213475 None] Acquiring lock "cinder-quobyte-d0d76867-45a4-40e6-ad6c-563c035b9afa" by "delete_volume" {{(pid=83259) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 16 14:52:33 devstack cinder-volume[83259]: DEBUG cinder.coordination [None req-ac93b6ef-a2db-4ca7-bd3b-e44f23219e26 tempest-TaggedBootDevicesTest-180213475 None] Lock "cinder-quobyte-d0d76867-45a4-40e6-ad6c-563c035b9afa" acquired by "delete_volume" :: waited 0.011s {{(pid=83259) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 16 14:52:33 devstack cinder-volume[83259]: DEBUG oslo.privsep.daemon [-] privsep: reply[5265e013-1646-4a46-b2a1-f87f1f996a13]: (4, 'qcow2') {{(pid=84312) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 16 14:52:33 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [None req-ac93b6ef-a2db-4ca7-bd3b-e44f23219e26 tempest-TaggedBootDevicesTest-180213475 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c/volume-d0d76867-45a4-40e6-ad6c-563c035b9afa {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 14:52:34 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [None req-ac93b6ef-a2db-4ca7-bd3b-e44f23219e26 tempest-TaggedBootDevicesTest-180213475 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c/volume-d0d76867-45a4-40e6-ad6c-563c035b9afa" returned: 0 in 0.703s {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 14:52:34 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [None req-ac93b6ef-a2db-4ca7-bd3b-e44f23219e26 tempest-TaggedBootDevicesTest-180213475 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c/volume-d0d76867-45a4-40e6-ad6c-563c035b9afa {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 14:52:34 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [None req-ac93b6ef-a2db-4ca7-bd3b-e44f23219e26 tempest-TaggedBootDevicesTest-180213475 None] CMD "rm -f /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c/volume-d0d76867-45a4-40e6-ad6c-563c035b9afa" returned: 0 in 0.120s {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 14:52:34 devstack cinder-volume[83259]: DEBUG cinder.coordination [None req-ac93b6ef-a2db-4ca7-bd3b-e44f23219e26 tempest-TaggedBootDevicesTest-180213475 None] Lock "cinder-quobyte-d0d76867-45a4-40e6-ad6c-563c035b9afa" released by "delete_volume" :: held 1.112s {{(pid=83259) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 16 14:52:35 devstack cinder-volume[83259]: DEBUG cinder.quota [None req-ac93b6ef-a2db-4ca7-bd3b-e44f23219e26 tempest-TaggedBootDevicesTest-180213475 None] Created reservations ['54bd4624-c042-4a27-9ab5-8dbee48883bd', '979971ef-4add-4cd1-8689-6c97443b53b8', 'ac276cb3-152b-4208-ad1e-b341217c17bf', '6d9defb7-ef04-4ec3-ae54-024d3fc138ed'] {{(pid=83259) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 16 14:52:35 devstack cinder-volume[83259]: DEBUG oslo_concurrency.lockutils [None req-ac93b6ef-a2db-4ca7-bd3b-e44f23219e26 tempest-TaggedBootDevicesTest-180213475 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83259) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 16 14:52:35 devstack cinder-volume[83259]: DEBUG oslo_concurrency.lockutils [None req-ac93b6ef-a2db-4ca7-bd3b-e44f23219e26 tempest-TaggedBootDevicesTest-180213475 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=83259) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 16 14:52:35 devstack cinder-volume[83259]: DEBUG cinder.volume.drivers.quobyte [None req-ac93b6ef-a2db-4ca7-bd3b-e44f23219e26 tempest-TaggedBootDevicesTest-180213475 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-61f585ac-f8e2-4d19-a890-7ebc2726cc72': None} {{(pid=83259) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:639}} Sep 16 14:52:35 devstack cinder-volume[83259]: DEBUG cinder.volume.drivers.quobyte [None req-ac93b6ef-a2db-4ca7-bd3b-e44f23219e26 tempest-TaggedBootDevicesTest-180213475 None] Available shares ['10.10.41.181/cinder-vol-61f585ac-f8e2-4d19-a890-7ebc2726cc72'] {{(pid=83259) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:669}} Sep 16 14:52:35 devstack cinder-volume[83259]: DEBUG oslo_concurrency.lockutils [None req-ac93b6ef-a2db-4ca7-bd3b-e44f23219e26 tempest-TaggedBootDevicesTest-180213475 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=83259) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 16 14:52:35 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [None req-ac93b6ef-a2db-4ca7-bd3b-e44f23219e26 tempest-TaggedBootDevicesTest-180213475 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 14:52:35 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [None req-ac93b6ef-a2db-4ca7-bd3b-e44f23219e26 tempest-TaggedBootDevicesTest-180213475 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c" returned: 0 in 0.181s {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 14:52:36 devstack cinder-volume[83259]: DEBUG cinder.manager [None req-ac93b6ef-a2db-4ca7-bd3b-e44f23219e26 tempest-TaggedBootDevicesTest-180213475 None] Notifying Schedulers of capabilities ... {{(pid=83259) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 16 14:52:36 devstack cinder-volume[83259]: INFO cinder.volume.manager [None req-ac93b6ef-a2db-4ca7-bd3b-e44f23219e26 tempest-TaggedBootDevicesTest-180213475 None] Deleted volume successfully. Sep 16 14:52:36 devstack cinder-volume[83259]: DEBUG cinder.coordination [None req-8b7f7082-27c2-470c-99d5-3b5c2dd62b5d tempest-TaggedBootDevicesTest-180213475 None] Acquiring lock "cinder-ec2a536c-e2a0-4b7d-a9f0-2881b05a353e-delete_volume" by "delete_volume" {{(pid=83259) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 16 14:52:36 devstack cinder-volume[83259]: DEBUG cinder.coordination [None req-8b7f7082-27c2-470c-99d5-3b5c2dd62b5d tempest-TaggedBootDevicesTest-180213475 None] Lock "cinder-ec2a536c-e2a0-4b7d-a9f0-2881b05a353e-delete_volume" acquired by "delete_volume" :: waited 0.093s {{(pid=83259) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 16 14:52:36 devstack cinder-volume[83259]: DEBUG cinder.coordination [None req-ac93b6ef-a2db-4ca7-bd3b-e44f23219e26 tempest-TaggedBootDevicesTest-180213475 None] Lock "cinder-d0d76867-45a4-40e6-ad6c-563c035b9afa-delete_volume" released by "delete_volume" :: held 2.684s {{(pid=83259) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 16 14:52:36 devstack cinder-volume[83259]: WARNING cinder.volume.volume_utils [None req-8b7f7082-27c2-470c-99d5-3b5c2dd62b5d tempest-TaggedBootDevicesTest-180213475 None] Volume driver (QuobyteDriver 1.2) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 16 14:52:36 devstack cinder-volume[83259]: DEBUG cinder.coordination [None req-8b7f7082-27c2-470c-99d5-3b5c2dd62b5d tempest-TaggedBootDevicesTest-180213475 None] Acquiring lock "cinder-quobyte-ec2a536c-e2a0-4b7d-a9f0-2881b05a353e" by "delete_volume" {{(pid=83259) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 16 14:52:36 devstack cinder-volume[83259]: DEBUG cinder.coordination [None req-8b7f7082-27c2-470c-99d5-3b5c2dd62b5d tempest-TaggedBootDevicesTest-180213475 None] Lock "cinder-quobyte-ec2a536c-e2a0-4b7d-a9f0-2881b05a353e" acquired by "delete_volume" :: waited 0.012s {{(pid=83259) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 16 14:52:36 devstack cinder-volume[83259]: DEBUG oslo.privsep.daemon [-] privsep: reply[e25dc53e-2e31-4227-97f0-c32f4902e4a6]: (4, 'qcow2') {{(pid=84312) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 16 14:52:36 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [None req-8b7f7082-27c2-470c-99d5-3b5c2dd62b5d tempest-TaggedBootDevicesTest-180213475 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c/volume-ec2a536c-e2a0-4b7d-a9f0-2881b05a353e {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 14:52:37 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [None req-8b7f7082-27c2-470c-99d5-3b5c2dd62b5d tempest-TaggedBootDevicesTest-180213475 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c/volume-ec2a536c-e2a0-4b7d-a9f0-2881b05a353e" returned: 0 in 0.605s {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 14:52:37 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [None req-8b7f7082-27c2-470c-99d5-3b5c2dd62b5d tempest-TaggedBootDevicesTest-180213475 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c/volume-ec2a536c-e2a0-4b7d-a9f0-2881b05a353e {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 14:52:37 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [None req-8b7f7082-27c2-470c-99d5-3b5c2dd62b5d tempest-TaggedBootDevicesTest-180213475 None] CMD "rm -f /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c/volume-ec2a536c-e2a0-4b7d-a9f0-2881b05a353e" returned: 0 in 0.133s {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 14:52:37 devstack cinder-volume[83259]: DEBUG cinder.coordination [None req-8b7f7082-27c2-470c-99d5-3b5c2dd62b5d tempest-TaggedBootDevicesTest-180213475 None] Lock "cinder-quobyte-ec2a536c-e2a0-4b7d-a9f0-2881b05a353e" released by "delete_volume" :: held 1.064s {{(pid=83259) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 16 14:52:37 devstack cinder-volume[83259]: DEBUG cinder.quota [None req-8b7f7082-27c2-470c-99d5-3b5c2dd62b5d tempest-TaggedBootDevicesTest-180213475 None] Created reservations ['63472d24-3a9e-4c0c-9cab-2b26f7430ad6', 'c98fcd2a-1268-4fe0-9e79-a74e0a05dcd6', '8f673c6f-d98f-466e-896e-c66b30d82c48', 'eb6dd29c-5340-4192-aceb-0b10ae6392ce'] {{(pid=83259) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 16 14:52:38 devstack cinder-volume[83259]: DEBUG oslo_concurrency.lockutils [None req-8b7f7082-27c2-470c-99d5-3b5c2dd62b5d tempest-TaggedBootDevicesTest-180213475 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83259) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 16 14:52:38 devstack cinder-volume[83259]: DEBUG oslo_concurrency.lockutils [None req-8b7f7082-27c2-470c-99d5-3b5c2dd62b5d tempest-TaggedBootDevicesTest-180213475 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.005s {{(pid=83259) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 16 14:52:38 devstack cinder-volume[83259]: DEBUG cinder.volume.drivers.quobyte [None req-8b7f7082-27c2-470c-99d5-3b5c2dd62b5d tempest-TaggedBootDevicesTest-180213475 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-61f585ac-f8e2-4d19-a890-7ebc2726cc72': None} {{(pid=83259) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:639}} Sep 16 14:52:38 devstack cinder-volume[83259]: DEBUG cinder.volume.drivers.quobyte [None req-8b7f7082-27c2-470c-99d5-3b5c2dd62b5d tempest-TaggedBootDevicesTest-180213475 None] Available shares ['10.10.41.181/cinder-vol-61f585ac-f8e2-4d19-a890-7ebc2726cc72'] {{(pid=83259) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:669}} Sep 16 14:52:38 devstack cinder-volume[83259]: DEBUG oslo_concurrency.lockutils [None req-8b7f7082-27c2-470c-99d5-3b5c2dd62b5d tempest-TaggedBootDevicesTest-180213475 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=83259) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 16 14:52:38 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [None req-8b7f7082-27c2-470c-99d5-3b5c2dd62b5d tempest-TaggedBootDevicesTest-180213475 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 14:52:38 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [None req-8b7f7082-27c2-470c-99d5-3b5c2dd62b5d tempest-TaggedBootDevicesTest-180213475 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c" returned: 0 in 0.147s {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 14:52:38 devstack cinder-volume[83259]: DEBUG cinder.manager [None req-8b7f7082-27c2-470c-99d5-3b5c2dd62b5d tempest-TaggedBootDevicesTest-180213475 None] Notifying Schedulers of capabilities ... {{(pid=83259) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 16 14:52:38 devstack cinder-volume[83259]: INFO cinder.volume.manager [None req-8b7f7082-27c2-470c-99d5-3b5c2dd62b5d tempest-TaggedBootDevicesTest-180213475 None] Deleted volume successfully. Sep 16 14:52:38 devstack cinder-volume[83259]: DEBUG cinder.coordination [None req-8b7f7082-27c2-470c-99d5-3b5c2dd62b5d tempest-TaggedBootDevicesTest-180213475 None] Lock "cinder-ec2a536c-e2a0-4b7d-a9f0-2881b05a353e-delete_volume" released by "delete_volume" :: held 2.352s {{(pid=83259) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 16 14:52:44 devstack cinder-volume[83259]: DEBUG oslo_service.periodic_task [None req-050ec8a1-6ffd-499d-95ad-d548a84437e2 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=83259) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} Sep 16 14:52:44 devstack cinder-volume[83259]: DEBUG oslo_concurrency.lockutils [None req-050ec8a1-6ffd-499d-95ad-d548a84437e2 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83259) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 16 14:52:44 devstack cinder-volume[83259]: DEBUG oslo_concurrency.lockutils [None req-050ec8a1-6ffd-499d-95ad-d548a84437e2 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=83259) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 16 14:52:44 devstack cinder-volume[83259]: DEBUG cinder.volume.drivers.quobyte [None req-050ec8a1-6ffd-499d-95ad-d548a84437e2 None None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-61f585ac-f8e2-4d19-a890-7ebc2726cc72': None} {{(pid=83259) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:639}} Sep 16 14:52:44 devstack cinder-volume[83259]: DEBUG cinder.volume.drivers.quobyte [None req-050ec8a1-6ffd-499d-95ad-d548a84437e2 None None] Available shares ['10.10.41.181/cinder-vol-61f585ac-f8e2-4d19-a890-7ebc2726cc72'] {{(pid=83259) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:669}} Sep 16 14:52:44 devstack cinder-volume[83259]: DEBUG oslo_concurrency.lockutils [None req-050ec8a1-6ffd-499d-95ad-d548a84437e2 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=83259) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 16 14:52:44 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [None req-050ec8a1-6ffd-499d-95ad-d548a84437e2 None None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 14:52:44 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [None req-050ec8a1-6ffd-499d-95ad-d548a84437e2 None None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c" returned: 0 in 0.146s {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 14:52:44 devstack cinder-volume[83259]: DEBUG cinder.manager [None req-050ec8a1-6ffd-499d-95ad-d548a84437e2 None None] Notifying Schedulers of capabilities ... {{(pid=83259) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 16 14:52:48 devstack cinder-volume[83259]: DEBUG dbcounter [-] [83259] Writing DB stats cinder:SELECT=23,cinder:UPDATE=25,cinder:INSERT=8,cinder:DELETE=1 {{(pid=83259) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Sep 16 14:52:48 devstack cinder-volume[83259]: DEBUG dbcounter [-] [83259] Writing DB stats cinder:SELECT=26,cinder:UPDATE=30,cinder:DELETE=3,cinder:INSERT=4 {{(pid=83259) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Sep 16 14:53:44 devstack cinder-volume[83259]: DEBUG oslo_service.periodic_task [None req-050ec8a1-6ffd-499d-95ad-d548a84437e2 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=83259) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} Sep 16 14:53:44 devstack cinder-volume[83259]: DEBUG oslo_concurrency.lockutils [None req-050ec8a1-6ffd-499d-95ad-d548a84437e2 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83259) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 16 14:53:44 devstack cinder-volume[83259]: DEBUG oslo_concurrency.lockutils [None req-050ec8a1-6ffd-499d-95ad-d548a84437e2 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.012s {{(pid=83259) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 16 14:53:44 devstack cinder-volume[83259]: DEBUG cinder.volume.drivers.quobyte [None req-050ec8a1-6ffd-499d-95ad-d548a84437e2 None None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-61f585ac-f8e2-4d19-a890-7ebc2726cc72': None} {{(pid=83259) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:639}} Sep 16 14:53:44 devstack cinder-volume[83259]: DEBUG cinder.volume.drivers.quobyte [None req-050ec8a1-6ffd-499d-95ad-d548a84437e2 None None] Available shares ['10.10.41.181/cinder-vol-61f585ac-f8e2-4d19-a890-7ebc2726cc72'] {{(pid=83259) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:669}} Sep 16 14:53:44 devstack cinder-volume[83259]: DEBUG oslo_concurrency.lockutils [None req-050ec8a1-6ffd-499d-95ad-d548a84437e2 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.045s {{(pid=83259) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 16 14:53:44 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [None req-050ec8a1-6ffd-499d-95ad-d548a84437e2 None None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 14:53:44 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [None req-050ec8a1-6ffd-499d-95ad-d548a84437e2 None None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c" returned: 0 in 0.240s {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 14:53:44 devstack cinder-volume[83259]: DEBUG cinder.manager [None req-050ec8a1-6ffd-499d-95ad-d548a84437e2 None None] Notifying Schedulers of capabilities ... {{(pid=83259) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 16 14:54:09 devstack cinder-volume[83259]: DEBUG dbcounter [-] [83259] Writing DB stats cinder:SELECT=1 {{(pid=83259) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Sep 16 14:54:09 devstack cinder-volume[83259]: DEBUG dbcounter [-] [83259] Writing DB stats cinder:UPDATE=1 {{(pid=83259) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Sep 16 14:54:34 devstack cinder-volume[83259]: WARNING cinder.volume.volume_utils [None req-bb9f9853-0584-4c6b-84aa-2b09a546f7ed tempest-AttachVolumeNegativeTest-1792000208 None] Volume driver (QuobyteDriver 1.2) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 16 14:54:34 devstack cinder-volume[83259]: DEBUG cinder.volume.flows.manager.create_volume [None req-bb9f9853-0584-4c6b-84aa-2b09a546f7ed tempest-AttachVolumeNegativeTest-1792000208 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#Quobyte'], 'hosts': ['devstack@QuobyteHD#Quobyte']} {{(pid=83259) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1387}} Sep 16 14:54:34 devstack cinder-volume[83259]: DEBUG cinder.volume.manager [None req-bb9f9853-0584-4c6b-84aa-2b09a546f7ed tempest-AttachVolumeNegativeTest-1792000208 None] Flow 'volume_create_manager' (1d725ad3-a641-4242-a822-1b6feaa36b76) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83259) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 16 14:54:34 devstack cinder-volume[83259]: DEBUG cinder.volume.manager [None req-bb9f9853-0584-4c6b-84aa-2b09a546f7ed tempest-AttachVolumeNegativeTest-1792000208 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (60376559-82ff-4aad-b28f-7d6788f68d73) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83259) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 14:54:34 devstack cinder-volume[83259]: DEBUG cinder.volume.manager [None req-bb9f9853-0584-4c6b-84aa-2b09a546f7ed tempest-AttachVolumeNegativeTest-1792000208 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (60376559-82ff-4aad-b28f-7d6788f68d73) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-16T12:54:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-351059054',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#Quobyte',id=10a54a3e-06db-4c81-bdc1-a300a53d94c5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6f9bb5f3fa194a3b9bc3b14a650a0c50',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-16T12:54:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-16T12:54:34Z,use_quota=True,user_id='4e8bef68591e4514a725ed5d2c8799ab',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(485ead50-3df8-4d76-8d34-a4db136c980a),volume_type_id=485ead50-3df8-4d76-8d34-a4db136c980a)' {{(pid=83259) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 14:54:34 devstack cinder-volume[83259]: DEBUG cinder.volume.manager [None req-bb9f9853-0584-4c6b-84aa-2b09a546f7ed tempest-AttachVolumeNegativeTest-1792000208 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fe544c8b-e7bf-4f5d-96c6-699ed9e4d47a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83259) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 14:54:34 devstack cinder-volume[83259]: DEBUG cinder.volume.manager [None req-bb9f9853-0584-4c6b-84aa-2b09a546f7ed tempest-AttachVolumeNegativeTest-1792000208 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fe544c8b-e7bf-4f5d-96c6-699ed9e4d47a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83259) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 14:54:34 devstack cinder-volume[83259]: DEBUG cinder.volume.manager [None req-bb9f9853-0584-4c6b-84aa-2b09a546f7ed tempest-AttachVolumeNegativeTest-1792000208 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (aafcc265-a53b-4420-aaad-cb637e601fbc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83259) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 14:54:34 devstack cinder-volume[83259]: DEBUG cinder.volume.manager [None req-bb9f9853-0584-4c6b-84aa-2b09a546f7ed tempest-AttachVolumeNegativeTest-1792000208 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (aafcc265-a53b-4420-aaad-cb637e601fbc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '10a54a3e-06db-4c81-bdc1-a300a53d94c5', 'volume_name': 'volume-10a54a3e-06db-4c81-bdc1-a300a53d94c5', 'volume_size': 1}' {{(pid=83259) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 14:54:34 devstack cinder-volume[83259]: DEBUG cinder.volume.manager [None req-bb9f9853-0584-4c6b-84aa-2b09a546f7ed tempest-AttachVolumeNegativeTest-1792000208 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (60f1f919-d810-44c3-b85d-3791d8f0e5cb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83259) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 14:54:34 devstack cinder-volume[83259]: DEBUG cinder.volume.manager [None req-bb9f9853-0584-4c6b-84aa-2b09a546f7ed tempest-AttachVolumeNegativeTest-1792000208 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (60f1f919-d810-44c3-b85d-3791d8f0e5cb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83259) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 14:54:34 devstack cinder-volume[83259]: DEBUG cinder.volume.manager [None req-bb9f9853-0584-4c6b-84aa-2b09a546f7ed tempest-AttachVolumeNegativeTest-1792000208 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a7faf79d-56cd-40df-927c-33616a97f91a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83259) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 14:54:34 devstack cinder-volume[83259]: INFO cinder.volume.flows.manager.create_volume [None req-bb9f9853-0584-4c6b-84aa-2b09a546f7ed tempest-AttachVolumeNegativeTest-1792000208 None] Volume 10a54a3e-06db-4c81-bdc1-a300a53d94c5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-10a54a3e-06db-4c81-bdc1-a300a53d94c5', 'volume_size': 1} Sep 16 14:54:34 devstack cinder-volume[83259]: DEBUG oslo_concurrency.lockutils [None req-bb9f9853-0584-4c6b-84aa-2b09a546f7ed tempest-AttachVolumeNegativeTest-1792000208 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83259) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 16 14:54:34 devstack cinder-volume[83259]: DEBUG oslo_concurrency.lockutils [None req-bb9f9853-0584-4c6b-84aa-2b09a546f7ed tempest-AttachVolumeNegativeTest-1792000208 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=83259) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 16 14:54:34 devstack cinder-volume[83259]: DEBUG cinder.volume.drivers.quobyte [None req-bb9f9853-0584-4c6b-84aa-2b09a546f7ed tempest-AttachVolumeNegativeTest-1792000208 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-16T12:54:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-351059054',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#Quobyte',id=10a54a3e-06db-4c81-bdc1-a300a53d94c5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6f9bb5f3fa194a3b9bc3b14a650a0c50',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-16T12:54:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-16T12:54:34Z,use_quota=True,user_id='4e8bef68591e4514a725ed5d2c8799ab',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(485ead50-3df8-4d76-8d34-a4db136c980a),volume_type_id=485ead50-3df8-4d76-8d34-a4db136c980a)}" {{(pid=83259) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Sep 16 14:54:34 devstack cinder-volume[83259]: DEBUG cinder.volume.drivers.remotefs [None req-bb9f9853-0584-4c6b-84aa-2b09a546f7ed tempest-AttachVolumeNegativeTest-1792000208 None] Creating volume 10a54a3e-06db-4c81-bdc1-a300a53d94c5 {{(pid=83259) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}} Sep 16 14:54:34 devstack cinder-volume[83259]: DEBUG oslo_concurrency.lockutils [None req-bb9f9853-0584-4c6b-84aa-2b09a546f7ed tempest-AttachVolumeNegativeTest-1792000208 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83259) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 16 14:54:34 devstack cinder-volume[83259]: DEBUG oslo_concurrency.lockutils [None req-bb9f9853-0584-4c6b-84aa-2b09a546f7ed tempest-AttachVolumeNegativeTest-1792000208 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83259) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 16 14:54:34 devstack cinder-volume[83259]: DEBUG cinder.volume.drivers.quobyte [None req-bb9f9853-0584-4c6b-84aa-2b09a546f7ed tempest-AttachVolumeNegativeTest-1792000208 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-61f585ac-f8e2-4d19-a890-7ebc2726cc72': None} {{(pid=83259) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:639}} Sep 16 14:54:34 devstack cinder-volume[83259]: DEBUG cinder.volume.drivers.quobyte [None req-bb9f9853-0584-4c6b-84aa-2b09a546f7ed tempest-AttachVolumeNegativeTest-1792000208 None] Available shares ['10.10.41.181/cinder-vol-61f585ac-f8e2-4d19-a890-7ebc2726cc72'] {{(pid=83259) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:669}} Sep 16 14:54:34 devstack cinder-volume[83259]: DEBUG oslo_concurrency.lockutils [None req-bb9f9853-0584-4c6b-84aa-2b09a546f7ed tempest-AttachVolumeNegativeTest-1792000208 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=83259) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 16 14:54:34 devstack cinder-volume[83259]: DEBUG cinder.volume.drivers.quobyte [None req-bb9f9853-0584-4c6b-84aa-2b09a546f7ed tempest-AttachVolumeNegativeTest-1792000208 None] Selected 10.10.41.181/cinder-vol-61f585ac-f8e2-4d19-a890-7ebc2726cc72 as target Quobyte volume. {{(pid=83259) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:690}} Sep 16 14:54:34 devstack cinder-volume[83259]: INFO cinder.volume.drivers.remotefs [None req-bb9f9853-0584-4c6b-84aa-2b09a546f7ed tempest-AttachVolumeNegativeTest-1792000208 None] casted to 10.10.41.181/cinder-vol-61f585ac-f8e2-4d19-a890-7ebc2726cc72 Sep 16 14:54:34 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [None req-bb9f9853-0584-4c6b-84aa-2b09a546f7ed tempest-AttachVolumeNegativeTest-1792000208 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c/volume-10a54a3e-06db-4c81-bdc1-a300a53d94c5 1073741824 {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 14:54:34 devstack quobyte-client[83286]: System call of process 89320 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 16 14:54:34 devstack quobyte-client[83286]: The server volume:87712ffe-8a69-446d-9ed6-4430c7ee9792@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=87712ffe-8a69-446d-9ed6-4430c7ee9792, inode=13, name=volume-10a54a3e-06db-4c81-bdc1-a300a53d94c5, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.206), requestorAccessMask=0 Sep 16 14:54:34 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [None req-bb9f9853-0584-4c6b-84aa-2b09a546f7ed tempest-AttachVolumeNegativeTest-1792000208 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c/volume-10a54a3e-06db-4c81-bdc1-a300a53d94c5 1073741824" returned: 0 in 0.437s {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 14:54:34 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [None req-bb9f9853-0584-4c6b-84aa-2b09a546f7ed tempest-AttachVolumeNegativeTest-1792000208 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c/volume-10a54a3e-06db-4c81-bdc1-a300a53d94c5 {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 14:54:35 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [None req-bb9f9853-0584-4c6b-84aa-2b09a546f7ed tempest-AttachVolumeNegativeTest-1792000208 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c/volume-10a54a3e-06db-4c81-bdc1-a300a53d94c5" returned: 0 in 0.128s {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 14:54:35 devstack cinder-volume[83259]: DEBUG cinder.volume.drivers.quobyte [None req-bb9f9853-0584-4c6b-84aa-2b09a546f7ed tempest-AttachVolumeNegativeTest-1792000208 None] <== create_volume: return (625ms) {'provider_location': '10.10.41.181/cinder-vol-61f585ac-f8e2-4d19-a890-7ebc2726cc72'} {{(pid=83259) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Sep 16 14:54:35 devstack cinder-volume[83259]: DEBUG oslo_concurrency.lockutils [None req-bb9f9853-0584-4c6b-84aa-2b09a546f7ed tempest-AttachVolumeNegativeTest-1792000208 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.639s {{(pid=83259) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 16 14:54:35 devstack cinder-volume[83259]: DEBUG cinder.volume.manager [None req-bb9f9853-0584-4c6b-84aa-2b09a546f7ed tempest-AttachVolumeNegativeTest-1792000208 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a7faf79d-56cd-40df-927c-33616a97f91a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-10a54a3e-06db-4c81-bdc1-a300a53d94c5', 'volume_size': 1}' {{(pid=83259) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 14:54:35 devstack cinder-volume[83259]: DEBUG cinder.volume.manager [None req-bb9f9853-0584-4c6b-84aa-2b09a546f7ed tempest-AttachVolumeNegativeTest-1792000208 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (73c58ba0-bed3-4dc3-ba41-17f4203387ab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83259) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 14:54:35 devstack cinder-volume[83259]: INFO cinder.volume.flows.manager.create_volume [None req-bb9f9853-0584-4c6b-84aa-2b09a546f7ed tempest-AttachVolumeNegativeTest-1792000208 None] Volume volume-10a54a3e-06db-4c81-bdc1-a300a53d94c5 (10a54a3e-06db-4c81-bdc1-a300a53d94c5): created successfully Sep 16 14:54:35 devstack cinder-volume[83259]: DEBUG cinder.volume.manager [None req-bb9f9853-0584-4c6b-84aa-2b09a546f7ed tempest-AttachVolumeNegativeTest-1792000208 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (73c58ba0-bed3-4dc3-ba41-17f4203387ab) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83259) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 14:54:35 devstack cinder-volume[83259]: DEBUG cinder.volume.manager [None req-bb9f9853-0584-4c6b-84aa-2b09a546f7ed tempest-AttachVolumeNegativeTest-1792000208 None] Flow 'volume_create_manager' (1d725ad3-a641-4242-a822-1b6feaa36b76) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83259) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 16 14:54:35 devstack cinder-volume[83259]: INFO cinder.volume.manager [None req-bb9f9853-0584-4c6b-84aa-2b09a546f7ed tempest-AttachVolumeNegativeTest-1792000208 None] Created volume successfully. Sep 16 14:54:40 devstack cinder-volume[83259]: DEBUG oslo_concurrency.lockutils [req-f9395067-cdb1-405c-bc0c-396e1c77f410 req-2c43fd93-39e5-4682-abfb-851804450931 tempest-AttachVolumeNegativeTest-1792000208 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=83259) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 16 14:54:40 devstack cinder-volume[83259]: DEBUG oslo_concurrency.lockutils [req-f9395067-cdb1-405c-bc0c-396e1c77f410 req-2c43fd93-39e5-4682-abfb-851804450931 tempest-AttachVolumeNegativeTest-1792000208 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.002s {{(pid=83259) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 16 14:54:40 devstack cinder-volume[83259]: DEBUG oslo.privsep.daemon [-] privsep: reply[2275bd59-c78a-4d86-ae83-37d8f9417ccd]: (4, 'qcow2') {{(pid=84312) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 16 14:54:40 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [req-f9395067-cdb1-405c-bc0c-396e1c77f410 req-2c43fd93-39e5-4682-abfb-851804450931 tempest-AttachVolumeNegativeTest-1792000208 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c/volume-10a54a3e-06db-4c81-bdc1-a300a53d94c5 {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 14:54:40 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [req-f9395067-cdb1-405c-bc0c-396e1c77f410 req-2c43fd93-39e5-4682-abfb-851804450931 tempest-AttachVolumeNegativeTest-1792000208 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c/volume-10a54a3e-06db-4c81-bdc1-a300a53d94c5" returned: 0 in 0.422s {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 14:54:40 devstack cinder-volume[83259]: DEBUG oslo_concurrency.lockutils [req-f9395067-cdb1-405c-bc0c-396e1c77f410 req-2c43fd93-39e5-4682-abfb-851804450931 tempest-AttachVolumeNegativeTest-1792000208 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.484s {{(pid=83259) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 16 14:54:41 devstack cinder-volume[83259]: DEBUG cinder.volume.manager [req-f9395067-cdb1-405c-bc0c-396e1c77f410 req-2c43fd93-39e5-4682-abfb-851804450931 tempest-AttachVolumeNegativeTest-1792000208 None] Connection info returned from driver {'export': '10.10.41.181/cinder-vol-61f585ac-f8e2-4d19-a890-7ebc2726cc72', 'name': 'volume-10a54a3e-06db-4c81-bdc1-a300a53d94c5', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'bafd6cf4-e3a2-4505-9369-a60e7b0ff93c', 'enforce_multipath': True} {{(pid=83259) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4891}} Sep 16 14:54:41 devstack cinder-volume[83259]: WARNING cinder.volume.volume_utils [req-f9395067-cdb1-405c-bc0c-396e1c77f410 req-2c43fd93-39e5-4682-abfb-851804450931 tempest-AttachVolumeNegativeTest-1792000208 None] Volume driver (QuobyteDriver 1.2) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 16 14:54:41 devstack cinder-volume[83259]: INFO cinder.volume.manager [req-f9395067-cdb1-405c-bc0c-396e1c77f410 req-2c43fd93-39e5-4682-abfb-851804450931 tempest-AttachVolumeNegativeTest-1792000208 None] attachment_update completed successfully. Sep 16 14:54:44 devstack cinder-volume[83259]: DEBUG oslo_service.periodic_task [None req-050ec8a1-6ffd-499d-95ad-d548a84437e2 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=83259) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} Sep 16 14:54:44 devstack cinder-volume[83259]: DEBUG oslo_concurrency.lockutils [None req-050ec8a1-6ffd-499d-95ad-d548a84437e2 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83259) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 16 14:54:44 devstack cinder-volume[83259]: DEBUG oslo_concurrency.lockutils [None req-050ec8a1-6ffd-499d-95ad-d548a84437e2 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=83259) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 16 14:54:44 devstack cinder-volume[83259]: DEBUG cinder.volume.drivers.quobyte [None req-050ec8a1-6ffd-499d-95ad-d548a84437e2 None None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-61f585ac-f8e2-4d19-a890-7ebc2726cc72': None} {{(pid=83259) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:639}} Sep 16 14:54:44 devstack cinder-volume[83259]: DEBUG cinder.volume.drivers.quobyte [None req-050ec8a1-6ffd-499d-95ad-d548a84437e2 None None] Available shares ['10.10.41.181/cinder-vol-61f585ac-f8e2-4d19-a890-7ebc2726cc72'] {{(pid=83259) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:669}} Sep 16 14:54:44 devstack cinder-volume[83259]: DEBUG oslo_concurrency.lockutils [None req-050ec8a1-6ffd-499d-95ad-d548a84437e2 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=83259) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 16 14:54:44 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [None req-050ec8a1-6ffd-499d-95ad-d548a84437e2 None None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 14:54:44 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [None req-050ec8a1-6ffd-499d-95ad-d548a84437e2 None None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c" returned: 0 in 0.101s {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 14:54:44 devstack cinder-volume[83259]: DEBUG cinder.manager [None req-050ec8a1-6ffd-499d-95ad-d548a84437e2 None None] Notifying Schedulers of capabilities ... {{(pid=83259) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 16 14:54:45 devstack cinder-volume[83259]: WARNING cinder.volume.volume_utils [req-f1b05502-5f18-4765-aac3-39cf443526c1 req-adc82e66-f3a0-4e4c-a7bb-9dd268edbe7a tempest-AttachVolumeTestJSON-915876093 None] Volume driver (QuobyteDriver 1.2) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 16 14:54:45 devstack cinder-volume[83259]: WARNING cinder.volume.volume_utils [req-f1b05502-5f18-4765-aac3-39cf443526c1 req-adc82e66-f3a0-4e4c-a7bb-9dd268edbe7a tempest-AttachVolumeTestJSON-915876093 None] Volume driver (QuobyteDriver 1.2) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 16 14:54:45 devstack cinder-volume[83259]: INFO cinder.volume.manager [req-f1b05502-5f18-4765-aac3-39cf443526c1 req-adc82e66-f3a0-4e4c-a7bb-9dd268edbe7a tempest-AttachVolumeTestJSON-915876093 None] Terminate volume connection completed successfully. Sep 16 14:54:45 devstack cinder-volume[83259]: DEBUG cinder.volume.manager [req-f1b05502-5f18-4765-aac3-39cf443526c1 req-adc82e66-f3a0-4e4c-a7bb-9dd268edbe7a tempest-AttachVolumeTestJSON-915876093 None] Deleting attachment cf7b1b73-23cc-41ee-a96c-fbba3faffbeb. {{(pid=83259) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5022}} Sep 16 14:54:55 devstack cinder-volume[83259]: DEBUG dbcounter [-] [83259] Writing DB stats cinder:UPDATE=5,cinder:SELECT=7 {{(pid=83259) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Sep 16 14:54:55 devstack cinder-volume[83259]: DEBUG dbcounter [-] [83259] Writing DB stats cinder:SELECT=8,cinder:UPDATE=2,cinder:DELETE=1 {{(pid=83259) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Sep 16 14:55:23 devstack cinder-volume[83259]: WARNING cinder.volume.volume_utils [None req-0d12231b-107e-4acf-a128-935db297c75f tempest-AttachVolumeShelveTestJSON-1870144154 None] Volume driver (QuobyteDriver 1.2) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 16 14:55:23 devstack cinder-volume[83259]: DEBUG cinder.volume.flows.manager.create_volume [None req-0d12231b-107e-4acf-a128-935db297c75f tempest-AttachVolumeShelveTestJSON-1870144154 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#Quobyte'], 'hosts': ['devstack@QuobyteHD#Quobyte']} {{(pid=83259) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1387}} Sep 16 14:55:24 devstack cinder-volume[83259]: DEBUG cinder.volume.manager [None req-0d12231b-107e-4acf-a128-935db297c75f tempest-AttachVolumeShelveTestJSON-1870144154 None] Flow 'volume_create_manager' (283d8935-b9fc-4665-a2a9-948acb300f44) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83259) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 16 14:55:24 devstack cinder-volume[83259]: DEBUG cinder.volume.manager [None req-0d12231b-107e-4acf-a128-935db297c75f tempest-AttachVolumeShelveTestJSON-1870144154 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b9cb6a90-1260-4ba2-a548-5bd15507726c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83259) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 14:55:24 devstack cinder-volume[83259]: DEBUG cinder.volume.manager [None req-0d12231b-107e-4acf-a128-935db297c75f tempest-AttachVolumeShelveTestJSON-1870144154 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b9cb6a90-1260-4ba2-a548-5bd15507726c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-16T12:55:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-volume-791598203',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#Quobyte',id=1d2d2164-2d63-4cb8-84db-04d369193c7d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='45c144e02d244cdd8cf9ea862f5f1fbb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-16T12:55:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-16T12:55:23Z,use_quota=True,user_id='cf7c6ad97fd740eab49ab56b41295a5b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(485ead50-3df8-4d76-8d34-a4db136c980a),volume_type_id=485ead50-3df8-4d76-8d34-a4db136c980a)' {{(pid=83259) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 14:55:24 devstack cinder-volume[83259]: DEBUG cinder.volume.manager [None req-0d12231b-107e-4acf-a128-935db297c75f tempest-AttachVolumeShelveTestJSON-1870144154 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6e0c910d-978a-4c7c-b903-0c5feb7ad13d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83259) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 14:55:24 devstack cinder-volume[83259]: DEBUG cinder.volume.manager [None req-0d12231b-107e-4acf-a128-935db297c75f tempest-AttachVolumeShelveTestJSON-1870144154 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6e0c910d-978a-4c7c-b903-0c5feb7ad13d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83259) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 14:55:24 devstack cinder-volume[83259]: DEBUG cinder.volume.manager [None req-0d12231b-107e-4acf-a128-935db297c75f tempest-AttachVolumeShelveTestJSON-1870144154 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0c7ff277-4ff7-4c77-816c-780d146b4167) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83259) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 14:55:24 devstack cinder-volume[83259]: DEBUG cinder.volume.manager [None req-0d12231b-107e-4acf-a128-935db297c75f tempest-AttachVolumeShelveTestJSON-1870144154 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0c7ff277-4ff7-4c77-816c-780d146b4167) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1d2d2164-2d63-4cb8-84db-04d369193c7d', 'volume_name': 'volume-1d2d2164-2d63-4cb8-84db-04d369193c7d', 'volume_size': 1}' {{(pid=83259) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 14:55:24 devstack cinder-volume[83259]: DEBUG cinder.volume.manager [None req-0d12231b-107e-4acf-a128-935db297c75f tempest-AttachVolumeShelveTestJSON-1870144154 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (71ab6224-3301-4180-883a-72ddc37edba1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83259) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 14:55:24 devstack cinder-volume[83259]: DEBUG cinder.volume.manager [None req-0d12231b-107e-4acf-a128-935db297c75f tempest-AttachVolumeShelveTestJSON-1870144154 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (71ab6224-3301-4180-883a-72ddc37edba1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83259) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 14:55:24 devstack cinder-volume[83259]: DEBUG cinder.volume.manager [None req-0d12231b-107e-4acf-a128-935db297c75f tempest-AttachVolumeShelveTestJSON-1870144154 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f590a357-299f-4c4e-b4f6-57c195174c97) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83259) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 14:55:24 devstack cinder-volume[83259]: INFO cinder.volume.flows.manager.create_volume [None req-0d12231b-107e-4acf-a128-935db297c75f tempest-AttachVolumeShelveTestJSON-1870144154 None] Volume 1d2d2164-2d63-4cb8-84db-04d369193c7d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1d2d2164-2d63-4cb8-84db-04d369193c7d', 'volume_size': 1} Sep 16 14:55:24 devstack cinder-volume[83259]: DEBUG oslo_concurrency.lockutils [None req-0d12231b-107e-4acf-a128-935db297c75f tempest-AttachVolumeShelveTestJSON-1870144154 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83259) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 16 14:55:24 devstack cinder-volume[83259]: DEBUG oslo_concurrency.lockutils [None req-0d12231b-107e-4acf-a128-935db297c75f tempest-AttachVolumeShelveTestJSON-1870144154 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.013s {{(pid=83259) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 16 14:55:24 devstack cinder-volume[83259]: DEBUG cinder.volume.drivers.quobyte [None req-0d12231b-107e-4acf-a128-935db297c75f tempest-AttachVolumeShelveTestJSON-1870144154 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-16T12:55:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-volume-791598203',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#Quobyte',id=1d2d2164-2d63-4cb8-84db-04d369193c7d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='45c144e02d244cdd8cf9ea862f5f1fbb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-16T12:55:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-16T12:55:23Z,use_quota=True,user_id='cf7c6ad97fd740eab49ab56b41295a5b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(485ead50-3df8-4d76-8d34-a4db136c980a),volume_type_id=485ead50-3df8-4d76-8d34-a4db136c980a)}" {{(pid=83259) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Sep 16 14:55:24 devstack cinder-volume[83259]: DEBUG cinder.volume.drivers.remotefs [None req-0d12231b-107e-4acf-a128-935db297c75f tempest-AttachVolumeShelveTestJSON-1870144154 None] Creating volume 1d2d2164-2d63-4cb8-84db-04d369193c7d {{(pid=83259) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}} Sep 16 14:55:24 devstack cinder-volume[83259]: DEBUG oslo_concurrency.lockutils [None req-0d12231b-107e-4acf-a128-935db297c75f tempest-AttachVolumeShelveTestJSON-1870144154 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83259) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 16 14:55:24 devstack cinder-volume[83259]: DEBUG oslo_concurrency.lockutils [None req-0d12231b-107e-4acf-a128-935db297c75f tempest-AttachVolumeShelveTestJSON-1870144154 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83259) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 16 14:55:24 devstack cinder-volume[83259]: DEBUG cinder.volume.drivers.quobyte [None req-0d12231b-107e-4acf-a128-935db297c75f tempest-AttachVolumeShelveTestJSON-1870144154 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-61f585ac-f8e2-4d19-a890-7ebc2726cc72': None} {{(pid=83259) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:639}} Sep 16 14:55:24 devstack cinder-volume[83259]: DEBUG cinder.volume.drivers.quobyte [None req-0d12231b-107e-4acf-a128-935db297c75f tempest-AttachVolumeShelveTestJSON-1870144154 None] Available shares ['10.10.41.181/cinder-vol-61f585ac-f8e2-4d19-a890-7ebc2726cc72'] {{(pid=83259) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:669}} Sep 16 14:55:24 devstack cinder-volume[83259]: DEBUG oslo_concurrency.lockutils [None req-0d12231b-107e-4acf-a128-935db297c75f tempest-AttachVolumeShelveTestJSON-1870144154 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.095s {{(pid=83259) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 16 14:55:24 devstack cinder-volume[83259]: DEBUG cinder.volume.drivers.quobyte [None req-0d12231b-107e-4acf-a128-935db297c75f tempest-AttachVolumeShelveTestJSON-1870144154 None] Selected 10.10.41.181/cinder-vol-61f585ac-f8e2-4d19-a890-7ebc2726cc72 as target Quobyte volume. {{(pid=83259) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:690}} Sep 16 14:55:24 devstack cinder-volume[83259]: INFO cinder.volume.drivers.remotefs [None req-0d12231b-107e-4acf-a128-935db297c75f tempest-AttachVolumeShelveTestJSON-1870144154 None] casted to 10.10.41.181/cinder-vol-61f585ac-f8e2-4d19-a890-7ebc2726cc72 Sep 16 14:55:24 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [None req-0d12231b-107e-4acf-a128-935db297c75f tempest-AttachVolumeShelveTestJSON-1870144154 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c/volume-1d2d2164-2d63-4cb8-84db-04d369193c7d 1073741824 {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 14:55:25 devstack quobyte-client[83286]: System call of process 89906 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 16 14:55:25 devstack quobyte-client[83286]: The server volume:87712ffe-8a69-446d-9ed6-4430c7ee9792@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=87712ffe-8a69-446d-9ed6-4430c7ee9792, inode=14, name=volume-1d2d2164-2d63-4cb8-84db-04d369193c7d, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.206), requestorAccessMask=0 Sep 16 14:55:26 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [None req-0d12231b-107e-4acf-a128-935db297c75f tempest-AttachVolumeShelveTestJSON-1870144154 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c/volume-1d2d2164-2d63-4cb8-84db-04d369193c7d 1073741824" returned: 0 in 1.050s {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 14:55:26 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [None req-0d12231b-107e-4acf-a128-935db297c75f tempest-AttachVolumeShelveTestJSON-1870144154 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c/volume-1d2d2164-2d63-4cb8-84db-04d369193c7d {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 14:55:26 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [None req-0d12231b-107e-4acf-a128-935db297c75f tempest-AttachVolumeShelveTestJSON-1870144154 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c/volume-1d2d2164-2d63-4cb8-84db-04d369193c7d" returned: 0 in 0.343s {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 14:55:26 devstack cinder-volume[83259]: DEBUG cinder.volume.drivers.quobyte [None req-0d12231b-107e-4acf-a128-935db297c75f tempest-AttachVolumeShelveTestJSON-1870144154 None] <== create_volume: return (1642ms) {'provider_location': '10.10.41.181/cinder-vol-61f585ac-f8e2-4d19-a890-7ebc2726cc72'} {{(pid=83259) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Sep 16 14:55:26 devstack cinder-volume[83259]: DEBUG oslo_concurrency.lockutils [None req-0d12231b-107e-4acf-a128-935db297c75f tempest-AttachVolumeShelveTestJSON-1870144154 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.675s {{(pid=83259) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 16 14:55:27 devstack cinder-volume[83259]: DEBUG cinder.volume.manager [None req-0d12231b-107e-4acf-a128-935db297c75f tempest-AttachVolumeShelveTestJSON-1870144154 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f590a357-299f-4c4e-b4f6-57c195174c97) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1d2d2164-2d63-4cb8-84db-04d369193c7d', 'volume_size': 1}' {{(pid=83259) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 14:55:27 devstack cinder-volume[83259]: DEBUG cinder.volume.manager [None req-0d12231b-107e-4acf-a128-935db297c75f tempest-AttachVolumeShelveTestJSON-1870144154 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e26f7f4a-9283-4f00-88d0-06cb4a074384) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83259) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 14:55:27 devstack cinder-volume[83259]: INFO cinder.volume.flows.manager.create_volume [None req-0d12231b-107e-4acf-a128-935db297c75f tempest-AttachVolumeShelveTestJSON-1870144154 None] Volume volume-1d2d2164-2d63-4cb8-84db-04d369193c7d (1d2d2164-2d63-4cb8-84db-04d369193c7d): created successfully Sep 16 14:55:27 devstack cinder-volume[83259]: DEBUG cinder.volume.manager [None req-0d12231b-107e-4acf-a128-935db297c75f tempest-AttachVolumeShelveTestJSON-1870144154 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e26f7f4a-9283-4f00-88d0-06cb4a074384) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83259) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 14:55:27 devstack cinder-volume[83259]: DEBUG cinder.volume.manager [None req-0d12231b-107e-4acf-a128-935db297c75f tempest-AttachVolumeShelveTestJSON-1870144154 None] Flow 'volume_create_manager' (283d8935-b9fc-4665-a2a9-948acb300f44) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83259) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 16 14:55:27 devstack cinder-volume[83259]: INFO cinder.volume.manager [None req-0d12231b-107e-4acf-a128-935db297c75f tempest-AttachVolumeShelveTestJSON-1870144154 None] Created volume successfully. Sep 16 14:55:37 devstack cinder-volume[83259]: DEBUG dbcounter [-] [83259] Writing DB stats cinder:SELECT=1,cinder:UPDATE=1 {{(pid=83259) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Sep 16 14:55:37 devstack cinder-volume[83259]: DEBUG dbcounter [-] [83259] Writing DB stats cinder:UPDATE=3,cinder:SELECT=1,cinder:DELETE=1 {{(pid=83259) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Sep 16 14:55:44 devstack cinder-volume[83259]: DEBUG oslo_service.periodic_task [None req-050ec8a1-6ffd-499d-95ad-d548a84437e2 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=83259) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} Sep 16 14:55:44 devstack cinder-volume[83259]: DEBUG oslo_concurrency.lockutils [None req-050ec8a1-6ffd-499d-95ad-d548a84437e2 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83259) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 16 14:55:44 devstack cinder-volume[83259]: DEBUG oslo_concurrency.lockutils [None req-050ec8a1-6ffd-499d-95ad-d548a84437e2 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.005s {{(pid=83259) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 16 14:55:44 devstack cinder-volume[83259]: DEBUG cinder.volume.drivers.quobyte [None req-050ec8a1-6ffd-499d-95ad-d548a84437e2 None None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-61f585ac-f8e2-4d19-a890-7ebc2726cc72': None} {{(pid=83259) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:639}} Sep 16 14:55:44 devstack cinder-volume[83259]: DEBUG cinder.volume.drivers.quobyte [None req-050ec8a1-6ffd-499d-95ad-d548a84437e2 None None] Available shares ['10.10.41.181/cinder-vol-61f585ac-f8e2-4d19-a890-7ebc2726cc72'] {{(pid=83259) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:669}} Sep 16 14:55:44 devstack cinder-volume[83259]: DEBUG oslo_concurrency.lockutils [None req-050ec8a1-6ffd-499d-95ad-d548a84437e2 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.026s {{(pid=83259) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 16 14:55:44 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [None req-050ec8a1-6ffd-499d-95ad-d548a84437e2 None None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 14:55:44 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [None req-050ec8a1-6ffd-499d-95ad-d548a84437e2 None None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c" returned: 0 in 0.259s {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 14:55:44 devstack cinder-volume[83259]: DEBUG cinder.manager [None req-050ec8a1-6ffd-499d-95ad-d548a84437e2 None None] Notifying Schedulers of capabilities ... {{(pid=83259) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 16 14:56:05 devstack cinder-volume[83259]: DEBUG oslo_concurrency.lockutils [req-ce69a367-2eae-4e30-acaf-3f4a88a8629b req-16b811df-70bb-4f0c-98f7-9fd33f73423e tempest-AttachVolumeShelveTestJSON-1870144154 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=83259) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 16 14:56:05 devstack cinder-volume[83259]: DEBUG oslo_concurrency.lockutils [req-ce69a367-2eae-4e30-acaf-3f4a88a8629b req-16b811df-70bb-4f0c-98f7-9fd33f73423e tempest-AttachVolumeShelveTestJSON-1870144154 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.005s {{(pid=83259) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 16 14:56:05 devstack cinder-volume[83259]: DEBUG oslo.privsep.daemon [-] privsep: reply[906e6b09-f561-42a0-a137-e87b954dacc3]: (4, 'qcow2') {{(pid=84312) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 16 14:56:05 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [req-ce69a367-2eae-4e30-acaf-3f4a88a8629b req-16b811df-70bb-4f0c-98f7-9fd33f73423e tempest-AttachVolumeShelveTestJSON-1870144154 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c/volume-1d2d2164-2d63-4cb8-84db-04d369193c7d {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 14:56:06 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [req-ce69a367-2eae-4e30-acaf-3f4a88a8629b req-16b811df-70bb-4f0c-98f7-9fd33f73423e tempest-AttachVolumeShelveTestJSON-1870144154 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c/volume-1d2d2164-2d63-4cb8-84db-04d369193c7d" returned: 0 in 0.502s {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 14:56:06 devstack cinder-volume[83259]: DEBUG oslo_concurrency.lockutils [req-ce69a367-2eae-4e30-acaf-3f4a88a8629b req-16b811df-70bb-4f0c-98f7-9fd33f73423e tempest-AttachVolumeShelveTestJSON-1870144154 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.575s {{(pid=83259) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 16 14:56:06 devstack cinder-volume[83259]: DEBUG cinder.volume.manager [req-ce69a367-2eae-4e30-acaf-3f4a88a8629b req-16b811df-70bb-4f0c-98f7-9fd33f73423e tempest-AttachVolumeShelveTestJSON-1870144154 None] Connection info returned from driver {'export': '10.10.41.181/cinder-vol-61f585ac-f8e2-4d19-a890-7ebc2726cc72', 'name': 'volume-1d2d2164-2d63-4cb8-84db-04d369193c7d', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'cb0f18dd-ee53-4754-be63-ff2503ae6301', 'enforce_multipath': True} {{(pid=83259) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4891}} Sep 16 14:56:06 devstack cinder-volume[83259]: WARNING cinder.volume.volume_utils [req-ce69a367-2eae-4e30-acaf-3f4a88a8629b req-16b811df-70bb-4f0c-98f7-9fd33f73423e tempest-AttachVolumeShelveTestJSON-1870144154 None] Volume driver (QuobyteDriver 1.2) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 16 14:56:06 devstack cinder-volume[83259]: INFO cinder.volume.manager [req-ce69a367-2eae-4e30-acaf-3f4a88a8629b req-16b811df-70bb-4f0c-98f7-9fd33f73423e tempest-AttachVolumeShelveTestJSON-1870144154 None] attachment_update completed successfully. Sep 16 14:56:16 devstack cinder-volume[83259]: DEBUG dbcounter [-] [83259] Writing DB stats cinder:SELECT=5,cinder:UPDATE=1 {{(pid=83259) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Sep 16 14:56:16 devstack cinder-volume[83259]: DEBUG dbcounter [-] [83259] Writing DB stats cinder:SELECT=7,cinder:UPDATE=3 {{(pid=83259) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Sep 16 14:56:44 devstack cinder-volume[83259]: DEBUG oslo_service.periodic_task [None req-050ec8a1-6ffd-499d-95ad-d548a84437e2 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=83259) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} Sep 16 14:56:44 devstack cinder-volume[83259]: DEBUG oslo_concurrency.lockutils [None req-050ec8a1-6ffd-499d-95ad-d548a84437e2 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83259) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 16 14:56:44 devstack cinder-volume[83259]: DEBUG oslo_concurrency.lockutils [None req-050ec8a1-6ffd-499d-95ad-d548a84437e2 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=83259) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 16 14:56:44 devstack cinder-volume[83259]: DEBUG cinder.volume.drivers.quobyte [None req-050ec8a1-6ffd-499d-95ad-d548a84437e2 None None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-61f585ac-f8e2-4d19-a890-7ebc2726cc72': None} {{(pid=83259) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:639}} Sep 16 14:56:44 devstack cinder-volume[83259]: DEBUG cinder.volume.drivers.quobyte [None req-050ec8a1-6ffd-499d-95ad-d548a84437e2 None None] Available shares ['10.10.41.181/cinder-vol-61f585ac-f8e2-4d19-a890-7ebc2726cc72'] {{(pid=83259) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:669}} Sep 16 14:56:44 devstack cinder-volume[83259]: DEBUG oslo_concurrency.lockutils [None req-050ec8a1-6ffd-499d-95ad-d548a84437e2 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.044s {{(pid=83259) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 16 14:56:44 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [None req-050ec8a1-6ffd-499d-95ad-d548a84437e2 None None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 14:56:45 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [None req-050ec8a1-6ffd-499d-95ad-d548a84437e2 None None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c" returned: 0 in 0.290s {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 14:56:45 devstack cinder-volume[83259]: DEBUG cinder.manager [None req-050ec8a1-6ffd-499d-95ad-d548a84437e2 None None] Notifying Schedulers of capabilities ... {{(pid=83259) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 16 14:57:20 devstack cinder-volume[83259]: WARNING cinder.volume.volume_utils [req-8531da1a-f3d3-42a5-a8fb-2f28c69297d6 req-494e0d8d-8dc2-447f-98e7-50c0dd728552 tempest-AttachVolumeNegativeTest-1792000208 None] Volume driver (QuobyteDriver 1.2) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 16 14:57:20 devstack cinder-volume[83259]: WARNING cinder.volume.volume_utils [req-8531da1a-f3d3-42a5-a8fb-2f28c69297d6 req-494e0d8d-8dc2-447f-98e7-50c0dd728552 tempest-AttachVolumeNegativeTest-1792000208 None] Volume driver (QuobyteDriver 1.2) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 16 14:57:21 devstack cinder-volume[83259]: INFO cinder.volume.manager [req-8531da1a-f3d3-42a5-a8fb-2f28c69297d6 req-494e0d8d-8dc2-447f-98e7-50c0dd728552 tempest-AttachVolumeNegativeTest-1792000208 None] Terminate volume connection completed successfully. Sep 16 14:57:21 devstack cinder-volume[83259]: DEBUG cinder.volume.manager [req-8531da1a-f3d3-42a5-a8fb-2f28c69297d6 req-494e0d8d-8dc2-447f-98e7-50c0dd728552 tempest-AttachVolumeNegativeTest-1792000208 None] Deleting attachment bafd6cf4-e3a2-4505-9369-a60e7b0ff93c. {{(pid=83259) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5022}} Sep 16 14:57:30 devstack cinder-volume[83259]: DEBUG dbcounter [-] [83259] Writing DB stats cinder:SELECT=2 {{(pid=83259) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Sep 16 14:57:44 devstack cinder-volume[83259]: DEBUG oslo_service.periodic_task [None req-050ec8a1-6ffd-499d-95ad-d548a84437e2 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=83259) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} Sep 16 14:57:44 devstack cinder-volume[83259]: DEBUG oslo_concurrency.lockutils [None req-050ec8a1-6ffd-499d-95ad-d548a84437e2 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83259) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 16 14:57:44 devstack cinder-volume[83259]: DEBUG oslo_concurrency.lockutils [None req-050ec8a1-6ffd-499d-95ad-d548a84437e2 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.006s {{(pid=83259) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 16 14:57:44 devstack cinder-volume[83259]: DEBUG cinder.volume.drivers.quobyte [None req-050ec8a1-6ffd-499d-95ad-d548a84437e2 None None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-61f585ac-f8e2-4d19-a890-7ebc2726cc72': None} {{(pid=83259) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:639}} Sep 16 14:57:44 devstack cinder-volume[83259]: DEBUG cinder.volume.drivers.quobyte [None req-050ec8a1-6ffd-499d-95ad-d548a84437e2 None None] Available shares ['10.10.41.181/cinder-vol-61f585ac-f8e2-4d19-a890-7ebc2726cc72'] {{(pid=83259) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:669}} Sep 16 14:57:44 devstack cinder-volume[83259]: DEBUG oslo_concurrency.lockutils [None req-050ec8a1-6ffd-499d-95ad-d548a84437e2 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.031s {{(pid=83259) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 16 14:57:44 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [None req-050ec8a1-6ffd-499d-95ad-d548a84437e2 None None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 14:57:44 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [None req-050ec8a1-6ffd-499d-95ad-d548a84437e2 None None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c" returned: 0 in 0.286s {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 14:57:45 devstack cinder-volume[83259]: DEBUG cinder.manager [None req-050ec8a1-6ffd-499d-95ad-d548a84437e2 None None] Notifying Schedulers of capabilities ... {{(pid=83259) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 16 14:58:09 devstack cinder-volume[83259]: DEBUG dbcounter [-] [83259] Writing DB stats cinder:SELECT=1,cinder:UPDATE=1 {{(pid=83259) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Sep 16 14:58:23 devstack cinder-volume[83259]: WARNING cinder.volume.volume_utils [req-07768049-cb84-418a-9ef8-52835402529e req-598ed1a8-eb7d-4b3e-8108-134404f53339 tempest-AttachVolumeShelveTestJSON-1870144154 None] Volume driver (QuobyteDriver 1.2) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 16 14:58:23 devstack cinder-volume[83259]: WARNING cinder.volume.volume_utils [req-07768049-cb84-418a-9ef8-52835402529e req-598ed1a8-eb7d-4b3e-8108-134404f53339 tempest-AttachVolumeShelveTestJSON-1870144154 None] Volume driver (QuobyteDriver 1.2) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 16 14:58:23 devstack cinder-volume[83259]: INFO cinder.volume.manager [req-07768049-cb84-418a-9ef8-52835402529e req-598ed1a8-eb7d-4b3e-8108-134404f53339 tempest-AttachVolumeShelveTestJSON-1870144154 None] Terminate volume connection completed successfully. Sep 16 14:58:23 devstack cinder-volume[83259]: DEBUG cinder.volume.manager [req-07768049-cb84-418a-9ef8-52835402529e req-598ed1a8-eb7d-4b3e-8108-134404f53339 tempest-AttachVolumeShelveTestJSON-1870144154 None] Deleting attachment cb0f18dd-ee53-4754-be63-ff2503ae6301. {{(pid=83259) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5022}} Sep 16 14:58:33 devstack cinder-volume[83259]: DEBUG dbcounter [-] [83259] Writing DB stats cinder:SELECT=1 {{(pid=83259) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Sep 16 14:58:33 devstack cinder-volume[83259]: DEBUG dbcounter [-] [83259] Writing DB stats cinder:SELECT=1 {{(pid=83259) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Sep 16 14:58:40 devstack cinder-volume[83259]: WARNING cinder.volume.volume_utils [None req-4ed938fa-e47b-4e4f-aa55-28c1c1c14fe2 tempest-AttachVolumeTestJSON-915876093 None] Volume driver (QuobyteDriver 1.2) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 16 14:58:40 devstack cinder-volume[83259]: DEBUG cinder.volume.flows.manager.create_volume [None req-4ed938fa-e47b-4e4f-aa55-28c1c1c14fe2 tempest-AttachVolumeTestJSON-915876093 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#Quobyte'], 'hosts': ['devstack@QuobyteHD#Quobyte']} {{(pid=83259) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1387}} Sep 16 14:58:40 devstack cinder-volume[83259]: DEBUG cinder.volume.manager [None req-4ed938fa-e47b-4e4f-aa55-28c1c1c14fe2 tempest-AttachVolumeTestJSON-915876093 None] Flow 'volume_create_manager' (2c9b0cdc-0a68-44bf-b644-2e83167c8be4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83259) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 16 14:58:40 devstack cinder-volume[83259]: DEBUG cinder.volume.manager [None req-4ed938fa-e47b-4e4f-aa55-28c1c1c14fe2 tempest-AttachVolumeTestJSON-915876093 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (795ba848-e0b1-48b8-a428-b663f7da0277) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83259) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 14:58:40 devstack cinder-volume[83259]: DEBUG cinder.volume.manager [None req-4ed938fa-e47b-4e4f-aa55-28c1c1c14fe2 tempest-AttachVolumeTestJSON-915876093 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (795ba848-e0b1-48b8-a428-b663f7da0277) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-16T12:58:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-1849065132',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#Quobyte',id=81434dec-fe40-4312-b68f-92d3987af93f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='331242ac1f7b4849a722a7ac3f427737',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-16T12:58:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-16T12:58:40Z,use_quota=True,user_id='b8432da90b8b4bd288e28699b0a73a24',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(485ead50-3df8-4d76-8d34-a4db136c980a),volume_type_id=485ead50-3df8-4d76-8d34-a4db136c980a)' {{(pid=83259) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 14:58:40 devstack cinder-volume[83259]: DEBUG cinder.volume.manager [None req-4ed938fa-e47b-4e4f-aa55-28c1c1c14fe2 tempest-AttachVolumeTestJSON-915876093 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f6a31b62-c473-42d5-b3c5-075099db2e54) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83259) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 14:58:40 devstack cinder-volume[83259]: DEBUG cinder.volume.manager [None req-4ed938fa-e47b-4e4f-aa55-28c1c1c14fe2 tempest-AttachVolumeTestJSON-915876093 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f6a31b62-c473-42d5-b3c5-075099db2e54) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83259) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 14:58:40 devstack cinder-volume[83259]: DEBUG cinder.volume.manager [None req-4ed938fa-e47b-4e4f-aa55-28c1c1c14fe2 tempest-AttachVolumeTestJSON-915876093 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d04088b4-6fd2-4fae-a842-530a3c0a1425) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83259) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 14:58:40 devstack cinder-volume[83259]: DEBUG cinder.volume.manager [None req-4ed938fa-e47b-4e4f-aa55-28c1c1c14fe2 tempest-AttachVolumeTestJSON-915876093 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d04088b4-6fd2-4fae-a842-530a3c0a1425) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '81434dec-fe40-4312-b68f-92d3987af93f', 'volume_name': 'volume-81434dec-fe40-4312-b68f-92d3987af93f', 'volume_size': 1}' {{(pid=83259) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 14:58:40 devstack cinder-volume[83259]: DEBUG cinder.volume.manager [None req-4ed938fa-e47b-4e4f-aa55-28c1c1c14fe2 tempest-AttachVolumeTestJSON-915876093 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fc8b8254-2e1d-4596-bb5c-8bdd06cca2eb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83259) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 14:58:40 devstack cinder-volume[83259]: DEBUG cinder.volume.manager [None req-4ed938fa-e47b-4e4f-aa55-28c1c1c14fe2 tempest-AttachVolumeTestJSON-915876093 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fc8b8254-2e1d-4596-bb5c-8bdd06cca2eb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83259) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 14:58:40 devstack cinder-volume[83259]: DEBUG cinder.volume.manager [None req-4ed938fa-e47b-4e4f-aa55-28c1c1c14fe2 tempest-AttachVolumeTestJSON-915876093 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (195dbfbb-8c9a-4d8d-aaa5-4640c98759fa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83259) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 14:58:40 devstack cinder-volume[83259]: INFO cinder.volume.flows.manager.create_volume [None req-4ed938fa-e47b-4e4f-aa55-28c1c1c14fe2 tempest-AttachVolumeTestJSON-915876093 None] Volume 81434dec-fe40-4312-b68f-92d3987af93f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-81434dec-fe40-4312-b68f-92d3987af93f', 'volume_size': 1} Sep 16 14:58:40 devstack cinder-volume[83259]: DEBUG oslo_concurrency.lockutils [None req-4ed938fa-e47b-4e4f-aa55-28c1c1c14fe2 tempest-AttachVolumeTestJSON-915876093 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83259) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 16 14:58:40 devstack cinder-volume[83259]: DEBUG oslo_concurrency.lockutils [None req-4ed938fa-e47b-4e4f-aa55-28c1c1c14fe2 tempest-AttachVolumeTestJSON-915876093 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.005s {{(pid=83259) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 16 14:58:40 devstack cinder-volume[83259]: DEBUG cinder.volume.drivers.quobyte [None req-4ed938fa-e47b-4e4f-aa55-28c1c1c14fe2 tempest-AttachVolumeTestJSON-915876093 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-16T12:58:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-1849065132',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#Quobyte',id=81434dec-fe40-4312-b68f-92d3987af93f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='331242ac1f7b4849a722a7ac3f427737',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-16T12:58:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-16T12:58:40Z,use_quota=True,user_id='b8432da90b8b4bd288e28699b0a73a24',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(485ead50-3df8-4d76-8d34-a4db136c980a),volume_type_id=485ead50-3df8-4d76-8d34-a4db136c980a)}" {{(pid=83259) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Sep 16 14:58:40 devstack cinder-volume[83259]: DEBUG cinder.volume.drivers.remotefs [None req-4ed938fa-e47b-4e4f-aa55-28c1c1c14fe2 tempest-AttachVolumeTestJSON-915876093 None] Creating volume 81434dec-fe40-4312-b68f-92d3987af93f {{(pid=83259) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}} Sep 16 14:58:40 devstack cinder-volume[83259]: DEBUG oslo_concurrency.lockutils [None req-4ed938fa-e47b-4e4f-aa55-28c1c1c14fe2 tempest-AttachVolumeTestJSON-915876093 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83259) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 16 14:58:40 devstack cinder-volume[83259]: DEBUG oslo_concurrency.lockutils [None req-4ed938fa-e47b-4e4f-aa55-28c1c1c14fe2 tempest-AttachVolumeTestJSON-915876093 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83259) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 16 14:58:40 devstack cinder-volume[83259]: DEBUG cinder.volume.drivers.quobyte [None req-4ed938fa-e47b-4e4f-aa55-28c1c1c14fe2 tempest-AttachVolumeTestJSON-915876093 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-61f585ac-f8e2-4d19-a890-7ebc2726cc72': None} {{(pid=83259) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:639}} Sep 16 14:58:40 devstack cinder-volume[83259]: DEBUG cinder.volume.drivers.quobyte [None req-4ed938fa-e47b-4e4f-aa55-28c1c1c14fe2 tempest-AttachVolumeTestJSON-915876093 None] Available shares ['10.10.41.181/cinder-vol-61f585ac-f8e2-4d19-a890-7ebc2726cc72'] {{(pid=83259) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:669}} Sep 16 14:58:40 devstack cinder-volume[83259]: DEBUG oslo_concurrency.lockutils [None req-4ed938fa-e47b-4e4f-aa55-28c1c1c14fe2 tempest-AttachVolumeTestJSON-915876093 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=83259) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 16 14:58:40 devstack cinder-volume[83259]: DEBUG cinder.volume.drivers.quobyte [None req-4ed938fa-e47b-4e4f-aa55-28c1c1c14fe2 tempest-AttachVolumeTestJSON-915876093 None] Selected 10.10.41.181/cinder-vol-61f585ac-f8e2-4d19-a890-7ebc2726cc72 as target Quobyte volume. {{(pid=83259) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:690}} Sep 16 14:58:40 devstack cinder-volume[83259]: INFO cinder.volume.drivers.remotefs [None req-4ed938fa-e47b-4e4f-aa55-28c1c1c14fe2 tempest-AttachVolumeTestJSON-915876093 None] casted to 10.10.41.181/cinder-vol-61f585ac-f8e2-4d19-a890-7ebc2726cc72 Sep 16 14:58:40 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [None req-4ed938fa-e47b-4e4f-aa55-28c1c1c14fe2 tempest-AttachVolumeTestJSON-915876093 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c/volume-81434dec-fe40-4312-b68f-92d3987af93f 1073741824 {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 14:58:41 devstack quobyte-client[83286]: The server volume:87712ffe-8a69-446d-9ed6-4430c7ee9792@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=87712ffe-8a69-446d-9ed6-4430c7ee9792, inode=15, name=volume-81434dec-fe40-4312-b68f-92d3987af93f, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.206), requestorAccessMask=0 Sep 16 14:58:41 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [None req-4ed938fa-e47b-4e4f-aa55-28c1c1c14fe2 tempest-AttachVolumeTestJSON-915876093 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c/volume-81434dec-fe40-4312-b68f-92d3987af93f 1073741824" returned: 0 in 0.987s {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 14:58:41 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [None req-4ed938fa-e47b-4e4f-aa55-28c1c1c14fe2 tempest-AttachVolumeTestJSON-915876093 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c/volume-81434dec-fe40-4312-b68f-92d3987af93f {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 14:58:42 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [None req-4ed938fa-e47b-4e4f-aa55-28c1c1c14fe2 tempest-AttachVolumeTestJSON-915876093 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c/volume-81434dec-fe40-4312-b68f-92d3987af93f" returned: 0 in 0.273s {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 14:58:42 devstack cinder-volume[83259]: DEBUG cinder.volume.drivers.quobyte [None req-4ed938fa-e47b-4e4f-aa55-28c1c1c14fe2 tempest-AttachVolumeTestJSON-915876093 None] <== create_volume: return (1401ms) {'provider_location': '10.10.41.181/cinder-vol-61f585ac-f8e2-4d19-a890-7ebc2726cc72'} {{(pid=83259) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Sep 16 14:58:42 devstack cinder-volume[83259]: DEBUG oslo_concurrency.lockutils [None req-4ed938fa-e47b-4e4f-aa55-28c1c1c14fe2 tempest-AttachVolumeTestJSON-915876093 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.419s {{(pid=83259) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 16 14:58:42 devstack cinder-volume[83259]: DEBUG cinder.volume.manager [None req-4ed938fa-e47b-4e4f-aa55-28c1c1c14fe2 tempest-AttachVolumeTestJSON-915876093 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (195dbfbb-8c9a-4d8d-aaa5-4640c98759fa) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-81434dec-fe40-4312-b68f-92d3987af93f', 'volume_size': 1}' {{(pid=83259) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 14:58:42 devstack cinder-volume[83259]: DEBUG cinder.volume.manager [None req-4ed938fa-e47b-4e4f-aa55-28c1c1c14fe2 tempest-AttachVolumeTestJSON-915876093 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (647ed7af-a9c4-4420-84a3-8c4cda507dd7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83259) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 14:58:42 devstack cinder-volume[83259]: INFO cinder.volume.flows.manager.create_volume [None req-4ed938fa-e47b-4e4f-aa55-28c1c1c14fe2 tempest-AttachVolumeTestJSON-915876093 None] Volume volume-81434dec-fe40-4312-b68f-92d3987af93f (81434dec-fe40-4312-b68f-92d3987af93f): created successfully Sep 16 14:58:42 devstack cinder-volume[83259]: DEBUG cinder.volume.manager [None req-4ed938fa-e47b-4e4f-aa55-28c1c1c14fe2 tempest-AttachVolumeTestJSON-915876093 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (647ed7af-a9c4-4420-84a3-8c4cda507dd7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83259) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 14:58:42 devstack cinder-volume[83259]: DEBUG cinder.volume.manager [None req-4ed938fa-e47b-4e4f-aa55-28c1c1c14fe2 tempest-AttachVolumeTestJSON-915876093 None] Flow 'volume_create_manager' (2c9b0cdc-0a68-44bf-b644-2e83167c8be4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83259) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 16 14:58:42 devstack cinder-volume[83259]: INFO cinder.volume.manager [None req-4ed938fa-e47b-4e4f-aa55-28c1c1c14fe2 tempest-AttachVolumeTestJSON-915876093 None] Created volume successfully. Sep 16 14:58:44 devstack cinder-volume[83259]: DEBUG oslo_service.periodic_task [None req-050ec8a1-6ffd-499d-95ad-d548a84437e2 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=83259) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} Sep 16 14:58:44 devstack cinder-volume[83259]: DEBUG oslo_concurrency.lockutils [None req-050ec8a1-6ffd-499d-95ad-d548a84437e2 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83259) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 16 14:58:44 devstack cinder-volume[83259]: DEBUG oslo_concurrency.lockutils [None req-050ec8a1-6ffd-499d-95ad-d548a84437e2 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.005s {{(pid=83259) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 16 14:58:44 devstack cinder-volume[83259]: DEBUG cinder.volume.drivers.quobyte [None req-050ec8a1-6ffd-499d-95ad-d548a84437e2 None None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-61f585ac-f8e2-4d19-a890-7ebc2726cc72': None} {{(pid=83259) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:639}} Sep 16 14:58:44 devstack cinder-volume[83259]: DEBUG cinder.volume.drivers.quobyte [None req-050ec8a1-6ffd-499d-95ad-d548a84437e2 None None] Available shares ['10.10.41.181/cinder-vol-61f585ac-f8e2-4d19-a890-7ebc2726cc72'] {{(pid=83259) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:669}} Sep 16 14:58:44 devstack cinder-volume[83259]: DEBUG oslo_concurrency.lockutils [None req-050ec8a1-6ffd-499d-95ad-d548a84437e2 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.025s {{(pid=83259) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 16 14:58:44 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [None req-050ec8a1-6ffd-499d-95ad-d548a84437e2 None None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 14:58:44 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [None req-050ec8a1-6ffd-499d-95ad-d548a84437e2 None None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c" returned: 0 in 0.214s {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 14:58:44 devstack cinder-volume[83259]: DEBUG cinder.manager [None req-050ec8a1-6ffd-499d-95ad-d548a84437e2 None None] Notifying Schedulers of capabilities ... {{(pid=83259) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 16 14:58:49 devstack cinder-volume[83259]: DEBUG oslo_concurrency.lockutils [req-93527150-602d-4fa6-bde5-ab2f377a4470 req-ce04cafd-5adb-4fb1-8459-afe7969bb103 tempest-AttachVolumeTestJSON-915876093 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=83259) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 16 14:58:49 devstack cinder-volume[83259]: DEBUG oslo_concurrency.lockutils [req-93527150-602d-4fa6-bde5-ab2f377a4470 req-ce04cafd-5adb-4fb1-8459-afe7969bb103 tempest-AttachVolumeTestJSON-915876093 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.004s {{(pid=83259) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 16 14:58:49 devstack cinder-volume[83259]: DEBUG oslo.privsep.daemon [-] privsep: reply[07ae6408-1aa5-4405-b7e5-2db44b55b509]: (4, 'qcow2') {{(pid=84312) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 16 14:58:49 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [req-93527150-602d-4fa6-bde5-ab2f377a4470 req-ce04cafd-5adb-4fb1-8459-afe7969bb103 tempest-AttachVolumeTestJSON-915876093 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c/volume-81434dec-fe40-4312-b68f-92d3987af93f {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 14:58:50 devstack quobyte-client[83286]: System call of process 90875 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 16 14:58:50 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [req-93527150-602d-4fa6-bde5-ab2f377a4470 req-ce04cafd-5adb-4fb1-8459-afe7969bb103 tempest-AttachVolumeTestJSON-915876093 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c/volume-81434dec-fe40-4312-b68f-92d3987af93f" returned: 0 in 0.577s {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 14:58:50 devstack cinder-volume[83259]: DEBUG oslo_concurrency.lockutils [req-93527150-602d-4fa6-bde5-ab2f377a4470 req-ce04cafd-5adb-4fb1-8459-afe7969bb103 tempest-AttachVolumeTestJSON-915876093 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.669s {{(pid=83259) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 16 14:58:51 devstack cinder-volume[83259]: DEBUG cinder.volume.manager [req-93527150-602d-4fa6-bde5-ab2f377a4470 req-ce04cafd-5adb-4fb1-8459-afe7969bb103 tempest-AttachVolumeTestJSON-915876093 None] Connection info returned from driver {'export': '10.10.41.181/cinder-vol-61f585ac-f8e2-4d19-a890-7ebc2726cc72', 'name': 'volume-81434dec-fe40-4312-b68f-92d3987af93f', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '4a1bc2d0-fc03-455a-8977-cbff6c083166', 'enforce_multipath': True} {{(pid=83259) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4891}} Sep 16 14:58:51 devstack cinder-volume[83259]: WARNING cinder.volume.volume_utils [req-93527150-602d-4fa6-bde5-ab2f377a4470 req-ce04cafd-5adb-4fb1-8459-afe7969bb103 tempest-AttachVolumeTestJSON-915876093 None] Volume driver (QuobyteDriver 1.2) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 16 14:58:51 devstack cinder-volume[83259]: INFO cinder.volume.manager [req-93527150-602d-4fa6-bde5-ab2f377a4470 req-ce04cafd-5adb-4fb1-8459-afe7969bb103 tempest-AttachVolumeTestJSON-915876093 None] attachment_update completed successfully. Sep 16 14:58:59 devstack cinder-volume[83259]: WARNING cinder.volume.volume_utils [None req-a68a9c3b-5756-4f43-8513-13cee02a70f9 tempest-AttachVolumeTestJSON-915876093 None] Volume driver (QuobyteDriver 1.2) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 16 14:58:59 devstack cinder-volume[83259]: DEBUG cinder.volume.flows.manager.create_volume [None req-a68a9c3b-5756-4f43-8513-13cee02a70f9 tempest-AttachVolumeTestJSON-915876093 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#Quobyte'], 'hosts': ['devstack@QuobyteHD#Quobyte']} {{(pid=83259) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1387}} Sep 16 14:59:00 devstack cinder-volume[83259]: DEBUG cinder.volume.manager [None req-a68a9c3b-5756-4f43-8513-13cee02a70f9 tempest-AttachVolumeTestJSON-915876093 None] Flow 'volume_create_manager' (1bfd38aa-db7d-407f-9ccd-41610cf44c54) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83259) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 16 14:59:00 devstack cinder-volume[83259]: DEBUG cinder.volume.manager [None req-a68a9c3b-5756-4f43-8513-13cee02a70f9 tempest-AttachVolumeTestJSON-915876093 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3e022f40-2366-4a92-996c-aba10d5902a7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83259) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 14:59:00 devstack cinder-volume[83259]: DEBUG cinder.volume.manager [None req-a68a9c3b-5756-4f43-8513-13cee02a70f9 tempest-AttachVolumeTestJSON-915876093 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3e022f40-2366-4a92-996c-aba10d5902a7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-16T12:58:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-1324028577',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#Quobyte',id=431c6780-942d-4cfd-a36f-8b56ad91b09f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='331242ac1f7b4849a722a7ac3f427737',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-16T12:59:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-16T12:59:00Z,use_quota=True,user_id='b8432da90b8b4bd288e28699b0a73a24',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(485ead50-3df8-4d76-8d34-a4db136c980a),volume_type_id=485ead50-3df8-4d76-8d34-a4db136c980a)' {{(pid=83259) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 14:59:00 devstack cinder-volume[83259]: DEBUG cinder.volume.manager [None req-a68a9c3b-5756-4f43-8513-13cee02a70f9 tempest-AttachVolumeTestJSON-915876093 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d17577e3-d9df-4d04-a413-a02e9108e6f3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83259) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 14:59:00 devstack cinder-volume[83259]: DEBUG cinder.volume.manager [None req-a68a9c3b-5756-4f43-8513-13cee02a70f9 tempest-AttachVolumeTestJSON-915876093 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d17577e3-d9df-4d04-a413-a02e9108e6f3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83259) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 14:59:00 devstack cinder-volume[83259]: DEBUG cinder.volume.manager [None req-a68a9c3b-5756-4f43-8513-13cee02a70f9 tempest-AttachVolumeTestJSON-915876093 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ed73e549-6694-4316-9c50-85a07a458092) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83259) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 14:59:00 devstack cinder-volume[83259]: DEBUG cinder.volume.manager [None req-a68a9c3b-5756-4f43-8513-13cee02a70f9 tempest-AttachVolumeTestJSON-915876093 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ed73e549-6694-4316-9c50-85a07a458092) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '431c6780-942d-4cfd-a36f-8b56ad91b09f', 'volume_name': 'volume-431c6780-942d-4cfd-a36f-8b56ad91b09f', 'volume_size': 1}' {{(pid=83259) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 14:59:00 devstack cinder-volume[83259]: DEBUG cinder.volume.manager [None req-a68a9c3b-5756-4f43-8513-13cee02a70f9 tempest-AttachVolumeTestJSON-915876093 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8515df10-b6dd-4305-8fd5-05af95e623ac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83259) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 14:59:00 devstack cinder-volume[83259]: DEBUG cinder.volume.manager [None req-a68a9c3b-5756-4f43-8513-13cee02a70f9 tempest-AttachVolumeTestJSON-915876093 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8515df10-b6dd-4305-8fd5-05af95e623ac) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83259) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 14:59:00 devstack cinder-volume[83259]: DEBUG cinder.volume.manager [None req-a68a9c3b-5756-4f43-8513-13cee02a70f9 tempest-AttachVolumeTestJSON-915876093 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ea67a68d-5d62-44a6-85b8-8e20c4e29735) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83259) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 14:59:00 devstack cinder-volume[83259]: INFO cinder.volume.flows.manager.create_volume [None req-a68a9c3b-5756-4f43-8513-13cee02a70f9 tempest-AttachVolumeTestJSON-915876093 None] Volume 431c6780-942d-4cfd-a36f-8b56ad91b09f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-431c6780-942d-4cfd-a36f-8b56ad91b09f', 'volume_size': 1} Sep 16 14:59:00 devstack cinder-volume[83259]: DEBUG oslo_concurrency.lockutils [None req-a68a9c3b-5756-4f43-8513-13cee02a70f9 tempest-AttachVolumeTestJSON-915876093 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83259) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 16 14:59:00 devstack cinder-volume[83259]: DEBUG oslo_concurrency.lockutils [None req-a68a9c3b-5756-4f43-8513-13cee02a70f9 tempest-AttachVolumeTestJSON-915876093 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.004s {{(pid=83259) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 16 14:59:00 devstack cinder-volume[83259]: DEBUG cinder.volume.drivers.quobyte [None req-a68a9c3b-5756-4f43-8513-13cee02a70f9 tempest-AttachVolumeTestJSON-915876093 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-16T12:58:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-1324028577',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#Quobyte',id=431c6780-942d-4cfd-a36f-8b56ad91b09f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='331242ac1f7b4849a722a7ac3f427737',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-16T12:59:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-16T12:59:00Z,use_quota=True,user_id='b8432da90b8b4bd288e28699b0a73a24',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(485ead50-3df8-4d76-8d34-a4db136c980a),volume_type_id=485ead50-3df8-4d76-8d34-a4db136c980a)}" {{(pid=83259) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Sep 16 14:59:00 devstack cinder-volume[83259]: DEBUG cinder.volume.drivers.remotefs [None req-a68a9c3b-5756-4f43-8513-13cee02a70f9 tempest-AttachVolumeTestJSON-915876093 None] Creating volume 431c6780-942d-4cfd-a36f-8b56ad91b09f {{(pid=83259) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}} Sep 16 14:59:00 devstack cinder-volume[83259]: DEBUG oslo_concurrency.lockutils [None req-a68a9c3b-5756-4f43-8513-13cee02a70f9 tempest-AttachVolumeTestJSON-915876093 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83259) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 16 14:59:00 devstack cinder-volume[83259]: DEBUG oslo_concurrency.lockutils [None req-a68a9c3b-5756-4f43-8513-13cee02a70f9 tempest-AttachVolumeTestJSON-915876093 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83259) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 16 14:59:00 devstack cinder-volume[83259]: DEBUG cinder.volume.drivers.quobyte [None req-a68a9c3b-5756-4f43-8513-13cee02a70f9 tempest-AttachVolumeTestJSON-915876093 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-61f585ac-f8e2-4d19-a890-7ebc2726cc72': None} {{(pid=83259) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:639}} Sep 16 14:59:00 devstack cinder-volume[83259]: DEBUG cinder.volume.drivers.quobyte [None req-a68a9c3b-5756-4f43-8513-13cee02a70f9 tempest-AttachVolumeTestJSON-915876093 None] Available shares ['10.10.41.181/cinder-vol-61f585ac-f8e2-4d19-a890-7ebc2726cc72'] {{(pid=83259) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:669}} Sep 16 14:59:00 devstack cinder-volume[83259]: DEBUG oslo_concurrency.lockutils [None req-a68a9c3b-5756-4f43-8513-13cee02a70f9 tempest-AttachVolumeTestJSON-915876093 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=83259) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 16 14:59:00 devstack cinder-volume[83259]: DEBUG cinder.volume.drivers.quobyte [None req-a68a9c3b-5756-4f43-8513-13cee02a70f9 tempest-AttachVolumeTestJSON-915876093 None] Selected 10.10.41.181/cinder-vol-61f585ac-f8e2-4d19-a890-7ebc2726cc72 as target Quobyte volume. {{(pid=83259) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:690}} Sep 16 14:59:00 devstack cinder-volume[83259]: INFO cinder.volume.drivers.remotefs [None req-a68a9c3b-5756-4f43-8513-13cee02a70f9 tempest-AttachVolumeTestJSON-915876093 None] casted to 10.10.41.181/cinder-vol-61f585ac-f8e2-4d19-a890-7ebc2726cc72 Sep 16 14:59:00 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [None req-a68a9c3b-5756-4f43-8513-13cee02a70f9 tempest-AttachVolumeTestJSON-915876093 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c/volume-431c6780-942d-4cfd-a36f-8b56ad91b09f 1073741824 {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 14:59:00 devstack quobyte-client[83286]: System call of process 91290 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 16 14:59:00 devstack quobyte-client[83286]: The server volume:87712ffe-8a69-446d-9ed6-4430c7ee9792@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=87712ffe-8a69-446d-9ed6-4430c7ee9792, inode=16, name=volume-431c6780-942d-4cfd-a36f-8b56ad91b09f, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.206), requestorAccessMask=0 Sep 16 14:59:01 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [None req-a68a9c3b-5756-4f43-8513-13cee02a70f9 tempest-AttachVolumeTestJSON-915876093 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c/volume-431c6780-942d-4cfd-a36f-8b56ad91b09f 1073741824" returned: 0 in 0.823s {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 14:59:01 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [None req-a68a9c3b-5756-4f43-8513-13cee02a70f9 tempest-AttachVolumeTestJSON-915876093 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c/volume-431c6780-942d-4cfd-a36f-8b56ad91b09f {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 14:59:01 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [None req-a68a9c3b-5756-4f43-8513-13cee02a70f9 tempest-AttachVolumeTestJSON-915876093 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c/volume-431c6780-942d-4cfd-a36f-8b56ad91b09f" returned: 0 in 0.202s {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 14:59:01 devstack cinder-volume[83259]: DEBUG cinder.volume.drivers.quobyte [None req-a68a9c3b-5756-4f43-8513-13cee02a70f9 tempest-AttachVolumeTestJSON-915876093 None] <== create_volume: return (1150ms) {'provider_location': '10.10.41.181/cinder-vol-61f585ac-f8e2-4d19-a890-7ebc2726cc72'} {{(pid=83259) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Sep 16 14:59:01 devstack cinder-volume[83259]: DEBUG oslo_concurrency.lockutils [None req-a68a9c3b-5756-4f43-8513-13cee02a70f9 tempest-AttachVolumeTestJSON-915876093 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.185s {{(pid=83259) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 16 14:59:01 devstack cinder-volume[83259]: DEBUG cinder.volume.manager [None req-a68a9c3b-5756-4f43-8513-13cee02a70f9 tempest-AttachVolumeTestJSON-915876093 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ea67a68d-5d62-44a6-85b8-8e20c4e29735) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-431c6780-942d-4cfd-a36f-8b56ad91b09f', 'volume_size': 1}' {{(pid=83259) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 14:59:01 devstack cinder-volume[83259]: DEBUG cinder.volume.manager [None req-a68a9c3b-5756-4f43-8513-13cee02a70f9 tempest-AttachVolumeTestJSON-915876093 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (54a8d3e3-c96f-44f1-ba0b-0b760e907812) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83259) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 14:59:01 devstack cinder-volume[83259]: INFO cinder.volume.flows.manager.create_volume [None req-a68a9c3b-5756-4f43-8513-13cee02a70f9 tempest-AttachVolumeTestJSON-915876093 None] Volume volume-431c6780-942d-4cfd-a36f-8b56ad91b09f (431c6780-942d-4cfd-a36f-8b56ad91b09f): created successfully Sep 16 14:59:01 devstack cinder-volume[83259]: DEBUG cinder.volume.manager [None req-a68a9c3b-5756-4f43-8513-13cee02a70f9 tempest-AttachVolumeTestJSON-915876093 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (54a8d3e3-c96f-44f1-ba0b-0b760e907812) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83259) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 14:59:01 devstack cinder-volume[83259]: DEBUG cinder.volume.manager [None req-a68a9c3b-5756-4f43-8513-13cee02a70f9 tempest-AttachVolumeTestJSON-915876093 None] Flow 'volume_create_manager' (1bfd38aa-db7d-407f-9ccd-41610cf44c54) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83259) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 16 14:59:01 devstack cinder-volume[83259]: INFO cinder.volume.manager [None req-a68a9c3b-5756-4f43-8513-13cee02a70f9 tempest-AttachVolumeTestJSON-915876093 None] Created volume successfully. Sep 16 14:59:06 devstack cinder-volume[83259]: DEBUG oslo_concurrency.lockutils [req-343efb7f-46b9-4ef6-bb48-438fd58af959 req-4c26da48-e3a4-4380-ba7e-2d6d37005f7f tempest-AttachVolumeTestJSON-915876093 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=83259) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 16 14:59:06 devstack cinder-volume[83259]: DEBUG oslo_concurrency.lockutils [req-343efb7f-46b9-4ef6-bb48-438fd58af959 req-4c26da48-e3a4-4380-ba7e-2d6d37005f7f tempest-AttachVolumeTestJSON-915876093 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.003s {{(pid=83259) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 16 14:59:06 devstack cinder-volume[83259]: DEBUG oslo.privsep.daemon [-] privsep: reply[5ca147a7-b902-4be5-baee-932bc57b86fc]: (4, 'qcow2') {{(pid=84312) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 16 14:59:06 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [req-343efb7f-46b9-4ef6-bb48-438fd58af959 req-4c26da48-e3a4-4380-ba7e-2d6d37005f7f tempest-AttachVolumeTestJSON-915876093 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c/volume-431c6780-942d-4cfd-a36f-8b56ad91b09f {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 14:59:07 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [req-343efb7f-46b9-4ef6-bb48-438fd58af959 req-4c26da48-e3a4-4380-ba7e-2d6d37005f7f tempest-AttachVolumeTestJSON-915876093 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c/volume-431c6780-942d-4cfd-a36f-8b56ad91b09f" returned: 0 in 0.429s {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 14:59:07 devstack cinder-volume[83259]: DEBUG oslo_concurrency.lockutils [req-343efb7f-46b9-4ef6-bb48-438fd58af959 req-4c26da48-e3a4-4380-ba7e-2d6d37005f7f tempest-AttachVolumeTestJSON-915876093 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.491s {{(pid=83259) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 16 14:59:07 devstack cinder-volume[83259]: DEBUG cinder.volume.manager [req-343efb7f-46b9-4ef6-bb48-438fd58af959 req-4c26da48-e3a4-4380-ba7e-2d6d37005f7f tempest-AttachVolumeTestJSON-915876093 None] Connection info returned from driver {'export': '10.10.41.181/cinder-vol-61f585ac-f8e2-4d19-a890-7ebc2726cc72', 'name': 'volume-431c6780-942d-4cfd-a36f-8b56ad91b09f', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '82165f17-9ccd-48cf-b7bf-b6fcfd2acd01', 'enforce_multipath': True} {{(pid=83259) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4891}} Sep 16 14:59:07 devstack cinder-volume[83259]: WARNING cinder.volume.volume_utils [req-343efb7f-46b9-4ef6-bb48-438fd58af959 req-4c26da48-e3a4-4380-ba7e-2d6d37005f7f tempest-AttachVolumeTestJSON-915876093 None] Volume driver (QuobyteDriver 1.2) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 16 14:59:07 devstack cinder-volume[83259]: INFO cinder.volume.manager [req-343efb7f-46b9-4ef6-bb48-438fd58af959 req-4c26da48-e3a4-4380-ba7e-2d6d37005f7f tempest-AttachVolumeTestJSON-915876093 None] attachment_update completed successfully. Sep 16 14:59:17 devstack cinder-volume[83259]: DEBUG dbcounter [-] [83259] Writing DB stats cinder:SELECT=13,cinder:DELETE=1,cinder:UPDATE=5 {{(pid=83259) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Sep 16 14:59:17 devstack cinder-volume[83259]: DEBUG dbcounter [-] [83259] Writing DB stats cinder:UPDATE=9,cinder:SELECT=13,cinder:DELETE=1 {{(pid=83259) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Sep 16 14:59:30 devstack cinder-volume[83259]: WARNING cinder.volume.volume_utils [None req-deb05d62-3d8c-45b4-810f-fc403a9f55a4 tempest-AttachVolumeNegativeTest-1792000208 None] Volume driver (QuobyteDriver 1.2) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 16 14:59:30 devstack cinder-volume[83259]: DEBUG cinder.volume.flows.manager.create_volume [None req-deb05d62-3d8c-45b4-810f-fc403a9f55a4 tempest-AttachVolumeNegativeTest-1792000208 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#Quobyte'], 'hosts': ['devstack@QuobyteHD#Quobyte']} {{(pid=83259) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1387}} Sep 16 14:59:30 devstack cinder-volume[83259]: DEBUG cinder.volume.manager [None req-deb05d62-3d8c-45b4-810f-fc403a9f55a4 tempest-AttachVolumeNegativeTest-1792000208 None] Flow 'volume_create_manager' (e8b0eea5-f37d-4577-a563-8b64cb501786) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83259) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 16 14:59:30 devstack cinder-volume[83259]: DEBUG cinder.volume.manager [None req-deb05d62-3d8c-45b4-810f-fc403a9f55a4 tempest-AttachVolumeNegativeTest-1792000208 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (399802c0-0941-4d63-a8ea-5cbbb21772ea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83259) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 14:59:30 devstack cinder-volume[83259]: DEBUG cinder.volume.manager [None req-deb05d62-3d8c-45b4-810f-fc403a9f55a4 tempest-AttachVolumeNegativeTest-1792000208 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (399802c0-0941-4d63-a8ea-5cbbb21772ea) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-16T12:59:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-617198277',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#Quobyte',id=a65a9189-8157-4c94-9cd3-809421b0b1cb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6f9bb5f3fa194a3b9bc3b14a650a0c50',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-16T12:59:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-16T12:59:30Z,use_quota=True,user_id='4e8bef68591e4514a725ed5d2c8799ab',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(485ead50-3df8-4d76-8d34-a4db136c980a),volume_type_id=485ead50-3df8-4d76-8d34-a4db136c980a)' {{(pid=83259) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 14:59:30 devstack cinder-volume[83259]: DEBUG cinder.volume.manager [None req-deb05d62-3d8c-45b4-810f-fc403a9f55a4 tempest-AttachVolumeNegativeTest-1792000208 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (065bd384-06e3-45a5-abf5-0932358258cb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83259) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 14:59:30 devstack cinder-volume[83259]: DEBUG cinder.volume.manager [None req-deb05d62-3d8c-45b4-810f-fc403a9f55a4 tempest-AttachVolumeNegativeTest-1792000208 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (065bd384-06e3-45a5-abf5-0932358258cb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83259) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 14:59:30 devstack cinder-volume[83259]: DEBUG cinder.volume.manager [None req-deb05d62-3d8c-45b4-810f-fc403a9f55a4 tempest-AttachVolumeNegativeTest-1792000208 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e0f07bbf-5e69-4253-8cc3-b5e4403a4dd1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83259) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 14:59:30 devstack cinder-volume[83259]: DEBUG cinder.volume.manager [None req-deb05d62-3d8c-45b4-810f-fc403a9f55a4 tempest-AttachVolumeNegativeTest-1792000208 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e0f07bbf-5e69-4253-8cc3-b5e4403a4dd1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a65a9189-8157-4c94-9cd3-809421b0b1cb', 'volume_name': 'volume-a65a9189-8157-4c94-9cd3-809421b0b1cb', 'volume_size': 1}' {{(pid=83259) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 14:59:30 devstack cinder-volume[83259]: DEBUG cinder.volume.manager [None req-deb05d62-3d8c-45b4-810f-fc403a9f55a4 tempest-AttachVolumeNegativeTest-1792000208 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5e56e20c-fa2e-4ea4-92f8-2c68cf2c302d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83259) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 14:59:30 devstack cinder-volume[83259]: DEBUG cinder.volume.manager [None req-deb05d62-3d8c-45b4-810f-fc403a9f55a4 tempest-AttachVolumeNegativeTest-1792000208 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5e56e20c-fa2e-4ea4-92f8-2c68cf2c302d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83259) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 14:59:30 devstack cinder-volume[83259]: DEBUG cinder.volume.manager [None req-deb05d62-3d8c-45b4-810f-fc403a9f55a4 tempest-AttachVolumeNegativeTest-1792000208 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b232eca8-8af5-4a1b-bbc0-925b42944642) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83259) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 14:59:30 devstack cinder-volume[83259]: INFO cinder.volume.flows.manager.create_volume [None req-deb05d62-3d8c-45b4-810f-fc403a9f55a4 tempest-AttachVolumeNegativeTest-1792000208 None] Volume a65a9189-8157-4c94-9cd3-809421b0b1cb: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a65a9189-8157-4c94-9cd3-809421b0b1cb', 'volume_size': 1} Sep 16 14:59:30 devstack cinder-volume[83259]: DEBUG oslo_concurrency.lockutils [None req-deb05d62-3d8c-45b4-810f-fc403a9f55a4 tempest-AttachVolumeNegativeTest-1792000208 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83259) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 16 14:59:30 devstack cinder-volume[83259]: DEBUG oslo_concurrency.lockutils [None req-deb05d62-3d8c-45b4-810f-fc403a9f55a4 tempest-AttachVolumeNegativeTest-1792000208 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=83259) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 16 14:59:30 devstack cinder-volume[83259]: DEBUG cinder.volume.drivers.quobyte [None req-deb05d62-3d8c-45b4-810f-fc403a9f55a4 tempest-AttachVolumeNegativeTest-1792000208 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-16T12:59:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-617198277',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#Quobyte',id=a65a9189-8157-4c94-9cd3-809421b0b1cb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6f9bb5f3fa194a3b9bc3b14a650a0c50',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-16T12:59:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-16T12:59:30Z,use_quota=True,user_id='4e8bef68591e4514a725ed5d2c8799ab',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(485ead50-3df8-4d76-8d34-a4db136c980a),volume_type_id=485ead50-3df8-4d76-8d34-a4db136c980a)}" {{(pid=83259) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Sep 16 14:59:30 devstack cinder-volume[83259]: DEBUG cinder.volume.drivers.remotefs [None req-deb05d62-3d8c-45b4-810f-fc403a9f55a4 tempest-AttachVolumeNegativeTest-1792000208 None] Creating volume a65a9189-8157-4c94-9cd3-809421b0b1cb {{(pid=83259) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}} Sep 16 14:59:30 devstack cinder-volume[83259]: DEBUG oslo_concurrency.lockutils [None req-deb05d62-3d8c-45b4-810f-fc403a9f55a4 tempest-AttachVolumeNegativeTest-1792000208 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83259) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 16 14:59:30 devstack cinder-volume[83259]: DEBUG oslo_concurrency.lockutils [None req-deb05d62-3d8c-45b4-810f-fc403a9f55a4 tempest-AttachVolumeNegativeTest-1792000208 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83259) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 16 14:59:30 devstack cinder-volume[83259]: DEBUG cinder.volume.drivers.quobyte [None req-deb05d62-3d8c-45b4-810f-fc403a9f55a4 tempest-AttachVolumeNegativeTest-1792000208 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-61f585ac-f8e2-4d19-a890-7ebc2726cc72': None} {{(pid=83259) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:639}} Sep 16 14:59:30 devstack cinder-volume[83259]: DEBUG cinder.volume.drivers.quobyte [None req-deb05d62-3d8c-45b4-810f-fc403a9f55a4 tempest-AttachVolumeNegativeTest-1792000208 None] Available shares ['10.10.41.181/cinder-vol-61f585ac-f8e2-4d19-a890-7ebc2726cc72'] {{(pid=83259) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:669}} Sep 16 14:59:30 devstack cinder-volume[83259]: DEBUG oslo_concurrency.lockutils [None req-deb05d62-3d8c-45b4-810f-fc403a9f55a4 tempest-AttachVolumeNegativeTest-1792000208 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=83259) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 16 14:59:30 devstack cinder-volume[83259]: DEBUG cinder.volume.drivers.quobyte [None req-deb05d62-3d8c-45b4-810f-fc403a9f55a4 tempest-AttachVolumeNegativeTest-1792000208 None] Selected 10.10.41.181/cinder-vol-61f585ac-f8e2-4d19-a890-7ebc2726cc72 as target Quobyte volume. {{(pid=83259) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:690}} Sep 16 14:59:30 devstack cinder-volume[83259]: INFO cinder.volume.drivers.remotefs [None req-deb05d62-3d8c-45b4-810f-fc403a9f55a4 tempest-AttachVolumeNegativeTest-1792000208 None] casted to 10.10.41.181/cinder-vol-61f585ac-f8e2-4d19-a890-7ebc2726cc72 Sep 16 14:59:30 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [None req-deb05d62-3d8c-45b4-810f-fc403a9f55a4 tempest-AttachVolumeNegativeTest-1792000208 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c/volume-a65a9189-8157-4c94-9cd3-809421b0b1cb 1073741824 {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 14:59:30 devstack quobyte-client[83286]: System call of process 91510 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 16 14:59:30 devstack quobyte-client[83286]: The server volume:87712ffe-8a69-446d-9ed6-4430c7ee9792@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=87712ffe-8a69-446d-9ed6-4430c7ee9792, inode=17, name=volume-a65a9189-8157-4c94-9cd3-809421b0b1cb, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.206), requestorAccessMask=0 Sep 16 14:59:30 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [None req-deb05d62-3d8c-45b4-810f-fc403a9f55a4 tempest-AttachVolumeNegativeTest-1792000208 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c/volume-a65a9189-8157-4c94-9cd3-809421b0b1cb 1073741824" returned: 0 in 0.357s {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 14:59:30 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [None req-deb05d62-3d8c-45b4-810f-fc403a9f55a4 tempest-AttachVolumeNegativeTest-1792000208 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c/volume-a65a9189-8157-4c94-9cd3-809421b0b1cb {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 14:59:30 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [None req-deb05d62-3d8c-45b4-810f-fc403a9f55a4 tempest-AttachVolumeNegativeTest-1792000208 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c/volume-a65a9189-8157-4c94-9cd3-809421b0b1cb" returned: 0 in 0.129s {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 14:59:30 devstack cinder-volume[83259]: DEBUG cinder.volume.drivers.quobyte [None req-deb05d62-3d8c-45b4-810f-fc403a9f55a4 tempest-AttachVolumeNegativeTest-1792000208 None] <== create_volume: return (624ms) {'provider_location': '10.10.41.181/cinder-vol-61f585ac-f8e2-4d19-a890-7ebc2726cc72'} {{(pid=83259) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Sep 16 14:59:30 devstack cinder-volume[83259]: DEBUG oslo_concurrency.lockutils [None req-deb05d62-3d8c-45b4-810f-fc403a9f55a4 tempest-AttachVolumeNegativeTest-1792000208 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.638s {{(pid=83259) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 16 14:59:31 devstack cinder-volume[83259]: DEBUG cinder.volume.manager [None req-deb05d62-3d8c-45b4-810f-fc403a9f55a4 tempest-AttachVolumeNegativeTest-1792000208 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b232eca8-8af5-4a1b-bbc0-925b42944642) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a65a9189-8157-4c94-9cd3-809421b0b1cb', 'volume_size': 1}' {{(pid=83259) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 14:59:31 devstack cinder-volume[83259]: DEBUG cinder.volume.manager [None req-deb05d62-3d8c-45b4-810f-fc403a9f55a4 tempest-AttachVolumeNegativeTest-1792000208 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d4c1a5a7-5fe6-4066-a474-9f50aca4646e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83259) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 14:59:31 devstack cinder-volume[83259]: INFO cinder.volume.flows.manager.create_volume [None req-deb05d62-3d8c-45b4-810f-fc403a9f55a4 tempest-AttachVolumeNegativeTest-1792000208 None] Volume volume-a65a9189-8157-4c94-9cd3-809421b0b1cb (a65a9189-8157-4c94-9cd3-809421b0b1cb): created successfully Sep 16 14:59:31 devstack cinder-volume[83259]: DEBUG cinder.volume.manager [None req-deb05d62-3d8c-45b4-810f-fc403a9f55a4 tempest-AttachVolumeNegativeTest-1792000208 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d4c1a5a7-5fe6-4066-a474-9f50aca4646e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83259) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 14:59:31 devstack cinder-volume[83259]: DEBUG cinder.volume.manager [None req-deb05d62-3d8c-45b4-810f-fc403a9f55a4 tempest-AttachVolumeNegativeTest-1792000208 None] Flow 'volume_create_manager' (e8b0eea5-f37d-4577-a563-8b64cb501786) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83259) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 16 14:59:31 devstack cinder-volume[83259]: INFO cinder.volume.manager [None req-deb05d62-3d8c-45b4-810f-fc403a9f55a4 tempest-AttachVolumeNegativeTest-1792000208 None] Created volume successfully. Sep 16 14:59:36 devstack cinder-volume[83259]: DEBUG oslo_concurrency.lockutils [req-6f127107-5a92-417e-ace5-06df858a33ce req-a7a98fb0-ed6c-42a3-b558-c40d2b5cf634 tempest-AttachVolumeNegativeTest-1792000208 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=83259) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 16 14:59:36 devstack cinder-volume[83259]: DEBUG oslo_concurrency.lockutils [req-6f127107-5a92-417e-ace5-06df858a33ce req-a7a98fb0-ed6c-42a3-b558-c40d2b5cf634 tempest-AttachVolumeNegativeTest-1792000208 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.005s {{(pid=83259) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 16 14:59:36 devstack cinder-volume[83259]: DEBUG oslo.privsep.daemon [-] privsep: reply[6a0da884-a1b0-4869-a9cc-89bc0da89ea4]: (4, 'qcow2') {{(pid=84312) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 16 14:59:36 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [req-6f127107-5a92-417e-ace5-06df858a33ce req-a7a98fb0-ed6c-42a3-b558-c40d2b5cf634 tempest-AttachVolumeNegativeTest-1792000208 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c/volume-a65a9189-8157-4c94-9cd3-809421b0b1cb {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 14:59:36 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [req-6f127107-5a92-417e-ace5-06df858a33ce req-a7a98fb0-ed6c-42a3-b558-c40d2b5cf634 tempest-AttachVolumeNegativeTest-1792000208 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c/volume-a65a9189-8157-4c94-9cd3-809421b0b1cb" returned: 0 in 0.550s {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 14:59:36 devstack cinder-volume[83259]: DEBUG oslo_concurrency.lockutils [req-6f127107-5a92-417e-ace5-06df858a33ce req-a7a98fb0-ed6c-42a3-b558-c40d2b5cf634 tempest-AttachVolumeNegativeTest-1792000208 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.620s {{(pid=83259) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 16 14:59:37 devstack cinder-volume[83259]: DEBUG cinder.volume.manager [req-6f127107-5a92-417e-ace5-06df858a33ce req-a7a98fb0-ed6c-42a3-b558-c40d2b5cf634 tempest-AttachVolumeNegativeTest-1792000208 None] Connection info returned from driver {'export': '10.10.41.181/cinder-vol-61f585ac-f8e2-4d19-a890-7ebc2726cc72', 'name': 'volume-a65a9189-8157-4c94-9cd3-809421b0b1cb', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '94247913-ad6c-4eed-b41e-2d7a9fd392a1', 'enforce_multipath': True} {{(pid=83259) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4891}} Sep 16 14:59:37 devstack cinder-volume[83259]: WARNING cinder.volume.volume_utils [req-6f127107-5a92-417e-ace5-06df858a33ce req-a7a98fb0-ed6c-42a3-b558-c40d2b5cf634 tempest-AttachVolumeNegativeTest-1792000208 None] Volume driver (QuobyteDriver 1.2) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 16 14:59:37 devstack cinder-volume[83259]: INFO cinder.volume.manager [req-6f127107-5a92-417e-ace5-06df858a33ce req-a7a98fb0-ed6c-42a3-b558-c40d2b5cf634 tempest-AttachVolumeNegativeTest-1792000208 None] attachment_update completed successfully. Sep 16 14:59:40 devstack cinder-volume[83259]: WARNING cinder.volume.volume_utils [req-9cde579d-ce27-4732-a880-e7d52153b098 req-8f48e693-63f7-4df7-bb04-6a80a2e00a19 tempest-AttachVolumeTestJSON-915876093 None] Volume driver (QuobyteDriver 1.2) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 16 14:59:40 devstack cinder-volume[83259]: WARNING cinder.volume.volume_utils [req-9cde579d-ce27-4732-a880-e7d52153b098 req-8f48e693-63f7-4df7-bb04-6a80a2e00a19 tempest-AttachVolumeTestJSON-915876093 None] Volume driver (QuobyteDriver 1.2) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 16 14:59:40 devstack cinder-volume[83259]: INFO cinder.volume.manager [req-9cde579d-ce27-4732-a880-e7d52153b098 req-8f48e693-63f7-4df7-bb04-6a80a2e00a19 tempest-AttachVolumeTestJSON-915876093 None] Terminate volume connection completed successfully. Sep 16 14:59:40 devstack cinder-volume[83259]: DEBUG cinder.volume.manager [req-9cde579d-ce27-4732-a880-e7d52153b098 req-8f48e693-63f7-4df7-bb04-6a80a2e00a19 tempest-AttachVolumeTestJSON-915876093 None] Deleting attachment 4a1bc2d0-fc03-455a-8977-cbff6c083166. {{(pid=83259) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5022}} Sep 16 14:59:44 devstack cinder-volume[83259]: DEBUG oslo_service.periodic_task [None req-050ec8a1-6ffd-499d-95ad-d548a84437e2 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=83259) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} Sep 16 14:59:44 devstack cinder-volume[83259]: DEBUG oslo_concurrency.lockutils [None req-050ec8a1-6ffd-499d-95ad-d548a84437e2 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83259) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 16 14:59:44 devstack cinder-volume[83259]: DEBUG oslo_concurrency.lockutils [None req-050ec8a1-6ffd-499d-95ad-d548a84437e2 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=83259) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 16 14:59:44 devstack cinder-volume[83259]: DEBUG cinder.volume.drivers.quobyte [None req-050ec8a1-6ffd-499d-95ad-d548a84437e2 None None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-61f585ac-f8e2-4d19-a890-7ebc2726cc72': None} {{(pid=83259) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:639}} Sep 16 14:59:44 devstack cinder-volume[83259]: DEBUG cinder.volume.drivers.quobyte [None req-050ec8a1-6ffd-499d-95ad-d548a84437e2 None None] Available shares ['10.10.41.181/cinder-vol-61f585ac-f8e2-4d19-a890-7ebc2726cc72'] {{(pid=83259) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:669}} Sep 16 14:59:44 devstack cinder-volume[83259]: DEBUG oslo_concurrency.lockutils [None req-050ec8a1-6ffd-499d-95ad-d548a84437e2 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=83259) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 16 14:59:44 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [None req-050ec8a1-6ffd-499d-95ad-d548a84437e2 None None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 14:59:44 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [None req-050ec8a1-6ffd-499d-95ad-d548a84437e2 None None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c" returned: 0 in 0.111s {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 14:59:44 devstack cinder-volume[83259]: DEBUG cinder.manager [None req-050ec8a1-6ffd-499d-95ad-d548a84437e2 None None] Notifying Schedulers of capabilities ... {{(pid=83259) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 16 14:59:50 devstack cinder-volume[83259]: DEBUG dbcounter [-] [83259] Writing DB stats cinder:UPDATE=2,cinder:DELETE=1,cinder:SELECT=4 {{(pid=83259) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Sep 16 14:59:50 devstack cinder-volume[83259]: DEBUG dbcounter [-] [83259] Writing DB stats cinder:SELECT=11,cinder:UPDATE=5 {{(pid=83259) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Sep 16 15:00:04 devstack cinder-volume[83259]: WARNING cinder.volume.volume_utils [req-463ccace-1860-440e-bf99-31882acd32d6 req-80291bad-8dd4-452d-9932-a1ae67a5febb tempest-AttachVolumeTestJSON-915876093 None] Volume driver (QuobyteDriver 1.2) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 16 15:00:04 devstack cinder-volume[83259]: WARNING cinder.volume.volume_utils [req-463ccace-1860-440e-bf99-31882acd32d6 req-80291bad-8dd4-452d-9932-a1ae67a5febb tempest-AttachVolumeTestJSON-915876093 None] Volume driver (QuobyteDriver 1.2) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 16 15:00:04 devstack cinder-volume[83259]: INFO cinder.volume.manager [req-463ccace-1860-440e-bf99-31882acd32d6 req-80291bad-8dd4-452d-9932-a1ae67a5febb tempest-AttachVolumeTestJSON-915876093 None] Terminate volume connection completed successfully. Sep 16 15:00:04 devstack cinder-volume[83259]: DEBUG cinder.volume.manager [req-463ccace-1860-440e-bf99-31882acd32d6 req-80291bad-8dd4-452d-9932-a1ae67a5febb tempest-AttachVolumeTestJSON-915876093 None] Deleting attachment 82165f17-9ccd-48cf-b7bf-b6fcfd2acd01. {{(pid=83259) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5022}} Sep 16 15:00:05 devstack cinder-volume[83259]: WARNING cinder.volume.volume_utils [req-822c7bd1-c38d-4882-b8b3-be1d3b57ed53 req-2908666b-5be8-4f00-8e25-fab4ee66f8c4 tempest-AttachVolumeNegativeTest-1792000208 None] Volume driver (QuobyteDriver 1.2) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 16 15:00:05 devstack cinder-volume[83259]: WARNING cinder.volume.volume_utils [req-822c7bd1-c38d-4882-b8b3-be1d3b57ed53 req-2908666b-5be8-4f00-8e25-fab4ee66f8c4 tempest-AttachVolumeNegativeTest-1792000208 None] Volume driver (QuobyteDriver 1.2) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 16 15:00:05 devstack cinder-volume[83259]: INFO cinder.volume.manager [req-822c7bd1-c38d-4882-b8b3-be1d3b57ed53 req-2908666b-5be8-4f00-8e25-fab4ee66f8c4 tempest-AttachVolumeNegativeTest-1792000208 None] Terminate volume connection completed successfully. Sep 16 15:00:05 devstack cinder-volume[83259]: DEBUG cinder.volume.manager [req-822c7bd1-c38d-4882-b8b3-be1d3b57ed53 req-2908666b-5be8-4f00-8e25-fab4ee66f8c4 tempest-AttachVolumeNegativeTest-1792000208 None] Deleting attachment 94247913-ad6c-4eed-b41e-2d7a9fd392a1. {{(pid=83259) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5022}} Sep 16 15:00:14 devstack cinder-volume[83259]: DEBUG dbcounter [-] [83259] Writing DB stats cinder:SELECT=2 {{(pid=83259) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Sep 16 15:00:15 devstack cinder-volume[83259]: DEBUG dbcounter [-] [83259] Writing DB stats cinder:UPDATE=1,cinder:SELECT=3 {{(pid=83259) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Sep 16 15:00:21 devstack cinder-volume[83259]: DEBUG cinder.coordination [None req-ba34ab76-9a02-4b2c-ac45-a964428e6581 tempest-AttachVolumeTestJSON-915876093 None] Acquiring lock "cinder-431c6780-942d-4cfd-a36f-8b56ad91b09f-delete_volume" by "delete_volume" {{(pid=83259) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 16 15:00:21 devstack cinder-volume[83259]: DEBUG cinder.coordination [None req-ba34ab76-9a02-4b2c-ac45-a964428e6581 tempest-AttachVolumeTestJSON-915876093 None] Lock "cinder-431c6780-942d-4cfd-a36f-8b56ad91b09f-delete_volume" acquired by "delete_volume" :: waited 0.039s {{(pid=83259) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 16 15:00:21 devstack cinder-volume[83259]: WARNING cinder.volume.volume_utils [None req-ba34ab76-9a02-4b2c-ac45-a964428e6581 tempest-AttachVolumeTestJSON-915876093 None] Volume driver (QuobyteDriver 1.2) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 16 15:00:21 devstack cinder-volume[83259]: DEBUG cinder.coordination [None req-ba34ab76-9a02-4b2c-ac45-a964428e6581 tempest-AttachVolumeTestJSON-915876093 None] Acquiring lock "cinder-quobyte-431c6780-942d-4cfd-a36f-8b56ad91b09f" by "delete_volume" {{(pid=83259) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 16 15:00:21 devstack cinder-volume[83259]: DEBUG cinder.coordination [None req-ba34ab76-9a02-4b2c-ac45-a964428e6581 tempest-AttachVolumeTestJSON-915876093 None] Lock "cinder-quobyte-431c6780-942d-4cfd-a36f-8b56ad91b09f" acquired by "delete_volume" :: waited 0.015s {{(pid=83259) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 16 15:00:21 devstack cinder-volume[83259]: DEBUG oslo.privsep.daemon [-] privsep: reply[fe4e41b1-1914-4a79-8616-94b57d60daf3]: (4, 'qcow2') {{(pid=84312) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 16 15:00:21 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [None req-ba34ab76-9a02-4b2c-ac45-a964428e6581 tempest-AttachVolumeTestJSON-915876093 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c/volume-431c6780-942d-4cfd-a36f-8b56ad91b09f {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 15:00:22 devstack quobyte-client[83286]: System call of process 91750 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 16 15:00:22 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [None req-ba34ab76-9a02-4b2c-ac45-a964428e6581 tempest-AttachVolumeTestJSON-915876093 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c/volume-431c6780-942d-4cfd-a36f-8b56ad91b09f" returned: 0 in 0.822s {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 15:00:22 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [None req-ba34ab76-9a02-4b2c-ac45-a964428e6581 tempest-AttachVolumeTestJSON-915876093 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c/volume-431c6780-942d-4cfd-a36f-8b56ad91b09f {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 15:00:22 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [None req-ba34ab76-9a02-4b2c-ac45-a964428e6581 tempest-AttachVolumeTestJSON-915876093 None] CMD "rm -f /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c/volume-431c6780-942d-4cfd-a36f-8b56ad91b09f" returned: 0 in 0.277s {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 15:00:22 devstack cinder-volume[83259]: DEBUG cinder.coordination [None req-ba34ab76-9a02-4b2c-ac45-a964428e6581 tempest-AttachVolumeTestJSON-915876093 None] Lock "cinder-quobyte-431c6780-942d-4cfd-a36f-8b56ad91b09f" released by "delete_volume" :: held 1.365s {{(pid=83259) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 16 15:00:23 devstack cinder-volume[83259]: DEBUG cinder.quota [None req-ba34ab76-9a02-4b2c-ac45-a964428e6581 tempest-AttachVolumeTestJSON-915876093 None] Created reservations ['92cdee90-51ab-41fe-a148-acdc9da4e4ec', '93d89e35-202b-47a2-a1b9-bd66b54562f5', '8bb81ceb-a88a-4434-884c-9d26673fb25a', '08faa466-2822-4eb9-a3ff-d2fd913274e0'] {{(pid=83259) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 16 15:00:23 devstack cinder-volume[83259]: DEBUG oslo_concurrency.lockutils [None req-ba34ab76-9a02-4b2c-ac45-a964428e6581 tempest-AttachVolumeTestJSON-915876093 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83259) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 16 15:00:23 devstack cinder-volume[83259]: DEBUG oslo_concurrency.lockutils [None req-ba34ab76-9a02-4b2c-ac45-a964428e6581 tempest-AttachVolumeTestJSON-915876093 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.006s {{(pid=83259) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 16 15:00:23 devstack cinder-volume[83259]: DEBUG cinder.volume.drivers.quobyte [None req-ba34ab76-9a02-4b2c-ac45-a964428e6581 tempest-AttachVolumeTestJSON-915876093 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-61f585ac-f8e2-4d19-a890-7ebc2726cc72': None} {{(pid=83259) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:639}} Sep 16 15:00:23 devstack cinder-volume[83259]: DEBUG cinder.volume.drivers.quobyte [None req-ba34ab76-9a02-4b2c-ac45-a964428e6581 tempest-AttachVolumeTestJSON-915876093 None] Available shares ['10.10.41.181/cinder-vol-61f585ac-f8e2-4d19-a890-7ebc2726cc72'] {{(pid=83259) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:669}} Sep 16 15:00:23 devstack cinder-volume[83259]: DEBUG oslo_concurrency.lockutils [None req-ba34ab76-9a02-4b2c-ac45-a964428e6581 tempest-AttachVolumeTestJSON-915876093 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.022s {{(pid=83259) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 16 15:00:23 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [None req-ba34ab76-9a02-4b2c-ac45-a964428e6581 tempest-AttachVolumeTestJSON-915876093 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 15:00:23 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [None req-ba34ab76-9a02-4b2c-ac45-a964428e6581 tempest-AttachVolumeTestJSON-915876093 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c" returned: 0 in 0.176s {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 15:00:23 devstack cinder-volume[83259]: DEBUG cinder.manager [None req-ba34ab76-9a02-4b2c-ac45-a964428e6581 tempest-AttachVolumeTestJSON-915876093 None] Notifying Schedulers of capabilities ... {{(pid=83259) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 16 15:00:23 devstack cinder-volume[83259]: INFO cinder.volume.manager [None req-ba34ab76-9a02-4b2c-ac45-a964428e6581 tempest-AttachVolumeTestJSON-915876093 None] Deleted volume successfully. Sep 16 15:00:24 devstack cinder-volume[83259]: DEBUG cinder.coordination [None req-90b38982-9fa6-459e-a580-3eb2f0e02481 tempest-AttachVolumeTestJSON-915876093 None] Acquiring lock "cinder-81434dec-fe40-4312-b68f-92d3987af93f-delete_volume" by "delete_volume" {{(pid=83259) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 16 15:00:24 devstack cinder-volume[83259]: DEBUG cinder.coordination [None req-ba34ab76-9a02-4b2c-ac45-a964428e6581 tempest-AttachVolumeTestJSON-915876093 None] Lock "cinder-431c6780-942d-4cfd-a36f-8b56ad91b09f-delete_volume" released by "delete_volume" :: held 3.013s {{(pid=83259) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 16 15:00:24 devstack cinder-volume[83259]: DEBUG cinder.coordination [None req-90b38982-9fa6-459e-a580-3eb2f0e02481 tempest-AttachVolumeTestJSON-915876093 None] Lock "cinder-81434dec-fe40-4312-b68f-92d3987af93f-delete_volume" acquired by "delete_volume" :: waited 0.206s {{(pid=83259) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 16 15:00:24 devstack cinder-volume[83259]: WARNING cinder.volume.volume_utils [None req-90b38982-9fa6-459e-a580-3eb2f0e02481 tempest-AttachVolumeTestJSON-915876093 None] Volume driver (QuobyteDriver 1.2) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 16 15:00:24 devstack cinder-volume[83259]: DEBUG cinder.coordination [None req-90b38982-9fa6-459e-a580-3eb2f0e02481 tempest-AttachVolumeTestJSON-915876093 None] Acquiring lock "cinder-quobyte-81434dec-fe40-4312-b68f-92d3987af93f" by "delete_volume" {{(pid=83259) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 16 15:00:24 devstack cinder-volume[83259]: DEBUG cinder.coordination [None req-90b38982-9fa6-459e-a580-3eb2f0e02481 tempest-AttachVolumeTestJSON-915876093 None] Lock "cinder-quobyte-81434dec-fe40-4312-b68f-92d3987af93f" acquired by "delete_volume" :: waited 0.026s {{(pid=83259) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 16 15:00:24 devstack cinder-volume[83259]: DEBUG oslo.privsep.daemon [-] privsep: reply[ea052bf5-6605-4de0-8247-103801c829d0]: (4, 'qcow2') {{(pid=84312) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 16 15:00:24 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [None req-90b38982-9fa6-459e-a580-3eb2f0e02481 tempest-AttachVolumeTestJSON-915876093 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c/volume-81434dec-fe40-4312-b68f-92d3987af93f {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 15:00:25 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [None req-90b38982-9fa6-459e-a580-3eb2f0e02481 tempest-AttachVolumeTestJSON-915876093 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c/volume-81434dec-fe40-4312-b68f-92d3987af93f" returned: 0 in 0.675s {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 15:00:25 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [None req-90b38982-9fa6-459e-a580-3eb2f0e02481 tempest-AttachVolumeTestJSON-915876093 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c/volume-81434dec-fe40-4312-b68f-92d3987af93f {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 15:00:25 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [None req-90b38982-9fa6-459e-a580-3eb2f0e02481 tempest-AttachVolumeTestJSON-915876093 None] CMD "rm -f /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c/volume-81434dec-fe40-4312-b68f-92d3987af93f" returned: 0 in 0.166s {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 15:00:25 devstack cinder-volume[83259]: DEBUG cinder.coordination [None req-90b38982-9fa6-459e-a580-3eb2f0e02481 tempest-AttachVolumeTestJSON-915876093 None] Lock "cinder-quobyte-81434dec-fe40-4312-b68f-92d3987af93f" released by "delete_volume" :: held 1.036s {{(pid=83259) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 16 15:00:26 devstack cinder-volume[83259]: DEBUG cinder.quota [None req-90b38982-9fa6-459e-a580-3eb2f0e02481 tempest-AttachVolumeTestJSON-915876093 None] Created reservations ['5ca86d13-fcb0-41d0-866f-7bf7e6ab3be7', 'f814b787-3193-420b-8f95-b28aa15e2848', '0444b512-8586-46de-a455-e331e525588d', '7abc83ad-eb80-4de6-878a-1ffb0e968a57'] {{(pid=83259) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 16 15:00:26 devstack cinder-volume[83259]: DEBUG oslo_concurrency.lockutils [None req-90b38982-9fa6-459e-a580-3eb2f0e02481 tempest-AttachVolumeTestJSON-915876093 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83259) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 16 15:00:26 devstack cinder-volume[83259]: DEBUG oslo_concurrency.lockutils [None req-90b38982-9fa6-459e-a580-3eb2f0e02481 tempest-AttachVolumeTestJSON-915876093 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=83259) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 16 15:00:26 devstack cinder-volume[83259]: DEBUG cinder.volume.drivers.quobyte [None req-90b38982-9fa6-459e-a580-3eb2f0e02481 tempest-AttachVolumeTestJSON-915876093 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-61f585ac-f8e2-4d19-a890-7ebc2726cc72': None} {{(pid=83259) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:639}} Sep 16 15:00:26 devstack cinder-volume[83259]: DEBUG cinder.volume.drivers.quobyte [None req-90b38982-9fa6-459e-a580-3eb2f0e02481 tempest-AttachVolumeTestJSON-915876093 None] Available shares ['10.10.41.181/cinder-vol-61f585ac-f8e2-4d19-a890-7ebc2726cc72'] {{(pid=83259) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:669}} Sep 16 15:00:26 devstack cinder-volume[83259]: DEBUG oslo_concurrency.lockutils [None req-90b38982-9fa6-459e-a580-3eb2f0e02481 tempest-AttachVolumeTestJSON-915876093 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=83259) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 16 15:00:26 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [None req-90b38982-9fa6-459e-a580-3eb2f0e02481 tempest-AttachVolumeTestJSON-915876093 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 15:00:26 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [None req-90b38982-9fa6-459e-a580-3eb2f0e02481 tempest-AttachVolumeTestJSON-915876093 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c" returned: 0 in 0.090s {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 15:00:26 devstack cinder-volume[83259]: DEBUG cinder.manager [None req-90b38982-9fa6-459e-a580-3eb2f0e02481 tempest-AttachVolumeTestJSON-915876093 None] Notifying Schedulers of capabilities ... {{(pid=83259) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 16 15:00:26 devstack cinder-volume[83259]: INFO cinder.volume.manager [None req-90b38982-9fa6-459e-a580-3eb2f0e02481 tempest-AttachVolumeTestJSON-915876093 None] Deleted volume successfully. Sep 16 15:00:26 devstack cinder-volume[83259]: DEBUG cinder.coordination [None req-90b38982-9fa6-459e-a580-3eb2f0e02481 tempest-AttachVolumeTestJSON-915876093 None] Lock "cinder-81434dec-fe40-4312-b68f-92d3987af93f-delete_volume" released by "delete_volume" :: held 2.100s {{(pid=83259) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 16 15:00:26 devstack cinder-volume[83259]: DEBUG cinder.coordination [None req-ea387096-7aec-43be-b03c-bc2ce395a430 tempest-AttachVolumeTestJSON-915876093 None] Acquiring lock "cinder-4b70d60a-fac5-44f1-a436-23faf8c9767c-delete_volume" by "delete_volume" {{(pid=83259) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 16 15:00:26 devstack cinder-volume[83259]: DEBUG cinder.coordination [None req-ea387096-7aec-43be-b03c-bc2ce395a430 tempest-AttachVolumeTestJSON-915876093 None] Lock "cinder-4b70d60a-fac5-44f1-a436-23faf8c9767c-delete_volume" acquired by "delete_volume" :: waited 0.104s {{(pid=83259) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 16 15:00:26 devstack cinder-volume[83259]: WARNING cinder.volume.volume_utils [None req-ea387096-7aec-43be-b03c-bc2ce395a430 tempest-AttachVolumeTestJSON-915876093 None] Volume driver (QuobyteDriver 1.2) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 16 15:00:26 devstack cinder-volume[83259]: DEBUG cinder.coordination [None req-ea387096-7aec-43be-b03c-bc2ce395a430 tempest-AttachVolumeTestJSON-915876093 None] Acquiring lock "cinder-quobyte-4b70d60a-fac5-44f1-a436-23faf8c9767c" by "delete_volume" {{(pid=83259) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 16 15:00:26 devstack cinder-volume[83259]: DEBUG cinder.coordination [None req-ea387096-7aec-43be-b03c-bc2ce395a430 tempest-AttachVolumeTestJSON-915876093 None] Lock "cinder-quobyte-4b70d60a-fac5-44f1-a436-23faf8c9767c" acquired by "delete_volume" :: waited 0.037s {{(pid=83259) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 16 15:00:26 devstack cinder-volume[83259]: DEBUG oslo.privsep.daemon [-] privsep: reply[f9df2a42-3cad-4c45-9548-64762822291f]: (4, 'qcow2') {{(pid=84312) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 16 15:00:26 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [None req-ea387096-7aec-43be-b03c-bc2ce395a430 tempest-AttachVolumeTestJSON-915876093 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c/volume-4b70d60a-fac5-44f1-a436-23faf8c9767c {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 15:00:27 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [None req-ea387096-7aec-43be-b03c-bc2ce395a430 tempest-AttachVolumeTestJSON-915876093 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c/volume-4b70d60a-fac5-44f1-a436-23faf8c9767c" returned: 0 in 0.617s {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 15:00:27 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [None req-ea387096-7aec-43be-b03c-bc2ce395a430 tempest-AttachVolumeTestJSON-915876093 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c/volume-4b70d60a-fac5-44f1-a436-23faf8c9767c {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 15:00:27 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [None req-ea387096-7aec-43be-b03c-bc2ce395a430 tempest-AttachVolumeTestJSON-915876093 None] CMD "rm -f /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c/volume-4b70d60a-fac5-44f1-a436-23faf8c9767c" returned: 0 in 0.136s {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 15:00:27 devstack cinder-volume[83259]: DEBUG cinder.coordination [None req-ea387096-7aec-43be-b03c-bc2ce395a430 tempest-AttachVolumeTestJSON-915876093 None] Lock "cinder-quobyte-4b70d60a-fac5-44f1-a436-23faf8c9767c" released by "delete_volume" :: held 1.049s {{(pid=83259) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 16 15:00:28 devstack cinder-volume[83259]: DEBUG cinder.quota [None req-ea387096-7aec-43be-b03c-bc2ce395a430 tempest-AttachVolumeTestJSON-915876093 None] Created reservations ['6b4457f7-4c82-43b2-ae3a-5b703f2e23f0', '36b41ea1-fba3-4a6e-8963-e0223839b567', '5e578611-4e88-456a-bc93-9643c9ea2462', '08fe8f7d-e100-420e-b74e-b21deddebbd0'] {{(pid=83259) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 16 15:00:28 devstack cinder-volume[83259]: DEBUG oslo_concurrency.lockutils [None req-ea387096-7aec-43be-b03c-bc2ce395a430 tempest-AttachVolumeTestJSON-915876093 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83259) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 16 15:00:28 devstack cinder-volume[83259]: DEBUG oslo_concurrency.lockutils [None req-ea387096-7aec-43be-b03c-bc2ce395a430 tempest-AttachVolumeTestJSON-915876093 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=83259) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 16 15:00:28 devstack cinder-volume[83259]: DEBUG cinder.volume.drivers.quobyte [None req-ea387096-7aec-43be-b03c-bc2ce395a430 tempest-AttachVolumeTestJSON-915876093 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-61f585ac-f8e2-4d19-a890-7ebc2726cc72': None} {{(pid=83259) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:639}} Sep 16 15:00:28 devstack cinder-volume[83259]: DEBUG cinder.volume.drivers.quobyte [None req-ea387096-7aec-43be-b03c-bc2ce395a430 tempest-AttachVolumeTestJSON-915876093 None] Available shares ['10.10.41.181/cinder-vol-61f585ac-f8e2-4d19-a890-7ebc2726cc72'] {{(pid=83259) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:669}} Sep 16 15:00:28 devstack cinder-volume[83259]: DEBUG oslo_concurrency.lockutils [None req-ea387096-7aec-43be-b03c-bc2ce395a430 tempest-AttachVolumeTestJSON-915876093 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=83259) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 16 15:00:28 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [None req-ea387096-7aec-43be-b03c-bc2ce395a430 tempest-AttachVolumeTestJSON-915876093 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 15:00:29 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [None req-ea387096-7aec-43be-b03c-bc2ce395a430 tempest-AttachVolumeTestJSON-915876093 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c" returned: 0 in 0.294s {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 15:00:29 devstack cinder-volume[83259]: DEBUG cinder.manager [None req-ea387096-7aec-43be-b03c-bc2ce395a430 tempest-AttachVolumeTestJSON-915876093 None] Notifying Schedulers of capabilities ... {{(pid=83259) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 16 15:00:29 devstack cinder-volume[83259]: INFO cinder.volume.manager [None req-ea387096-7aec-43be-b03c-bc2ce395a430 tempest-AttachVolumeTestJSON-915876093 None] Deleted volume successfully. Sep 16 15:00:30 devstack cinder-volume[83259]: DEBUG cinder.coordination [None req-ea387096-7aec-43be-b03c-bc2ce395a430 tempest-AttachVolumeTestJSON-915876093 None] Lock "cinder-4b70d60a-fac5-44f1-a436-23faf8c9767c-delete_volume" released by "delete_volume" :: held 3.248s {{(pid=83259) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 16 15:00:30 devstack cinder-volume[83259]: WARNING cinder.volume.volume_utils [None req-618d5e83-9627-41b9-94df-fd769960ce7a tempest-AttachVolumeShelveTestJSON-1870144154 None] Volume driver (QuobyteDriver 1.2) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 16 15:00:30 devstack cinder-volume[83259]: DEBUG cinder.volume.flows.manager.create_volume [None req-618d5e83-9627-41b9-94df-fd769960ce7a tempest-AttachVolumeShelveTestJSON-1870144154 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#Quobyte'], 'hosts': ['devstack@QuobyteHD#Quobyte']} {{(pid=83259) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1387}} Sep 16 15:00:30 devstack cinder-volume[83259]: DEBUG cinder.volume.manager [None req-618d5e83-9627-41b9-94df-fd769960ce7a tempest-AttachVolumeShelveTestJSON-1870144154 None] Flow 'volume_create_manager' (7ebf83d4-9a10-40d9-ba9c-521b676a5584) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83259) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 16 15:00:30 devstack cinder-volume[83259]: DEBUG cinder.volume.manager [None req-618d5e83-9627-41b9-94df-fd769960ce7a tempest-AttachVolumeShelveTestJSON-1870144154 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (407ed5ed-f00c-4efa-a4b8-5580d3bf28fd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83259) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 15:00:30 devstack cinder-volume[83259]: DEBUG cinder.volume.manager [None req-618d5e83-9627-41b9-94df-fd769960ce7a tempest-AttachVolumeShelveTestJSON-1870144154 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (407ed5ed-f00c-4efa-a4b8-5580d3bf28fd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-16T13:00:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-volume-220113752',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#Quobyte',id=df84a042-c784-400d-a1cc-463270aa0e26,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='45c144e02d244cdd8cf9ea862f5f1fbb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-16T13:00:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-16T13:00:30Z,use_quota=True,user_id='cf7c6ad97fd740eab49ab56b41295a5b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(485ead50-3df8-4d76-8d34-a4db136c980a),volume_type_id=485ead50-3df8-4d76-8d34-a4db136c980a)' {{(pid=83259) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 15:00:30 devstack cinder-volume[83259]: DEBUG cinder.volume.manager [None req-618d5e83-9627-41b9-94df-fd769960ce7a tempest-AttachVolumeShelveTestJSON-1870144154 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (99512428-cff6-4757-8b9c-784d6f56f430) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83259) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 15:00:30 devstack cinder-volume[83259]: DEBUG cinder.volume.manager [None req-618d5e83-9627-41b9-94df-fd769960ce7a tempest-AttachVolumeShelveTestJSON-1870144154 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (99512428-cff6-4757-8b9c-784d6f56f430) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83259) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 15:00:30 devstack cinder-volume[83259]: DEBUG cinder.volume.manager [None req-618d5e83-9627-41b9-94df-fd769960ce7a tempest-AttachVolumeShelveTestJSON-1870144154 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e56d3dc5-274d-4aa1-b6bc-1f0fda2f78b2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83259) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 15:00:30 devstack cinder-volume[83259]: DEBUG cinder.volume.manager [None req-618d5e83-9627-41b9-94df-fd769960ce7a tempest-AttachVolumeShelveTestJSON-1870144154 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e56d3dc5-274d-4aa1-b6bc-1f0fda2f78b2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'df84a042-c784-400d-a1cc-463270aa0e26', 'volume_name': 'volume-df84a042-c784-400d-a1cc-463270aa0e26', 'volume_size': 1}' {{(pid=83259) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 15:00:30 devstack cinder-volume[83259]: DEBUG cinder.volume.manager [None req-618d5e83-9627-41b9-94df-fd769960ce7a tempest-AttachVolumeShelveTestJSON-1870144154 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (59ea1c56-16e7-4e97-883c-ca93544cc0ea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83259) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 15:00:30 devstack cinder-volume[83259]: DEBUG cinder.volume.manager [None req-618d5e83-9627-41b9-94df-fd769960ce7a tempest-AttachVolumeShelveTestJSON-1870144154 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (59ea1c56-16e7-4e97-883c-ca93544cc0ea) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83259) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 15:00:30 devstack cinder-volume[83259]: DEBUG cinder.volume.manager [None req-618d5e83-9627-41b9-94df-fd769960ce7a tempest-AttachVolumeShelveTestJSON-1870144154 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ed353597-bb16-4fd6-b444-454a62b48cc8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83259) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 15:00:30 devstack cinder-volume[83259]: INFO cinder.volume.flows.manager.create_volume [None req-618d5e83-9627-41b9-94df-fd769960ce7a tempest-AttachVolumeShelveTestJSON-1870144154 None] Volume df84a042-c784-400d-a1cc-463270aa0e26: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-df84a042-c784-400d-a1cc-463270aa0e26', 'volume_size': 1} Sep 16 15:00:30 devstack cinder-volume[83259]: DEBUG oslo_concurrency.lockutils [None req-618d5e83-9627-41b9-94df-fd769960ce7a tempest-AttachVolumeShelveTestJSON-1870144154 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83259) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 16 15:00:30 devstack cinder-volume[83259]: DEBUG oslo_concurrency.lockutils [None req-618d5e83-9627-41b9-94df-fd769960ce7a tempest-AttachVolumeShelveTestJSON-1870144154 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=83259) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 16 15:00:30 devstack cinder-volume[83259]: DEBUG cinder.volume.drivers.quobyte [None req-618d5e83-9627-41b9-94df-fd769960ce7a tempest-AttachVolumeShelveTestJSON-1870144154 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-16T13:00:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-volume-220113752',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#Quobyte',id=df84a042-c784-400d-a1cc-463270aa0e26,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='45c144e02d244cdd8cf9ea862f5f1fbb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-16T13:00:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-16T13:00:30Z,use_quota=True,user_id='cf7c6ad97fd740eab49ab56b41295a5b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(485ead50-3df8-4d76-8d34-a4db136c980a),volume_type_id=485ead50-3df8-4d76-8d34-a4db136c980a)}" {{(pid=83259) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Sep 16 15:00:30 devstack cinder-volume[83259]: DEBUG cinder.volume.drivers.remotefs [None req-618d5e83-9627-41b9-94df-fd769960ce7a tempest-AttachVolumeShelveTestJSON-1870144154 None] Creating volume df84a042-c784-400d-a1cc-463270aa0e26 {{(pid=83259) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}} Sep 16 15:00:30 devstack cinder-volume[83259]: DEBUG oslo_concurrency.lockutils [None req-618d5e83-9627-41b9-94df-fd769960ce7a tempest-AttachVolumeShelveTestJSON-1870144154 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83259) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 16 15:00:30 devstack cinder-volume[83259]: DEBUG oslo_concurrency.lockutils [None req-618d5e83-9627-41b9-94df-fd769960ce7a tempest-AttachVolumeShelveTestJSON-1870144154 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83259) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 16 15:00:30 devstack cinder-volume[83259]: DEBUG cinder.volume.drivers.quobyte [None req-618d5e83-9627-41b9-94df-fd769960ce7a tempest-AttachVolumeShelveTestJSON-1870144154 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-61f585ac-f8e2-4d19-a890-7ebc2726cc72': None} {{(pid=83259) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:639}} Sep 16 15:00:30 devstack cinder-volume[83259]: DEBUG cinder.volume.drivers.quobyte [None req-618d5e83-9627-41b9-94df-fd769960ce7a tempest-AttachVolumeShelveTestJSON-1870144154 None] Available shares ['10.10.41.181/cinder-vol-61f585ac-f8e2-4d19-a890-7ebc2726cc72'] {{(pid=83259) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:669}} Sep 16 15:00:30 devstack cinder-volume[83259]: DEBUG oslo_concurrency.lockutils [None req-618d5e83-9627-41b9-94df-fd769960ce7a tempest-AttachVolumeShelveTestJSON-1870144154 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=83259) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 16 15:00:30 devstack cinder-volume[83259]: DEBUG cinder.volume.drivers.quobyte [None req-618d5e83-9627-41b9-94df-fd769960ce7a tempest-AttachVolumeShelveTestJSON-1870144154 None] Selected 10.10.41.181/cinder-vol-61f585ac-f8e2-4d19-a890-7ebc2726cc72 as target Quobyte volume. {{(pid=83259) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:690}} Sep 16 15:00:30 devstack cinder-volume[83259]: INFO cinder.volume.drivers.remotefs [None req-618d5e83-9627-41b9-94df-fd769960ce7a tempest-AttachVolumeShelveTestJSON-1870144154 None] casted to 10.10.41.181/cinder-vol-61f585ac-f8e2-4d19-a890-7ebc2726cc72 Sep 16 15:00:30 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [None req-618d5e83-9627-41b9-94df-fd769960ce7a tempest-AttachVolumeShelveTestJSON-1870144154 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c/volume-df84a042-c784-400d-a1cc-463270aa0e26 1073741824 {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 15:00:30 devstack quobyte-client[83286]: The server volume:87712ffe-8a69-446d-9ed6-4430c7ee9792@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=87712ffe-8a69-446d-9ed6-4430c7ee9792, inode=18, name=volume-df84a042-c784-400d-a1cc-463270aa0e26, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.206), requestorAccessMask=0 Sep 16 15:00:30 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [None req-618d5e83-9627-41b9-94df-fd769960ce7a tempest-AttachVolumeShelveTestJSON-1870144154 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c/volume-df84a042-c784-400d-a1cc-463270aa0e26 1073741824" returned: 0 in 0.532s {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 15:00:30 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [None req-618d5e83-9627-41b9-94df-fd769960ce7a tempest-AttachVolumeShelveTestJSON-1870144154 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c/volume-df84a042-c784-400d-a1cc-463270aa0e26 {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 15:00:31 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [None req-618d5e83-9627-41b9-94df-fd769960ce7a tempest-AttachVolumeShelveTestJSON-1870144154 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c/volume-df84a042-c784-400d-a1cc-463270aa0e26" returned: 0 in 0.124s {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 15:00:31 devstack cinder-volume[83259]: DEBUG cinder.volume.drivers.quobyte [None req-618d5e83-9627-41b9-94df-fd769960ce7a tempest-AttachVolumeShelveTestJSON-1870144154 None] <== create_volume: return (731ms) {'provider_location': '10.10.41.181/cinder-vol-61f585ac-f8e2-4d19-a890-7ebc2726cc72'} {{(pid=83259) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Sep 16 15:00:31 devstack cinder-volume[83259]: DEBUG oslo_concurrency.lockutils [None req-618d5e83-9627-41b9-94df-fd769960ce7a tempest-AttachVolumeShelveTestJSON-1870144154 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.743s {{(pid=83259) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 16 15:00:31 devstack cinder-volume[83259]: DEBUG cinder.volume.manager [None req-618d5e83-9627-41b9-94df-fd769960ce7a tempest-AttachVolumeShelveTestJSON-1870144154 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ed353597-bb16-4fd6-b444-454a62b48cc8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-df84a042-c784-400d-a1cc-463270aa0e26', 'volume_size': 1}' {{(pid=83259) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 15:00:31 devstack cinder-volume[83259]: DEBUG cinder.volume.manager [None req-618d5e83-9627-41b9-94df-fd769960ce7a tempest-AttachVolumeShelveTestJSON-1870144154 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (300cc248-934d-4b30-b3b4-d64ec324244b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83259) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 15:00:31 devstack cinder-volume[83259]: INFO cinder.volume.flows.manager.create_volume [None req-618d5e83-9627-41b9-94df-fd769960ce7a tempest-AttachVolumeShelveTestJSON-1870144154 None] Volume volume-df84a042-c784-400d-a1cc-463270aa0e26 (df84a042-c784-400d-a1cc-463270aa0e26): created successfully Sep 16 15:00:31 devstack cinder-volume[83259]: DEBUG cinder.volume.manager [None req-618d5e83-9627-41b9-94df-fd769960ce7a tempest-AttachVolumeShelveTestJSON-1870144154 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (300cc248-934d-4b30-b3b4-d64ec324244b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83259) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 15:00:31 devstack cinder-volume[83259]: DEBUG cinder.volume.manager [None req-618d5e83-9627-41b9-94df-fd769960ce7a tempest-AttachVolumeShelveTestJSON-1870144154 None] Flow 'volume_create_manager' (7ebf83d4-9a10-40d9-ba9c-521b676a5584) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83259) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 16 15:00:31 devstack cinder-volume[83259]: INFO cinder.volume.manager [None req-618d5e83-9627-41b9-94df-fd769960ce7a tempest-AttachVolumeShelveTestJSON-1870144154 None] Created volume successfully. Sep 16 15:00:41 devstack cinder-volume[83259]: DEBUG dbcounter [-] [83259] Writing DB stats cinder:UPDATE=35,cinder:SELECT=17,cinder:INSERT=4 {{(pid=83259) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Sep 16 15:00:41 devstack cinder-volume[83259]: DEBUG dbcounter [-] [83259] Writing DB stats cinder:SELECT=15,cinder:INSERT=8,cinder:UPDATE=17,cinder:DELETE=4 {{(pid=83259) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Sep 16 15:00:42 devstack cinder-volume[83259]: WARNING cinder.volume.volume_utils [None req-d49817a4-2ef6-4b98-aa8d-ca04ec736e68 tempest-VolumesTestJSON-1606793835 None] Volume driver (QuobyteDriver 1.2) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 16 15:00:42 devstack cinder-volume[83259]: DEBUG cinder.volume.flows.manager.create_volume [None req-d49817a4-2ef6-4b98-aa8d-ca04ec736e68 tempest-VolumesTestJSON-1606793835 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#Quobyte'], 'hosts': ['devstack@QuobyteHD#Quobyte']} {{(pid=83259) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1387}} Sep 16 15:00:42 devstack cinder-volume[83259]: DEBUG cinder.volume.manager [None req-d49817a4-2ef6-4b98-aa8d-ca04ec736e68 tempest-VolumesTestJSON-1606793835 None] Flow 'volume_create_manager' (5699cad9-125e-4038-b5e1-1f8d852ddd3e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83259) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 16 15:00:42 devstack cinder-volume[83259]: DEBUG cinder.volume.manager [None req-d49817a4-2ef6-4b98-aa8d-ca04ec736e68 tempest-VolumesTestJSON-1606793835 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1392b5fb-5d02-42a6-916e-369e12991e12) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83259) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 15:00:42 devstack cinder-volume[83259]: DEBUG cinder.volume.manager [None req-d49817a4-2ef6-4b98-aa8d-ca04ec736e68 tempest-VolumesTestJSON-1606793835 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1392b5fb-5d02-42a6-916e-369e12991e12) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-16T13:00:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-1812639922',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#Quobyte',id=e4f887ff-0385-4df2-8b8d-140a19427809,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='9b7f54e1fc674fa4b5aed600600e0eba',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-16T13:00:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-16T13:00:43Z,use_quota=True,user_id='b4014fad3da74677b25734c452e4772f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(485ead50-3df8-4d76-8d34-a4db136c980a),volume_type_id=485ead50-3df8-4d76-8d34-a4db136c980a)' {{(pid=83259) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 15:00:42 devstack cinder-volume[83259]: DEBUG cinder.volume.manager [None req-d49817a4-2ef6-4b98-aa8d-ca04ec736e68 tempest-VolumesTestJSON-1606793835 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dd9252aa-cfef-4db9-83c3-13b9b69ed333) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83259) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 15:00:42 devstack cinder-volume[83259]: DEBUG cinder.volume.manager [None req-d49817a4-2ef6-4b98-aa8d-ca04ec736e68 tempest-VolumesTestJSON-1606793835 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dd9252aa-cfef-4db9-83c3-13b9b69ed333) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83259) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 15:00:42 devstack cinder-volume[83259]: DEBUG cinder.volume.manager [None req-d49817a4-2ef6-4b98-aa8d-ca04ec736e68 tempest-VolumesTestJSON-1606793835 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c685fabd-4514-43c8-b391-11c55e8081af) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83259) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 15:00:42 devstack cinder-volume[83259]: DEBUG cinder.volume.manager [None req-d49817a4-2ef6-4b98-aa8d-ca04ec736e68 tempest-VolumesTestJSON-1606793835 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c685fabd-4514-43c8-b391-11c55e8081af) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e4f887ff-0385-4df2-8b8d-140a19427809', 'volume_name': 'volume-e4f887ff-0385-4df2-8b8d-140a19427809', 'volume_size': 1}' {{(pid=83259) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 15:00:43 devstack cinder-volume[83259]: DEBUG cinder.volume.manager [None req-d49817a4-2ef6-4b98-aa8d-ca04ec736e68 tempest-VolumesTestJSON-1606793835 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3a544e5f-5044-48a5-b2aa-11fdd41bafe4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83259) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 15:00:43 devstack cinder-volume[83259]: DEBUG cinder.volume.manager [None req-d49817a4-2ef6-4b98-aa8d-ca04ec736e68 tempest-VolumesTestJSON-1606793835 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3a544e5f-5044-48a5-b2aa-11fdd41bafe4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83259) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 15:00:43 devstack cinder-volume[83259]: DEBUG cinder.volume.manager [None req-d49817a4-2ef6-4b98-aa8d-ca04ec736e68 tempest-VolumesTestJSON-1606793835 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (932e5eff-a0c2-4eaa-a9ea-18b000f8d751) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83259) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 15:00:43 devstack cinder-volume[83259]: INFO cinder.volume.flows.manager.create_volume [None req-d49817a4-2ef6-4b98-aa8d-ca04ec736e68 tempest-VolumesTestJSON-1606793835 None] Volume e4f887ff-0385-4df2-8b8d-140a19427809: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e4f887ff-0385-4df2-8b8d-140a19427809', 'volume_size': 1} Sep 16 15:00:43 devstack cinder-volume[83259]: DEBUG oslo_concurrency.lockutils [None req-d49817a4-2ef6-4b98-aa8d-ca04ec736e68 tempest-VolumesTestJSON-1606793835 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83259) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 16 15:00:43 devstack cinder-volume[83259]: DEBUG oslo_concurrency.lockutils [None req-d49817a4-2ef6-4b98-aa8d-ca04ec736e68 tempest-VolumesTestJSON-1606793835 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.005s {{(pid=83259) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 16 15:00:43 devstack cinder-volume[83259]: DEBUG cinder.volume.drivers.quobyte [None req-d49817a4-2ef6-4b98-aa8d-ca04ec736e68 tempest-VolumesTestJSON-1606793835 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-16T13:00:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-1812639922',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#Quobyte',id=e4f887ff-0385-4df2-8b8d-140a19427809,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='9b7f54e1fc674fa4b5aed600600e0eba',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-16T13:00:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-16T13:00:43Z,use_quota=True,user_id='b4014fad3da74677b25734c452e4772f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(485ead50-3df8-4d76-8d34-a4db136c980a),volume_type_id=485ead50-3df8-4d76-8d34-a4db136c980a)}" {{(pid=83259) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Sep 16 15:00:43 devstack cinder-volume[83259]: DEBUG cinder.volume.drivers.remotefs [None req-d49817a4-2ef6-4b98-aa8d-ca04ec736e68 tempest-VolumesTestJSON-1606793835 None] Creating volume e4f887ff-0385-4df2-8b8d-140a19427809 {{(pid=83259) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}} Sep 16 15:00:43 devstack cinder-volume[83259]: DEBUG oslo_concurrency.lockutils [None req-d49817a4-2ef6-4b98-aa8d-ca04ec736e68 tempest-VolumesTestJSON-1606793835 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83259) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 16 15:00:43 devstack cinder-volume[83259]: DEBUG oslo_concurrency.lockutils [None req-d49817a4-2ef6-4b98-aa8d-ca04ec736e68 tempest-VolumesTestJSON-1606793835 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.006s {{(pid=83259) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 16 15:00:43 devstack cinder-volume[83259]: DEBUG cinder.volume.drivers.quobyte [None req-d49817a4-2ef6-4b98-aa8d-ca04ec736e68 tempest-VolumesTestJSON-1606793835 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-61f585ac-f8e2-4d19-a890-7ebc2726cc72': None} {{(pid=83259) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:639}} Sep 16 15:00:43 devstack cinder-volume[83259]: DEBUG cinder.volume.drivers.quobyte [None req-d49817a4-2ef6-4b98-aa8d-ca04ec736e68 tempest-VolumesTestJSON-1606793835 None] Available shares ['10.10.41.181/cinder-vol-61f585ac-f8e2-4d19-a890-7ebc2726cc72'] {{(pid=83259) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:669}} Sep 16 15:00:43 devstack cinder-volume[83259]: DEBUG oslo_concurrency.lockutils [None req-d49817a4-2ef6-4b98-aa8d-ca04ec736e68 tempest-VolumesTestJSON-1606793835 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.036s {{(pid=83259) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 16 15:00:43 devstack cinder-volume[83259]: DEBUG cinder.volume.drivers.quobyte [None req-d49817a4-2ef6-4b98-aa8d-ca04ec736e68 tempest-VolumesTestJSON-1606793835 None] Selected 10.10.41.181/cinder-vol-61f585ac-f8e2-4d19-a890-7ebc2726cc72 as target Quobyte volume. {{(pid=83259) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:690}} Sep 16 15:00:43 devstack cinder-volume[83259]: INFO cinder.volume.drivers.remotefs [None req-d49817a4-2ef6-4b98-aa8d-ca04ec736e68 tempest-VolumesTestJSON-1606793835 None] casted to 10.10.41.181/cinder-vol-61f585ac-f8e2-4d19-a890-7ebc2726cc72 Sep 16 15:00:43 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [None req-d49817a4-2ef6-4b98-aa8d-ca04ec736e68 tempest-VolumesTestJSON-1606793835 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c/volume-e4f887ff-0385-4df2-8b8d-140a19427809 1073741824 {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 15:00:43 devstack quobyte-client[83286]: System call of process 91842 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 16 15:00:43 devstack quobyte-client[83286]: The server volume:87712ffe-8a69-446d-9ed6-4430c7ee9792@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=87712ffe-8a69-446d-9ed6-4430c7ee9792, inode=19, name=volume-e4f887ff-0385-4df2-8b8d-140a19427809, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.206), requestorAccessMask=0 Sep 16 15:00:43 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [None req-d49817a4-2ef6-4b98-aa8d-ca04ec736e68 tempest-VolumesTestJSON-1606793835 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c/volume-e4f887ff-0385-4df2-8b8d-140a19427809 1073741824" returned: 0 in 0.715s {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 15:00:43 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [None req-d49817a4-2ef6-4b98-aa8d-ca04ec736e68 tempest-VolumesTestJSON-1606793835 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c/volume-e4f887ff-0385-4df2-8b8d-140a19427809 {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 15:00:44 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [None req-d49817a4-2ef6-4b98-aa8d-ca04ec736e68 tempest-VolumesTestJSON-1606793835 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c/volume-e4f887ff-0385-4df2-8b8d-140a19427809" returned: 0 in 0.188s {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 15:00:44 devstack cinder-volume[83259]: DEBUG cinder.volume.drivers.quobyte [None req-d49817a4-2ef6-4b98-aa8d-ca04ec736e68 tempest-VolumesTestJSON-1606793835 None] <== create_volume: return (1141ms) {'provider_location': '10.10.41.181/cinder-vol-61f585ac-f8e2-4d19-a890-7ebc2726cc72'} {{(pid=83259) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Sep 16 15:00:44 devstack cinder-volume[83259]: DEBUG oslo_concurrency.lockutils [None req-d49817a4-2ef6-4b98-aa8d-ca04ec736e68 tempest-VolumesTestJSON-1606793835 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.170s {{(pid=83259) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 16 15:00:44 devstack cinder-volume[83259]: DEBUG cinder.volume.manager [None req-d49817a4-2ef6-4b98-aa8d-ca04ec736e68 tempest-VolumesTestJSON-1606793835 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (932e5eff-a0c2-4eaa-a9ea-18b000f8d751) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e4f887ff-0385-4df2-8b8d-140a19427809', 'volume_size': 1}' {{(pid=83259) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 15:00:44 devstack cinder-volume[83259]: DEBUG cinder.volume.manager [None req-d49817a4-2ef6-4b98-aa8d-ca04ec736e68 tempest-VolumesTestJSON-1606793835 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f66837d6-5b8e-4e0a-b837-ad7c60c04f84) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83259) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 15:00:44 devstack cinder-volume[83259]: INFO cinder.volume.flows.manager.create_volume [None req-d49817a4-2ef6-4b98-aa8d-ca04ec736e68 tempest-VolumesTestJSON-1606793835 None] Volume volume-e4f887ff-0385-4df2-8b8d-140a19427809 (e4f887ff-0385-4df2-8b8d-140a19427809): created successfully Sep 16 15:00:44 devstack cinder-volume[83259]: DEBUG cinder.volume.manager [None req-d49817a4-2ef6-4b98-aa8d-ca04ec736e68 tempest-VolumesTestJSON-1606793835 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f66837d6-5b8e-4e0a-b837-ad7c60c04f84) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83259) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 15:00:44 devstack cinder-volume[83259]: DEBUG cinder.volume.manager [None req-d49817a4-2ef6-4b98-aa8d-ca04ec736e68 tempest-VolumesTestJSON-1606793835 None] Flow 'volume_create_manager' (5699cad9-125e-4038-b5e1-1f8d852ddd3e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83259) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 16 15:00:44 devstack cinder-volume[83259]: DEBUG oslo_service.periodic_task [None req-050ec8a1-6ffd-499d-95ad-d548a84437e2 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=83259) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} Sep 16 15:00:44 devstack cinder-volume[83259]: DEBUG oslo_concurrency.lockutils [None req-050ec8a1-6ffd-499d-95ad-d548a84437e2 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83259) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 16 15:00:44 devstack cinder-volume[83259]: DEBUG oslo_concurrency.lockutils [None req-050ec8a1-6ffd-499d-95ad-d548a84437e2 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.013s {{(pid=83259) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 16 15:00:44 devstack cinder-volume[83259]: DEBUG cinder.volume.drivers.quobyte [None req-050ec8a1-6ffd-499d-95ad-d548a84437e2 None None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-61f585ac-f8e2-4d19-a890-7ebc2726cc72': None} {{(pid=83259) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:639}} Sep 16 15:00:44 devstack cinder-volume[83259]: DEBUG cinder.volume.drivers.quobyte [None req-050ec8a1-6ffd-499d-95ad-d548a84437e2 None None] Available shares ['10.10.41.181/cinder-vol-61f585ac-f8e2-4d19-a890-7ebc2726cc72'] {{(pid=83259) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:669}} Sep 16 15:00:44 devstack cinder-volume[83259]: DEBUG oslo_concurrency.lockutils [None req-050ec8a1-6ffd-499d-95ad-d548a84437e2 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.030s {{(pid=83259) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 16 15:00:44 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [None req-050ec8a1-6ffd-499d-95ad-d548a84437e2 None None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 15:00:45 devstack cinder-volume[83259]: INFO cinder.volume.manager [None req-d49817a4-2ef6-4b98-aa8d-ca04ec736e68 tempest-VolumesTestJSON-1606793835 None] Created volume successfully. Sep 16 15:00:45 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [None req-050ec8a1-6ffd-499d-95ad-d548a84437e2 None None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c" returned: 0 in 1.099s {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 15:00:45 devstack cinder-volume[83259]: DEBUG cinder.manager [None req-050ec8a1-6ffd-499d-95ad-d548a84437e2 None None] Notifying Schedulers of capabilities ... {{(pid=83259) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 16 15:00:46 devstack cinder-volume[83259]: WARNING cinder.volume.volume_utils [None req-9b87cd4f-790e-4d9d-9eaf-00cf73227fb7 tempest-VolumesTestJSON-1606793835 None] Volume driver (QuobyteDriver 1.2) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 16 15:00:46 devstack cinder-volume[83259]: DEBUG cinder.volume.flows.manager.create_volume [None req-9b87cd4f-790e-4d9d-9eaf-00cf73227fb7 tempest-VolumesTestJSON-1606793835 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#Quobyte'], 'hosts': ['devstack@QuobyteHD#Quobyte']} {{(pid=83259) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1387}} Sep 16 15:00:46 devstack cinder-volume[83259]: DEBUG cinder.volume.manager [None req-9b87cd4f-790e-4d9d-9eaf-00cf73227fb7 tempest-VolumesTestJSON-1606793835 None] Flow 'volume_create_manager' (f913ec5f-2873-4fad-97c7-bbf20307ae85) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83259) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 16 15:00:46 devstack cinder-volume[83259]: DEBUG cinder.volume.manager [None req-9b87cd4f-790e-4d9d-9eaf-00cf73227fb7 tempest-VolumesTestJSON-1606793835 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fba1338d-6c85-489f-8dc8-b077c10a76ec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83259) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 15:00:46 devstack cinder-volume[83259]: DEBUG cinder.volume.manager [None req-9b87cd4f-790e-4d9d-9eaf-00cf73227fb7 tempest-VolumesTestJSON-1606793835 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fba1338d-6c85-489f-8dc8-b077c10a76ec) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-16T13:00:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-832237701',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#Quobyte',id=bb6bc9ef-ba4c-4017-bfdd-aaa3d89da601,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='9b7f54e1fc674fa4b5aed600600e0eba',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-16T13:00:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-16T13:00:46Z,use_quota=True,user_id='b4014fad3da74677b25734c452e4772f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(485ead50-3df8-4d76-8d34-a4db136c980a),volume_type_id=485ead50-3df8-4d76-8d34-a4db136c980a)' {{(pid=83259) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 15:00:46 devstack cinder-volume[83259]: DEBUG cinder.volume.manager [None req-9b87cd4f-790e-4d9d-9eaf-00cf73227fb7 tempest-VolumesTestJSON-1606793835 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (999daa37-7c0d-423e-8b4e-f5f0d44e6776) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83259) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 15:00:46 devstack cinder-volume[83259]: DEBUG cinder.volume.manager [None req-9b87cd4f-790e-4d9d-9eaf-00cf73227fb7 tempest-VolumesTestJSON-1606793835 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (999daa37-7c0d-423e-8b4e-f5f0d44e6776) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83259) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 15:00:46 devstack cinder-volume[83259]: DEBUG cinder.volume.manager [None req-9b87cd4f-790e-4d9d-9eaf-00cf73227fb7 tempest-VolumesTestJSON-1606793835 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (44e7731b-39b0-4aab-bd90-40eaa52efb65) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83259) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 15:00:46 devstack cinder-volume[83259]: DEBUG cinder.volume.manager [None req-9b87cd4f-790e-4d9d-9eaf-00cf73227fb7 tempest-VolumesTestJSON-1606793835 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (44e7731b-39b0-4aab-bd90-40eaa52efb65) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'bb6bc9ef-ba4c-4017-bfdd-aaa3d89da601', 'volume_name': 'volume-bb6bc9ef-ba4c-4017-bfdd-aaa3d89da601', 'volume_size': 1}' {{(pid=83259) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 15:00:46 devstack cinder-volume[83259]: DEBUG cinder.volume.manager [None req-9b87cd4f-790e-4d9d-9eaf-00cf73227fb7 tempest-VolumesTestJSON-1606793835 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6c285560-0f6d-4798-86e5-4024423c3f42) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83259) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 15:00:46 devstack cinder-volume[83259]: DEBUG cinder.volume.manager [None req-9b87cd4f-790e-4d9d-9eaf-00cf73227fb7 tempest-VolumesTestJSON-1606793835 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6c285560-0f6d-4798-86e5-4024423c3f42) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83259) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 15:00:47 devstack cinder-volume[83259]: DEBUG cinder.volume.manager [None req-9b87cd4f-790e-4d9d-9eaf-00cf73227fb7 tempest-VolumesTestJSON-1606793835 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3bbefdbd-0094-46c4-a1f8-8327328c61b5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83259) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 15:00:47 devstack cinder-volume[83259]: INFO cinder.volume.flows.manager.create_volume [None req-9b87cd4f-790e-4d9d-9eaf-00cf73227fb7 tempest-VolumesTestJSON-1606793835 None] Volume bb6bc9ef-ba4c-4017-bfdd-aaa3d89da601: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-bb6bc9ef-ba4c-4017-bfdd-aaa3d89da601', 'volume_size': 1} Sep 16 15:00:47 devstack cinder-volume[83259]: DEBUG oslo_concurrency.lockutils [None req-9b87cd4f-790e-4d9d-9eaf-00cf73227fb7 tempest-VolumesTestJSON-1606793835 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83259) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 16 15:00:47 devstack cinder-volume[83259]: DEBUG oslo_concurrency.lockutils [None req-9b87cd4f-790e-4d9d-9eaf-00cf73227fb7 tempest-VolumesTestJSON-1606793835 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.003s {{(pid=83259) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 16 15:00:47 devstack cinder-volume[83259]: DEBUG cinder.volume.drivers.quobyte [None req-9b87cd4f-790e-4d9d-9eaf-00cf73227fb7 tempest-VolumesTestJSON-1606793835 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-16T13:00:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-832237701',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#Quobyte',id=bb6bc9ef-ba4c-4017-bfdd-aaa3d89da601,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='9b7f54e1fc674fa4b5aed600600e0eba',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-16T13:00:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-16T13:00:46Z,use_quota=True,user_id='b4014fad3da74677b25734c452e4772f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(485ead50-3df8-4d76-8d34-a4db136c980a),volume_type_id=485ead50-3df8-4d76-8d34-a4db136c980a)}" {{(pid=83259) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Sep 16 15:00:47 devstack cinder-volume[83259]: DEBUG cinder.volume.drivers.remotefs [None req-9b87cd4f-790e-4d9d-9eaf-00cf73227fb7 tempest-VolumesTestJSON-1606793835 None] Creating volume bb6bc9ef-ba4c-4017-bfdd-aaa3d89da601 {{(pid=83259) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}} Sep 16 15:00:47 devstack cinder-volume[83259]: DEBUG oslo_concurrency.lockutils [None req-9b87cd4f-790e-4d9d-9eaf-00cf73227fb7 tempest-VolumesTestJSON-1606793835 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83259) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 16 15:00:47 devstack cinder-volume[83259]: DEBUG oslo_concurrency.lockutils [None req-9b87cd4f-790e-4d9d-9eaf-00cf73227fb7 tempest-VolumesTestJSON-1606793835 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83259) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 16 15:00:47 devstack cinder-volume[83259]: DEBUG cinder.volume.drivers.quobyte [None req-9b87cd4f-790e-4d9d-9eaf-00cf73227fb7 tempest-VolumesTestJSON-1606793835 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-61f585ac-f8e2-4d19-a890-7ebc2726cc72': None} {{(pid=83259) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:639}} Sep 16 15:00:47 devstack cinder-volume[83259]: DEBUG cinder.volume.drivers.quobyte [None req-9b87cd4f-790e-4d9d-9eaf-00cf73227fb7 tempest-VolumesTestJSON-1606793835 None] Available shares ['10.10.41.181/cinder-vol-61f585ac-f8e2-4d19-a890-7ebc2726cc72'] {{(pid=83259) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:669}} Sep 16 15:00:47 devstack cinder-volume[83259]: DEBUG oslo_concurrency.lockutils [None req-9b87cd4f-790e-4d9d-9eaf-00cf73227fb7 tempest-VolumesTestJSON-1606793835 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=83259) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 16 15:00:47 devstack cinder-volume[83259]: DEBUG cinder.volume.drivers.quobyte [None req-9b87cd4f-790e-4d9d-9eaf-00cf73227fb7 tempest-VolumesTestJSON-1606793835 None] Selected 10.10.41.181/cinder-vol-61f585ac-f8e2-4d19-a890-7ebc2726cc72 as target Quobyte volume. {{(pid=83259) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:690}} Sep 16 15:00:47 devstack cinder-volume[83259]: INFO cinder.volume.drivers.remotefs [None req-9b87cd4f-790e-4d9d-9eaf-00cf73227fb7 tempest-VolumesTestJSON-1606793835 None] casted to 10.10.41.181/cinder-vol-61f585ac-f8e2-4d19-a890-7ebc2726cc72 Sep 16 15:00:47 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [None req-9b87cd4f-790e-4d9d-9eaf-00cf73227fb7 tempest-VolumesTestJSON-1606793835 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c/volume-bb6bc9ef-ba4c-4017-bfdd-aaa3d89da601 1073741824 {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 15:00:47 devstack quobyte-client[83286]: The server volume:87712ffe-8a69-446d-9ed6-4430c7ee9792@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=87712ffe-8a69-446d-9ed6-4430c7ee9792, inode=20, name=volume-bb6bc9ef-ba4c-4017-bfdd-aaa3d89da601, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.206), requestorAccessMask=0 Sep 16 15:00:47 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [None req-9b87cd4f-790e-4d9d-9eaf-00cf73227fb7 tempest-VolumesTestJSON-1606793835 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c/volume-bb6bc9ef-ba4c-4017-bfdd-aaa3d89da601 1073741824" returned: 0 in 0.331s {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 15:00:47 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [None req-9b87cd4f-790e-4d9d-9eaf-00cf73227fb7 tempest-VolumesTestJSON-1606793835 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c/volume-bb6bc9ef-ba4c-4017-bfdd-aaa3d89da601 {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 15:00:47 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [None req-9b87cd4f-790e-4d9d-9eaf-00cf73227fb7 tempest-VolumesTestJSON-1606793835 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c/volume-bb6bc9ef-ba4c-4017-bfdd-aaa3d89da601" returned: 0 in 0.084s {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 15:00:47 devstack cinder-volume[83259]: DEBUG cinder.volume.drivers.quobyte [None req-9b87cd4f-790e-4d9d-9eaf-00cf73227fb7 tempest-VolumesTestJSON-1606793835 None] <== create_volume: return (488ms) {'provider_location': '10.10.41.181/cinder-vol-61f585ac-f8e2-4d19-a890-7ebc2726cc72'} {{(pid=83259) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Sep 16 15:00:47 devstack cinder-volume[83259]: DEBUG oslo_concurrency.lockutils [None req-9b87cd4f-790e-4d9d-9eaf-00cf73227fb7 tempest-VolumesTestJSON-1606793835 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.503s {{(pid=83259) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 16 15:00:47 devstack cinder-volume[83259]: DEBUG cinder.volume.manager [None req-9b87cd4f-790e-4d9d-9eaf-00cf73227fb7 tempest-VolumesTestJSON-1606793835 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3bbefdbd-0094-46c4-a1f8-8327328c61b5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-bb6bc9ef-ba4c-4017-bfdd-aaa3d89da601', 'volume_size': 1}' {{(pid=83259) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 15:00:47 devstack cinder-volume[83259]: DEBUG cinder.volume.manager [None req-9b87cd4f-790e-4d9d-9eaf-00cf73227fb7 tempest-VolumesTestJSON-1606793835 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (50cc6525-0880-45c8-a1d4-0d64699404b0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83259) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 15:00:47 devstack cinder-volume[83259]: INFO cinder.volume.flows.manager.create_volume [None req-9b87cd4f-790e-4d9d-9eaf-00cf73227fb7 tempest-VolumesTestJSON-1606793835 None] Volume volume-bb6bc9ef-ba4c-4017-bfdd-aaa3d89da601 (bb6bc9ef-ba4c-4017-bfdd-aaa3d89da601): created successfully Sep 16 15:00:47 devstack cinder-volume[83259]: DEBUG cinder.volume.manager [None req-9b87cd4f-790e-4d9d-9eaf-00cf73227fb7 tempest-VolumesTestJSON-1606793835 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (50cc6525-0880-45c8-a1d4-0d64699404b0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83259) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 15:00:47 devstack cinder-volume[83259]: DEBUG cinder.volume.manager [None req-9b87cd4f-790e-4d9d-9eaf-00cf73227fb7 tempest-VolumesTestJSON-1606793835 None] Flow 'volume_create_manager' (f913ec5f-2873-4fad-97c7-bbf20307ae85) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83259) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 16 15:00:47 devstack cinder-volume[83259]: INFO cinder.volume.manager [None req-9b87cd4f-790e-4d9d-9eaf-00cf73227fb7 tempest-VolumesTestJSON-1606793835 None] Created volume successfully. Sep 16 15:00:49 devstack cinder-volume[83259]: WARNING cinder.volume.volume_utils [None req-e59885dc-4d0d-4675-8a1b-476071255ad2 tempest-VolumesTestJSON-1606793835 None] Volume driver (QuobyteDriver 1.2) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 16 15:00:49 devstack cinder-volume[83259]: DEBUG cinder.volume.flows.manager.create_volume [None req-e59885dc-4d0d-4675-8a1b-476071255ad2 tempest-VolumesTestJSON-1606793835 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#Quobyte'], 'hosts': ['devstack@QuobyteHD#Quobyte']} {{(pid=83259) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1387}} Sep 16 15:00:49 devstack cinder-volume[83259]: DEBUG cinder.volume.manager [None req-e59885dc-4d0d-4675-8a1b-476071255ad2 tempest-VolumesTestJSON-1606793835 None] Flow 'volume_create_manager' (95ba8497-35f4-421d-999a-56575deae70e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83259) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 16 15:00:49 devstack cinder-volume[83259]: DEBUG cinder.volume.manager [None req-e59885dc-4d0d-4675-8a1b-476071255ad2 tempest-VolumesTestJSON-1606793835 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3263ce8a-48bf-4565-97d2-06bf0498279f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83259) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 15:00:49 devstack cinder-volume[83259]: DEBUG cinder.volume.manager [None req-e59885dc-4d0d-4675-8a1b-476071255ad2 tempest-VolumesTestJSON-1606793835 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3263ce8a-48bf-4565-97d2-06bf0498279f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-16T13:00:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-31207074',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#Quobyte',id=366eb140-56a1-4db8-95f3-57898fd99b46,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='9b7f54e1fc674fa4b5aed600600e0eba',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-16T13:00:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-16T13:00:50Z,use_quota=True,user_id='b4014fad3da74677b25734c452e4772f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(485ead50-3df8-4d76-8d34-a4db136c980a),volume_type_id=485ead50-3df8-4d76-8d34-a4db136c980a)' {{(pid=83259) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 15:00:49 devstack cinder-volume[83259]: DEBUG cinder.volume.manager [None req-e59885dc-4d0d-4675-8a1b-476071255ad2 tempest-VolumesTestJSON-1606793835 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ac23a140-50fa-46a0-a430-95396a27341f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83259) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 15:00:49 devstack cinder-volume[83259]: DEBUG cinder.volume.manager [None req-e59885dc-4d0d-4675-8a1b-476071255ad2 tempest-VolumesTestJSON-1606793835 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ac23a140-50fa-46a0-a430-95396a27341f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83259) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 15:00:49 devstack cinder-volume[83259]: DEBUG cinder.volume.manager [None req-e59885dc-4d0d-4675-8a1b-476071255ad2 tempest-VolumesTestJSON-1606793835 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9dcf618c-4b91-4876-a373-e5eb3725e630) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83259) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 15:00:49 devstack cinder-volume[83259]: DEBUG cinder.volume.manager [None req-e59885dc-4d0d-4675-8a1b-476071255ad2 tempest-VolumesTestJSON-1606793835 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9dcf618c-4b91-4876-a373-e5eb3725e630) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '366eb140-56a1-4db8-95f3-57898fd99b46', 'volume_name': 'volume-366eb140-56a1-4db8-95f3-57898fd99b46', 'volume_size': 1}' {{(pid=83259) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 15:00:49 devstack cinder-volume[83259]: DEBUG cinder.volume.manager [None req-e59885dc-4d0d-4675-8a1b-476071255ad2 tempest-VolumesTestJSON-1606793835 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d782d578-e7f8-444b-814a-d138b91e88b7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83259) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 15:00:49 devstack cinder-volume[83259]: DEBUG cinder.volume.manager [None req-e59885dc-4d0d-4675-8a1b-476071255ad2 tempest-VolumesTestJSON-1606793835 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d782d578-e7f8-444b-814a-d138b91e88b7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83259) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 15:00:49 devstack cinder-volume[83259]: DEBUG cinder.volume.manager [None req-e59885dc-4d0d-4675-8a1b-476071255ad2 tempest-VolumesTestJSON-1606793835 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (53b29e91-50d1-463a-b19e-aae665491cbd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83259) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 15:00:49 devstack cinder-volume[83259]: INFO cinder.volume.flows.manager.create_volume [None req-e59885dc-4d0d-4675-8a1b-476071255ad2 tempest-VolumesTestJSON-1606793835 None] Volume 366eb140-56a1-4db8-95f3-57898fd99b46: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-366eb140-56a1-4db8-95f3-57898fd99b46', 'volume_size': 1} Sep 16 15:00:49 devstack cinder-volume[83259]: DEBUG oslo_concurrency.lockutils [None req-e59885dc-4d0d-4675-8a1b-476071255ad2 tempest-VolumesTestJSON-1606793835 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83259) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 16 15:00:49 devstack cinder-volume[83259]: DEBUG oslo_concurrency.lockutils [None req-e59885dc-4d0d-4675-8a1b-476071255ad2 tempest-VolumesTestJSON-1606793835 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=83259) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 16 15:00:49 devstack cinder-volume[83259]: DEBUG cinder.volume.drivers.quobyte [None req-e59885dc-4d0d-4675-8a1b-476071255ad2 tempest-VolumesTestJSON-1606793835 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-16T13:00:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-31207074',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#Quobyte',id=366eb140-56a1-4db8-95f3-57898fd99b46,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='9b7f54e1fc674fa4b5aed600600e0eba',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-16T13:00:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-16T13:00:50Z,use_quota=True,user_id='b4014fad3da74677b25734c452e4772f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(485ead50-3df8-4d76-8d34-a4db136c980a),volume_type_id=485ead50-3df8-4d76-8d34-a4db136c980a)}" {{(pid=83259) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Sep 16 15:00:49 devstack cinder-volume[83259]: DEBUG cinder.volume.drivers.remotefs [None req-e59885dc-4d0d-4675-8a1b-476071255ad2 tempest-VolumesTestJSON-1606793835 None] Creating volume 366eb140-56a1-4db8-95f3-57898fd99b46 {{(pid=83259) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}} Sep 16 15:00:49 devstack cinder-volume[83259]: DEBUG oslo_concurrency.lockutils [None req-e59885dc-4d0d-4675-8a1b-476071255ad2 tempest-VolumesTestJSON-1606793835 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83259) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 16 15:00:49 devstack cinder-volume[83259]: DEBUG oslo_concurrency.lockutils [None req-e59885dc-4d0d-4675-8a1b-476071255ad2 tempest-VolumesTestJSON-1606793835 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83259) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 16 15:00:49 devstack cinder-volume[83259]: DEBUG cinder.volume.drivers.quobyte [None req-e59885dc-4d0d-4675-8a1b-476071255ad2 tempest-VolumesTestJSON-1606793835 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-61f585ac-f8e2-4d19-a890-7ebc2726cc72': None} {{(pid=83259) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:639}} Sep 16 15:00:49 devstack cinder-volume[83259]: DEBUG cinder.volume.drivers.quobyte [None req-e59885dc-4d0d-4675-8a1b-476071255ad2 tempest-VolumesTestJSON-1606793835 None] Available shares ['10.10.41.181/cinder-vol-61f585ac-f8e2-4d19-a890-7ebc2726cc72'] {{(pid=83259) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:669}} Sep 16 15:00:49 devstack cinder-volume[83259]: DEBUG oslo_concurrency.lockutils [None req-e59885dc-4d0d-4675-8a1b-476071255ad2 tempest-VolumesTestJSON-1606793835 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=83259) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 16 15:00:49 devstack cinder-volume[83259]: DEBUG cinder.volume.drivers.quobyte [None req-e59885dc-4d0d-4675-8a1b-476071255ad2 tempest-VolumesTestJSON-1606793835 None] Selected 10.10.41.181/cinder-vol-61f585ac-f8e2-4d19-a890-7ebc2726cc72 as target Quobyte volume. {{(pid=83259) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:690}} Sep 16 15:00:49 devstack cinder-volume[83259]: INFO cinder.volume.drivers.remotefs [None req-e59885dc-4d0d-4675-8a1b-476071255ad2 tempest-VolumesTestJSON-1606793835 None] casted to 10.10.41.181/cinder-vol-61f585ac-f8e2-4d19-a890-7ebc2726cc72 Sep 16 15:00:49 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [None req-e59885dc-4d0d-4675-8a1b-476071255ad2 tempest-VolumesTestJSON-1606793835 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c/volume-366eb140-56a1-4db8-95f3-57898fd99b46 1073741824 {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 15:00:50 devstack quobyte-client[83286]: The server volume:87712ffe-8a69-446d-9ed6-4430c7ee9792@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=87712ffe-8a69-446d-9ed6-4430c7ee9792, inode=21, name=volume-366eb140-56a1-4db8-95f3-57898fd99b46, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.206), requestorAccessMask=0 Sep 16 15:00:50 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [None req-e59885dc-4d0d-4675-8a1b-476071255ad2 tempest-VolumesTestJSON-1606793835 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c/volume-366eb140-56a1-4db8-95f3-57898fd99b46 1073741824" returned: 0 in 0.369s {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 15:00:50 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [None req-e59885dc-4d0d-4675-8a1b-476071255ad2 tempest-VolumesTestJSON-1606793835 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c/volume-366eb140-56a1-4db8-95f3-57898fd99b46 {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 15:00:50 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [None req-e59885dc-4d0d-4675-8a1b-476071255ad2 tempest-VolumesTestJSON-1606793835 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c/volume-366eb140-56a1-4db8-95f3-57898fd99b46" returned: 0 in 0.146s {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 15:00:50 devstack cinder-volume[83259]: DEBUG cinder.volume.drivers.quobyte [None req-e59885dc-4d0d-4675-8a1b-476071255ad2 tempest-VolumesTestJSON-1606793835 None] <== create_volume: return (622ms) {'provider_location': '10.10.41.181/cinder-vol-61f585ac-f8e2-4d19-a890-7ebc2726cc72'} {{(pid=83259) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Sep 16 15:00:50 devstack cinder-volume[83259]: DEBUG oslo_concurrency.lockutils [None req-e59885dc-4d0d-4675-8a1b-476071255ad2 tempest-VolumesTestJSON-1606793835 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.635s {{(pid=83259) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 16 15:00:50 devstack cinder-volume[83259]: DEBUG cinder.volume.manager [None req-e59885dc-4d0d-4675-8a1b-476071255ad2 tempest-VolumesTestJSON-1606793835 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (53b29e91-50d1-463a-b19e-aae665491cbd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-366eb140-56a1-4db8-95f3-57898fd99b46', 'volume_size': 1}' {{(pid=83259) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 15:00:50 devstack cinder-volume[83259]: DEBUG cinder.volume.manager [None req-e59885dc-4d0d-4675-8a1b-476071255ad2 tempest-VolumesTestJSON-1606793835 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (982f633b-4f84-42e5-b89d-dd7a1dedf2fc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83259) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 15:00:50 devstack cinder-volume[83259]: INFO cinder.volume.flows.manager.create_volume [None req-e59885dc-4d0d-4675-8a1b-476071255ad2 tempest-VolumesTestJSON-1606793835 None] Volume volume-366eb140-56a1-4db8-95f3-57898fd99b46 (366eb140-56a1-4db8-95f3-57898fd99b46): created successfully Sep 16 15:00:50 devstack cinder-volume[83259]: DEBUG cinder.volume.manager [None req-e59885dc-4d0d-4675-8a1b-476071255ad2 tempest-VolumesTestJSON-1606793835 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (982f633b-4f84-42e5-b89d-dd7a1dedf2fc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83259) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 15:00:50 devstack cinder-volume[83259]: DEBUG cinder.volume.manager [None req-e59885dc-4d0d-4675-8a1b-476071255ad2 tempest-VolumesTestJSON-1606793835 None] Flow 'volume_create_manager' (95ba8497-35f4-421d-999a-56575deae70e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83259) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 16 15:00:50 devstack cinder-volume[83259]: INFO cinder.volume.manager [None req-e59885dc-4d0d-4675-8a1b-476071255ad2 tempest-VolumesTestJSON-1606793835 None] Created volume successfully. Sep 16 15:00:54 devstack cinder-volume[83259]: DEBUG cinder.coordination [None req-5ee8d1d1-f20d-4669-9663-1acd62b9e157 tempest-VolumesTestJSON-1606793835 None] Acquiring lock "cinder-366eb140-56a1-4db8-95f3-57898fd99b46-delete_volume" by "delete_volume" {{(pid=83259) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 16 15:00:54 devstack cinder-volume[83259]: DEBUG cinder.coordination [None req-5ee8d1d1-f20d-4669-9663-1acd62b9e157 tempest-VolumesTestJSON-1606793835 None] Lock "cinder-366eb140-56a1-4db8-95f3-57898fd99b46-delete_volume" acquired by "delete_volume" :: waited 0.189s {{(pid=83259) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 16 15:00:54 devstack cinder-volume[83259]: WARNING cinder.volume.volume_utils [req-6f965221-10c2-43b8-81a8-d275a78f34cc req-93be611a-3b01-44d8-b541-0d1d2e9a135d tempest-AttachVolumeShelveTestJSON-1870144154 None] Volume driver (QuobyteDriver 1.2) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 16 15:00:54 devstack cinder-volume[83259]: WARNING cinder.volume.volume_utils [None req-5ee8d1d1-f20d-4669-9663-1acd62b9e157 tempest-VolumesTestJSON-1606793835 None] Volume driver (QuobyteDriver 1.2) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 16 15:00:54 devstack cinder-volume[83259]: DEBUG cinder.coordination [None req-5ee8d1d1-f20d-4669-9663-1acd62b9e157 tempest-VolumesTestJSON-1606793835 None] Acquiring lock "cinder-quobyte-366eb140-56a1-4db8-95f3-57898fd99b46" by "delete_volume" {{(pid=83259) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 16 15:00:54 devstack cinder-volume[83259]: WARNING cinder.volume.volume_utils [req-6f965221-10c2-43b8-81a8-d275a78f34cc req-93be611a-3b01-44d8-b541-0d1d2e9a135d tempest-AttachVolumeShelveTestJSON-1870144154 None] Volume driver (QuobyteDriver 1.2) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 16 15:00:54 devstack cinder-volume[83259]: DEBUG cinder.volume.manager [req-6f965221-10c2-43b8-81a8-d275a78f34cc req-93be611a-3b01-44d8-b541-0d1d2e9a135d tempest-AttachVolumeShelveTestJSON-1870144154 None] No connector for attachment 4e9d7c71-83e2-4ca7-9eb3-394e5f82c2fc; skipping storage backend terminate_connection call. {{(pid=83259) _connection_terminate /opt/stack/cinder/cinder/volume/manager.py:4977}} Sep 16 15:00:54 devstack cinder-volume[83259]: DEBUG cinder.volume.manager [req-6f965221-10c2-43b8-81a8-d275a78f34cc req-93be611a-3b01-44d8-b541-0d1d2e9a135d tempest-AttachVolumeShelveTestJSON-1870144154 None] Deleting attachment 4e9d7c71-83e2-4ca7-9eb3-394e5f82c2fc. {{(pid=83259) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5022}} Sep 16 15:00:54 devstack cinder-volume[83259]: DEBUG cinder.coordination [None req-5ee8d1d1-f20d-4669-9663-1acd62b9e157 tempest-VolumesTestJSON-1606793835 None] Lock "cinder-quobyte-366eb140-56a1-4db8-95f3-57898fd99b46" acquired by "delete_volume" :: waited 0.055s {{(pid=83259) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 16 15:00:54 devstack cinder-volume[83259]: DEBUG oslo.privsep.daemon [-] privsep: reply[1c0d3950-85f0-497b-b1ee-60900734ca0e]: (4, 'qcow2') {{(pid=84312) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 16 15:00:54 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [None req-5ee8d1d1-f20d-4669-9663-1acd62b9e157 tempest-VolumesTestJSON-1606793835 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c/volume-366eb140-56a1-4db8-95f3-57898fd99b46 {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 15:00:56 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [None req-5ee8d1d1-f20d-4669-9663-1acd62b9e157 tempest-VolumesTestJSON-1606793835 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c/volume-366eb140-56a1-4db8-95f3-57898fd99b46" returned: 0 in 1.390s {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 15:00:56 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [None req-5ee8d1d1-f20d-4669-9663-1acd62b9e157 tempest-VolumesTestJSON-1606793835 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c/volume-366eb140-56a1-4db8-95f3-57898fd99b46 {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 15:00:56 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [None req-5ee8d1d1-f20d-4669-9663-1acd62b9e157 tempest-VolumesTestJSON-1606793835 None] CMD "rm -f /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c/volume-366eb140-56a1-4db8-95f3-57898fd99b46" returned: 0 in 0.255s {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 15:00:56 devstack cinder-volume[83259]: DEBUG cinder.coordination [None req-5ee8d1d1-f20d-4669-9663-1acd62b9e157 tempest-VolumesTestJSON-1606793835 None] Lock "cinder-quobyte-366eb140-56a1-4db8-95f3-57898fd99b46" released by "delete_volume" :: held 1.946s {{(pid=83259) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 16 15:00:57 devstack cinder-volume[83259]: DEBUG cinder.quota [None req-5ee8d1d1-f20d-4669-9663-1acd62b9e157 tempest-VolumesTestJSON-1606793835 None] Created reservations ['0c04f6e0-48d4-40c9-939b-e641274a7d58', '972be188-5dc2-4684-991a-9da33c3c1d33', 'f45878c8-6c39-46ce-b35d-514b2110e1fe', '44b183bf-aa61-439d-bb53-8b6a4d15e4e8'] {{(pid=83259) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 16 15:00:57 devstack cinder-volume[83259]: DEBUG oslo_concurrency.lockutils [None req-5ee8d1d1-f20d-4669-9663-1acd62b9e157 tempest-VolumesTestJSON-1606793835 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83259) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 16 15:00:57 devstack cinder-volume[83259]: DEBUG oslo_concurrency.lockutils [None req-5ee8d1d1-f20d-4669-9663-1acd62b9e157 tempest-VolumesTestJSON-1606793835 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.008s {{(pid=83259) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 16 15:00:57 devstack cinder-volume[83259]: DEBUG cinder.volume.drivers.quobyte [None req-5ee8d1d1-f20d-4669-9663-1acd62b9e157 tempest-VolumesTestJSON-1606793835 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-61f585ac-f8e2-4d19-a890-7ebc2726cc72': None} {{(pid=83259) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:639}} Sep 16 15:00:57 devstack cinder-volume[83259]: DEBUG cinder.volume.drivers.quobyte [None req-5ee8d1d1-f20d-4669-9663-1acd62b9e157 tempest-VolumesTestJSON-1606793835 None] Available shares ['10.10.41.181/cinder-vol-61f585ac-f8e2-4d19-a890-7ebc2726cc72'] {{(pid=83259) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:669}} Sep 16 15:00:57 devstack cinder-volume[83259]: DEBUG oslo_concurrency.lockutils [None req-5ee8d1d1-f20d-4669-9663-1acd62b9e157 tempest-VolumesTestJSON-1606793835 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.024s {{(pid=83259) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 16 15:00:57 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [None req-5ee8d1d1-f20d-4669-9663-1acd62b9e157 tempest-VolumesTestJSON-1606793835 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 15:00:57 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [None req-5ee8d1d1-f20d-4669-9663-1acd62b9e157 tempest-VolumesTestJSON-1606793835 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c" returned: 0 in 0.188s {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 15:00:57 devstack cinder-volume[83259]: DEBUG cinder.manager [None req-5ee8d1d1-f20d-4669-9663-1acd62b9e157 tempest-VolumesTestJSON-1606793835 None] Notifying Schedulers of capabilities ... {{(pid=83259) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 16 15:00:57 devstack cinder-volume[83259]: INFO cinder.volume.manager [None req-5ee8d1d1-f20d-4669-9663-1acd62b9e157 tempest-VolumesTestJSON-1606793835 None] Deleted volume successfully. Sep 16 15:00:58 devstack cinder-volume[83259]: DEBUG cinder.coordination [None req-ae129a5d-8e5b-443a-b0a4-8b9f172dd25a tempest-VolumesTestJSON-1606793835 None] Acquiring lock "cinder-bb6bc9ef-ba4c-4017-bfdd-aaa3d89da601-delete_volume" by "delete_volume" {{(pid=83259) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 16 15:00:58 devstack cinder-volume[83259]: DEBUG cinder.coordination [None req-5ee8d1d1-f20d-4669-9663-1acd62b9e157 tempest-VolumesTestJSON-1606793835 None] Lock "cinder-366eb140-56a1-4db8-95f3-57898fd99b46-delete_volume" released by "delete_volume" :: held 3.891s {{(pid=83259) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 16 15:00:58 devstack cinder-volume[83259]: DEBUG cinder.coordination [None req-ae129a5d-8e5b-443a-b0a4-8b9f172dd25a tempest-VolumesTestJSON-1606793835 None] Lock "cinder-bb6bc9ef-ba4c-4017-bfdd-aaa3d89da601-delete_volume" acquired by "delete_volume" :: waited 0.090s {{(pid=83259) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 16 15:00:58 devstack cinder-volume[83259]: WARNING cinder.volume.volume_utils [None req-ae129a5d-8e5b-443a-b0a4-8b9f172dd25a tempest-VolumesTestJSON-1606793835 None] Volume driver (QuobyteDriver 1.2) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 16 15:00:58 devstack cinder-volume[83259]: DEBUG cinder.coordination [None req-ae129a5d-8e5b-443a-b0a4-8b9f172dd25a tempest-VolumesTestJSON-1606793835 None] Acquiring lock "cinder-quobyte-bb6bc9ef-ba4c-4017-bfdd-aaa3d89da601" by "delete_volume" {{(pid=83259) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 16 15:00:58 devstack cinder-volume[83259]: DEBUG cinder.coordination [None req-ae129a5d-8e5b-443a-b0a4-8b9f172dd25a tempest-VolumesTestJSON-1606793835 None] Lock "cinder-quobyte-bb6bc9ef-ba4c-4017-bfdd-aaa3d89da601" acquired by "delete_volume" :: waited 0.014s {{(pid=83259) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 16 15:00:58 devstack cinder-volume[83259]: DEBUG oslo.privsep.daemon [-] privsep: reply[66d589a7-3116-43a0-a6d7-48500a9ca7df]: (4, 'qcow2') {{(pid=84312) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 16 15:00:58 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [None req-ae129a5d-8e5b-443a-b0a4-8b9f172dd25a tempest-VolumesTestJSON-1606793835 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c/volume-bb6bc9ef-ba4c-4017-bfdd-aaa3d89da601 {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 15:00:59 devstack quobyte-client[83286]: System call of process 91952 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 16 15:00:59 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [None req-ae129a5d-8e5b-443a-b0a4-8b9f172dd25a tempest-VolumesTestJSON-1606793835 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c/volume-bb6bc9ef-ba4c-4017-bfdd-aaa3d89da601" returned: 0 in 1.046s {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 15:00:59 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [None req-ae129a5d-8e5b-443a-b0a4-8b9f172dd25a tempest-VolumesTestJSON-1606793835 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c/volume-bb6bc9ef-ba4c-4017-bfdd-aaa3d89da601 {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 15:00:59 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [None req-ae129a5d-8e5b-443a-b0a4-8b9f172dd25a tempest-VolumesTestJSON-1606793835 None] CMD "rm -f /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c/volume-bb6bc9ef-ba4c-4017-bfdd-aaa3d89da601" returned: 0 in 0.201s {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 15:00:59 devstack cinder-volume[83259]: DEBUG cinder.coordination [None req-ae129a5d-8e5b-443a-b0a4-8b9f172dd25a tempest-VolumesTestJSON-1606793835 None] Lock "cinder-quobyte-bb6bc9ef-ba4c-4017-bfdd-aaa3d89da601" released by "delete_volume" :: held 1.529s {{(pid=83259) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 16 15:01:00 devstack cinder-volume[83259]: DEBUG cinder.quota [None req-ae129a5d-8e5b-443a-b0a4-8b9f172dd25a tempest-VolumesTestJSON-1606793835 None] Created reservations ['465a913e-9038-471d-b060-a0a6fe60835c', 'ad5e9874-c2fc-4f79-9bf3-507f026d6cdf', 'd8a95db1-dee6-4ffc-9bfe-58966966d79f', '4fbe7d92-c325-4bb7-b0b4-e837eb0fcfd6'] {{(pid=83259) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 16 15:01:01 devstack cinder-volume[83259]: DEBUG oslo_concurrency.lockutils [None req-ae129a5d-8e5b-443a-b0a4-8b9f172dd25a tempest-VolumesTestJSON-1606793835 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83259) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 16 15:01:01 devstack cinder-volume[83259]: DEBUG oslo_concurrency.lockutils [None req-ae129a5d-8e5b-443a-b0a4-8b9f172dd25a tempest-VolumesTestJSON-1606793835 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.007s {{(pid=83259) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 16 15:01:01 devstack cinder-volume[83259]: DEBUG cinder.volume.drivers.quobyte [None req-ae129a5d-8e5b-443a-b0a4-8b9f172dd25a tempest-VolumesTestJSON-1606793835 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-61f585ac-f8e2-4d19-a890-7ebc2726cc72': None} {{(pid=83259) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:639}} Sep 16 15:01:01 devstack cinder-volume[83259]: DEBUG cinder.volume.drivers.quobyte [None req-ae129a5d-8e5b-443a-b0a4-8b9f172dd25a tempest-VolumesTestJSON-1606793835 None] Available shares ['10.10.41.181/cinder-vol-61f585ac-f8e2-4d19-a890-7ebc2726cc72'] {{(pid=83259) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:669}} Sep 16 15:01:01 devstack cinder-volume[83259]: DEBUG oslo_concurrency.lockutils [None req-ae129a5d-8e5b-443a-b0a4-8b9f172dd25a tempest-VolumesTestJSON-1606793835 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=83259) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 16 15:01:01 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [None req-ae129a5d-8e5b-443a-b0a4-8b9f172dd25a tempest-VolumesTestJSON-1606793835 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 15:01:01 devstack cinder-volume[83259]: DEBUG cinder.coordination [None req-70f8515e-4734-41ef-96c9-849077c800f7 tempest-VolumesTestJSON-1606793835 None] Acquiring lock "cinder-e4f887ff-0385-4df2-8b8d-140a19427809-delete_volume" by "delete_volume" {{(pid=83259) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 16 15:01:01 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [None req-ae129a5d-8e5b-443a-b0a4-8b9f172dd25a tempest-VolumesTestJSON-1606793835 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c" returned: 0 in 0.475s {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 15:01:01 devstack cinder-volume[83259]: DEBUG cinder.manager [None req-ae129a5d-8e5b-443a-b0a4-8b9f172dd25a tempest-VolumesTestJSON-1606793835 None] Notifying Schedulers of capabilities ... {{(pid=83259) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 16 15:01:01 devstack cinder-volume[83259]: INFO cinder.volume.manager [None req-ae129a5d-8e5b-443a-b0a4-8b9f172dd25a tempest-VolumesTestJSON-1606793835 None] Deleted volume successfully. Sep 16 15:01:01 devstack cinder-volume[83259]: DEBUG cinder.coordination [None req-70f8515e-4734-41ef-96c9-849077c800f7 tempest-VolumesTestJSON-1606793835 None] Lock "cinder-e4f887ff-0385-4df2-8b8d-140a19427809-delete_volume" acquired by "delete_volume" :: waited 0.311s {{(pid=83259) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 16 15:01:01 devstack cinder-volume[83259]: DEBUG cinder.coordination [None req-ae129a5d-8e5b-443a-b0a4-8b9f172dd25a tempest-VolumesTestJSON-1606793835 None] Lock "cinder-bb6bc9ef-ba4c-4017-bfdd-aaa3d89da601-delete_volume" released by "delete_volume" :: held 3.415s {{(pid=83259) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 16 15:01:01 devstack cinder-volume[83259]: WARNING cinder.volume.volume_utils [None req-70f8515e-4734-41ef-96c9-849077c800f7 tempest-VolumesTestJSON-1606793835 None] Volume driver (QuobyteDriver 1.2) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 16 15:01:01 devstack cinder-volume[83259]: DEBUG cinder.coordination [None req-70f8515e-4734-41ef-96c9-849077c800f7 tempest-VolumesTestJSON-1606793835 None] Acquiring lock "cinder-quobyte-e4f887ff-0385-4df2-8b8d-140a19427809" by "delete_volume" {{(pid=83259) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 16 15:01:01 devstack cinder-volume[83259]: DEBUG cinder.coordination [None req-70f8515e-4734-41ef-96c9-849077c800f7 tempest-VolumesTestJSON-1606793835 None] Lock "cinder-quobyte-e4f887ff-0385-4df2-8b8d-140a19427809" acquired by "delete_volume" :: waited 0.022s {{(pid=83259) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 16 15:01:01 devstack cinder-volume[83259]: DEBUG oslo.privsep.daemon [-] privsep: reply[b6dc8dff-d6c5-4020-a31c-8497ec1d1d88]: (4, 'qcow2') {{(pid=84312) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 16 15:01:01 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [None req-70f8515e-4734-41ef-96c9-849077c800f7 tempest-VolumesTestJSON-1606793835 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c/volume-e4f887ff-0385-4df2-8b8d-140a19427809 {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 15:01:02 devstack quobyte-client[83286]: System call of process 91968 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 16 15:01:02 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [None req-70f8515e-4734-41ef-96c9-849077c800f7 tempest-VolumesTestJSON-1606793835 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c/volume-e4f887ff-0385-4df2-8b8d-140a19427809" returned: 0 in 0.572s {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 15:01:02 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [None req-70f8515e-4734-41ef-96c9-849077c800f7 tempest-VolumesTestJSON-1606793835 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c/volume-e4f887ff-0385-4df2-8b8d-140a19427809 {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 15:01:02 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [None req-70f8515e-4734-41ef-96c9-849077c800f7 tempest-VolumesTestJSON-1606793835 None] CMD "rm -f /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c/volume-e4f887ff-0385-4df2-8b8d-140a19427809" returned: 0 in 0.124s {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 15:01:02 devstack cinder-volume[83259]: DEBUG cinder.coordination [None req-70f8515e-4734-41ef-96c9-849077c800f7 tempest-VolumesTestJSON-1606793835 None] Lock "cinder-quobyte-e4f887ff-0385-4df2-8b8d-140a19427809" released by "delete_volume" :: held 0.869s {{(pid=83259) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 16 15:01:02 devstack cinder-volume[83259]: DEBUG cinder.quota [None req-70f8515e-4734-41ef-96c9-849077c800f7 tempest-VolumesTestJSON-1606793835 None] Created reservations ['4fff8b17-aa8b-4823-8544-53a88dc2afe5', '3847d2bc-c8b8-4640-943a-d25af30c61e6', '6f8a713a-1e3c-40c2-8705-ce6450c34a36', 'c2562e1c-e3cc-4fc9-974a-6be63e6a8ba0'] {{(pid=83259) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 16 15:01:03 devstack cinder-volume[83259]: DEBUG oslo_concurrency.lockutils [None req-70f8515e-4734-41ef-96c9-849077c800f7 tempest-VolumesTestJSON-1606793835 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83259) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 16 15:01:03 devstack cinder-volume[83259]: DEBUG oslo_concurrency.lockutils [None req-70f8515e-4734-41ef-96c9-849077c800f7 tempest-VolumesTestJSON-1606793835 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=83259) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 16 15:01:03 devstack cinder-volume[83259]: DEBUG cinder.volume.drivers.quobyte [None req-70f8515e-4734-41ef-96c9-849077c800f7 tempest-VolumesTestJSON-1606793835 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-61f585ac-f8e2-4d19-a890-7ebc2726cc72': None} {{(pid=83259) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:639}} Sep 16 15:01:03 devstack cinder-volume[83259]: DEBUG cinder.volume.drivers.quobyte [None req-70f8515e-4734-41ef-96c9-849077c800f7 tempest-VolumesTestJSON-1606793835 None] Available shares ['10.10.41.181/cinder-vol-61f585ac-f8e2-4d19-a890-7ebc2726cc72'] {{(pid=83259) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:669}} Sep 16 15:01:03 devstack cinder-volume[83259]: DEBUG oslo_concurrency.lockutils [None req-70f8515e-4734-41ef-96c9-849077c800f7 tempest-VolumesTestJSON-1606793835 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=83259) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 16 15:01:03 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [None req-70f8515e-4734-41ef-96c9-849077c800f7 tempest-VolumesTestJSON-1606793835 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 15:01:03 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [None req-70f8515e-4734-41ef-96c9-849077c800f7 tempest-VolumesTestJSON-1606793835 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c" returned: 0 in 0.088s {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 15:01:03 devstack cinder-volume[83259]: DEBUG cinder.manager [None req-70f8515e-4734-41ef-96c9-849077c800f7 tempest-VolumesTestJSON-1606793835 None] Notifying Schedulers of capabilities ... {{(pid=83259) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 16 15:01:03 devstack cinder-volume[83259]: INFO cinder.volume.manager [None req-70f8515e-4734-41ef-96c9-849077c800f7 tempest-VolumesTestJSON-1606793835 None] Deleted volume successfully. Sep 16 15:01:03 devstack cinder-volume[83259]: DEBUG cinder.coordination [None req-70f8515e-4734-41ef-96c9-849077c800f7 tempest-VolumesTestJSON-1606793835 None] Lock "cinder-e4f887ff-0385-4df2-8b8d-140a19427809-delete_volume" released by "delete_volume" :: held 1.969s {{(pid=83259) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 16 15:01:10 devstack cinder-volume[83259]: DEBUG cinder.volume.manager [None req-78c94893-6b46-4a8f-a616-461106d4a713 tempest-BackendsCapabilitiesAdminTestsJSON-764567511 None] Obtained capabilities list: {'volume_backend_name': 'Quobyte', 'vendor_name': 'Open Source', 'driver_version': '1.2', 'storage_protocol': 'quobyte', 'total_capacity_gb': 924.9134750366211, 'free_capacity_gb': 924.9134750366211, 'reserved_percentage': 0, 'QoS_support': False, 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=83259) get_capabilities /opt/stack/cinder/cinder/volume/manager.py:4797}} Sep 16 15:01:11 devstack cinder-volume[83259]: DEBUG cinder.volume.manager [None req-2cb7e573-07cb-4d63-884c-aba50e6fde40 tempest-BackendsCapabilitiesAdminTestsJSON-764567511 None] Obtained capabilities list: {'volume_backend_name': 'Quobyte', 'vendor_name': 'Open Source', 'driver_version': '1.2', 'storage_protocol': 'quobyte', 'total_capacity_gb': 924.9134750366211, 'free_capacity_gb': 924.9134750366211, 'reserved_percentage': 0, 'QoS_support': False, 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=83259) get_capabilities /opt/stack/cinder/cinder/volume/manager.py:4797}} Sep 16 15:01:13 devstack cinder-volume[83259]: DEBUG dbcounter [-] [83259] Writing DB stats cinder:UPDATE=34,cinder:SELECT=22,cinder:DELETE=3,cinder:INSERT=4 {{(pid=83259) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Sep 16 15:01:13 devstack cinder-volume[83259]: DEBUG dbcounter [-] [83259] Writing DB stats cinder:SELECT=16,cinder:UPDATE=26,cinder:DELETE=3,cinder:INSERT=8 {{(pid=83259) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Sep 16 15:01:24 devstack cinder-volume[83259]: WARNING cinder.volume.volume_utils [None req-cb5d36c9-9b10-4714-8764-5d45fbcf3ccb tempest-GroupsTest-867167237 None] Volume driver (QuobyteDriver 1.2) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 16 15:01:24 devstack cinder-volume[83259]: INFO cinder.volume.manager [None req-cb5d36c9-9b10-4714-8764-5d45fbcf3ccb tempest-GroupsTest-867167237 None] Group tempest-Group1-1639415975: creating Sep 16 15:01:24 devstack cinder-volume[83259]: INFO cinder.volume.manager [None req-cb5d36c9-9b10-4714-8764-5d45fbcf3ccb tempest-GroupsTest-867167237 None] Group tempest-Group1-1639415975: created successfully Sep 16 15:01:24 devstack cinder-volume[83259]: INFO cinder.volume.manager [None req-cb5d36c9-9b10-4714-8764-5d45fbcf3ccb tempest-GroupsTest-867167237 None] Create group completed successfully. Sep 16 15:01:25 devstack cinder-volume[83259]: WARNING cinder.volume.volume_utils [None req-ee2d61b3-5bc2-4002-9ab0-19b7c0b5b3ed tempest-GroupsTest-867167237 None] Volume driver (QuobyteDriver 1.2) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 16 15:01:25 devstack cinder-volume[83259]: INFO cinder.volume.manager [None req-ee2d61b3-5bc2-4002-9ab0-19b7c0b5b3ed tempest-GroupsTest-867167237 None] Group tempest-Group2-815443240: creating Sep 16 15:01:25 devstack cinder-volume[83259]: INFO cinder.volume.manager [None req-ee2d61b3-5bc2-4002-9ab0-19b7c0b5b3ed tempest-GroupsTest-867167237 None] Group tempest-Group2-815443240: created successfully Sep 16 15:01:25 devstack cinder-volume[83259]: INFO cinder.volume.manager [None req-ee2d61b3-5bc2-4002-9ab0-19b7c0b5b3ed tempest-GroupsTest-867167237 None] Create group completed successfully. Sep 16 15:01:27 devstack cinder-volume[83259]: WARNING cinder.volume.volume_utils [None req-822c129e-c54d-43c1-8957-818f0a69c74f tempest-GroupsTest-867167237 None] Volume driver (QuobyteDriver 1.2) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 16 15:01:27 devstack cinder-volume[83259]: DEBUG cinder.volume.flows.manager.create_volume [None req-822c129e-c54d-43c1-8957-818f0a69c74f tempest-GroupsTest-867167237 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#Quobyte'], 'hosts': ['devstack@QuobyteHD#Quobyte']} {{(pid=83259) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1387}} Sep 16 15:01:28 devstack cinder-volume[83259]: DEBUG cinder.volume.manager [None req-822c129e-c54d-43c1-8957-818f0a69c74f tempest-GroupsTest-867167237 None] Flow 'volume_create_manager' (b7020c9d-eb7f-417e-9c51-0a1bf29408f6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83259) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 16 15:01:28 devstack cinder-volume[83259]: DEBUG cinder.volume.manager [None req-822c129e-c54d-43c1-8957-818f0a69c74f tempest-GroupsTest-867167237 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (93ee416d-6a9e-49c1-892a-bba6b61fa657) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83259) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 15:01:28 devstack cinder-volume[83259]: DEBUG cinder.volume.manager [None req-822c129e-c54d-43c1-8957-818f0a69c74f tempest-GroupsTest-867167237 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (93ee416d-6a9e-49c1-892a-bba6b61fa657) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-16T13:01:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-2134847975',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=787356b5-7b95-467e-b0eb-c11e8a4f9117,host='devstack@QuobyteHD#Quobyte',id=8f7f1145-765c-42e4-af6f-f1bbd78686a8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='55b558a4f95a488d8bcf964b9f5bffe7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-16T13:01:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-16T13:01:28Z,use_quota=True,user_id='f47b87e10b714084bb382c74867f4990',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f2ec4905-1f7f-4342-92e7-de49c79842eb),volume_type_id=f2ec4905-1f7f-4342-92e7-de49c79842eb)' {{(pid=83259) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 15:01:28 devstack cinder-volume[83259]: DEBUG cinder.volume.manager [None req-822c129e-c54d-43c1-8957-818f0a69c74f tempest-GroupsTest-867167237 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9649c5f8-061b-4247-9da7-b1167889aa01) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83259) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 15:01:28 devstack cinder-volume[83259]: DEBUG cinder.volume.manager [None req-822c129e-c54d-43c1-8957-818f0a69c74f tempest-GroupsTest-867167237 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9649c5f8-061b-4247-9da7-b1167889aa01) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83259) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 15:01:28 devstack cinder-volume[83259]: DEBUG cinder.volume.manager [None req-822c129e-c54d-43c1-8957-818f0a69c74f tempest-GroupsTest-867167237 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (55fe9d6d-ec35-4e4c-b9cb-99b12bbb4d0f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83259) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 15:01:28 devstack cinder-volume[83259]: DEBUG cinder.volume.manager [None req-822c129e-c54d-43c1-8957-818f0a69c74f tempest-GroupsTest-867167237 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (55fe9d6d-ec35-4e4c-b9cb-99b12bbb4d0f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8f7f1145-765c-42e4-af6f-f1bbd78686a8', 'volume_name': 'volume-8f7f1145-765c-42e4-af6f-f1bbd78686a8', 'volume_size': 1}' {{(pid=83259) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 15:01:28 devstack cinder-volume[83259]: DEBUG cinder.volume.manager [None req-822c129e-c54d-43c1-8957-818f0a69c74f tempest-GroupsTest-867167237 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (27cd9da2-5592-4515-bdee-66eca61832c7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83259) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 15:01:28 devstack cinder-volume[83259]: DEBUG cinder.volume.manager [None req-822c129e-c54d-43c1-8957-818f0a69c74f tempest-GroupsTest-867167237 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (27cd9da2-5592-4515-bdee-66eca61832c7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83259) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 15:01:28 devstack cinder-volume[83259]: DEBUG cinder.volume.manager [None req-822c129e-c54d-43c1-8957-818f0a69c74f tempest-GroupsTest-867167237 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (30e424cf-701e-4309-8180-bc8b995f65c5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83259) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 15:01:28 devstack cinder-volume[83259]: INFO cinder.volume.flows.manager.create_volume [None req-822c129e-c54d-43c1-8957-818f0a69c74f tempest-GroupsTest-867167237 None] Volume 8f7f1145-765c-42e4-af6f-f1bbd78686a8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8f7f1145-765c-42e4-af6f-f1bbd78686a8', 'volume_size': 1} Sep 16 15:01:28 devstack cinder-volume[83259]: DEBUG oslo_concurrency.lockutils [None req-822c129e-c54d-43c1-8957-818f0a69c74f tempest-GroupsTest-867167237 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83259) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 16 15:01:28 devstack cinder-volume[83259]: DEBUG oslo_concurrency.lockutils [None req-822c129e-c54d-43c1-8957-818f0a69c74f tempest-GroupsTest-867167237 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=83259) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 16 15:01:28 devstack cinder-volume[83259]: DEBUG cinder.volume.drivers.quobyte [None req-822c129e-c54d-43c1-8957-818f0a69c74f tempest-GroupsTest-867167237 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=787356b5-7b95-467e-b0eb-c11e8a4f9117,created_at=2025-09-16T13:01:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-2134847975',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=787356b5-7b95-467e-b0eb-c11e8a4f9117,host='devstack@QuobyteHD#Quobyte',id=8f7f1145-765c-42e4-af6f-f1bbd78686a8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='55b558a4f95a488d8bcf964b9f5bffe7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-16T13:01:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-16T13:01:28Z,use_quota=True,user_id='f47b87e10b714084bb382c74867f4990',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f2ec4905-1f7f-4342-92e7-de49c79842eb),volume_type_id=f2ec4905-1f7f-4342-92e7-de49c79842eb)}" {{(pid=83259) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Sep 16 15:01:28 devstack cinder-volume[83259]: DEBUG cinder.volume.drivers.remotefs [None req-822c129e-c54d-43c1-8957-818f0a69c74f tempest-GroupsTest-867167237 None] Creating volume 8f7f1145-765c-42e4-af6f-f1bbd78686a8 {{(pid=83259) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}} Sep 16 15:01:28 devstack cinder-volume[83259]: DEBUG oslo_concurrency.lockutils [None req-822c129e-c54d-43c1-8957-818f0a69c74f tempest-GroupsTest-867167237 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83259) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 16 15:01:28 devstack cinder-volume[83259]: DEBUG oslo_concurrency.lockutils [None req-822c129e-c54d-43c1-8957-818f0a69c74f tempest-GroupsTest-867167237 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83259) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 16 15:01:28 devstack cinder-volume[83259]: DEBUG cinder.volume.drivers.quobyte [None req-822c129e-c54d-43c1-8957-818f0a69c74f tempest-GroupsTest-867167237 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-61f585ac-f8e2-4d19-a890-7ebc2726cc72': None} {{(pid=83259) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:639}} Sep 16 15:01:28 devstack cinder-volume[83259]: DEBUG cinder.volume.drivers.quobyte [None req-822c129e-c54d-43c1-8957-818f0a69c74f tempest-GroupsTest-867167237 None] Available shares ['10.10.41.181/cinder-vol-61f585ac-f8e2-4d19-a890-7ebc2726cc72'] {{(pid=83259) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:669}} Sep 16 15:01:28 devstack cinder-volume[83259]: DEBUG oslo_concurrency.lockutils [None req-822c129e-c54d-43c1-8957-818f0a69c74f tempest-GroupsTest-867167237 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=83259) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 16 15:01:28 devstack cinder-volume[83259]: DEBUG cinder.volume.drivers.quobyte [None req-822c129e-c54d-43c1-8957-818f0a69c74f tempest-GroupsTest-867167237 None] Selected 10.10.41.181/cinder-vol-61f585ac-f8e2-4d19-a890-7ebc2726cc72 as target Quobyte volume. {{(pid=83259) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:690}} Sep 16 15:01:28 devstack cinder-volume[83259]: INFO cinder.volume.drivers.remotefs [None req-822c129e-c54d-43c1-8957-818f0a69c74f tempest-GroupsTest-867167237 None] casted to 10.10.41.181/cinder-vol-61f585ac-f8e2-4d19-a890-7ebc2726cc72 Sep 16 15:01:28 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [None req-822c129e-c54d-43c1-8957-818f0a69c74f tempest-GroupsTest-867167237 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c/volume-8f7f1145-765c-42e4-af6f-f1bbd78686a8 1073741824 {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 15:01:28 devstack quobyte-client[83286]: System call of process 92056 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 16 15:01:28 devstack quobyte-client[83286]: The server volume:87712ffe-8a69-446d-9ed6-4430c7ee9792@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=87712ffe-8a69-446d-9ed6-4430c7ee9792, inode=22, name=volume-8f7f1145-765c-42e4-af6f-f1bbd78686a8, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.206), requestorAccessMask=0 Sep 16 15:01:28 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [None req-822c129e-c54d-43c1-8957-818f0a69c74f tempest-GroupsTest-867167237 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c/volume-8f7f1145-765c-42e4-af6f-f1bbd78686a8 1073741824" returned: 0 in 0.423s {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 15:01:28 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [None req-822c129e-c54d-43c1-8957-818f0a69c74f tempest-GroupsTest-867167237 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c/volume-8f7f1145-765c-42e4-af6f-f1bbd78686a8 {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 15:01:28 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [None req-822c129e-c54d-43c1-8957-818f0a69c74f tempest-GroupsTest-867167237 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c/volume-8f7f1145-765c-42e4-af6f-f1bbd78686a8" returned: 0 in 0.103s {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 15:01:28 devstack cinder-volume[83259]: DEBUG cinder.volume.drivers.quobyte [None req-822c129e-c54d-43c1-8957-818f0a69c74f tempest-GroupsTest-867167237 None] <== create_volume: return (595ms) {'provider_location': '10.10.41.181/cinder-vol-61f585ac-f8e2-4d19-a890-7ebc2726cc72'} {{(pid=83259) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Sep 16 15:01:28 devstack cinder-volume[83259]: DEBUG oslo_concurrency.lockutils [None req-822c129e-c54d-43c1-8957-818f0a69c74f tempest-GroupsTest-867167237 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.607s {{(pid=83259) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 16 15:01:28 devstack cinder-volume[83259]: DEBUG cinder.volume.manager [None req-822c129e-c54d-43c1-8957-818f0a69c74f tempest-GroupsTest-867167237 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (30e424cf-701e-4309-8180-bc8b995f65c5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8f7f1145-765c-42e4-af6f-f1bbd78686a8', 'volume_size': 1}' {{(pid=83259) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 15:01:29 devstack cinder-volume[83259]: DEBUG cinder.volume.manager [None req-822c129e-c54d-43c1-8957-818f0a69c74f tempest-GroupsTest-867167237 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b5e0a073-d326-4e65-a4ad-05327a0ef096) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83259) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 15:01:29 devstack cinder-volume[83259]: INFO cinder.volume.flows.manager.create_volume [None req-822c129e-c54d-43c1-8957-818f0a69c74f tempest-GroupsTest-867167237 None] Volume volume-8f7f1145-765c-42e4-af6f-f1bbd78686a8 (8f7f1145-765c-42e4-af6f-f1bbd78686a8): created successfully Sep 16 15:01:29 devstack cinder-volume[83259]: DEBUG cinder.volume.manager [None req-822c129e-c54d-43c1-8957-818f0a69c74f tempest-GroupsTest-867167237 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b5e0a073-d326-4e65-a4ad-05327a0ef096) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83259) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 15:01:29 devstack cinder-volume[83259]: DEBUG cinder.volume.manager [None req-822c129e-c54d-43c1-8957-818f0a69c74f tempest-GroupsTest-867167237 None] Flow 'volume_create_manager' (b7020c9d-eb7f-417e-9c51-0a1bf29408f6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83259) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 16 15:01:29 devstack cinder-volume[83259]: INFO cinder.volume.manager [None req-822c129e-c54d-43c1-8957-818f0a69c74f tempest-GroupsTest-867167237 None] Created volume successfully. Sep 16 15:01:30 devstack cinder-volume[83259]: WARNING cinder.volume.volume_utils [None req-9fca8f8f-279c-4967-82f3-83df19f2d448 tempest-GroupsTest-867167237 None] Volume driver (QuobyteDriver 1.2) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 16 15:01:30 devstack cinder-volume[83259]: DEBUG cinder.coordination [None req-9fca8f8f-279c-4967-82f3-83df19f2d448 tempest-GroupsTest-867167237 None] Acquiring lock "cinder-quobyte-8f7f1145-765c-42e4-af6f-f1bbd78686a8" by "delete_volume" {{(pid=83259) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 16 15:01:30 devstack cinder-volume[83259]: DEBUG cinder.coordination [None req-9fca8f8f-279c-4967-82f3-83df19f2d448 tempest-GroupsTest-867167237 None] Lock "cinder-quobyte-8f7f1145-765c-42e4-af6f-f1bbd78686a8" acquired by "delete_volume" :: waited 0.069s {{(pid=83259) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 16 15:01:30 devstack cinder-volume[83259]: DEBUG oslo.privsep.daemon [-] privsep: reply[93908b24-f866-4f6a-8cc6-3ce0f6d41010]: (4, 'qcow2') {{(pid=84312) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 16 15:01:30 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [None req-9fca8f8f-279c-4967-82f3-83df19f2d448 tempest-GroupsTest-867167237 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c/volume-8f7f1145-765c-42e4-af6f-f1bbd78686a8 {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 15:01:31 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [None req-9fca8f8f-279c-4967-82f3-83df19f2d448 tempest-GroupsTest-867167237 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c/volume-8f7f1145-765c-42e4-af6f-f1bbd78686a8" returned: 0 in 0.525s {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 15:01:31 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [None req-9fca8f8f-279c-4967-82f3-83df19f2d448 tempest-GroupsTest-867167237 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c/volume-8f7f1145-765c-42e4-af6f-f1bbd78686a8 {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 15:01:31 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [None req-9fca8f8f-279c-4967-82f3-83df19f2d448 tempest-GroupsTest-867167237 None] CMD "rm -f /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c/volume-8f7f1145-765c-42e4-af6f-f1bbd78686a8" returned: 0 in 0.248s {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 15:01:31 devstack cinder-volume[83259]: DEBUG cinder.coordination [None req-9fca8f8f-279c-4967-82f3-83df19f2d448 tempest-GroupsTest-867167237 None] Lock "cinder-quobyte-8f7f1145-765c-42e4-af6f-f1bbd78686a8" released by "delete_volume" :: held 1.062s {{(pid=83259) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 16 15:01:32 devstack cinder-volume[83259]: DEBUG cinder.quota [None req-9fca8f8f-279c-4967-82f3-83df19f2d448 tempest-GroupsTest-867167237 None] Created reservations ['d696921e-9f9e-43e3-9846-21d8010926e6'] {{(pid=83259) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 16 15:01:32 devstack cinder-volume[83259]: WARNING cinder.quota [None req-9fca8f8f-279c-4967-82f3-83df19f2d448 tempest-GroupsTest-867167237 None] Deprecated: Default quota for resource: volumes_tempest-GroupsTest-volume-type-768357520 is set by the default quota flag: quota_volumes_tempest-GroupsTest-volume-type-768357520, it is now deprecated. Please use the default quota class for default quota. Sep 16 15:01:32 devstack cinder-volume[83259]: WARNING cinder.quota [None req-9fca8f8f-279c-4967-82f3-83df19f2d448 tempest-GroupsTest-867167237 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupsTest-volume-type-768357520 is set by the default quota flag: quota_gigabytes_tempest-GroupsTest-volume-type-768357520, it is now deprecated. Please use the default quota class for default quota. Sep 16 15:01:32 devstack cinder-volume[83259]: DEBUG cinder.quota [None req-9fca8f8f-279c-4967-82f3-83df19f2d448 tempest-GroupsTest-867167237 None] Created reservations ['4098e2ff-3aea-469f-8da3-c5c984bdcde8', 'c972a673-c62f-402d-87b5-eb5ba8b9b570', 'a88479fc-a2a7-4dec-a841-5f8e79e3ab33', 'b7b387a8-2b54-4c45-91d9-996541c69d1f'] {{(pid=83259) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 16 15:01:32 devstack cinder-volume[83259]: DEBUG oslo_concurrency.lockutils [None req-9fca8f8f-279c-4967-82f3-83df19f2d448 tempest-GroupsTest-867167237 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83259) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 16 15:01:32 devstack cinder-volume[83259]: DEBUG oslo_concurrency.lockutils [None req-9fca8f8f-279c-4967-82f3-83df19f2d448 tempest-GroupsTest-867167237 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=83259) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 16 15:01:32 devstack cinder-volume[83259]: DEBUG cinder.volume.drivers.quobyte [None req-9fca8f8f-279c-4967-82f3-83df19f2d448 tempest-GroupsTest-867167237 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-61f585ac-f8e2-4d19-a890-7ebc2726cc72': None} {{(pid=83259) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:639}} Sep 16 15:01:32 devstack cinder-volume[83259]: DEBUG cinder.volume.drivers.quobyte [None req-9fca8f8f-279c-4967-82f3-83df19f2d448 tempest-GroupsTest-867167237 None] Available shares ['10.10.41.181/cinder-vol-61f585ac-f8e2-4d19-a890-7ebc2726cc72'] {{(pid=83259) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:669}} Sep 16 15:01:32 devstack cinder-volume[83259]: DEBUG oslo_concurrency.lockutils [None req-9fca8f8f-279c-4967-82f3-83df19f2d448 tempest-GroupsTest-867167237 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=83259) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 16 15:01:32 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [None req-9fca8f8f-279c-4967-82f3-83df19f2d448 tempest-GroupsTest-867167237 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 15:01:32 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [None req-9fca8f8f-279c-4967-82f3-83df19f2d448 tempest-GroupsTest-867167237 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c" returned: 0 in 0.156s {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 15:01:33 devstack cinder-volume[83259]: DEBUG cinder.manager [None req-9fca8f8f-279c-4967-82f3-83df19f2d448 tempest-GroupsTest-867167237 None] Notifying Schedulers of capabilities ... {{(pid=83259) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 16 15:01:33 devstack cinder-volume[83259]: INFO cinder.volume.manager [None req-9fca8f8f-279c-4967-82f3-83df19f2d448 tempest-GroupsTest-867167237 None] Delete group completed successfully. Sep 16 15:01:34 devstack cinder-volume[83259]: WARNING cinder.volume.volume_utils [None req-e92204aa-2ae7-48f1-82be-8996f66235d3 tempest-GroupsTest-867167237 None] Volume driver (QuobyteDriver 1.2) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 16 15:01:34 devstack cinder-volume[83259]: DEBUG cinder.quota [None req-e92204aa-2ae7-48f1-82be-8996f66235d3 tempest-GroupsTest-867167237 None] Created reservations ['70a6d66f-7b70-4193-be8c-357f37be7baa'] {{(pid=83259) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 16 15:01:35 devstack cinder-volume[83259]: DEBUG oslo_concurrency.lockutils [None req-e92204aa-2ae7-48f1-82be-8996f66235d3 tempest-GroupsTest-867167237 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83259) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 16 15:01:35 devstack cinder-volume[83259]: DEBUG oslo_concurrency.lockutils [None req-e92204aa-2ae7-48f1-82be-8996f66235d3 tempest-GroupsTest-867167237 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=83259) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 16 15:01:35 devstack cinder-volume[83259]: DEBUG cinder.volume.drivers.quobyte [None req-e92204aa-2ae7-48f1-82be-8996f66235d3 tempest-GroupsTest-867167237 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-61f585ac-f8e2-4d19-a890-7ebc2726cc72': None} {{(pid=83259) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:639}} Sep 16 15:01:35 devstack cinder-volume[83259]: DEBUG cinder.volume.drivers.quobyte [None req-e92204aa-2ae7-48f1-82be-8996f66235d3 tempest-GroupsTest-867167237 None] Available shares ['10.10.41.181/cinder-vol-61f585ac-f8e2-4d19-a890-7ebc2726cc72'] {{(pid=83259) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:669}} Sep 16 15:01:35 devstack cinder-volume[83259]: DEBUG oslo_concurrency.lockutils [None req-e92204aa-2ae7-48f1-82be-8996f66235d3 tempest-GroupsTest-867167237 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.083s {{(pid=83259) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 16 15:01:35 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [None req-e92204aa-2ae7-48f1-82be-8996f66235d3 tempest-GroupsTest-867167237 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 15:01:36 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [None req-e92204aa-2ae7-48f1-82be-8996f66235d3 tempest-GroupsTest-867167237 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c" returned: 0 in 0.821s {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 15:01:36 devstack cinder-volume[83259]: DEBUG cinder.manager [None req-e92204aa-2ae7-48f1-82be-8996f66235d3 tempest-GroupsTest-867167237 None] Notifying Schedulers of capabilities ... {{(pid=83259) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 16 15:01:36 devstack cinder-volume[83259]: INFO cinder.volume.manager [None req-e92204aa-2ae7-48f1-82be-8996f66235d3 tempest-GroupsTest-867167237 None] Delete group completed successfully. Sep 16 15:01:38 devstack cinder-volume[83259]: WARNING cinder.volume.volume_utils [None req-fc7c7930-1dd8-4524-8f2f-09cb073edcc8 tempest-GroupsTest-867167237 None] Volume driver (QuobyteDriver 1.2) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 16 15:01:38 devstack cinder-volume[83259]: INFO cinder.volume.manager [None req-fc7c7930-1dd8-4524-8f2f-09cb073edcc8 tempest-GroupsTest-867167237 None] Group tempest-GroupsTest-Group-1260255526: creating Sep 16 15:01:38 devstack cinder-volume[83259]: INFO cinder.volume.manager [None req-fc7c7930-1dd8-4524-8f2f-09cb073edcc8 tempest-GroupsTest-867167237 None] Group tempest-GroupsTest-Group-1260255526: created successfully Sep 16 15:01:38 devstack cinder-volume[83259]: INFO cinder.volume.manager [None req-fc7c7930-1dd8-4524-8f2f-09cb073edcc8 tempest-GroupsTest-867167237 None] Create group completed successfully. Sep 16 15:01:40 devstack cinder-volume[83259]: WARNING cinder.volume.volume_utils [None req-5f452b5a-5d05-4d87-8a2f-688df3781813 tempest-GroupsTest-867167237 None] Volume driver (QuobyteDriver 1.2) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 16 15:01:40 devstack cinder-volume[83259]: DEBUG cinder.volume.flows.manager.create_volume [None req-5f452b5a-5d05-4d87-8a2f-688df3781813 tempest-GroupsTest-867167237 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#Quobyte'], 'hosts': ['devstack@QuobyteHD#Quobyte']} {{(pid=83259) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1387}} Sep 16 15:01:40 devstack cinder-volume[83259]: DEBUG cinder.volume.manager [None req-5f452b5a-5d05-4d87-8a2f-688df3781813 tempest-GroupsTest-867167237 None] Flow 'volume_create_manager' (2d77e040-3465-4e3d-8c53-1af051dac62c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83259) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 16 15:01:40 devstack cinder-volume[83259]: DEBUG cinder.volume.manager [None req-5f452b5a-5d05-4d87-8a2f-688df3781813 tempest-GroupsTest-867167237 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fe74e13f-5fe6-4893-956c-1ce3c0c928cb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83259) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 15:01:40 devstack cinder-volume[83259]: DEBUG cinder.volume.manager [None req-5f452b5a-5d05-4d87-8a2f-688df3781813 tempest-GroupsTest-867167237 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fe74e13f-5fe6-4893-956c-1ce3c0c928cb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-16T13:01:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-108293277',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=66f0e047-8334-40b5-980c-609ada8f87cc,host='devstack@QuobyteHD#Quobyte',id=78450b2f-89b3-4e3e-b920-723914c88f12,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='55b558a4f95a488d8bcf964b9f5bffe7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-16T13:01:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-16T13:01:40Z,use_quota=True,user_id='f47b87e10b714084bb382c74867f4990',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(602dc07d-6500-48b0-8782-03b39bc6ee54),volume_type_id=602dc07d-6500-48b0-8782-03b39bc6ee54)' {{(pid=83259) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 15:01:40 devstack cinder-volume[83259]: DEBUG cinder.volume.manager [None req-5f452b5a-5d05-4d87-8a2f-688df3781813 tempest-GroupsTest-867167237 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7ec7d97f-7149-4e2c-b365-23f2d545444a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83259) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 15:01:40 devstack cinder-volume[83259]: DEBUG cinder.volume.manager [None req-5f452b5a-5d05-4d87-8a2f-688df3781813 tempest-GroupsTest-867167237 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7ec7d97f-7149-4e2c-b365-23f2d545444a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83259) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 15:01:40 devstack cinder-volume[83259]: DEBUG cinder.volume.manager [None req-5f452b5a-5d05-4d87-8a2f-688df3781813 tempest-GroupsTest-867167237 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ddca9330-93a1-4581-8f0e-135ecb03cea6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83259) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 15:01:40 devstack cinder-volume[83259]: DEBUG cinder.volume.manager [None req-5f452b5a-5d05-4d87-8a2f-688df3781813 tempest-GroupsTest-867167237 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ddca9330-93a1-4581-8f0e-135ecb03cea6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '78450b2f-89b3-4e3e-b920-723914c88f12', 'volume_name': 'volume-78450b2f-89b3-4e3e-b920-723914c88f12', 'volume_size': 1}' {{(pid=83259) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 15:01:40 devstack cinder-volume[83259]: DEBUG cinder.volume.manager [None req-5f452b5a-5d05-4d87-8a2f-688df3781813 tempest-GroupsTest-867167237 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (444cf971-000c-4530-9cbd-30c050d73490) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83259) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 15:01:40 devstack cinder-volume[83259]: DEBUG cinder.volume.manager [None req-5f452b5a-5d05-4d87-8a2f-688df3781813 tempest-GroupsTest-867167237 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (444cf971-000c-4530-9cbd-30c050d73490) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83259) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 15:01:40 devstack cinder-volume[83259]: DEBUG cinder.volume.manager [None req-5f452b5a-5d05-4d87-8a2f-688df3781813 tempest-GroupsTest-867167237 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0268dc2d-6380-4c6b-80e7-5627f57deaaf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83259) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 15:01:40 devstack cinder-volume[83259]: INFO cinder.volume.flows.manager.create_volume [None req-5f452b5a-5d05-4d87-8a2f-688df3781813 tempest-GroupsTest-867167237 None] Volume 78450b2f-89b3-4e3e-b920-723914c88f12: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-78450b2f-89b3-4e3e-b920-723914c88f12', 'volume_size': 1} Sep 16 15:01:40 devstack cinder-volume[83259]: DEBUG oslo_concurrency.lockutils [None req-5f452b5a-5d05-4d87-8a2f-688df3781813 tempest-GroupsTest-867167237 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83259) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 16 15:01:40 devstack cinder-volume[83259]: DEBUG oslo_concurrency.lockutils [None req-5f452b5a-5d05-4d87-8a2f-688df3781813 tempest-GroupsTest-867167237 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.003s {{(pid=83259) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 16 15:01:40 devstack cinder-volume[83259]: DEBUG cinder.volume.drivers.quobyte [None req-5f452b5a-5d05-4d87-8a2f-688df3781813 tempest-GroupsTest-867167237 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=66f0e047-8334-40b5-980c-609ada8f87cc,created_at=2025-09-16T13:01:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-108293277',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=66f0e047-8334-40b5-980c-609ada8f87cc,host='devstack@QuobyteHD#Quobyte',id=78450b2f-89b3-4e3e-b920-723914c88f12,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='55b558a4f95a488d8bcf964b9f5bffe7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-16T13:01:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-16T13:01:40Z,use_quota=True,user_id='f47b87e10b714084bb382c74867f4990',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(602dc07d-6500-48b0-8782-03b39bc6ee54),volume_type_id=602dc07d-6500-48b0-8782-03b39bc6ee54)}" {{(pid=83259) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Sep 16 15:01:40 devstack cinder-volume[83259]: DEBUG cinder.volume.drivers.remotefs [None req-5f452b5a-5d05-4d87-8a2f-688df3781813 tempest-GroupsTest-867167237 None] Creating volume 78450b2f-89b3-4e3e-b920-723914c88f12 {{(pid=83259) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}} Sep 16 15:01:40 devstack cinder-volume[83259]: DEBUG oslo_concurrency.lockutils [None req-5f452b5a-5d05-4d87-8a2f-688df3781813 tempest-GroupsTest-867167237 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83259) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 16 15:01:40 devstack cinder-volume[83259]: DEBUG oslo_concurrency.lockutils [None req-5f452b5a-5d05-4d87-8a2f-688df3781813 tempest-GroupsTest-867167237 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83259) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 16 15:01:40 devstack cinder-volume[83259]: DEBUG cinder.volume.drivers.quobyte [None req-5f452b5a-5d05-4d87-8a2f-688df3781813 tempest-GroupsTest-867167237 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-61f585ac-f8e2-4d19-a890-7ebc2726cc72': None} {{(pid=83259) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:639}} Sep 16 15:01:40 devstack cinder-volume[83259]: DEBUG cinder.volume.drivers.quobyte [None req-5f452b5a-5d05-4d87-8a2f-688df3781813 tempest-GroupsTest-867167237 None] Available shares ['10.10.41.181/cinder-vol-61f585ac-f8e2-4d19-a890-7ebc2726cc72'] {{(pid=83259) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:669}} Sep 16 15:01:40 devstack cinder-volume[83259]: DEBUG oslo_concurrency.lockutils [None req-5f452b5a-5d05-4d87-8a2f-688df3781813 tempest-GroupsTest-867167237 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=83259) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 16 15:01:40 devstack cinder-volume[83259]: DEBUG cinder.volume.drivers.quobyte [None req-5f452b5a-5d05-4d87-8a2f-688df3781813 tempest-GroupsTest-867167237 None] Selected 10.10.41.181/cinder-vol-61f585ac-f8e2-4d19-a890-7ebc2726cc72 as target Quobyte volume. {{(pid=83259) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:690}} Sep 16 15:01:40 devstack cinder-volume[83259]: INFO cinder.volume.drivers.remotefs [None req-5f452b5a-5d05-4d87-8a2f-688df3781813 tempest-GroupsTest-867167237 None] casted to 10.10.41.181/cinder-vol-61f585ac-f8e2-4d19-a890-7ebc2726cc72 Sep 16 15:01:40 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [None req-5f452b5a-5d05-4d87-8a2f-688df3781813 tempest-GroupsTest-867167237 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c/volume-78450b2f-89b3-4e3e-b920-723914c88f12 1073741824 {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 15:01:40 devstack quobyte-client[83286]: The server volume:87712ffe-8a69-446d-9ed6-4430c7ee9792@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=87712ffe-8a69-446d-9ed6-4430c7ee9792, inode=23, name=volume-78450b2f-89b3-4e3e-b920-723914c88f12, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.206), requestorAccessMask=0 Sep 16 15:01:41 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [None req-5f452b5a-5d05-4d87-8a2f-688df3781813 tempest-GroupsTest-867167237 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c/volume-78450b2f-89b3-4e3e-b920-723914c88f12 1073741824" returned: 0 in 0.418s {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 15:01:41 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [None req-5f452b5a-5d05-4d87-8a2f-688df3781813 tempest-GroupsTest-867167237 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c/volume-78450b2f-89b3-4e3e-b920-723914c88f12 {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 15:01:41 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [None req-5f452b5a-5d05-4d87-8a2f-688df3781813 tempest-GroupsTest-867167237 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c/volume-78450b2f-89b3-4e3e-b920-723914c88f12" returned: 0 in 0.118s {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 15:01:41 devstack cinder-volume[83259]: DEBUG cinder.volume.drivers.quobyte [None req-5f452b5a-5d05-4d87-8a2f-688df3781813 tempest-GroupsTest-867167237 None] <== create_volume: return (640ms) {'provider_location': '10.10.41.181/cinder-vol-61f585ac-f8e2-4d19-a890-7ebc2726cc72'} {{(pid=83259) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Sep 16 15:01:41 devstack cinder-volume[83259]: DEBUG oslo_concurrency.lockutils [None req-5f452b5a-5d05-4d87-8a2f-688df3781813 tempest-GroupsTest-867167237 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.687s {{(pid=83259) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 16 15:01:41 devstack cinder-volume[83259]: DEBUG cinder.volume.manager [None req-5f452b5a-5d05-4d87-8a2f-688df3781813 tempest-GroupsTest-867167237 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0268dc2d-6380-4c6b-80e7-5627f57deaaf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-78450b2f-89b3-4e3e-b920-723914c88f12', 'volume_size': 1}' {{(pid=83259) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 15:01:41 devstack cinder-volume[83259]: DEBUG cinder.volume.manager [None req-5f452b5a-5d05-4d87-8a2f-688df3781813 tempest-GroupsTest-867167237 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c4fbdbd0-07c7-44b2-89a1-1e0e2f3ca1ba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83259) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 15:01:41 devstack cinder-volume[83259]: INFO cinder.volume.flows.manager.create_volume [None req-5f452b5a-5d05-4d87-8a2f-688df3781813 tempest-GroupsTest-867167237 None] Volume volume-78450b2f-89b3-4e3e-b920-723914c88f12 (78450b2f-89b3-4e3e-b920-723914c88f12): created successfully Sep 16 15:01:41 devstack cinder-volume[83259]: DEBUG cinder.volume.manager [None req-5f452b5a-5d05-4d87-8a2f-688df3781813 tempest-GroupsTest-867167237 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c4fbdbd0-07c7-44b2-89a1-1e0e2f3ca1ba) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83259) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 15:01:41 devstack cinder-volume[83259]: DEBUG cinder.volume.manager [None req-5f452b5a-5d05-4d87-8a2f-688df3781813 tempest-GroupsTest-867167237 None] Flow 'volume_create_manager' (2d77e040-3465-4e3d-8c53-1af051dac62c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83259) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 16 15:01:41 devstack cinder-volume[83259]: INFO cinder.volume.manager [None req-5f452b5a-5d05-4d87-8a2f-688df3781813 tempest-GroupsTest-867167237 None] Created volume successfully. Sep 16 15:01:43 devstack cinder-volume[83259]: WARNING cinder.volume.volume_utils [None req-38411833-79e3-4014-bc27-11c134577b6f tempest-GroupsTest-867167237 None] Volume driver (QuobyteDriver 1.2) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 16 15:01:43 devstack cinder-volume[83259]: DEBUG cinder.volume.flows.manager.create_volume [None req-38411833-79e3-4014-bc27-11c134577b6f tempest-GroupsTest-867167237 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#Quobyte'], 'hosts': ['devstack@QuobyteHD#Quobyte']} {{(pid=83259) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1387}} Sep 16 15:01:43 devstack cinder-volume[83259]: DEBUG cinder.volume.manager [None req-38411833-79e3-4014-bc27-11c134577b6f tempest-GroupsTest-867167237 None] Flow 'volume_create_manager' (a17c2859-d3de-401b-bd14-e399d6ffedb5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83259) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 16 15:01:43 devstack cinder-volume[83259]: DEBUG cinder.volume.manager [None req-38411833-79e3-4014-bc27-11c134577b6f tempest-GroupsTest-867167237 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (889b412e-d20d-4e9e-9e9c-cc66b0594e1e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83259) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 15:01:43 devstack cinder-volume[83259]: DEBUG cinder.volume.manager [None req-38411833-79e3-4014-bc27-11c134577b6f tempest-GroupsTest-867167237 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (889b412e-d20d-4e9e-9e9c-cc66b0594e1e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-16T13:01:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-488901585',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=66f0e047-8334-40b5-980c-609ada8f87cc,host='devstack@QuobyteHD#Quobyte',id=75c41582-4aa3-4c64-9d3d-8a95875e8cac,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='55b558a4f95a488d8bcf964b9f5bffe7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-16T13:01:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-16T13:01:43Z,use_quota=True,user_id='f47b87e10b714084bb382c74867f4990',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(602dc07d-6500-48b0-8782-03b39bc6ee54),volume_type_id=602dc07d-6500-48b0-8782-03b39bc6ee54)' {{(pid=83259) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 15:01:43 devstack cinder-volume[83259]: DEBUG cinder.volume.manager [None req-38411833-79e3-4014-bc27-11c134577b6f tempest-GroupsTest-867167237 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5d276486-5151-49ce-8667-5aebea16a97c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83259) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 15:01:43 devstack cinder-volume[83259]: DEBUG cinder.volume.manager [None req-38411833-79e3-4014-bc27-11c134577b6f tempest-GroupsTest-867167237 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5d276486-5151-49ce-8667-5aebea16a97c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83259) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 15:01:43 devstack cinder-volume[83259]: DEBUG cinder.volume.manager [None req-38411833-79e3-4014-bc27-11c134577b6f tempest-GroupsTest-867167237 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cdaec15c-81a5-4b8f-90c5-f8ea80376350) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83259) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 15:01:43 devstack cinder-volume[83259]: DEBUG cinder.volume.manager [None req-38411833-79e3-4014-bc27-11c134577b6f tempest-GroupsTest-867167237 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cdaec15c-81a5-4b8f-90c5-f8ea80376350) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '75c41582-4aa3-4c64-9d3d-8a95875e8cac', 'volume_name': 'volume-75c41582-4aa3-4c64-9d3d-8a95875e8cac', 'volume_size': 1}' {{(pid=83259) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 15:01:43 devstack cinder-volume[83259]: DEBUG cinder.volume.manager [None req-38411833-79e3-4014-bc27-11c134577b6f tempest-GroupsTest-867167237 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ea863a3c-6bf3-4ca7-8ad4-3170b43b6c4a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83259) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 15:01:43 devstack cinder-volume[83259]: DEBUG cinder.volume.manager [None req-38411833-79e3-4014-bc27-11c134577b6f tempest-GroupsTest-867167237 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ea863a3c-6bf3-4ca7-8ad4-3170b43b6c4a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83259) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 15:01:43 devstack cinder-volume[83259]: DEBUG cinder.volume.manager [None req-38411833-79e3-4014-bc27-11c134577b6f tempest-GroupsTest-867167237 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ac4b393c-fbc1-45b2-995f-92a3e9116dfc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83259) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 15:01:43 devstack cinder-volume[83259]: INFO cinder.volume.flows.manager.create_volume [None req-38411833-79e3-4014-bc27-11c134577b6f tempest-GroupsTest-867167237 None] Volume 75c41582-4aa3-4c64-9d3d-8a95875e8cac: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-75c41582-4aa3-4c64-9d3d-8a95875e8cac', 'volume_size': 1} Sep 16 15:01:43 devstack cinder-volume[83259]: DEBUG oslo_concurrency.lockutils [None req-38411833-79e3-4014-bc27-11c134577b6f tempest-GroupsTest-867167237 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83259) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 16 15:01:43 devstack cinder-volume[83259]: DEBUG oslo_concurrency.lockutils [None req-38411833-79e3-4014-bc27-11c134577b6f tempest-GroupsTest-867167237 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=83259) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 16 15:01:43 devstack cinder-volume[83259]: DEBUG cinder.volume.drivers.quobyte [None req-38411833-79e3-4014-bc27-11c134577b6f tempest-GroupsTest-867167237 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=66f0e047-8334-40b5-980c-609ada8f87cc,created_at=2025-09-16T13:01:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-488901585',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=66f0e047-8334-40b5-980c-609ada8f87cc,host='devstack@QuobyteHD#Quobyte',id=75c41582-4aa3-4c64-9d3d-8a95875e8cac,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='55b558a4f95a488d8bcf964b9f5bffe7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-16T13:01:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-16T13:01:43Z,use_quota=True,user_id='f47b87e10b714084bb382c74867f4990',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(602dc07d-6500-48b0-8782-03b39bc6ee54),volume_type_id=602dc07d-6500-48b0-8782-03b39bc6ee54)}" {{(pid=83259) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Sep 16 15:01:43 devstack cinder-volume[83259]: DEBUG cinder.volume.drivers.remotefs [None req-38411833-79e3-4014-bc27-11c134577b6f tempest-GroupsTest-867167237 None] Creating volume 75c41582-4aa3-4c64-9d3d-8a95875e8cac {{(pid=83259) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}} Sep 16 15:01:43 devstack cinder-volume[83259]: DEBUG oslo_concurrency.lockutils [None req-38411833-79e3-4014-bc27-11c134577b6f tempest-GroupsTest-867167237 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83259) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 16 15:01:43 devstack cinder-volume[83259]: DEBUG oslo_concurrency.lockutils [None req-38411833-79e3-4014-bc27-11c134577b6f tempest-GroupsTest-867167237 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83259) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 16 15:01:43 devstack cinder-volume[83259]: DEBUG cinder.volume.drivers.quobyte [None req-38411833-79e3-4014-bc27-11c134577b6f tempest-GroupsTest-867167237 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-61f585ac-f8e2-4d19-a890-7ebc2726cc72': None} {{(pid=83259) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:639}} Sep 16 15:01:43 devstack cinder-volume[83259]: DEBUG cinder.volume.drivers.quobyte [None req-38411833-79e3-4014-bc27-11c134577b6f tempest-GroupsTest-867167237 None] Available shares ['10.10.41.181/cinder-vol-61f585ac-f8e2-4d19-a890-7ebc2726cc72'] {{(pid=83259) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:669}} Sep 16 15:01:43 devstack cinder-volume[83259]: DEBUG oslo_concurrency.lockutils [None req-38411833-79e3-4014-bc27-11c134577b6f tempest-GroupsTest-867167237 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=83259) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 16 15:01:43 devstack cinder-volume[83259]: DEBUG cinder.volume.drivers.quobyte [None req-38411833-79e3-4014-bc27-11c134577b6f tempest-GroupsTest-867167237 None] Selected 10.10.41.181/cinder-vol-61f585ac-f8e2-4d19-a890-7ebc2726cc72 as target Quobyte volume. {{(pid=83259) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:690}} Sep 16 15:01:43 devstack cinder-volume[83259]: INFO cinder.volume.drivers.remotefs [None req-38411833-79e3-4014-bc27-11c134577b6f tempest-GroupsTest-867167237 None] casted to 10.10.41.181/cinder-vol-61f585ac-f8e2-4d19-a890-7ebc2726cc72 Sep 16 15:01:43 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [None req-38411833-79e3-4014-bc27-11c134577b6f tempest-GroupsTest-867167237 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c/volume-75c41582-4aa3-4c64-9d3d-8a95875e8cac 1073741824 {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 15:01:43 devstack quobyte-client[83286]: The server volume:87712ffe-8a69-446d-9ed6-4430c7ee9792@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=87712ffe-8a69-446d-9ed6-4430c7ee9792, inode=24, name=volume-75c41582-4aa3-4c64-9d3d-8a95875e8cac, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.206), requestorAccessMask=0 Sep 16 15:01:44 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [None req-38411833-79e3-4014-bc27-11c134577b6f tempest-GroupsTest-867167237 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c/volume-75c41582-4aa3-4c64-9d3d-8a95875e8cac 1073741824" returned: 0 in 0.424s {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 15:01:44 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [None req-38411833-79e3-4014-bc27-11c134577b6f tempest-GroupsTest-867167237 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c/volume-75c41582-4aa3-4c64-9d3d-8a95875e8cac {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 15:01:44 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [None req-38411833-79e3-4014-bc27-11c134577b6f tempest-GroupsTest-867167237 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c/volume-75c41582-4aa3-4c64-9d3d-8a95875e8cac" returned: 0 in 0.089s {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 15:01:44 devstack cinder-volume[83259]: DEBUG cinder.volume.drivers.quobyte [None req-38411833-79e3-4014-bc27-11c134577b6f tempest-GroupsTest-867167237 None] <== create_volume: return (576ms) {'provider_location': '10.10.41.181/cinder-vol-61f585ac-f8e2-4d19-a890-7ebc2726cc72'} {{(pid=83259) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Sep 16 15:01:44 devstack cinder-volume[83259]: DEBUG oslo_concurrency.lockutils [None req-38411833-79e3-4014-bc27-11c134577b6f tempest-GroupsTest-867167237 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.589s {{(pid=83259) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 16 15:01:44 devstack cinder-volume[83259]: DEBUG cinder.volume.manager [None req-38411833-79e3-4014-bc27-11c134577b6f tempest-GroupsTest-867167237 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ac4b393c-fbc1-45b2-995f-92a3e9116dfc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-75c41582-4aa3-4c64-9d3d-8a95875e8cac', 'volume_size': 1}' {{(pid=83259) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 15:01:44 devstack cinder-volume[83259]: DEBUG cinder.volume.manager [None req-38411833-79e3-4014-bc27-11c134577b6f tempest-GroupsTest-867167237 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cd7da3a0-f8a5-48c4-9c5d-1ed368e1e506) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83259) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 15:01:44 devstack cinder-volume[83259]: INFO cinder.volume.flows.manager.create_volume [None req-38411833-79e3-4014-bc27-11c134577b6f tempest-GroupsTest-867167237 None] Volume volume-75c41582-4aa3-4c64-9d3d-8a95875e8cac (75c41582-4aa3-4c64-9d3d-8a95875e8cac): created successfully Sep 16 15:01:44 devstack cinder-volume[83259]: DEBUG cinder.volume.manager [None req-38411833-79e3-4014-bc27-11c134577b6f tempest-GroupsTest-867167237 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cd7da3a0-f8a5-48c4-9c5d-1ed368e1e506) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83259) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 15:01:44 devstack cinder-volume[83259]: DEBUG cinder.volume.manager [None req-38411833-79e3-4014-bc27-11c134577b6f tempest-GroupsTest-867167237 None] Flow 'volume_create_manager' (a17c2859-d3de-401b-bd14-e399d6ffedb5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83259) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 16 15:01:44 devstack cinder-volume[83259]: INFO cinder.volume.manager [None req-38411833-79e3-4014-bc27-11c134577b6f tempest-GroupsTest-867167237 None] Created volume successfully. Sep 16 15:01:44 devstack cinder-volume[83259]: DEBUG oslo_service.periodic_task [None req-050ec8a1-6ffd-499d-95ad-d548a84437e2 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=83259) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} Sep 16 15:01:44 devstack cinder-volume[83259]: DEBUG oslo_concurrency.lockutils [None req-050ec8a1-6ffd-499d-95ad-d548a84437e2 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83259) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 16 15:01:44 devstack cinder-volume[83259]: DEBUG oslo_concurrency.lockutils [None req-050ec8a1-6ffd-499d-95ad-d548a84437e2 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83259) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 16 15:01:44 devstack cinder-volume[83259]: DEBUG cinder.volume.drivers.quobyte [None req-050ec8a1-6ffd-499d-95ad-d548a84437e2 None None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-61f585ac-f8e2-4d19-a890-7ebc2726cc72': None} {{(pid=83259) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:639}} Sep 16 15:01:44 devstack cinder-volume[83259]: DEBUG cinder.volume.drivers.quobyte [None req-050ec8a1-6ffd-499d-95ad-d548a84437e2 None None] Available shares ['10.10.41.181/cinder-vol-61f585ac-f8e2-4d19-a890-7ebc2726cc72'] {{(pid=83259) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:669}} Sep 16 15:01:44 devstack cinder-volume[83259]: DEBUG oslo_concurrency.lockutils [None req-050ec8a1-6ffd-499d-95ad-d548a84437e2 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=83259) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 16 15:01:44 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [None req-050ec8a1-6ffd-499d-95ad-d548a84437e2 None None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 15:01:44 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [None req-050ec8a1-6ffd-499d-95ad-d548a84437e2 None None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c" returned: 0 in 0.126s {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 15:01:44 devstack cinder-volume[83259]: DEBUG cinder.manager [None req-050ec8a1-6ffd-499d-95ad-d548a84437e2 None None] Notifying Schedulers of capabilities ... {{(pid=83259) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 16 15:01:46 devstack cinder-volume[83259]: WARNING cinder.volume.volume_utils [None req-703ed199-7736-437b-86af-e7818448e3f2 tempest-GroupsTest-867167237 None] Volume driver (QuobyteDriver 1.2) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 16 15:01:46 devstack cinder-volume[83259]: INFO cinder.volume.manager [None req-703ed199-7736-437b-86af-e7818448e3f2 tempest-GroupsTest-867167237 None] Update group completed successfully. Sep 16 15:01:47 devstack cinder-volume[83259]: WARNING cinder.volume.volume_utils [None req-95c3ad73-455c-43bb-a8af-9f35f2d39cb1 tempest-GroupsTest-867167237 None] Volume driver (QuobyteDriver 1.2) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 16 15:01:47 devstack cinder-volume[83259]: INFO cinder.volume.manager [None req-95c3ad73-455c-43bb-a8af-9f35f2d39cb1 tempest-GroupsTest-867167237 None] Update group completed successfully. Sep 16 15:01:48 devstack cinder-volume[83259]: WARNING cinder.volume.volume_utils [None req-da7ca84c-f7be-4c4a-8f9b-c86efd064712 tempest-GroupsTest-867167237 None] Volume driver (QuobyteDriver 1.2) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 16 15:01:48 devstack cinder-volume[83259]: DEBUG cinder.coordination [None req-da7ca84c-f7be-4c4a-8f9b-c86efd064712 tempest-GroupsTest-867167237 None] Acquiring lock "cinder-quobyte-75c41582-4aa3-4c64-9d3d-8a95875e8cac" by "delete_volume" {{(pid=83259) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 16 15:01:48 devstack cinder-volume[83259]: DEBUG cinder.coordination [None req-da7ca84c-f7be-4c4a-8f9b-c86efd064712 tempest-GroupsTest-867167237 None] Lock "cinder-quobyte-75c41582-4aa3-4c64-9d3d-8a95875e8cac" acquired by "delete_volume" :: waited 0.084s {{(pid=83259) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 16 15:01:48 devstack cinder-volume[83259]: DEBUG oslo.privsep.daemon [-] privsep: reply[26236c8c-8834-42c3-82ee-584dfd3a6fe1]: (4, 'qcow2') {{(pid=84312) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 16 15:01:48 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [None req-da7ca84c-f7be-4c4a-8f9b-c86efd064712 tempest-GroupsTest-867167237 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c/volume-75c41582-4aa3-4c64-9d3d-8a95875e8cac {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 15:01:49 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [None req-da7ca84c-f7be-4c4a-8f9b-c86efd064712 tempest-GroupsTest-867167237 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c/volume-75c41582-4aa3-4c64-9d3d-8a95875e8cac" returned: 0 in 0.468s {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 15:01:49 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [None req-da7ca84c-f7be-4c4a-8f9b-c86efd064712 tempest-GroupsTest-867167237 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c/volume-75c41582-4aa3-4c64-9d3d-8a95875e8cac {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 15:01:49 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [None req-da7ca84c-f7be-4c4a-8f9b-c86efd064712 tempest-GroupsTest-867167237 None] CMD "rm -f /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c/volume-75c41582-4aa3-4c64-9d3d-8a95875e8cac" returned: 0 in 0.102s {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 15:01:49 devstack cinder-volume[83259]: DEBUG cinder.coordination [None req-da7ca84c-f7be-4c4a-8f9b-c86efd064712 tempest-GroupsTest-867167237 None] Lock "cinder-quobyte-75c41582-4aa3-4c64-9d3d-8a95875e8cac" released by "delete_volume" :: held 0.761s {{(pid=83259) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 16 15:01:49 devstack cinder-volume[83259]: DEBUG cinder.coordination [None req-da7ca84c-f7be-4c4a-8f9b-c86efd064712 tempest-GroupsTest-867167237 None] Acquiring lock "cinder-quobyte-78450b2f-89b3-4e3e-b920-723914c88f12" by "delete_volume" {{(pid=83259) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 16 15:01:49 devstack cinder-volume[83259]: DEBUG cinder.coordination [None req-da7ca84c-f7be-4c4a-8f9b-c86efd064712 tempest-GroupsTest-867167237 None] Lock "cinder-quobyte-78450b2f-89b3-4e3e-b920-723914c88f12" acquired by "delete_volume" :: waited 0.031s {{(pid=83259) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 16 15:01:49 devstack cinder-volume[83259]: DEBUG oslo.privsep.daemon [-] privsep: reply[2ca4d4c2-bcad-413f-9868-cbff0684f9cd]: (4, 'qcow2') {{(pid=84312) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 16 15:01:49 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [None req-da7ca84c-f7be-4c4a-8f9b-c86efd064712 tempest-GroupsTest-867167237 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c/volume-78450b2f-89b3-4e3e-b920-723914c88f12 {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 15:01:50 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [None req-da7ca84c-f7be-4c4a-8f9b-c86efd064712 tempest-GroupsTest-867167237 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c/volume-78450b2f-89b3-4e3e-b920-723914c88f12" returned: 0 in 0.469s {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 15:01:50 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [None req-da7ca84c-f7be-4c4a-8f9b-c86efd064712 tempest-GroupsTest-867167237 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c/volume-78450b2f-89b3-4e3e-b920-723914c88f12 {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 15:01:50 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [None req-da7ca84c-f7be-4c4a-8f9b-c86efd064712 tempest-GroupsTest-867167237 None] CMD "rm -f /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c/volume-78450b2f-89b3-4e3e-b920-723914c88f12" returned: 0 in 0.092s {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 15:01:50 devstack cinder-volume[83259]: DEBUG cinder.coordination [None req-da7ca84c-f7be-4c4a-8f9b-c86efd064712 tempest-GroupsTest-867167237 None] Lock "cinder-quobyte-78450b2f-89b3-4e3e-b920-723914c88f12" released by "delete_volume" :: held 0.722s {{(pid=83259) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 16 15:01:50 devstack cinder-volume[83259]: DEBUG cinder.quota [None req-da7ca84c-f7be-4c4a-8f9b-c86efd064712 tempest-GroupsTest-867167237 None] Created reservations ['4a6d7733-8d4e-4c8a-8fa2-03d7c937423c'] {{(pid=83259) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 16 15:01:50 devstack cinder-volume[83259]: WARNING cinder.quota [None req-da7ca84c-f7be-4c4a-8f9b-c86efd064712 tempest-GroupsTest-867167237 None] Deprecated: Default quota for resource: volumes_tempest-GroupsTest-volume-type-1686289848 is set by the default quota flag: quota_volumes_tempest-GroupsTest-volume-type-1686289848, it is now deprecated. Please use the default quota class for default quota. Sep 16 15:01:50 devstack cinder-volume[83259]: WARNING cinder.quota [None req-da7ca84c-f7be-4c4a-8f9b-c86efd064712 tempest-GroupsTest-867167237 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupsTest-volume-type-1686289848 is set by the default quota flag: quota_gigabytes_tempest-GroupsTest-volume-type-1686289848, it is now deprecated. Please use the default quota class for default quota. Sep 16 15:01:50 devstack cinder-volume[83259]: DEBUG cinder.quota [None req-da7ca84c-f7be-4c4a-8f9b-c86efd064712 tempest-GroupsTest-867167237 None] Created reservations ['7038e34b-d913-4c9f-96be-bc7242895a55', '28b06b3b-883d-43a3-8143-73caf64d6a7a', '4db184be-4592-4abd-8175-3a36e8ea35f0', '2a0440da-26e5-4239-8e9d-49faa2116fac'] {{(pid=83259) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 16 15:01:51 devstack cinder-volume[83259]: DEBUG cinder.quota [None req-da7ca84c-f7be-4c4a-8f9b-c86efd064712 tempest-GroupsTest-867167237 None] Created reservations ['37b38ccf-1753-4a64-a16e-da0c31eb9933', '255f0d42-70e0-41d0-9171-545a152added', '59b6bee5-380d-4cf2-81db-d86234815d1c', 'a729f17f-a72d-4b4a-b695-8e63053ae2fe'] {{(pid=83259) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 16 15:01:51 devstack cinder-volume[83259]: DEBUG oslo_concurrency.lockutils [None req-da7ca84c-f7be-4c4a-8f9b-c86efd064712 tempest-GroupsTest-867167237 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83259) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 16 15:01:51 devstack cinder-volume[83259]: DEBUG oslo_concurrency.lockutils [None req-da7ca84c-f7be-4c4a-8f9b-c86efd064712 tempest-GroupsTest-867167237 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=83259) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 16 15:01:51 devstack cinder-volume[83259]: DEBUG cinder.volume.drivers.quobyte [None req-da7ca84c-f7be-4c4a-8f9b-c86efd064712 tempest-GroupsTest-867167237 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-61f585ac-f8e2-4d19-a890-7ebc2726cc72': None} {{(pid=83259) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:639}} Sep 16 15:01:51 devstack cinder-volume[83259]: DEBUG cinder.volume.drivers.quobyte [None req-da7ca84c-f7be-4c4a-8f9b-c86efd064712 tempest-GroupsTest-867167237 None] Available shares ['10.10.41.181/cinder-vol-61f585ac-f8e2-4d19-a890-7ebc2726cc72'] {{(pid=83259) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:669}} Sep 16 15:01:51 devstack cinder-volume[83259]: DEBUG oslo_concurrency.lockutils [None req-da7ca84c-f7be-4c4a-8f9b-c86efd064712 tempest-GroupsTest-867167237 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=83259) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 16 15:01:51 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [None req-da7ca84c-f7be-4c4a-8f9b-c86efd064712 tempest-GroupsTest-867167237 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 15:01:51 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [None req-da7ca84c-f7be-4c4a-8f9b-c86efd064712 tempest-GroupsTest-867167237 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c" returned: 0 in 0.116s {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 15:01:51 devstack cinder-volume[83259]: DEBUG cinder.manager [None req-da7ca84c-f7be-4c4a-8f9b-c86efd064712 tempest-GroupsTest-867167237 None] Notifying Schedulers of capabilities ... {{(pid=83259) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 16 15:01:51 devstack cinder-volume[83259]: INFO cinder.volume.manager [None req-da7ca84c-f7be-4c4a-8f9b-c86efd064712 tempest-GroupsTest-867167237 None] Delete group completed successfully. Sep 16 15:02:09 devstack cinder-volume[83259]: DEBUG dbcounter [-] [83259] Writing DB stats cinder:SELECT=42,cinder:UPDATE=47,cinder:DELETE=3,cinder:INSERT=12 {{(pid=83259) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Sep 16 15:02:09 devstack cinder-volume[83259]: DEBUG dbcounter [-] [83259] Writing DB stats cinder:SELECT=39,cinder:UPDATE=39,cinder:INSERT=3 {{(pid=83259) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Sep 16 15:02:10 devstack cinder-volume[83259]: WARNING cinder.volume.volume_utils [None req-cdadfc2a-c7bf-44bb-9502-555a4897cf79 tempest-VolumeSnapshotQuotasNegativeTestJSON-1181957906 None] Volume driver (QuobyteDriver 1.2) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 16 15:02:10 devstack cinder-volume[83259]: DEBUG cinder.volume.flows.manager.create_volume [None req-cdadfc2a-c7bf-44bb-9502-555a4897cf79 tempest-VolumeSnapshotQuotasNegativeTestJSON-1181957906 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#Quobyte'], 'hosts': ['devstack@QuobyteHD#Quobyte']} {{(pid=83259) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1387}} Sep 16 15:02:10 devstack cinder-volume[83259]: DEBUG cinder.volume.manager [None req-cdadfc2a-c7bf-44bb-9502-555a4897cf79 tempest-VolumeSnapshotQuotasNegativeTestJSON-1181957906 None] Flow 'volume_create_manager' (6678c133-c090-4283-a83f-46bd0426b976) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83259) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 16 15:02:10 devstack cinder-volume[83259]: DEBUG cinder.volume.manager [None req-cdadfc2a-c7bf-44bb-9502-555a4897cf79 tempest-VolumeSnapshotQuotasNegativeTestJSON-1181957906 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (46fbc7b9-01b7-468c-904f-29da949b8cd5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83259) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 15:02:10 devstack cinder-volume[83259]: DEBUG cinder.volume.manager [None req-cdadfc2a-c7bf-44bb-9502-555a4897cf79 tempest-VolumeSnapshotQuotasNegativeTestJSON-1181957906 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (46fbc7b9-01b7-468c-904f-29da949b8cd5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-16T13:02:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeSnapshotQuotasNegativeTestJSON-Volume-1136895401',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#Quobyte',id=fb9f2567-2c6a-490d-ab8f-0d6cbe73ee0f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='293fdb31a6444e3885ff29b22d401887',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-16T13:02:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-16T13:02:10Z,use_quota=True,user_id='9518c8429b4841e1a6ce00b72c20386a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(485ead50-3df8-4d76-8d34-a4db136c980a),volume_type_id=485ead50-3df8-4d76-8d34-a4db136c980a)' {{(pid=83259) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 15:02:10 devstack cinder-volume[83259]: DEBUG cinder.volume.manager [None req-cdadfc2a-c7bf-44bb-9502-555a4897cf79 tempest-VolumeSnapshotQuotasNegativeTestJSON-1181957906 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fb2b9fe0-777f-471a-9d5f-b266b31f45a3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83259) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 15:02:10 devstack cinder-volume[83259]: DEBUG cinder.volume.manager [None req-cdadfc2a-c7bf-44bb-9502-555a4897cf79 tempest-VolumeSnapshotQuotasNegativeTestJSON-1181957906 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fb2b9fe0-777f-471a-9d5f-b266b31f45a3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83259) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 15:02:10 devstack cinder-volume[83259]: DEBUG cinder.volume.manager [None req-cdadfc2a-c7bf-44bb-9502-555a4897cf79 tempest-VolumeSnapshotQuotasNegativeTestJSON-1181957906 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8f6eeed3-0d7b-4b06-ae78-268923de319c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83259) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 15:02:10 devstack cinder-volume[83259]: DEBUG cinder.volume.manager [None req-cdadfc2a-c7bf-44bb-9502-555a4897cf79 tempest-VolumeSnapshotQuotasNegativeTestJSON-1181957906 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8f6eeed3-0d7b-4b06-ae78-268923de319c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'fb9f2567-2c6a-490d-ab8f-0d6cbe73ee0f', 'volume_name': 'volume-fb9f2567-2c6a-490d-ab8f-0d6cbe73ee0f', 'volume_size': 1}' {{(pid=83259) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 15:02:10 devstack cinder-volume[83259]: DEBUG cinder.volume.manager [None req-cdadfc2a-c7bf-44bb-9502-555a4897cf79 tempest-VolumeSnapshotQuotasNegativeTestJSON-1181957906 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a835ab7e-5875-4813-9f26-600a40ba0f7b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83259) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 15:02:10 devstack cinder-volume[83259]: DEBUG cinder.volume.manager [None req-cdadfc2a-c7bf-44bb-9502-555a4897cf79 tempest-VolumeSnapshotQuotasNegativeTestJSON-1181957906 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a835ab7e-5875-4813-9f26-600a40ba0f7b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83259) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 15:02:10 devstack cinder-volume[83259]: DEBUG cinder.volume.manager [None req-cdadfc2a-c7bf-44bb-9502-555a4897cf79 tempest-VolumeSnapshotQuotasNegativeTestJSON-1181957906 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (264ba13d-f79a-41e6-82a1-ac99e3d388e3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83259) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 15:02:10 devstack cinder-volume[83259]: INFO cinder.volume.flows.manager.create_volume [None req-cdadfc2a-c7bf-44bb-9502-555a4897cf79 tempest-VolumeSnapshotQuotasNegativeTestJSON-1181957906 None] Volume fb9f2567-2c6a-490d-ab8f-0d6cbe73ee0f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-fb9f2567-2c6a-490d-ab8f-0d6cbe73ee0f', 'volume_size': 1} Sep 16 15:02:10 devstack cinder-volume[83259]: DEBUG oslo_concurrency.lockutils [None req-cdadfc2a-c7bf-44bb-9502-555a4897cf79 tempest-VolumeSnapshotQuotasNegativeTestJSON-1181957906 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83259) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 16 15:02:10 devstack cinder-volume[83259]: DEBUG oslo_concurrency.lockutils [None req-cdadfc2a-c7bf-44bb-9502-555a4897cf79 tempest-VolumeSnapshotQuotasNegativeTestJSON-1181957906 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=83259) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 16 15:02:10 devstack cinder-volume[83259]: DEBUG cinder.volume.drivers.quobyte [None req-cdadfc2a-c7bf-44bb-9502-555a4897cf79 tempest-VolumeSnapshotQuotasNegativeTestJSON-1181957906 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-16T13:02:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeSnapshotQuotasNegativeTestJSON-Volume-1136895401',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#Quobyte',id=fb9f2567-2c6a-490d-ab8f-0d6cbe73ee0f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='293fdb31a6444e3885ff29b22d401887',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-16T13:02:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-16T13:02:10Z,use_quota=True,user_id='9518c8429b4841e1a6ce00b72c20386a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(485ead50-3df8-4d76-8d34-a4db136c980a),volume_type_id=485ead50-3df8-4d76-8d34-a4db136c980a)}" {{(pid=83259) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Sep 16 15:02:10 devstack cinder-volume[83259]: DEBUG cinder.volume.drivers.remotefs [None req-cdadfc2a-c7bf-44bb-9502-555a4897cf79 tempest-VolumeSnapshotQuotasNegativeTestJSON-1181957906 None] Creating volume fb9f2567-2c6a-490d-ab8f-0d6cbe73ee0f {{(pid=83259) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}} Sep 16 15:02:10 devstack cinder-volume[83259]: DEBUG oslo_concurrency.lockutils [None req-cdadfc2a-c7bf-44bb-9502-555a4897cf79 tempest-VolumeSnapshotQuotasNegativeTestJSON-1181957906 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83259) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 16 15:02:10 devstack cinder-volume[83259]: DEBUG oslo_concurrency.lockutils [None req-cdadfc2a-c7bf-44bb-9502-555a4897cf79 tempest-VolumeSnapshotQuotasNegativeTestJSON-1181957906 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83259) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 16 15:02:10 devstack cinder-volume[83259]: DEBUG cinder.volume.drivers.quobyte [None req-cdadfc2a-c7bf-44bb-9502-555a4897cf79 tempest-VolumeSnapshotQuotasNegativeTestJSON-1181957906 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-61f585ac-f8e2-4d19-a890-7ebc2726cc72': None} {{(pid=83259) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:639}} Sep 16 15:02:10 devstack cinder-volume[83259]: DEBUG cinder.volume.drivers.quobyte [None req-cdadfc2a-c7bf-44bb-9502-555a4897cf79 tempest-VolumeSnapshotQuotasNegativeTestJSON-1181957906 None] Available shares ['10.10.41.181/cinder-vol-61f585ac-f8e2-4d19-a890-7ebc2726cc72'] {{(pid=83259) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:669}} Sep 16 15:02:10 devstack cinder-volume[83259]: DEBUG oslo_concurrency.lockutils [None req-cdadfc2a-c7bf-44bb-9502-555a4897cf79 tempest-VolumeSnapshotQuotasNegativeTestJSON-1181957906 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=83259) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 16 15:02:10 devstack cinder-volume[83259]: DEBUG cinder.volume.drivers.quobyte [None req-cdadfc2a-c7bf-44bb-9502-555a4897cf79 tempest-VolumeSnapshotQuotasNegativeTestJSON-1181957906 None] Selected 10.10.41.181/cinder-vol-61f585ac-f8e2-4d19-a890-7ebc2726cc72 as target Quobyte volume. {{(pid=83259) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:690}} Sep 16 15:02:10 devstack cinder-volume[83259]: INFO cinder.volume.drivers.remotefs [None req-cdadfc2a-c7bf-44bb-9502-555a4897cf79 tempest-VolumeSnapshotQuotasNegativeTestJSON-1181957906 None] casted to 10.10.41.181/cinder-vol-61f585ac-f8e2-4d19-a890-7ebc2726cc72 Sep 16 15:02:10 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [None req-cdadfc2a-c7bf-44bb-9502-555a4897cf79 tempest-VolumeSnapshotQuotasNegativeTestJSON-1181957906 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c/volume-fb9f2567-2c6a-490d-ab8f-0d6cbe73ee0f 1073741824 {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 15:02:10 devstack quobyte-client[83286]: System call of process 92272 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 16 15:02:11 devstack quobyte-client[83286]: The server volume:87712ffe-8a69-446d-9ed6-4430c7ee9792@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=87712ffe-8a69-446d-9ed6-4430c7ee9792, inode=25, name=volume-fb9f2567-2c6a-490d-ab8f-0d6cbe73ee0f, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.206), requestorAccessMask=0 Sep 16 15:02:11 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [None req-cdadfc2a-c7bf-44bb-9502-555a4897cf79 tempest-VolumeSnapshotQuotasNegativeTestJSON-1181957906 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c/volume-fb9f2567-2c6a-490d-ab8f-0d6cbe73ee0f 1073741824" returned: 0 in 0.404s {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 15:02:11 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [None req-cdadfc2a-c7bf-44bb-9502-555a4897cf79 tempest-VolumeSnapshotQuotasNegativeTestJSON-1181957906 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c/volume-fb9f2567-2c6a-490d-ab8f-0d6cbe73ee0f {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 15:02:11 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [None req-cdadfc2a-c7bf-44bb-9502-555a4897cf79 tempest-VolumeSnapshotQuotasNegativeTestJSON-1181957906 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c/volume-fb9f2567-2c6a-490d-ab8f-0d6cbe73ee0f" returned: 0 in 0.168s {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 15:02:11 devstack cinder-volume[83259]: DEBUG cinder.volume.drivers.quobyte [None req-cdadfc2a-c7bf-44bb-9502-555a4897cf79 tempest-VolumeSnapshotQuotasNegativeTestJSON-1181957906 None] <== create_volume: return (670ms) {'provider_location': '10.10.41.181/cinder-vol-61f585ac-f8e2-4d19-a890-7ebc2726cc72'} {{(pid=83259) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Sep 16 15:02:11 devstack cinder-volume[83259]: DEBUG oslo_concurrency.lockutils [None req-cdadfc2a-c7bf-44bb-9502-555a4897cf79 tempest-VolumeSnapshotQuotasNegativeTestJSON-1181957906 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.684s {{(pid=83259) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 16 15:02:11 devstack cinder-volume[83259]: DEBUG cinder.volume.manager [None req-cdadfc2a-c7bf-44bb-9502-555a4897cf79 tempest-VolumeSnapshotQuotasNegativeTestJSON-1181957906 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (264ba13d-f79a-41e6-82a1-ac99e3d388e3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-fb9f2567-2c6a-490d-ab8f-0d6cbe73ee0f', 'volume_size': 1}' {{(pid=83259) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 15:02:11 devstack cinder-volume[83259]: DEBUG cinder.volume.manager [None req-cdadfc2a-c7bf-44bb-9502-555a4897cf79 tempest-VolumeSnapshotQuotasNegativeTestJSON-1181957906 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (163747e5-cdfd-4aa6-9490-0ecd83022944) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83259) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 15:02:11 devstack cinder-volume[83259]: INFO cinder.volume.flows.manager.create_volume [None req-cdadfc2a-c7bf-44bb-9502-555a4897cf79 tempest-VolumeSnapshotQuotasNegativeTestJSON-1181957906 None] Volume volume-fb9f2567-2c6a-490d-ab8f-0d6cbe73ee0f (fb9f2567-2c6a-490d-ab8f-0d6cbe73ee0f): created successfully Sep 16 15:02:11 devstack cinder-volume[83259]: DEBUG cinder.volume.manager [None req-cdadfc2a-c7bf-44bb-9502-555a4897cf79 tempest-VolumeSnapshotQuotasNegativeTestJSON-1181957906 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (163747e5-cdfd-4aa6-9490-0ecd83022944) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83259) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 15:02:11 devstack cinder-volume[83259]: DEBUG cinder.volume.manager [None req-cdadfc2a-c7bf-44bb-9502-555a4897cf79 tempest-VolumeSnapshotQuotasNegativeTestJSON-1181957906 None] Flow 'volume_create_manager' (6678c133-c090-4283-a83f-46bd0426b976) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83259) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 16 15:02:11 devstack cinder-volume[83259]: INFO cinder.volume.manager [None req-cdadfc2a-c7bf-44bb-9502-555a4897cf79 tempest-VolumeSnapshotQuotasNegativeTestJSON-1181957906 None] Created volume successfully. Sep 16 15:02:12 devstack cinder-volume[83259]: WARNING cinder.volume.volume_utils [None req-aca8c0c0-4262-4cc4-9bf5-704c82a5bc16 tempest-AttachVolumeNegativeTest-1792000208 None] Volume driver (QuobyteDriver 1.2) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 16 15:02:12 devstack cinder-volume[83259]: DEBUG cinder.volume.flows.manager.create_volume [None req-aca8c0c0-4262-4cc4-9bf5-704c82a5bc16 tempest-AttachVolumeNegativeTest-1792000208 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#Quobyte'], 'hosts': ['devstack@QuobyteHD#Quobyte']} {{(pid=83259) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1387}} Sep 16 15:02:12 devstack cinder-volume[83259]: DEBUG cinder.volume.manager [None req-aca8c0c0-4262-4cc4-9bf5-704c82a5bc16 tempest-AttachVolumeNegativeTest-1792000208 None] Flow 'volume_create_manager' (ef713a37-9503-44f8-9883-0f3abada2145) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83259) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 16 15:02:12 devstack cinder-volume[83259]: DEBUG cinder.volume.manager [None req-aca8c0c0-4262-4cc4-9bf5-704c82a5bc16 tempest-AttachVolumeNegativeTest-1792000208 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6ac3b06b-1ce8-4fe4-a3bb-8c29c256c2e9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83259) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 15:02:12 devstack cinder-volume[83259]: DEBUG cinder.volume.manager [None req-aca8c0c0-4262-4cc4-9bf5-704c82a5bc16 tempest-AttachVolumeNegativeTest-1792000208 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6ac3b06b-1ce8-4fe4-a3bb-8c29c256c2e9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-16T13:02:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-838718642',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#Quobyte',id=6f928547-f01f-45d6-9669-c3197222df6d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6f9bb5f3fa194a3b9bc3b14a650a0c50',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-16T13:02:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-16T13:02:13Z,use_quota=True,user_id='4e8bef68591e4514a725ed5d2c8799ab',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(485ead50-3df8-4d76-8d34-a4db136c980a),volume_type_id=485ead50-3df8-4d76-8d34-a4db136c980a)' {{(pid=83259) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 15:02:12 devstack cinder-volume[83259]: DEBUG cinder.volume.manager [None req-aca8c0c0-4262-4cc4-9bf5-704c82a5bc16 tempest-AttachVolumeNegativeTest-1792000208 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dd23ec12-3e51-4f73-a10a-56a3853ee6fc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83259) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 15:02:12 devstack cinder-volume[83259]: DEBUG cinder.volume.manager [None req-aca8c0c0-4262-4cc4-9bf5-704c82a5bc16 tempest-AttachVolumeNegativeTest-1792000208 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dd23ec12-3e51-4f73-a10a-56a3853ee6fc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83259) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 15:02:12 devstack cinder-volume[83259]: DEBUG cinder.volume.manager [None req-aca8c0c0-4262-4cc4-9bf5-704c82a5bc16 tempest-AttachVolumeNegativeTest-1792000208 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f3dbea89-bf4b-4ea2-a183-b6499ed259a8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83259) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 15:02:12 devstack cinder-volume[83259]: DEBUG cinder.volume.manager [None req-aca8c0c0-4262-4cc4-9bf5-704c82a5bc16 tempest-AttachVolumeNegativeTest-1792000208 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f3dbea89-bf4b-4ea2-a183-b6499ed259a8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6f928547-f01f-45d6-9669-c3197222df6d', 'volume_name': 'volume-6f928547-f01f-45d6-9669-c3197222df6d', 'volume_size': 1}' {{(pid=83259) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 15:02:12 devstack cinder-volume[83259]: DEBUG cinder.volume.manager [None req-aca8c0c0-4262-4cc4-9bf5-704c82a5bc16 tempest-AttachVolumeNegativeTest-1792000208 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0187022c-4fe3-406e-b2f4-31c0a70843db) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83259) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 15:02:12 devstack cinder-volume[83259]: DEBUG cinder.volume.manager [None req-aca8c0c0-4262-4cc4-9bf5-704c82a5bc16 tempest-AttachVolumeNegativeTest-1792000208 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0187022c-4fe3-406e-b2f4-31c0a70843db) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83259) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 15:02:12 devstack cinder-volume[83259]: DEBUG cinder.volume.manager [None req-aca8c0c0-4262-4cc4-9bf5-704c82a5bc16 tempest-AttachVolumeNegativeTest-1792000208 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f2ace074-af28-406d-bee8-7fefceff84e7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83259) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 15:02:12 devstack cinder-volume[83259]: INFO cinder.volume.flows.manager.create_volume [None req-aca8c0c0-4262-4cc4-9bf5-704c82a5bc16 tempest-AttachVolumeNegativeTest-1792000208 None] Volume 6f928547-f01f-45d6-9669-c3197222df6d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6f928547-f01f-45d6-9669-c3197222df6d', 'volume_size': 1} Sep 16 15:02:12 devstack cinder-volume[83259]: DEBUG oslo_concurrency.lockutils [None req-aca8c0c0-4262-4cc4-9bf5-704c82a5bc16 tempest-AttachVolumeNegativeTest-1792000208 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83259) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 16 15:02:12 devstack cinder-volume[83259]: DEBUG oslo_concurrency.lockutils [None req-aca8c0c0-4262-4cc4-9bf5-704c82a5bc16 tempest-AttachVolumeNegativeTest-1792000208 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.004s {{(pid=83259) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 16 15:02:12 devstack cinder-volume[83259]: DEBUG cinder.volume.drivers.quobyte [None req-aca8c0c0-4262-4cc4-9bf5-704c82a5bc16 tempest-AttachVolumeNegativeTest-1792000208 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-16T13:02:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-838718642',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#Quobyte',id=6f928547-f01f-45d6-9669-c3197222df6d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6f9bb5f3fa194a3b9bc3b14a650a0c50',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-16T13:02:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-16T13:02:13Z,use_quota=True,user_id='4e8bef68591e4514a725ed5d2c8799ab',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(485ead50-3df8-4d76-8d34-a4db136c980a),volume_type_id=485ead50-3df8-4d76-8d34-a4db136c980a)}" {{(pid=83259) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Sep 16 15:02:12 devstack cinder-volume[83259]: DEBUG cinder.volume.drivers.remotefs [None req-aca8c0c0-4262-4cc4-9bf5-704c82a5bc16 tempest-AttachVolumeNegativeTest-1792000208 None] Creating volume 6f928547-f01f-45d6-9669-c3197222df6d {{(pid=83259) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}} Sep 16 15:02:12 devstack cinder-volume[83259]: DEBUG oslo_concurrency.lockutils [None req-aca8c0c0-4262-4cc4-9bf5-704c82a5bc16 tempest-AttachVolumeNegativeTest-1792000208 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83259) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 16 15:02:12 devstack cinder-volume[83259]: DEBUG oslo_concurrency.lockutils [None req-aca8c0c0-4262-4cc4-9bf5-704c82a5bc16 tempest-AttachVolumeNegativeTest-1792000208 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83259) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 16 15:02:12 devstack cinder-volume[83259]: DEBUG cinder.volume.drivers.quobyte [None req-aca8c0c0-4262-4cc4-9bf5-704c82a5bc16 tempest-AttachVolumeNegativeTest-1792000208 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-61f585ac-f8e2-4d19-a890-7ebc2726cc72': None} {{(pid=83259) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:639}} Sep 16 15:02:12 devstack cinder-volume[83259]: DEBUG cinder.volume.drivers.quobyte [None req-aca8c0c0-4262-4cc4-9bf5-704c82a5bc16 tempest-AttachVolumeNegativeTest-1792000208 None] Available shares ['10.10.41.181/cinder-vol-61f585ac-f8e2-4d19-a890-7ebc2726cc72'] {{(pid=83259) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:669}} Sep 16 15:02:12 devstack cinder-volume[83259]: DEBUG oslo_concurrency.lockutils [None req-aca8c0c0-4262-4cc4-9bf5-704c82a5bc16 tempest-AttachVolumeNegativeTest-1792000208 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=83259) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 16 15:02:12 devstack cinder-volume[83259]: DEBUG cinder.volume.drivers.quobyte [None req-aca8c0c0-4262-4cc4-9bf5-704c82a5bc16 tempest-AttachVolumeNegativeTest-1792000208 None] Selected 10.10.41.181/cinder-vol-61f585ac-f8e2-4d19-a890-7ebc2726cc72 as target Quobyte volume. {{(pid=83259) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:690}} Sep 16 15:02:12 devstack cinder-volume[83259]: INFO cinder.volume.drivers.remotefs [None req-aca8c0c0-4262-4cc4-9bf5-704c82a5bc16 tempest-AttachVolumeNegativeTest-1792000208 None] casted to 10.10.41.181/cinder-vol-61f585ac-f8e2-4d19-a890-7ebc2726cc72 Sep 16 15:02:12 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [None req-aca8c0c0-4262-4cc4-9bf5-704c82a5bc16 tempest-AttachVolumeNegativeTest-1792000208 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c/volume-6f928547-f01f-45d6-9669-c3197222df6d 1073741824 {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 15:02:13 devstack quobyte-client[83286]: The server volume:87712ffe-8a69-446d-9ed6-4430c7ee9792@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=87712ffe-8a69-446d-9ed6-4430c7ee9792, inode=26, name=volume-6f928547-f01f-45d6-9669-c3197222df6d, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.206), requestorAccessMask=0 Sep 16 15:02:13 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [None req-aca8c0c0-4262-4cc4-9bf5-704c82a5bc16 tempest-AttachVolumeNegativeTest-1792000208 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c/volume-6f928547-f01f-45d6-9669-c3197222df6d 1073741824" returned: 0 in 0.733s {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 15:02:13 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [None req-aca8c0c0-4262-4cc4-9bf5-704c82a5bc16 tempest-AttachVolumeNegativeTest-1792000208 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c/volume-6f928547-f01f-45d6-9669-c3197222df6d {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 15:02:13 devstack cinder-volume[83259]: WARNING cinder.volume.volume_utils [None req-293eb85f-6b43-4114-853e-db20484668d3 tempest-VolumeSnapshotQuotasNegativeTestJSON-1181957906 None] Volume driver (QuobyteDriver 1.2) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 16 15:02:13 devstack cinder-volume[83259]: DEBUG oslo_concurrency.lockutils [None req-293eb85f-6b43-4114-853e-db20484668d3 tempest-VolumeSnapshotQuotasNegativeTestJSON-1181957906 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=83259) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 16 15:02:13 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [None req-aca8c0c0-4262-4cc4-9bf5-704c82a5bc16 tempest-AttachVolumeNegativeTest-1792000208 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c/volume-6f928547-f01f-45d6-9669-c3197222df6d" returned: 0 in 0.224s {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 15:02:13 devstack cinder-volume[83259]: DEBUG cinder.volume.drivers.quobyte [None req-aca8c0c0-4262-4cc4-9bf5-704c82a5bc16 tempest-AttachVolumeNegativeTest-1792000208 None] <== create_volume: return (1000ms) {'provider_location': '10.10.41.181/cinder-vol-61f585ac-f8e2-4d19-a890-7ebc2726cc72'} {{(pid=83259) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Sep 16 15:02:13 devstack cinder-volume[83259]: DEBUG oslo_concurrency.lockutils [None req-aca8c0c0-4262-4cc4-9bf5-704c82a5bc16 tempest-AttachVolumeNegativeTest-1792000208 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.013s {{(pid=83259) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 16 15:02:14 devstack cinder-volume[83259]: DEBUG oslo_concurrency.lockutils [None req-293eb85f-6b43-4114-853e-db20484668d3 tempest-VolumeSnapshotQuotasNegativeTestJSON-1181957906 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.139s {{(pid=83259) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 16 15:02:14 devstack cinder-volume[83259]: DEBUG cinder.volume.manager [None req-aca8c0c0-4262-4cc4-9bf5-704c82a5bc16 tempest-AttachVolumeNegativeTest-1792000208 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f2ace074-af28-406d-bee8-7fefceff84e7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6f928547-f01f-45d6-9669-c3197222df6d', 'volume_size': 1}' {{(pid=83259) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 15:02:14 devstack cinder-volume[83259]: DEBUG cinder.volume.manager [None req-aca8c0c0-4262-4cc4-9bf5-704c82a5bc16 tempest-AttachVolumeNegativeTest-1792000208 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d8b20dcf-eb8b-4fc8-87b9-9b6d924953a6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83259) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 15:02:14 devstack cinder-volume[83259]: INFO cinder.volume.flows.manager.create_volume [None req-aca8c0c0-4262-4cc4-9bf5-704c82a5bc16 tempest-AttachVolumeNegativeTest-1792000208 None] Volume volume-6f928547-f01f-45d6-9669-c3197222df6d (6f928547-f01f-45d6-9669-c3197222df6d): created successfully Sep 16 15:02:14 devstack cinder-volume[83259]: DEBUG cinder.volume.manager [None req-aca8c0c0-4262-4cc4-9bf5-704c82a5bc16 tempest-AttachVolumeNegativeTest-1792000208 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d8b20dcf-eb8b-4fc8-87b9-9b6d924953a6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83259) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 15:02:14 devstack cinder-volume[83259]: DEBUG cinder.volume.manager [None req-aca8c0c0-4262-4cc4-9bf5-704c82a5bc16 tempest-AttachVolumeNegativeTest-1792000208 None] Flow 'volume_create_manager' (ef713a37-9503-44f8-9883-0f3abada2145) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83259) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 16 15:02:14 devstack cinder-volume[83259]: DEBUG cinder.volume.drivers.remotefs [None req-293eb85f-6b43-4114-853e-db20484668d3 tempest-VolumeSnapshotQuotasNegativeTestJSON-1181957906 None] Creating offline snapshot 54060212-5495-4cf0-b3e0-6578bc7adc73 of volume fb9f2567-2c6a-490d-ab8f-0d6cbe73ee0f {{(pid=83259) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1694}} Sep 16 15:02:14 devstack cinder-volume[83259]: INFO cinder.volume.manager [None req-aca8c0c0-4262-4cc4-9bf5-704c82a5bc16 tempest-AttachVolumeNegativeTest-1792000208 None] Created volume successfully. Sep 16 15:02:14 devstack cinder-volume[83259]: DEBUG oslo.privsep.daemon [-] privsep: reply[63a3ff78-7eb0-4a71-bd0a-96ddc53f124d]: (4, 'qcow2') {{(pid=84312) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 16 15:02:14 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [None req-293eb85f-6b43-4114-853e-db20484668d3 tempest-VolumeSnapshotQuotasNegativeTestJSON-1181957906 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c/volume-fb9f2567-2c6a-490d-ab8f-0d6cbe73ee0f {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 15:02:15 devstack quobyte-client[83286]: System call of process 92283 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 16 15:02:15 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [None req-293eb85f-6b43-4114-853e-db20484668d3 tempest-VolumeSnapshotQuotasNegativeTestJSON-1181957906 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c/volume-fb9f2567-2c6a-490d-ab8f-0d6cbe73ee0f" returned: 0 in 0.746s {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 15:02:15 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [None req-293eb85f-6b43-4114-853e-db20484668d3 tempest-VolumeSnapshotQuotasNegativeTestJSON-1181957906 None] Running cmd (subprocess): qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c/volume-fb9f2567-2c6a-490d-ab8f-0d6cbe73ee0f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c/volume-fb9f2567-2c6a-490d-ab8f-0d6cbe73ee0f.54060212-5495-4cf0-b3e0-6578bc7adc73 1G {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 15:02:15 devstack quobyte-client[83286]: The server volume:87712ffe-8a69-446d-9ed6-4430c7ee9792@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=87712ffe-8a69-446d-9ed6-4430c7ee9792, inode=27, name=volume-fb9f2567-2c6a-490d-ab8f-0d6cbe73ee0f.54060212-5495-4cf0-b3e0-6578bc7adc73, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.206), requestorAccessMask=0 Sep 16 15:02:15 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [None req-293eb85f-6b43-4114-853e-db20484668d3 tempest-VolumeSnapshotQuotasNegativeTestJSON-1181957906 None] CMD "qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c/volume-fb9f2567-2c6a-490d-ab8f-0d6cbe73ee0f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c/volume-fb9f2567-2c6a-490d-ab8f-0d6cbe73ee0f.54060212-5495-4cf0-b3e0-6578bc7adc73 1G" returned: 0 in 0.376s {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 15:02:15 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [None req-293eb85f-6b43-4114-853e-db20484668d3 tempest-VolumeSnapshotQuotasNegativeTestJSON-1181957906 None] Running cmd (subprocess): qemu-img rebase -u -b volume-fb9f2567-2c6a-490d-ab8f-0d6cbe73ee0f -F qcow2 /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c/volume-fb9f2567-2c6a-490d-ab8f-0d6cbe73ee0f.54060212-5495-4cf0-b3e0-6578bc7adc73 {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 15:02:15 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [None req-293eb85f-6b43-4114-853e-db20484668d3 tempest-VolumeSnapshotQuotasNegativeTestJSON-1181957906 None] CMD "qemu-img rebase -u -b volume-fb9f2567-2c6a-490d-ab8f-0d6cbe73ee0f -F qcow2 /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c/volume-fb9f2567-2c6a-490d-ab8f-0d6cbe73ee0f.54060212-5495-4cf0-b3e0-6578bc7adc73" returned: 0 in 0.183s {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 15:02:15 devstack cinder-volume[83259]: DEBUG cinder.volume.drivers.remotefs [None req-293eb85f-6b43-4114-853e-db20484668d3 tempest-VolumeSnapshotQuotasNegativeTestJSON-1181957906 None] File path /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c/volume-fb9f2567-2c6a-490d-ab8f-0d6cbe73ee0f.54060212-5495-4cf0-b3e0-6578bc7adc73 is being set with permissions: 660 {{(pid=83259) _set_rw_permissions /opt/stack/cinder/cinder/volume/drivers/remotefs.py:492}} Sep 16 15:02:15 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [None req-293eb85f-6b43-4114-853e-db20484668d3 tempest-VolumeSnapshotQuotasNegativeTestJSON-1181957906 None] Running cmd (subprocess): chmod 660 /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c/volume-fb9f2567-2c6a-490d-ab8f-0d6cbe73ee0f.54060212-5495-4cf0-b3e0-6578bc7adc73 {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 15:02:15 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [None req-293eb85f-6b43-4114-853e-db20484668d3 tempest-VolumeSnapshotQuotasNegativeTestJSON-1181957906 None] CMD "chmod 660 /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c/volume-fb9f2567-2c6a-490d-ab8f-0d6cbe73ee0f.54060212-5495-4cf0-b3e0-6578bc7adc73" returned: 0 in 0.111s {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 15:02:15 devstack cinder-volume[83259]: DEBUG cinder.volume.drivers.remotefs [None req-293eb85f-6b43-4114-853e-db20484668d3 tempest-VolumeSnapshotQuotasNegativeTestJSON-1181957906 None] Setting permissions: /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c/volume-fb9f2567-2c6a-490d-ab8f-0d6cbe73ee0f -> 1000:1000 {{(pid=83259) _do_create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1584}} Sep 16 15:02:16 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [None req-293eb85f-6b43-4114-853e-db20484668d3 tempest-VolumeSnapshotQuotasNegativeTestJSON-1181957906 None] Running cmd (subprocess): chown --reference=/opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c/volume-fb9f2567-2c6a-490d-ab8f-0d6cbe73ee0f /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c/volume-fb9f2567-2c6a-490d-ab8f-0d6cbe73ee0f.54060212-5495-4cf0-b3e0-6578bc7adc73 {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 15:02:16 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [None req-293eb85f-6b43-4114-853e-db20484668d3 tempest-VolumeSnapshotQuotasNegativeTestJSON-1181957906 None] CMD "chown --reference=/opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c/volume-fb9f2567-2c6a-490d-ab8f-0d6cbe73ee0f /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c/volume-fb9f2567-2c6a-490d-ab8f-0d6cbe73ee0f.54060212-5495-4cf0-b3e0-6578bc7adc73" returned: 0 in 0.123s {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 15:02:16 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [None req-293eb85f-6b43-4114-853e-db20484668d3 tempest-VolumeSnapshotQuotasNegativeTestJSON-1181957906 None] Running cmd (subprocess): truncate -s0 /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c/volume-fb9f2567-2c6a-490d-ab8f-0d6cbe73ee0f.info {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 15:02:16 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [None req-293eb85f-6b43-4114-853e-db20484668d3 tempest-VolumeSnapshotQuotasNegativeTestJSON-1181957906 None] CMD "truncate -s0 /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c/volume-fb9f2567-2c6a-490d-ab8f-0d6cbe73ee0f.info" returned: 0 in 0.097s {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 15:02:16 devstack cinder-volume[83259]: DEBUG cinder.volume.drivers.remotefs [None req-293eb85f-6b43-4114-853e-db20484668d3 tempest-VolumeSnapshotQuotasNegativeTestJSON-1181957906 None] File path /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c/volume-fb9f2567-2c6a-490d-ab8f-0d6cbe73ee0f.info is being set with permissions: 660 {{(pid=83259) _set_rw_permissions /opt/stack/cinder/cinder/volume/drivers/remotefs.py:492}} Sep 16 15:02:16 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [None req-293eb85f-6b43-4114-853e-db20484668d3 tempest-VolumeSnapshotQuotasNegativeTestJSON-1181957906 None] Running cmd (subprocess): chmod 660 /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c/volume-fb9f2567-2c6a-490d-ab8f-0d6cbe73ee0f.info {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 15:02:16 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [None req-293eb85f-6b43-4114-853e-db20484668d3 tempest-VolumeSnapshotQuotasNegativeTestJSON-1181957906 None] CMD "chmod 660 /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c/volume-fb9f2567-2c6a-490d-ab8f-0d6cbe73ee0f.info" returned: 0 in 0.093s {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 15:02:16 devstack cinder-volume[83259]: DEBUG oslo_concurrency.lockutils [None req-293eb85f-6b43-4114-853e-db20484668d3 tempest-VolumeSnapshotQuotasNegativeTestJSON-1181957906 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.378s {{(pid=83259) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 16 15:02:16 devstack cinder-volume[83259]: INFO cinder.volume.manager [None req-293eb85f-6b43-4114-853e-db20484668d3 tempest-VolumeSnapshotQuotasNegativeTestJSON-1181957906 None] Create snapshot completed successfully Sep 16 15:02:18 devstack cinder-volume[83259]: DEBUG cinder.coordination [None req-31d18244-1d5b-4781-b70c-114afade4a0e tempest-VolumeSnapshotQuotasNegativeTestJSON-1181957906 None] Acquiring lock "cinder-54060212-5495-4cf0-b3e0-6578bc7adc73-delete_snapshot" by "delete_snapshot" {{(pid=83259) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 16 15:02:18 devstack cinder-volume[83259]: DEBUG cinder.coordination [None req-31d18244-1d5b-4781-b70c-114afade4a0e tempest-VolumeSnapshotQuotasNegativeTestJSON-1181957906 None] Lock "cinder-54060212-5495-4cf0-b3e0-6578bc7adc73-delete_snapshot" acquired by "delete_snapshot" :: waited 0.146s {{(pid=83259) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 16 15:02:18 devstack cinder-volume[83259]: WARNING cinder.volume.volume_utils [None req-31d18244-1d5b-4781-b70c-114afade4a0e tempest-VolumeSnapshotQuotasNegativeTestJSON-1181957906 None] Volume driver (QuobyteDriver 1.2) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 16 15:02:18 devstack cinder-volume[83259]: DEBUG cinder.coordination [None req-31d18244-1d5b-4781-b70c-114afade4a0e tempest-VolumeSnapshotQuotasNegativeTestJSON-1181957906 None] Acquiring lock "cinder-quobyte-fb9f2567-2c6a-490d-ab8f-0d6cbe73ee0f" by "delete_snapshot" {{(pid=83259) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 16 15:02:18 devstack cinder-volume[83259]: DEBUG cinder.coordination [None req-31d18244-1d5b-4781-b70c-114afade4a0e tempest-VolumeSnapshotQuotasNegativeTestJSON-1181957906 None] Lock "cinder-quobyte-fb9f2567-2c6a-490d-ab8f-0d6cbe73ee0f" acquired by "delete_snapshot" :: waited 0.020s {{(pid=83259) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 16 15:02:18 devstack cinder-volume[83259]: DEBUG cinder.coordination [None req-31d18244-1d5b-4781-b70c-114afade4a0e tempest-VolumeSnapshotQuotasNegativeTestJSON-1181957906 None] Acquiring lock "cinder-quobyte-54060212-5495-4cf0-b3e0-6578bc7adc73" by "_delete_snapshot" {{(pid=83259) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 16 15:02:18 devstack cinder-volume[83259]: DEBUG cinder.coordination [None req-31d18244-1d5b-4781-b70c-114afade4a0e tempest-VolumeSnapshotQuotasNegativeTestJSON-1181957906 None] Lock "cinder-quobyte-54060212-5495-4cf0-b3e0-6578bc7adc73" acquired by "_delete_snapshot" :: waited 0.016s {{(pid=83259) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 16 15:02:19 devstack cinder-volume[83259]: DEBUG cinder.volume.drivers.remotefs [None req-31d18244-1d5b-4781-b70c-114afade4a0e tempest-VolumeSnapshotQuotasNegativeTestJSON-1181957906 None] Deleting offline snapshot 54060212-5495-4cf0-b3e0-6578bc7adc73 of volume fb9f2567-2c6a-490d-ab8f-0d6cbe73ee0f {{(pid=83259) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1278}} Sep 16 15:02:19 devstack cinder-volume[83259]: DEBUG cinder.volume.drivers.remotefs [None req-31d18244-1d5b-4781-b70c-114afade4a0e tempest-VolumeSnapshotQuotasNegativeTestJSON-1181957906 None] snapshot_file for this snap is: volume-fb9f2567-2c6a-490d-ab8f-0d6cbe73ee0f.54060212-5495-4cf0-b3e0-6578bc7adc73 {{(pid=83259) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1307}} Sep 16 15:02:19 devstack cinder-volume[83259]: DEBUG oslo.privsep.daemon [-] privsep: reply[4cfca8ac-c74d-4abb-b3bd-a1b5ef7720d1]: (4, 'qcow2') {{(pid=84312) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 16 15:02:19 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [None req-31d18244-1d5b-4781-b70c-114afade4a0e tempest-VolumeSnapshotQuotasNegativeTestJSON-1181957906 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c/volume-fb9f2567-2c6a-490d-ab8f-0d6cbe73ee0f.54060212-5495-4cf0-b3e0-6578bc7adc73 {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 15:02:20 devstack quobyte-client[83286]: System call of process 92305 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 16 15:02:20 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [None req-31d18244-1d5b-4781-b70c-114afade4a0e tempest-VolumeSnapshotQuotasNegativeTestJSON-1181957906 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c/volume-fb9f2567-2c6a-490d-ab8f-0d6cbe73ee0f.54060212-5495-4cf0-b3e0-6578bc7adc73" returned: 0 in 0.989s {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 15:02:20 devstack cinder-volume[83259]: DEBUG cinder.volume.drivers.remotefs [None req-31d18244-1d5b-4781-b70c-114afade4a0e tempest-VolumeSnapshotQuotasNegativeTestJSON-1181957906 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-fb9f2567-2c6a-490d-ab8f-0d6cbe73ee0f(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83259) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:886}} Sep 16 15:02:20 devstack cinder-volume[83259]: DEBUG oslo.privsep.daemon [-] privsep: reply[2db0a504-fd85-46f3-bfa4-d1d6d9570bb1]: (4, 'qcow2') {{(pid=84312) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 16 15:02:20 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [None req-31d18244-1d5b-4781-b70c-114afade4a0e tempest-VolumeSnapshotQuotasNegativeTestJSON-1181957906 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c/volume-fb9f2567-2c6a-490d-ab8f-0d6cbe73ee0f {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 15:02:20 devstack quobyte-client[83286]: System call of process 92317 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 16 15:02:21 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [None req-31d18244-1d5b-4781-b70c-114afade4a0e tempest-VolumeSnapshotQuotasNegativeTestJSON-1181957906 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c/volume-fb9f2567-2c6a-490d-ab8f-0d6cbe73ee0f" returned: 0 in 1.094s {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 15:02:21 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [None req-31d18244-1d5b-4781-b70c-114afade4a0e tempest-VolumeSnapshotQuotasNegativeTestJSON-1181957906 None] Running cmd (subprocess): qemu-img commit -d /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c/volume-fb9f2567-2c6a-490d-ab8f-0d6cbe73ee0f.54060212-5495-4cf0-b3e0-6578bc7adc73 {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 15:02:21 devstack cinder-volume[83259]: DEBUG oslo_concurrency.lockutils [req-ba6ba5a2-2ec8-4ce8-8b11-8071b0c8a97c req-7a330ce1-125b-4319-ac3d-622853f4d3f3 tempest-AttachVolumeNegativeTest-1792000208 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=83259) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 16 15:02:21 devstack cinder-volume[83259]: DEBUG oslo_concurrency.lockutils [req-ba6ba5a2-2ec8-4ce8-8b11-8071b0c8a97c req-7a330ce1-125b-4319-ac3d-622853f4d3f3 tempest-AttachVolumeNegativeTest-1792000208 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.043s {{(pid=83259) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 16 15:02:21 devstack cinder-volume[83259]: DEBUG oslo.privsep.daemon [-] privsep: reply[a3ec763a-f13e-4485-bda0-d5ff73d3333f]: (4, 'qcow2') {{(pid=84312) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 16 15:02:21 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [req-ba6ba5a2-2ec8-4ce8-8b11-8071b0c8a97c req-7a330ce1-125b-4319-ac3d-622853f4d3f3 tempest-AttachVolumeNegativeTest-1792000208 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c/volume-6f928547-f01f-45d6-9669-c3197222df6d {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 15:02:21 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [None req-31d18244-1d5b-4781-b70c-114afade4a0e tempest-VolumeSnapshotQuotasNegativeTestJSON-1181957906 None] CMD "qemu-img commit -d /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c/volume-fb9f2567-2c6a-490d-ab8f-0d6cbe73ee0f.54060212-5495-4cf0-b3e0-6578bc7adc73" returned: 0 in 0.415s {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 15:02:21 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [None req-31d18244-1d5b-4781-b70c-114afade4a0e tempest-VolumeSnapshotQuotasNegativeTestJSON-1181957906 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c/volume-fb9f2567-2c6a-490d-ab8f-0d6cbe73ee0f.54060212-5495-4cf0-b3e0-6578bc7adc73 {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 15:02:22 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [None req-31d18244-1d5b-4781-b70c-114afade4a0e tempest-VolumeSnapshotQuotasNegativeTestJSON-1181957906 None] CMD "rm -f /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c/volume-fb9f2567-2c6a-490d-ab8f-0d6cbe73ee0f.54060212-5495-4cf0-b3e0-6578bc7adc73" returned: 0 in 0.237s {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 15:02:22 devstack cinder-volume[83259]: DEBUG cinder.coordination [None req-31d18244-1d5b-4781-b70c-114afade4a0e tempest-VolumeSnapshotQuotasNegativeTestJSON-1181957906 None] Lock "cinder-quobyte-54060212-5495-4cf0-b3e0-6578bc7adc73" released by "_delete_snapshot" :: held 3.252s {{(pid=83259) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 16 15:02:22 devstack cinder-volume[83259]: DEBUG cinder.coordination [None req-31d18244-1d5b-4781-b70c-114afade4a0e tempest-VolumeSnapshotQuotasNegativeTestJSON-1181957906 None] Lock "cinder-quobyte-fb9f2567-2c6a-490d-ab8f-0d6cbe73ee0f" released by "delete_snapshot" :: held 3.291s {{(pid=83259) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 16 15:02:22 devstack quobyte-client[83286]: System call of process 92326 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 16 15:02:22 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [req-ba6ba5a2-2ec8-4ce8-8b11-8071b0c8a97c req-7a330ce1-125b-4319-ac3d-622853f4d3f3 tempest-AttachVolumeNegativeTest-1792000208 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c/volume-6f928547-f01f-45d6-9669-c3197222df6d" returned: 0 in 0.912s {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 15:02:22 devstack cinder-volume[83259]: DEBUG oslo_concurrency.lockutils [req-ba6ba5a2-2ec8-4ce8-8b11-8071b0c8a97c req-7a330ce1-125b-4319-ac3d-622853f4d3f3 tempest-AttachVolumeNegativeTest-1792000208 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.961s {{(pid=83259) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 16 15:02:22 devstack cinder-volume[83259]: WARNING cinder.quota [None req-31d18244-1d5b-4781-b70c-114afade4a0e tempest-VolumeSnapshotQuotasNegativeTestJSON-1181957906 None] Deprecated: Default quota for resource: snapshots_QuobyteHD is set by the default quota flag: quota_snapshots_QuobyteHD, it is now deprecated. Please use the default quota class for default quota. Sep 16 15:02:22 devstack cinder-volume[83259]: DEBUG cinder.volume.manager [req-ba6ba5a2-2ec8-4ce8-8b11-8071b0c8a97c req-7a330ce1-125b-4319-ac3d-622853f4d3f3 tempest-AttachVolumeNegativeTest-1792000208 None] Connection info returned from driver {'export': '10.10.41.181/cinder-vol-61f585ac-f8e2-4d19-a890-7ebc2726cc72', 'name': 'volume-6f928547-f01f-45d6-9669-c3197222df6d', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '7726fcae-291f-4b47-81a1-d00ebc6c834b', 'enforce_multipath': True} {{(pid=83259) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4891}} Sep 16 15:02:22 devstack cinder-volume[83259]: WARNING cinder.volume.volume_utils [req-ba6ba5a2-2ec8-4ce8-8b11-8071b0c8a97c req-7a330ce1-125b-4319-ac3d-622853f4d3f3 tempest-AttachVolumeNegativeTest-1792000208 None] Volume driver (QuobyteDriver 1.2) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 16 15:02:22 devstack cinder-volume[83259]: DEBUG cinder.quota [None req-31d18244-1d5b-4781-b70c-114afade4a0e tempest-VolumeSnapshotQuotasNegativeTestJSON-1181957906 None] Created reservations ['08fdf4b5-71e8-493b-9a4b-d56703ea3e58', '688d7960-2915-4dc5-90d1-3e3fed046e78', '997d8d1b-ba42-45b2-a67f-5d26ff4f7a5e', '267d3436-4ae1-4430-89a6-7b8876cd471e'] {{(pid=83259) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 16 15:02:22 devstack cinder-volume[83259]: INFO cinder.volume.manager [req-ba6ba5a2-2ec8-4ce8-8b11-8071b0c8a97c req-7a330ce1-125b-4319-ac3d-622853f4d3f3 tempest-AttachVolumeNegativeTest-1792000208 None] attachment_update completed successfully. Sep 16 15:02:22 devstack cinder-volume[83259]: INFO cinder.volume.manager [None req-31d18244-1d5b-4781-b70c-114afade4a0e tempest-VolumeSnapshotQuotasNegativeTestJSON-1181957906 None] Delete snapshot completed successfully. Sep 16 15:02:22 devstack cinder-volume[83259]: DEBUG cinder.coordination [None req-31d18244-1d5b-4781-b70c-114afade4a0e tempest-VolumeSnapshotQuotasNegativeTestJSON-1181957906 None] Lock "cinder-54060212-5495-4cf0-b3e0-6578bc7adc73-delete_snapshot" released by "delete_snapshot" :: held 3.920s {{(pid=83259) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 16 15:02:23 devstack cinder-volume[83259]: DEBUG cinder.coordination [None req-d95dade9-9aac-48a8-927d-42dfdd340e94 tempest-VolumeSnapshotQuotasNegativeTestJSON-1181957906 None] Acquiring lock "cinder-fb9f2567-2c6a-490d-ab8f-0d6cbe73ee0f-delete_volume" by "delete_volume" {{(pid=83259) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 16 15:02:23 devstack cinder-volume[83259]: DEBUG cinder.coordination [None req-d95dade9-9aac-48a8-927d-42dfdd340e94 tempest-VolumeSnapshotQuotasNegativeTestJSON-1181957906 None] Lock "cinder-fb9f2567-2c6a-490d-ab8f-0d6cbe73ee0f-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=83259) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 16 15:02:23 devstack cinder-volume[83259]: WARNING cinder.volume.volume_utils [None req-d95dade9-9aac-48a8-927d-42dfdd340e94 tempest-VolumeSnapshotQuotasNegativeTestJSON-1181957906 None] Volume driver (QuobyteDriver 1.2) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 16 15:02:23 devstack cinder-volume[83259]: DEBUG cinder.coordination [None req-d95dade9-9aac-48a8-927d-42dfdd340e94 tempest-VolumeSnapshotQuotasNegativeTestJSON-1181957906 None] Acquiring lock "cinder-quobyte-fb9f2567-2c6a-490d-ab8f-0d6cbe73ee0f" by "delete_volume" {{(pid=83259) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 16 15:02:23 devstack cinder-volume[83259]: DEBUG cinder.coordination [None req-d95dade9-9aac-48a8-927d-42dfdd340e94 tempest-VolumeSnapshotQuotasNegativeTestJSON-1181957906 None] Lock "cinder-quobyte-fb9f2567-2c6a-490d-ab8f-0d6cbe73ee0f" acquired by "delete_volume" :: waited 0.013s {{(pid=83259) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 16 15:02:23 devstack cinder-volume[83259]: DEBUG oslo.privsep.daemon [-] privsep: reply[018c0b6e-abf4-4716-ad04-90a0c2f91666]: (4, 'qcow2') {{(pid=84312) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 16 15:02:23 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [None req-d95dade9-9aac-48a8-927d-42dfdd340e94 tempest-VolumeSnapshotQuotasNegativeTestJSON-1181957906 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c/volume-fb9f2567-2c6a-490d-ab8f-0d6cbe73ee0f {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 15:02:24 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [None req-d95dade9-9aac-48a8-927d-42dfdd340e94 tempest-VolumeSnapshotQuotasNegativeTestJSON-1181957906 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c/volume-fb9f2567-2c6a-490d-ab8f-0d6cbe73ee0f" returned: 0 in 0.737s {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 15:02:24 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [None req-d95dade9-9aac-48a8-927d-42dfdd340e94 tempest-VolumeSnapshotQuotasNegativeTestJSON-1181957906 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c/volume-fb9f2567-2c6a-490d-ab8f-0d6cbe73ee0f {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 15:02:24 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [None req-d95dade9-9aac-48a8-927d-42dfdd340e94 tempest-VolumeSnapshotQuotasNegativeTestJSON-1181957906 None] CMD "rm -f /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c/volume-fb9f2567-2c6a-490d-ab8f-0d6cbe73ee0f" returned: 0 in 0.083s {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 15:02:24 devstack cinder-volume[83259]: DEBUG cinder.coordination [None req-d95dade9-9aac-48a8-927d-42dfdd340e94 tempest-VolumeSnapshotQuotasNegativeTestJSON-1181957906 None] Lock "cinder-quobyte-fb9f2567-2c6a-490d-ab8f-0d6cbe73ee0f" released by "delete_volume" :: held 0.999s {{(pid=83259) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 16 15:02:24 devstack cinder-volume[83259]: DEBUG cinder.quota [None req-d95dade9-9aac-48a8-927d-42dfdd340e94 tempest-VolumeSnapshotQuotasNegativeTestJSON-1181957906 None] Created reservations ['1c3c7f1b-f9b3-4ee9-8f75-c2140ffcfbbd', '52817a73-43ed-4459-bf84-cd42779472d1', '5c8a4cc2-8fcf-453d-bacd-89b21356b510', '9bd952b7-de98-4afb-aebb-a48f0d1195b2'] {{(pid=83259) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 16 15:02:24 devstack cinder-volume[83259]: DEBUG oslo_concurrency.lockutils [None req-d95dade9-9aac-48a8-927d-42dfdd340e94 tempest-VolumeSnapshotQuotasNegativeTestJSON-1181957906 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83259) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 16 15:02:24 devstack cinder-volume[83259]: DEBUG oslo_concurrency.lockutils [None req-d95dade9-9aac-48a8-927d-42dfdd340e94 tempest-VolumeSnapshotQuotasNegativeTestJSON-1181957906 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.005s {{(pid=83259) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 16 15:02:24 devstack cinder-volume[83259]: DEBUG cinder.volume.drivers.quobyte [None req-d95dade9-9aac-48a8-927d-42dfdd340e94 tempest-VolumeSnapshotQuotasNegativeTestJSON-1181957906 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-61f585ac-f8e2-4d19-a890-7ebc2726cc72': None} {{(pid=83259) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:639}} Sep 16 15:02:24 devstack cinder-volume[83259]: DEBUG cinder.volume.drivers.quobyte [None req-d95dade9-9aac-48a8-927d-42dfdd340e94 tempest-VolumeSnapshotQuotasNegativeTestJSON-1181957906 None] Available shares ['10.10.41.181/cinder-vol-61f585ac-f8e2-4d19-a890-7ebc2726cc72'] {{(pid=83259) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:669}} Sep 16 15:02:24 devstack cinder-volume[83259]: DEBUG oslo_concurrency.lockutils [None req-d95dade9-9aac-48a8-927d-42dfdd340e94 tempest-VolumeSnapshotQuotasNegativeTestJSON-1181957906 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=83259) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 16 15:02:24 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [None req-d95dade9-9aac-48a8-927d-42dfdd340e94 tempest-VolumeSnapshotQuotasNegativeTestJSON-1181957906 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 15:02:25 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [None req-d95dade9-9aac-48a8-927d-42dfdd340e94 tempest-VolumeSnapshotQuotasNegativeTestJSON-1181957906 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c" returned: 0 in 0.116s {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 15:02:25 devstack cinder-volume[83259]: DEBUG cinder.manager [None req-d95dade9-9aac-48a8-927d-42dfdd340e94 tempest-VolumeSnapshotQuotasNegativeTestJSON-1181957906 None] Notifying Schedulers of capabilities ... {{(pid=83259) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 16 15:02:25 devstack cinder-volume[83259]: INFO cinder.volume.manager [None req-d95dade9-9aac-48a8-927d-42dfdd340e94 tempest-VolumeSnapshotQuotasNegativeTestJSON-1181957906 None] Deleted volume successfully. Sep 16 15:02:25 devstack cinder-volume[83259]: DEBUG cinder.coordination [None req-d95dade9-9aac-48a8-927d-42dfdd340e94 tempest-VolumeSnapshotQuotasNegativeTestJSON-1181957906 None] Lock "cinder-fb9f2567-2c6a-490d-ab8f-0d6cbe73ee0f-delete_volume" released by "delete_volume" :: held 2.037s {{(pid=83259) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 16 15:02:34 devstack cinder-volume[83259]: DEBUG dbcounter [-] [83259] Writing DB stats cinder:UPDATE=19,cinder:SELECT=15,cinder:DELETE=1,cinder:INSERT=6 {{(pid=83259) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Sep 16 15:02:35 devstack cinder-volume[83259]: DEBUG dbcounter [-] [83259] Writing DB stats cinder:SELECT=22,cinder:UPDATE=21,cinder:DELETE=3,cinder:INSERT=2 {{(pid=83259) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Sep 16 15:02:44 devstack cinder-volume[83259]: DEBUG oslo_service.periodic_task [None req-050ec8a1-6ffd-499d-95ad-d548a84437e2 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=83259) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} Sep 16 15:02:44 devstack cinder-volume[83259]: DEBUG oslo_concurrency.lockutils [None req-050ec8a1-6ffd-499d-95ad-d548a84437e2 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83259) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 16 15:02:44 devstack cinder-volume[83259]: DEBUG oslo_concurrency.lockutils [None req-050ec8a1-6ffd-499d-95ad-d548a84437e2 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=83259) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 16 15:02:44 devstack cinder-volume[83259]: DEBUG cinder.volume.drivers.quobyte [None req-050ec8a1-6ffd-499d-95ad-d548a84437e2 None None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-61f585ac-f8e2-4d19-a890-7ebc2726cc72': None} {{(pid=83259) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:639}} Sep 16 15:02:44 devstack cinder-volume[83259]: DEBUG cinder.volume.drivers.quobyte [None req-050ec8a1-6ffd-499d-95ad-d548a84437e2 None None] Available shares ['10.10.41.181/cinder-vol-61f585ac-f8e2-4d19-a890-7ebc2726cc72'] {{(pid=83259) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:669}} Sep 16 15:02:44 devstack cinder-volume[83259]: DEBUG oslo_concurrency.lockutils [None req-050ec8a1-6ffd-499d-95ad-d548a84437e2 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=83259) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 16 15:02:44 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [None req-050ec8a1-6ffd-499d-95ad-d548a84437e2 None None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 15:02:44 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [None req-050ec8a1-6ffd-499d-95ad-d548a84437e2 None None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c" returned: 0 in 0.109s {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 15:02:44 devstack cinder-volume[83259]: DEBUG cinder.manager [None req-050ec8a1-6ffd-499d-95ad-d548a84437e2 None None] Notifying Schedulers of capabilities ... {{(pid=83259) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 16 15:02:52 devstack cinder-volume[83259]: WARNING cinder.volume.volume_utils [req-2be78570-4482-41ea-855e-f9e17c64b9ee req-75804639-81a4-4792-a5a1-b367ff3e0a4f tempest-AttachVolumeNegativeTest-1792000208 None] Volume driver (QuobyteDriver 1.2) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 16 15:02:52 devstack cinder-volume[83259]: WARNING cinder.volume.volume_utils [req-2be78570-4482-41ea-855e-f9e17c64b9ee req-75804639-81a4-4792-a5a1-b367ff3e0a4f tempest-AttachVolumeNegativeTest-1792000208 None] Volume driver (QuobyteDriver 1.2) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 16 15:02:52 devstack cinder-volume[83259]: INFO cinder.volume.manager [req-2be78570-4482-41ea-855e-f9e17c64b9ee req-75804639-81a4-4792-a5a1-b367ff3e0a4f tempest-AttachVolumeNegativeTest-1792000208 None] Terminate volume connection completed successfully. Sep 16 15:02:52 devstack cinder-volume[83259]: DEBUG cinder.volume.manager [req-2be78570-4482-41ea-855e-f9e17c64b9ee req-75804639-81a4-4792-a5a1-b367ff3e0a4f tempest-AttachVolumeNegativeTest-1792000208 None] Deleting attachment 7726fcae-291f-4b47-81a1-d00ebc6c834b. {{(pid=83259) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5022}} Sep 16 15:02:53 devstack cinder-volume[83259]: WARNING cinder.volume.volume_utils [None req-90f1ec2d-6162-4d7b-b3ca-e2914184fa5e tempest-VolumesImageMetadata-743707409 None] Volume driver (QuobyteDriver 1.2) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 16 15:02:53 devstack cinder-volume[83259]: DEBUG cinder.volume.flows.manager.create_volume [None req-90f1ec2d-6162-4d7b-b3ca-e2914184fa5e tempest-VolumesImageMetadata-743707409 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#Quobyte'], 'hosts': ['devstack@QuobyteHD#Quobyte']} {{(pid=83259) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1387}} Sep 16 15:02:53 devstack cinder-volume[83259]: DEBUG cinder.volume.manager [None req-90f1ec2d-6162-4d7b-b3ca-e2914184fa5e tempest-VolumesImageMetadata-743707409 None] Flow 'volume_create_manager' (18d54f65-8be7-4cb8-a956-3705e227e1ae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83259) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 16 15:02:53 devstack cinder-volume[83259]: DEBUG cinder.volume.manager [None req-90f1ec2d-6162-4d7b-b3ca-e2914184fa5e tempest-VolumesImageMetadata-743707409 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0d95bf8d-a649-47a4-a7d8-157b67d2deba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83259) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 15:02:53 devstack cinder-volume[83259]: DEBUG cinder.volume.manager [None req-90f1ec2d-6162-4d7b-b3ca-e2914184fa5e tempest-VolumesImageMetadata-743707409 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0d95bf8d-a649-47a4-a7d8-157b67d2deba) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-16T13:02:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesImageMetadata-Volume-1101466896',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#Quobyte',id=4177b4c2-59d6-4a2c-8cc7-d111884cbbbc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='372733591c5d4c689799fea6cdcf4734',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-16T13:02:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-16T13:02:54Z,use_quota=True,user_id='39d51bb6aeb9488b91e48b254a4babbf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(485ead50-3df8-4d76-8d34-a4db136c980a),volume_type_id=485ead50-3df8-4d76-8d34-a4db136c980a)' {{(pid=83259) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 15:02:53 devstack cinder-volume[83259]: DEBUG cinder.volume.manager [None req-90f1ec2d-6162-4d7b-b3ca-e2914184fa5e tempest-VolumesImageMetadata-743707409 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b3bd04ac-4cfc-4c97-8a70-493dde79adc1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83259) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 15:02:53 devstack cinder-volume[83259]: DEBUG cinder.volume.manager [None req-90f1ec2d-6162-4d7b-b3ca-e2914184fa5e tempest-VolumesImageMetadata-743707409 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b3bd04ac-4cfc-4c97-8a70-493dde79adc1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83259) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 15:02:53 devstack cinder-volume[83259]: DEBUG cinder.volume.manager [None req-90f1ec2d-6162-4d7b-b3ca-e2914184fa5e tempest-VolumesImageMetadata-743707409 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f513e0dc-f1ef-4e37-aa77-c766a4c3db5f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83259) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 15:02:53 devstack cinder-volume[83259]: DEBUG cinder.image.glance [None req-90f1ec2d-6162-4d7b-b3ca-e2914184fa5e tempest-VolumesImageMetadata-743707409 None] Creating Keystone auth plugin from conf {{(pid=83259) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:128}} Sep 16 15:02:54 devstack cinder-volume[83259]: DEBUG cinder.volume.manager [None req-90f1ec2d-6162-4d7b-b3ca-e2914184fa5e tempest-VolumesImageMetadata-743707409 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f513e0dc-f1ef-4e37-aa77-c766a4c3db5f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '4177b4c2-59d6-4a2c-8cc7-d111884cbbbc', 'volume_name': 'volume-4177b4c2-59d6-4a2c-8cc7-d111884cbbbc', 'volume_size': 1, 'image_id': '7786237f-0aff-46c8-bcd0-3b9486a0637a', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/7786237f-0aff-46c8-bcd0-3b9486a0637a', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '97738b7ffcbe49cbaad0099563a58435', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '7786237f-0aff-46c8-bcd0-3b9486a0637a', 'created_at': datetime.datetime(2025, 9, 16, 12, 35, 41, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2025, 9, 16, 12, 35, 42, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/7786237f-0aff-46c8-bcd0-3b9486a0637a/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=83259) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 15:02:54 devstack cinder-volume[83259]: DEBUG cinder.volume.manager [None req-90f1ec2d-6162-4d7b-b3ca-e2914184fa5e tempest-VolumesImageMetadata-743707409 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9632378f-9877-4550-b5e9-d93a399bbe7d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83259) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 15:02:54 devstack cinder-volume[83259]: DEBUG cinder.volume.manager [None req-90f1ec2d-6162-4d7b-b3ca-e2914184fa5e tempest-VolumesImageMetadata-743707409 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9632378f-9877-4550-b5e9-d93a399bbe7d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83259) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 15:02:54 devstack cinder-volume[83259]: DEBUG cinder.volume.manager [None req-90f1ec2d-6162-4d7b-b3ca-e2914184fa5e tempest-VolumesImageMetadata-743707409 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (eac1640f-5e48-43d8-9125-614e17e7d713) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83259) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 15:02:54 devstack cinder-volume[83259]: INFO cinder.volume.flows.manager.create_volume [None req-90f1ec2d-6162-4d7b-b3ca-e2914184fa5e tempest-VolumesImageMetadata-743707409 None] Volume 4177b4c2-59d6-4a2c-8cc7-d111884cbbbc: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-4177b4c2-59d6-4a2c-8cc7-d111884cbbbc', 'volume_size': 1, 'image_id': '7786237f-0aff-46c8-bcd0-3b9486a0637a', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/7786237f-0aff-46c8-bcd0-3b9486a0637a', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '97738b7ffcbe49cbaad0099563a58435', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '7786237f-0aff-46c8-bcd0-3b9486a0637a', 'created_at': datetime.datetime(2025, 9, 16, 12, 35, 41, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2025, 9, 16, 12, 35, 42, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/7786237f-0aff-46c8-bcd0-3b9486a0637a/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Sep 16 15:02:54 devstack cinder-volume[83259]: DEBUG cinder.volume.flows.manager.create_volume [None req-90f1ec2d-6162-4d7b-b3ca-e2914184fa5e tempest-VolumesImageMetadata-743707409 None] Cloning 4177b4c2-59d6-4a2c-8cc7-d111884cbbbc from image 7786237f-0aff-46c8-bcd0-3b9486a0637a at location (None, [{'url': 'file:///opt/stack/data/glance/images/7786237f-0aff-46c8-bcd0-3b9486a0637a', 'metadata': {}}]). {{(pid=83259) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1085}} Sep 16 15:02:54 devstack cinder-volume[83259]: DEBUG cinder.image.image_utils [None req-90f1ec2d-6162-4d7b-b3ca-e2914184fa5e tempest-VolumesImageMetadata-743707409 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_7786237f-0aff-46c8-bcd0-3b9486a0637a_yp8wgk3ndevstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=83259) fetch /opt/stack/cinder/cinder/image/image_utils.py:700}} Sep 16 15:02:54 devstack cinder-volume[83259]: INFO cinder.image.image_utils [None req-90f1ec2d-6162-4d7b-b3ca-e2914184fa5e tempest-VolumesImageMetadata-743707409 None] Image download 20.69 MB at 20.69 MB/s Sep 16 15:02:55 devstack cinder-volume[83259]: DEBUG oslo.privsep.daemon [-] privsep: reply[38f5c94f-28f2-4d77-ac90-c7aabd98472a]: (4, 'qcow2') {{(pid=84312) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 16 15:02:55 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [None req-90f1ec2d-6162-4d7b-b3ca-e2914184fa5e tempest-VolumesImageMetadata-743707409 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_7786237f-0aff-46c8-bcd0-3b9486a0637a_yp8wgk3ndevstack@QuobyteHD {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 15:02:55 devstack sudo[92837]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_7786237f-0aff-46c8-bcd0-3b9486a0637a_yp8wgk3ndevstack@QuobyteHD Sep 16 15:02:55 devstack sudo[92837]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 15:02:59 devstack sudo[92837]: pam_unix(sudo:session): session closed for user root Sep 16 15:02:59 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [None req-90f1ec2d-6162-4d7b-b3ca-e2914184fa5e tempest-VolumesImageMetadata-743707409 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_7786237f-0aff-46c8-bcd0-3b9486a0637a_yp8wgk3ndevstack@QuobyteHD" returned: 0 in 4.274s {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 15:02:59 devstack cinder-volume[83259]: DEBUG cinder.image.image_utils [None req-90f1ec2d-6162-4d7b-b3ca-e2914184fa5e tempest-VolumesImageMetadata-743707409 None] Temporary image 7786237f-0aff-46c8-bcd0-3b9486a0637a is fetched for user 39d51bb6aeb9488b91e48b254a4babbf. {{(pid=83259) fetch /opt/stack/cinder/cinder/image/image_utils.py:1399}} Sep 16 15:03:00 devstack cinder-volume[83259]: DEBUG cinder.coordination [None req-c47eacab-1e17-456c-ae68-1720acd5c095 tempest-AttachVolumeShelveTestJSON-1870144154 None] Acquiring lock "cinder-df84a042-c784-400d-a1cc-463270aa0e26-delete_volume" by "delete_volume" {{(pid=83259) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 16 15:03:00 devstack cinder-volume[83259]: DEBUG cinder.coordination [None req-c47eacab-1e17-456c-ae68-1720acd5c095 tempest-AttachVolumeShelveTestJSON-1870144154 None] Lock "cinder-df84a042-c784-400d-a1cc-463270aa0e26-delete_volume" acquired by "delete_volume" :: waited 0.111s {{(pid=83259) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 16 15:03:00 devstack cinder-volume[83259]: DEBUG oslo.privsep.daemon [-] privsep: reply[a5bdf13c-e310-41d4-9b7e-3bc551cd28a0]: (4, 'qcow2') {{(pid=84312) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 16 15:03:00 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [None req-90f1ec2d-6162-4d7b-b3ca-e2914184fa5e tempest-VolumesImageMetadata-743707409 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_7786237f-0aff-46c8-bcd0-3b9486a0637a_yp8wgk3ndevstack@QuobyteHD {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 15:03:00 devstack cinder-volume[83259]: WARNING cinder.volume.volume_utils [None req-c47eacab-1e17-456c-ae68-1720acd5c095 tempest-AttachVolumeShelveTestJSON-1870144154 None] Volume driver (QuobyteDriver 1.2) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 16 15:03:00 devstack cinder-volume[83259]: DEBUG cinder.coordination [None req-c47eacab-1e17-456c-ae68-1720acd5c095 tempest-AttachVolumeShelveTestJSON-1870144154 None] Acquiring lock "cinder-quobyte-df84a042-c784-400d-a1cc-463270aa0e26" by "delete_volume" {{(pid=83259) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 16 15:03:01 devstack cinder-volume[83259]: DEBUG cinder.coordination [None req-c47eacab-1e17-456c-ae68-1720acd5c095 tempest-AttachVolumeShelveTestJSON-1870144154 None] Lock "cinder-quobyte-df84a042-c784-400d-a1cc-463270aa0e26" acquired by "delete_volume" :: waited 0.066s {{(pid=83259) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 16 15:03:01 devstack cinder-volume[83259]: DEBUG oslo.privsep.daemon [-] privsep: reply[014720b5-923f-4b79-9c43-2fe24bb2a2ad]: (4, 'qcow2') {{(pid=84312) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 16 15:03:01 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [None req-c47eacab-1e17-456c-ae68-1720acd5c095 tempest-AttachVolumeShelveTestJSON-1870144154 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c/volume-df84a042-c784-400d-a1cc-463270aa0e26 {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 15:03:01 devstack sudo[92883]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_7786237f-0aff-46c8-bcd0-3b9486a0637a_yp8wgk3ndevstack@QuobyteHD Sep 16 15:03:01 devstack sudo[92883]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 15:03:01 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [None req-c47eacab-1e17-456c-ae68-1720acd5c095 tempest-AttachVolumeShelveTestJSON-1870144154 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c/volume-df84a042-c784-400d-a1cc-463270aa0e26" returned: 0 in 0.753s {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 15:03:01 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [None req-c47eacab-1e17-456c-ae68-1720acd5c095 tempest-AttachVolumeShelveTestJSON-1870144154 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c/volume-df84a042-c784-400d-a1cc-463270aa0e26 {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 15:03:02 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [None req-c47eacab-1e17-456c-ae68-1720acd5c095 tempest-AttachVolumeShelveTestJSON-1870144154 None] CMD "rm -f /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c/volume-df84a042-c784-400d-a1cc-463270aa0e26" returned: 0 in 0.182s {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 15:03:02 devstack cinder-volume[83259]: DEBUG cinder.coordination [None req-c47eacab-1e17-456c-ae68-1720acd5c095 tempest-AttachVolumeShelveTestJSON-1870144154 None] Lock "cinder-quobyte-df84a042-c784-400d-a1cc-463270aa0e26" released by "delete_volume" :: held 1.223s {{(pid=83259) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 16 15:03:02 devstack cinder-volume[83259]: DEBUG cinder.quota [None req-c47eacab-1e17-456c-ae68-1720acd5c095 tempest-AttachVolumeShelveTestJSON-1870144154 None] Created reservations ['3b62294d-cbf3-4e17-a5ef-7bd93609ad6c', '89714121-c149-473b-b154-fc0cbc3b5130', 'd42fe471-426e-436c-acb1-8685f7151769', 'db0730a4-283e-418e-8739-bc96404ea137'] {{(pid=83259) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 16 15:03:02 devstack cinder-volume[83259]: DEBUG oslo_concurrency.lockutils [None req-c47eacab-1e17-456c-ae68-1720acd5c095 tempest-AttachVolumeShelveTestJSON-1870144154 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83259) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 16 15:03:02 devstack cinder-volume[83259]: DEBUG oslo_concurrency.lockutils [None req-c47eacab-1e17-456c-ae68-1720acd5c095 tempest-AttachVolumeShelveTestJSON-1870144154 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=83259) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 16 15:03:02 devstack cinder-volume[83259]: DEBUG cinder.volume.drivers.quobyte [None req-c47eacab-1e17-456c-ae68-1720acd5c095 tempest-AttachVolumeShelveTestJSON-1870144154 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-61f585ac-f8e2-4d19-a890-7ebc2726cc72': None} {{(pid=83259) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:639}} Sep 16 15:03:02 devstack cinder-volume[83259]: DEBUG cinder.volume.drivers.quobyte [None req-c47eacab-1e17-456c-ae68-1720acd5c095 tempest-AttachVolumeShelveTestJSON-1870144154 None] Available shares ['10.10.41.181/cinder-vol-61f585ac-f8e2-4d19-a890-7ebc2726cc72'] {{(pid=83259) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:669}} Sep 16 15:03:02 devstack cinder-volume[83259]: DEBUG oslo_concurrency.lockutils [None req-c47eacab-1e17-456c-ae68-1720acd5c095 tempest-AttachVolumeShelveTestJSON-1870144154 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=83259) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 16 15:03:02 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [None req-c47eacab-1e17-456c-ae68-1720acd5c095 tempest-AttachVolumeShelveTestJSON-1870144154 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 15:03:03 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [None req-c47eacab-1e17-456c-ae68-1720acd5c095 tempest-AttachVolumeShelveTestJSON-1870144154 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c" returned: 0 in 0.141s {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 15:03:03 devstack cinder-volume[83259]: DEBUG cinder.manager [None req-c47eacab-1e17-456c-ae68-1720acd5c095 tempest-AttachVolumeShelveTestJSON-1870144154 None] Notifying Schedulers of capabilities ... {{(pid=83259) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 16 15:03:03 devstack cinder-volume[83259]: INFO cinder.volume.manager [None req-c47eacab-1e17-456c-ae68-1720acd5c095 tempest-AttachVolumeShelveTestJSON-1870144154 None] Deleted volume successfully. Sep 16 15:03:03 devstack cinder-volume[83259]: DEBUG cinder.coordination [None req-c47eacab-1e17-456c-ae68-1720acd5c095 tempest-AttachVolumeShelveTestJSON-1870144154 None] Lock "cinder-df84a042-c784-400d-a1cc-463270aa0e26-delete_volume" released by "delete_volume" :: held 2.931s {{(pid=83259) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 16 15:03:03 devstack cinder-volume[83259]: DEBUG cinder.coordination [None req-3ba498eb-762f-431c-8005-bf6333effcd8 tempest-AttachVolumeShelveTestJSON-1870144154 None] Acquiring lock "cinder-1d2d2164-2d63-4cb8-84db-04d369193c7d-delete_volume" by "delete_volume" {{(pid=83259) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 16 15:03:03 devstack cinder-volume[83259]: DEBUG cinder.coordination [None req-3ba498eb-762f-431c-8005-bf6333effcd8 tempest-AttachVolumeShelveTestJSON-1870144154 None] Lock "cinder-1d2d2164-2d63-4cb8-84db-04d369193c7d-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=83259) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 16 15:03:04 devstack sudo[92883]: pam_unix(sudo:session): session closed for user root Sep 16 15:03:04 devstack cinder-volume[83259]: WARNING cinder.volume.volume_utils [None req-3ba498eb-762f-431c-8005-bf6333effcd8 tempest-AttachVolumeShelveTestJSON-1870144154 None] Volume driver (QuobyteDriver 1.2) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 16 15:03:04 devstack cinder-volume[83259]: DEBUG cinder.coordination [None req-3ba498eb-762f-431c-8005-bf6333effcd8 tempest-AttachVolumeShelveTestJSON-1870144154 None] Acquiring lock "cinder-quobyte-1d2d2164-2d63-4cb8-84db-04d369193c7d" by "delete_volume" {{(pid=83259) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 16 15:03:04 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [None req-90f1ec2d-6162-4d7b-b3ca-e2914184fa5e tempest-VolumesImageMetadata-743707409 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_7786237f-0aff-46c8-bcd0-3b9486a0637a_yp8wgk3ndevstack@QuobyteHD" returned: 0 in 3.696s {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 15:03:04 devstack cinder-volume[83259]: DEBUG oslo_concurrency.lockutils [None req-90f1ec2d-6162-4d7b-b3ca-e2914184fa5e tempest-VolumesImageMetadata-743707409 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83259) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 16 15:03:04 devstack cinder-volume[83259]: DEBUG oslo_concurrency.lockutils [None req-90f1ec2d-6162-4d7b-b3ca-e2914184fa5e tempest-VolumesImageMetadata-743707409 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=83259) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 16 15:03:04 devstack cinder-volume[83259]: DEBUG cinder.volume.drivers.quobyte [None req-90f1ec2d-6162-4d7b-b3ca-e2914184fa5e tempest-VolumesImageMetadata-743707409 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-16T13:02:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesImageMetadata-Volume-1101466896',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#Quobyte',id=4177b4c2-59d6-4a2c-8cc7-d111884cbbbc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='372733591c5d4c689799fea6cdcf4734',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-16T13:02:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-16T13:02:54Z,use_quota=True,user_id='39d51bb6aeb9488b91e48b254a4babbf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(485ead50-3df8-4d76-8d34-a4db136c980a),volume_type_id=485ead50-3df8-4d76-8d34-a4db136c980a)}" {{(pid=83259) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Sep 16 15:03:04 devstack cinder-volume[83259]: DEBUG cinder.volume.drivers.remotefs [None req-90f1ec2d-6162-4d7b-b3ca-e2914184fa5e tempest-VolumesImageMetadata-743707409 None] Creating volume 4177b4c2-59d6-4a2c-8cc7-d111884cbbbc {{(pid=83259) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}} Sep 16 15:03:04 devstack cinder-volume[83259]: DEBUG oslo_concurrency.lockutils [None req-90f1ec2d-6162-4d7b-b3ca-e2914184fa5e tempest-VolumesImageMetadata-743707409 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83259) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 16 15:03:04 devstack cinder-volume[83259]: DEBUG oslo_concurrency.lockutils [None req-90f1ec2d-6162-4d7b-b3ca-e2914184fa5e tempest-VolumesImageMetadata-743707409 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83259) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 16 15:03:04 devstack cinder-volume[83259]: DEBUG cinder.volume.drivers.quobyte [None req-90f1ec2d-6162-4d7b-b3ca-e2914184fa5e tempest-VolumesImageMetadata-743707409 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-61f585ac-f8e2-4d19-a890-7ebc2726cc72': None} {{(pid=83259) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:639}} Sep 16 15:03:04 devstack cinder-volume[83259]: DEBUG cinder.volume.drivers.quobyte [None req-90f1ec2d-6162-4d7b-b3ca-e2914184fa5e tempest-VolumesImageMetadata-743707409 None] Available shares ['10.10.41.181/cinder-vol-61f585ac-f8e2-4d19-a890-7ebc2726cc72'] {{(pid=83259) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:669}} Sep 16 15:03:04 devstack cinder-volume[83259]: DEBUG oslo_concurrency.lockutils [None req-90f1ec2d-6162-4d7b-b3ca-e2914184fa5e tempest-VolumesImageMetadata-743707409 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=83259) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 16 15:03:04 devstack cinder-volume[83259]: DEBUG cinder.volume.drivers.quobyte [None req-90f1ec2d-6162-4d7b-b3ca-e2914184fa5e tempest-VolumesImageMetadata-743707409 None] Selected 10.10.41.181/cinder-vol-61f585ac-f8e2-4d19-a890-7ebc2726cc72 as target Quobyte volume. {{(pid=83259) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:690}} Sep 16 15:03:04 devstack cinder-volume[83259]: INFO cinder.volume.drivers.remotefs [None req-90f1ec2d-6162-4d7b-b3ca-e2914184fa5e tempest-VolumesImageMetadata-743707409 None] casted to 10.10.41.181/cinder-vol-61f585ac-f8e2-4d19-a890-7ebc2726cc72 Sep 16 15:03:04 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [None req-90f1ec2d-6162-4d7b-b3ca-e2914184fa5e tempest-VolumesImageMetadata-743707409 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c/volume-4177b4c2-59d6-4a2c-8cc7-d111884cbbbc 1073741824 {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 15:03:04 devstack quobyte-client[83286]: System call of process 92895 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 16 15:03:04 devstack quobyte-client[83286]: The server volume:87712ffe-8a69-446d-9ed6-4430c7ee9792@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=87712ffe-8a69-446d-9ed6-4430c7ee9792, inode=29, name=volume-4177b4c2-59d6-4a2c-8cc7-d111884cbbbc, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.206), requestorAccessMask=0 Sep 16 15:03:04 devstack cinder-volume[83259]: DEBUG cinder.coordination [None req-3ba498eb-762f-431c-8005-bf6333effcd8 tempest-AttachVolumeShelveTestJSON-1870144154 None] Lock "cinder-quobyte-1d2d2164-2d63-4cb8-84db-04d369193c7d" acquired by "delete_volume" :: waited 0.217s {{(pid=83259) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 16 15:03:04 devstack cinder-volume[83259]: DEBUG oslo.privsep.daemon [-] privsep: reply[04f88b39-1129-4d8b-b62b-a3a550d4f7db]: (4, 'qcow2') {{(pid=84312) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 16 15:03:04 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [None req-3ba498eb-762f-431c-8005-bf6333effcd8 tempest-AttachVolumeShelveTestJSON-1870144154 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c/volume-1d2d2164-2d63-4cb8-84db-04d369193c7d {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 15:03:04 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [None req-90f1ec2d-6162-4d7b-b3ca-e2914184fa5e tempest-VolumesImageMetadata-743707409 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c/volume-4177b4c2-59d6-4a2c-8cc7-d111884cbbbc 1073741824" returned: 0 in 0.417s {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 15:03:04 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [None req-90f1ec2d-6162-4d7b-b3ca-e2914184fa5e tempest-VolumesImageMetadata-743707409 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c/volume-4177b4c2-59d6-4a2c-8cc7-d111884cbbbc {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 15:03:04 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [None req-90f1ec2d-6162-4d7b-b3ca-e2914184fa5e tempest-VolumesImageMetadata-743707409 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c/volume-4177b4c2-59d6-4a2c-8cc7-d111884cbbbc" returned: 0 in 0.092s {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 15:03:04 devstack cinder-volume[83259]: DEBUG cinder.volume.drivers.quobyte [None req-90f1ec2d-6162-4d7b-b3ca-e2914184fa5e tempest-VolumesImageMetadata-743707409 None] <== create_volume: return (588ms) {'provider_location': '10.10.41.181/cinder-vol-61f585ac-f8e2-4d19-a890-7ebc2726cc72'} {{(pid=83259) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Sep 16 15:03:04 devstack cinder-volume[83259]: DEBUG oslo_concurrency.lockutils [None req-90f1ec2d-6162-4d7b-b3ca-e2914184fa5e tempest-VolumesImageMetadata-743707409 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.604s {{(pid=83259) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 16 15:03:04 devstack cinder-volume[83259]: DEBUG cinder.volume.volume_utils [None req-90f1ec2d-6162-4d7b-b3ca-e2914184fa5e tempest-VolumesImageMetadata-743707409 None] Attempting download of 7786237f-0aff-46c8-bcd0-3b9486a0637a ((None, [{'url': 'file:///opt/stack/data/glance/images/7786237f-0aff-46c8-bcd0-3b9486a0637a', 'metadata': {}}])) to volume 4177b4c2-59d6-4a2c-8cc7-d111884cbbbc. {{(pid=83259) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1189}} Sep 16 15:03:04 devstack quobyte-client[83286]: System call of process 92898 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 16 15:03:05 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [None req-3ba498eb-762f-431c-8005-bf6333effcd8 tempest-AttachVolumeShelveTestJSON-1870144154 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c/volume-1d2d2164-2d63-4cb8-84db-04d369193c7d" returned: 0 in 0.634s {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 15:03:05 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [None req-3ba498eb-762f-431c-8005-bf6333effcd8 tempest-AttachVolumeShelveTestJSON-1870144154 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c/volume-1d2d2164-2d63-4cb8-84db-04d369193c7d {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 15:03:05 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [None req-3ba498eb-762f-431c-8005-bf6333effcd8 tempest-AttachVolumeShelveTestJSON-1870144154 None] CMD "rm -f /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c/volume-1d2d2164-2d63-4cb8-84db-04d369193c7d" returned: 0 in 0.196s {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 15:03:05 devstack cinder-volume[83259]: DEBUG oslo.privsep.daemon [-] privsep: reply[3dfa7d80-6eb9-4934-8f8e-27245636542c]: (4, 'raw') {{(pid=84312) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 16 15:03:05 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [None req-90f1ec2d-6162-4d7b-b3ca-e2914184fa5e tempest-VolumesImageMetadata-743707409 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_7786237f-0aff-46c8-bcd0-3b9486a0637a_w45ryo5x {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 15:03:05 devstack cinder-volume[83259]: DEBUG cinder.coordination [None req-3ba498eb-762f-431c-8005-bf6333effcd8 tempest-AttachVolumeShelveTestJSON-1870144154 None] Lock "cinder-quobyte-1d2d2164-2d63-4cb8-84db-04d369193c7d" released by "delete_volume" :: held 1.105s {{(pid=83259) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 16 15:03:05 devstack sudo[92903]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_7786237f-0aff-46c8-bcd0-3b9486a0637a_w45ryo5x Sep 16 15:03:05 devstack cinder-volume[83259]: DEBUG cinder.quota [None req-3ba498eb-762f-431c-8005-bf6333effcd8 tempest-AttachVolumeShelveTestJSON-1870144154 None] Created reservations ['25564236-5217-406e-b7bc-a7c6cd8c2862', 'b633a9a1-feb8-4b99-afbc-4db8f2a70fb5', '3624bc55-d05a-42c7-b045-e6e25ec08ffd', 'eec497ef-0fbb-4e1d-bc2e-b1a765f1d3f3'] {{(pid=83259) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 16 15:03:05 devstack sudo[92903]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 15:03:06 devstack cinder-volume[83259]: DEBUG oslo_concurrency.lockutils [None req-3ba498eb-762f-431c-8005-bf6333effcd8 tempest-AttachVolumeShelveTestJSON-1870144154 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83259) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 16 15:03:06 devstack cinder-volume[83259]: DEBUG oslo_concurrency.lockutils [None req-3ba498eb-762f-431c-8005-bf6333effcd8 tempest-AttachVolumeShelveTestJSON-1870144154 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.006s {{(pid=83259) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 16 15:03:06 devstack cinder-volume[83259]: DEBUG cinder.volume.drivers.quobyte [None req-3ba498eb-762f-431c-8005-bf6333effcd8 tempest-AttachVolumeShelveTestJSON-1870144154 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-61f585ac-f8e2-4d19-a890-7ebc2726cc72': None} {{(pid=83259) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:639}} Sep 16 15:03:06 devstack cinder-volume[83259]: DEBUG cinder.volume.drivers.quobyte [None req-3ba498eb-762f-431c-8005-bf6333effcd8 tempest-AttachVolumeShelveTestJSON-1870144154 None] Available shares ['10.10.41.181/cinder-vol-61f585ac-f8e2-4d19-a890-7ebc2726cc72'] {{(pid=83259) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:669}} Sep 16 15:03:06 devstack cinder-volume[83259]: DEBUG oslo_concurrency.lockutils [None req-3ba498eb-762f-431c-8005-bf6333effcd8 tempest-AttachVolumeShelveTestJSON-1870144154 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.044s {{(pid=83259) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 16 15:03:06 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [None req-3ba498eb-762f-431c-8005-bf6333effcd8 tempest-AttachVolumeShelveTestJSON-1870144154 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 15:03:06 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [None req-3ba498eb-762f-431c-8005-bf6333effcd8 tempest-AttachVolumeShelveTestJSON-1870144154 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c" returned: 0 in 0.194s {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 15:03:06 devstack cinder-volume[83259]: DEBUG cinder.manager [None req-3ba498eb-762f-431c-8005-bf6333effcd8 tempest-AttachVolumeShelveTestJSON-1870144154 None] Notifying Schedulers of capabilities ... {{(pid=83259) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 16 15:03:06 devstack cinder-volume[83259]: INFO cinder.volume.manager [None req-3ba498eb-762f-431c-8005-bf6333effcd8 tempest-AttachVolumeShelveTestJSON-1870144154 None] Deleted volume successfully. Sep 16 15:03:07 devstack cinder-volume[83259]: DEBUG cinder.coordination [None req-3ba498eb-762f-431c-8005-bf6333effcd8 tempest-AttachVolumeShelveTestJSON-1870144154 None] Lock "cinder-1d2d2164-2d63-4cb8-84db-04d369193c7d-delete_volume" released by "delete_volume" :: held 3.186s {{(pid=83259) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 16 15:03:08 devstack sudo[92903]: pam_unix(sudo:session): session closed for user root Sep 16 15:03:08 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [None req-90f1ec2d-6162-4d7b-b3ca-e2914184fa5e tempest-VolumesImageMetadata-743707409 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_7786237f-0aff-46c8-bcd0-3b9486a0637a_w45ryo5x" returned: 0 in 2.792s {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 15:03:08 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [None req-90f1ec2d-6162-4d7b-b3ca-e2914184fa5e tempest-VolumesImageMetadata-743707409 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_7786237f-0aff-46c8-bcd0-3b9486a0637a_w45ryo5x {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 15:03:08 devstack cinder-volume[83259]: DEBUG cinder.coordination [None req-e6e21fdc-37b9-4c53-b3e8-47f2ed75a756 tempest-AttachVolumeNegativeTest-1792000208 None] Acquiring lock "cinder-6f928547-f01f-45d6-9669-c3197222df6d-delete_volume" by "delete_volume" {{(pid=83259) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 16 15:03:09 devstack cinder-volume[83259]: DEBUG cinder.coordination [None req-e6e21fdc-37b9-4c53-b3e8-47f2ed75a756 tempest-AttachVolumeNegativeTest-1792000208 None] Lock "cinder-6f928547-f01f-45d6-9669-c3197222df6d-delete_volume" acquired by "delete_volume" :: waited 0.240s {{(pid=83259) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 16 15:03:09 devstack sudo[92920]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_7786237f-0aff-46c8-bcd0-3b9486a0637a_w45ryo5x Sep 16 15:03:09 devstack sudo[92920]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 15:03:09 devstack cinder-volume[83259]: WARNING cinder.volume.volume_utils [None req-e6e21fdc-37b9-4c53-b3e8-47f2ed75a756 tempest-AttachVolumeNegativeTest-1792000208 None] Volume driver (QuobyteDriver 1.2) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 16 15:03:09 devstack cinder-volume[83259]: DEBUG cinder.coordination [None req-e6e21fdc-37b9-4c53-b3e8-47f2ed75a756 tempest-AttachVolumeNegativeTest-1792000208 None] Acquiring lock "cinder-quobyte-6f928547-f01f-45d6-9669-c3197222df6d" by "delete_volume" {{(pid=83259) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 16 15:03:09 devstack cinder-volume[83259]: DEBUG cinder.coordination [None req-e6e21fdc-37b9-4c53-b3e8-47f2ed75a756 tempest-AttachVolumeNegativeTest-1792000208 None] Lock "cinder-quobyte-6f928547-f01f-45d6-9669-c3197222df6d" acquired by "delete_volume" :: waited 0.017s {{(pid=83259) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 16 15:03:09 devstack cinder-volume[83259]: DEBUG oslo.privsep.daemon [-] privsep: reply[1dc88976-ac54-4c98-b00b-668244a73c9f]: (4, 'qcow2') {{(pid=84312) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 16 15:03:09 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [None req-e6e21fdc-37b9-4c53-b3e8-47f2ed75a756 tempest-AttachVolumeNegativeTest-1792000208 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c/volume-6f928547-f01f-45d6-9669-c3197222df6d {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 15:03:10 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [None req-e6e21fdc-37b9-4c53-b3e8-47f2ed75a756 tempest-AttachVolumeNegativeTest-1792000208 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c/volume-6f928547-f01f-45d6-9669-c3197222df6d" returned: 0 in 0.681s {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 15:03:10 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [None req-e6e21fdc-37b9-4c53-b3e8-47f2ed75a756 tempest-AttachVolumeNegativeTest-1792000208 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c/volume-6f928547-f01f-45d6-9669-c3197222df6d {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 15:03:10 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [None req-e6e21fdc-37b9-4c53-b3e8-47f2ed75a756 tempest-AttachVolumeNegativeTest-1792000208 None] CMD "rm -f /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c/volume-6f928547-f01f-45d6-9669-c3197222df6d" returned: 0 in 0.303s {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 15:03:10 devstack cinder-volume[83259]: DEBUG cinder.coordination [None req-e6e21fdc-37b9-4c53-b3e8-47f2ed75a756 tempest-AttachVolumeNegativeTest-1792000208 None] Lock "cinder-quobyte-6f928547-f01f-45d6-9669-c3197222df6d" released by "delete_volume" :: held 1.292s {{(pid=83259) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 16 15:03:11 devstack cinder-volume[83259]: DEBUG cinder.quota [None req-e6e21fdc-37b9-4c53-b3e8-47f2ed75a756 tempest-AttachVolumeNegativeTest-1792000208 None] Created reservations ['9793df90-06f3-440f-8d20-af9382557d4b', 'f17e9459-3b55-409b-adeb-f99745f394e7', '708284cb-3d5f-47c3-a856-cf76487aa55c', 'b5e5e2c1-1f4b-447d-b0ea-bcf608c55933'] {{(pid=83259) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 16 15:03:11 devstack cinder-volume[83259]: DEBUG oslo_concurrency.lockutils [None req-e6e21fdc-37b9-4c53-b3e8-47f2ed75a756 tempest-AttachVolumeNegativeTest-1792000208 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83259) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 16 15:03:11 devstack cinder-volume[83259]: DEBUG oslo_concurrency.lockutils [None req-e6e21fdc-37b9-4c53-b3e8-47f2ed75a756 tempest-AttachVolumeNegativeTest-1792000208 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=83259) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 16 15:03:11 devstack cinder-volume[83259]: DEBUG cinder.volume.drivers.quobyte [None req-e6e21fdc-37b9-4c53-b3e8-47f2ed75a756 tempest-AttachVolumeNegativeTest-1792000208 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-61f585ac-f8e2-4d19-a890-7ebc2726cc72': None} {{(pid=83259) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:639}} Sep 16 15:03:11 devstack cinder-volume[83259]: DEBUG cinder.volume.drivers.quobyte [None req-e6e21fdc-37b9-4c53-b3e8-47f2ed75a756 tempest-AttachVolumeNegativeTest-1792000208 None] Available shares ['10.10.41.181/cinder-vol-61f585ac-f8e2-4d19-a890-7ebc2726cc72'] {{(pid=83259) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:669}} Sep 16 15:03:11 devstack cinder-volume[83259]: DEBUG oslo_concurrency.lockutils [None req-e6e21fdc-37b9-4c53-b3e8-47f2ed75a756 tempest-AttachVolumeNegativeTest-1792000208 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=83259) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 16 15:03:11 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [None req-e6e21fdc-37b9-4c53-b3e8-47f2ed75a756 tempest-AttachVolumeNegativeTest-1792000208 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 15:03:11 devstack sudo[92920]: pam_unix(sudo:session): session closed for user root Sep 16 15:03:12 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [None req-90f1ec2d-6162-4d7b-b3ca-e2914184fa5e tempest-VolumesImageMetadata-743707409 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_7786237f-0aff-46c8-bcd0-3b9486a0637a_w45ryo5x" returned: 1 in 3.866s {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 15:03:12 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [None req-90f1ec2d-6162-4d7b-b3ca-e2914184fa5e tempest-VolumesImageMetadata-743707409 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_7786237f-0aff-46c8-bcd0-3b9486a0637a_w45ryo5x' failed. Not Retrying. {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:423}} Sep 16 15:03:12 devstack cinder-volume[83259]: DEBUG oslo.privsep.daemon [-] privsep: reply[5addccbf-cb62-42df-a749-a532aaa8d5c6]: (4, 'qcow2') {{(pid=84312) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 16 15:03:12 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [None req-90f1ec2d-6162-4d7b-b3ca-e2914184fa5e tempest-VolumesImageMetadata-743707409 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_7786237f-0aff-46c8-bcd0-3b9486a0637a_yp8wgk3ndevstack@QuobyteHD {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 15:03:12 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [None req-e6e21fdc-37b9-4c53-b3e8-47f2ed75a756 tempest-AttachVolumeNegativeTest-1792000208 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c" returned: 0 in 0.306s {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 15:03:12 devstack cinder-volume[83259]: DEBUG cinder.manager [None req-e6e21fdc-37b9-4c53-b3e8-47f2ed75a756 tempest-AttachVolumeNegativeTest-1792000208 None] Notifying Schedulers of capabilities ... {{(pid=83259) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 16 15:03:12 devstack cinder-volume[83259]: INFO cinder.volume.manager [None req-e6e21fdc-37b9-4c53-b3e8-47f2ed75a756 tempest-AttachVolumeNegativeTest-1792000208 None] Deleted volume successfully. Sep 16 15:03:12 devstack cinder-volume[83259]: DEBUG cinder.coordination [None req-8f53f09d-4ee4-496a-adb5-a5b800b2b8cd tempest-AttachVolumeNegativeTest-1792000208 None] Acquiring lock "cinder-a65a9189-8157-4c94-9cd3-809421b0b1cb-delete_volume" by "delete_volume" {{(pid=83259) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 16 15:03:12 devstack cinder-volume[83259]: DEBUG cinder.coordination [None req-8f53f09d-4ee4-496a-adb5-a5b800b2b8cd tempest-AttachVolumeNegativeTest-1792000208 None] Lock "cinder-a65a9189-8157-4c94-9cd3-809421b0b1cb-delete_volume" acquired by "delete_volume" :: waited 0.100s {{(pid=83259) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 16 15:03:12 devstack cinder-volume[83259]: DEBUG cinder.coordination [None req-e6e21fdc-37b9-4c53-b3e8-47f2ed75a756 tempest-AttachVolumeNegativeTest-1792000208 None] Lock "cinder-6f928547-f01f-45d6-9669-c3197222df6d-delete_volume" released by "delete_volume" :: held 3.566s {{(pid=83259) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 16 15:03:12 devstack sudo[92950]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_7786237f-0aff-46c8-bcd0-3b9486a0637a_yp8wgk3ndevstack@QuobyteHD Sep 16 15:03:12 devstack sudo[92950]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 15:03:12 devstack cinder-volume[83259]: WARNING cinder.volume.volume_utils [None req-8f53f09d-4ee4-496a-adb5-a5b800b2b8cd tempest-AttachVolumeNegativeTest-1792000208 None] Volume driver (QuobyteDriver 1.2) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 16 15:03:12 devstack cinder-volume[83259]: DEBUG cinder.coordination [None req-8f53f09d-4ee4-496a-adb5-a5b800b2b8cd tempest-AttachVolumeNegativeTest-1792000208 None] Acquiring lock "cinder-quobyte-a65a9189-8157-4c94-9cd3-809421b0b1cb" by "delete_volume" {{(pid=83259) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 16 15:03:12 devstack cinder-volume[83259]: DEBUG cinder.coordination [None req-8f53f09d-4ee4-496a-adb5-a5b800b2b8cd tempest-AttachVolumeNegativeTest-1792000208 None] Lock "cinder-quobyte-a65a9189-8157-4c94-9cd3-809421b0b1cb" acquired by "delete_volume" :: waited 0.013s {{(pid=83259) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 16 15:03:12 devstack cinder-volume[83259]: DEBUG oslo.privsep.daemon [-] privsep: reply[d7238aae-65ec-42aa-ac0b-25142372cc2f]: (4, 'qcow2') {{(pid=84312) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 16 15:03:12 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [None req-8f53f09d-4ee4-496a-adb5-a5b800b2b8cd tempest-AttachVolumeNegativeTest-1792000208 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c/volume-a65a9189-8157-4c94-9cd3-809421b0b1cb {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 15:03:13 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [None req-8f53f09d-4ee4-496a-adb5-a5b800b2b8cd tempest-AttachVolumeNegativeTest-1792000208 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c/volume-a65a9189-8157-4c94-9cd3-809421b0b1cb" returned: 0 in 0.615s {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 15:03:13 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [None req-8f53f09d-4ee4-496a-adb5-a5b800b2b8cd tempest-AttachVolumeNegativeTest-1792000208 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c/volume-a65a9189-8157-4c94-9cd3-809421b0b1cb {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 15:03:13 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [None req-8f53f09d-4ee4-496a-adb5-a5b800b2b8cd tempest-AttachVolumeNegativeTest-1792000208 None] CMD "rm -f /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c/volume-a65a9189-8157-4c94-9cd3-809421b0b1cb" returned: 0 in 0.280s {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 15:03:14 devstack cinder-volume[83259]: DEBUG cinder.coordination [None req-8f53f09d-4ee4-496a-adb5-a5b800b2b8cd tempest-AttachVolumeNegativeTest-1792000208 None] Lock "cinder-quobyte-a65a9189-8157-4c94-9cd3-809421b0b1cb" released by "delete_volume" :: held 1.230s {{(pid=83259) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 16 15:03:14 devstack cinder-volume[83259]: DEBUG cinder.quota [None req-8f53f09d-4ee4-496a-adb5-a5b800b2b8cd tempest-AttachVolumeNegativeTest-1792000208 None] Created reservations ['de5d7c0c-8237-45ed-8dce-78b6ee5a8610', '3f435caf-f4c9-4459-a1c4-af28521e1b8a', '653c2d47-f787-466f-978a-1ca8fbf86b0c', 'e7cb8ce7-e9cc-41e8-9179-1351c791cf33'] {{(pid=83259) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 16 15:03:14 devstack cinder-volume[83259]: DEBUG oslo_concurrency.lockutils [None req-8f53f09d-4ee4-496a-adb5-a5b800b2b8cd tempest-AttachVolumeNegativeTest-1792000208 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83259) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 16 15:03:14 devstack cinder-volume[83259]: DEBUG oslo_concurrency.lockutils [None req-8f53f09d-4ee4-496a-adb5-a5b800b2b8cd tempest-AttachVolumeNegativeTest-1792000208 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.021s {{(pid=83259) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 16 15:03:14 devstack cinder-volume[83259]: DEBUG cinder.volume.drivers.quobyte [None req-8f53f09d-4ee4-496a-adb5-a5b800b2b8cd tempest-AttachVolumeNegativeTest-1792000208 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-61f585ac-f8e2-4d19-a890-7ebc2726cc72': None} {{(pid=83259) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:639}} Sep 16 15:03:14 devstack cinder-volume[83259]: DEBUG cinder.volume.drivers.quobyte [None req-8f53f09d-4ee4-496a-adb5-a5b800b2b8cd tempest-AttachVolumeNegativeTest-1792000208 None] Available shares ['10.10.41.181/cinder-vol-61f585ac-f8e2-4d19-a890-7ebc2726cc72'] {{(pid=83259) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:669}} Sep 16 15:03:14 devstack cinder-volume[83259]: DEBUG oslo_concurrency.lockutils [None req-8f53f09d-4ee4-496a-adb5-a5b800b2b8cd tempest-AttachVolumeNegativeTest-1792000208 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.039s {{(pid=83259) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 16 15:03:14 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [None req-8f53f09d-4ee4-496a-adb5-a5b800b2b8cd tempest-AttachVolumeNegativeTest-1792000208 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 15:03:15 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [None req-8f53f09d-4ee4-496a-adb5-a5b800b2b8cd tempest-AttachVolumeNegativeTest-1792000208 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c" returned: 0 in 0.253s {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 15:03:15 devstack cinder-volume[83259]: DEBUG cinder.manager [None req-8f53f09d-4ee4-496a-adb5-a5b800b2b8cd tempest-AttachVolumeNegativeTest-1792000208 None] Notifying Schedulers of capabilities ... {{(pid=83259) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 16 15:03:15 devstack cinder-volume[83259]: INFO cinder.volume.manager [None req-8f53f09d-4ee4-496a-adb5-a5b800b2b8cd tempest-AttachVolumeNegativeTest-1792000208 None] Deleted volume successfully. Sep 16 15:03:15 devstack sudo[92950]: pam_unix(sudo:session): session closed for user root Sep 16 15:03:15 devstack cinder-volume[83259]: DEBUG cinder.coordination [None req-c93a84c0-b402-4446-9d53-8b725310d82e tempest-AttachVolumeNegativeTest-1792000208 None] Acquiring lock "cinder-10a54a3e-06db-4c81-bdc1-a300a53d94c5-delete_volume" by "delete_volume" {{(pid=83259) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 16 15:03:15 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [None req-90f1ec2d-6162-4d7b-b3ca-e2914184fa5e tempest-VolumesImageMetadata-743707409 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_7786237f-0aff-46c8-bcd0-3b9486a0637a_yp8wgk3ndevstack@QuobyteHD" returned: 0 in 3.539s {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 15:03:15 devstack cinder-volume[83259]: DEBUG cinder.image.image_utils [None req-90f1ec2d-6162-4d7b-b3ca-e2914184fa5e tempest-VolumesImageMetadata-743707409 None] 7786237f-0aff-46c8-bcd0-3b9486a0637a was qcow2, converting to qcow2 {{(pid=83259) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1088}} Sep 16 15:03:15 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [None req-90f1ec2d-6162-4d7b-b3ca-e2914184fa5e tempest-VolumesImageMetadata-743707409 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_7786237f-0aff-46c8-bcd0-3b9486a0637a_yp8wgk3ndevstack@QuobyteHD /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c/volume-4177b4c2-59d6-4a2c-8cc7-d111884cbbbc {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 15:03:15 devstack sudo[92961]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_7786237f-0aff-46c8-bcd0-3b9486a0637a_yp8wgk3ndevstack@QuobyteHD /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c/volume-4177b4c2-59d6-4a2c-8cc7-d111884cbbbc Sep 16 15:03:15 devstack sudo[92961]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 15:03:15 devstack cinder-volume[83259]: DEBUG cinder.coordination [None req-c93a84c0-b402-4446-9d53-8b725310d82e tempest-AttachVolumeNegativeTest-1792000208 None] Lock "cinder-10a54a3e-06db-4c81-bdc1-a300a53d94c5-delete_volume" acquired by "delete_volume" :: waited 0.274s {{(pid=83259) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 16 15:03:15 devstack cinder-volume[83259]: DEBUG cinder.coordination [None req-8f53f09d-4ee4-496a-adb5-a5b800b2b8cd tempest-AttachVolumeNegativeTest-1792000208 None] Lock "cinder-a65a9189-8157-4c94-9cd3-809421b0b1cb-delete_volume" released by "delete_volume" :: held 3.370s {{(pid=83259) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 16 15:03:16 devstack cinder-volume[83259]: WARNING cinder.volume.volume_utils [None req-c93a84c0-b402-4446-9d53-8b725310d82e tempest-AttachVolumeNegativeTest-1792000208 None] Volume driver (QuobyteDriver 1.2) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 16 15:03:16 devstack cinder-volume[83259]: DEBUG cinder.coordination [None req-c93a84c0-b402-4446-9d53-8b725310d82e tempest-AttachVolumeNegativeTest-1792000208 None] Acquiring lock "cinder-quobyte-10a54a3e-06db-4c81-bdc1-a300a53d94c5" by "delete_volume" {{(pid=83259) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 16 15:03:16 devstack cinder-volume[83259]: DEBUG cinder.coordination [None req-c93a84c0-b402-4446-9d53-8b725310d82e tempest-AttachVolumeNegativeTest-1792000208 None] Lock "cinder-quobyte-10a54a3e-06db-4c81-bdc1-a300a53d94c5" acquired by "delete_volume" :: waited 0.020s {{(pid=83259) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 16 15:03:16 devstack cinder-volume[83259]: DEBUG oslo.privsep.daemon [-] privsep: reply[88a312dd-cad8-4df6-b708-9aa93d0accbb]: (4, 'qcow2') {{(pid=84312) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 16 15:03:16 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [None req-c93a84c0-b402-4446-9d53-8b725310d82e tempest-AttachVolumeNegativeTest-1792000208 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c/volume-10a54a3e-06db-4c81-bdc1-a300a53d94c5 {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 15:03:17 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [None req-c93a84c0-b402-4446-9d53-8b725310d82e tempest-AttachVolumeNegativeTest-1792000208 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c/volume-10a54a3e-06db-4c81-bdc1-a300a53d94c5" returned: 0 in 0.690s {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 15:03:17 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [None req-c93a84c0-b402-4446-9d53-8b725310d82e tempest-AttachVolumeNegativeTest-1792000208 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c/volume-10a54a3e-06db-4c81-bdc1-a300a53d94c5 {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 15:03:17 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [None req-c93a84c0-b402-4446-9d53-8b725310d82e tempest-AttachVolumeNegativeTest-1792000208 None] CMD "rm -f /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c/volume-10a54a3e-06db-4c81-bdc1-a300a53d94c5" returned: 0 in 0.185s {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 15:03:17 devstack cinder-volume[83259]: DEBUG cinder.coordination [None req-c93a84c0-b402-4446-9d53-8b725310d82e tempest-AttachVolumeNegativeTest-1792000208 None] Lock "cinder-quobyte-10a54a3e-06db-4c81-bdc1-a300a53d94c5" released by "delete_volume" :: held 1.111s {{(pid=83259) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 16 15:03:17 devstack quobyte-client[83286]: System call of process 92968 ( /usr/bin/qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 16 15:03:17 devstack cinder-volume[83259]: DEBUG cinder.quota [None req-c93a84c0-b402-4446-9d53-8b725310d82e tempest-AttachVolumeNegativeTest-1792000208 None] Created reservations ['cf5bceda-00c9-41ee-b3d7-c27f342aa085', '1a8c614a-0827-43bc-87b0-3d48b3e00818', '875cf262-3bbf-46e6-b197-835098dc060d', '95997245-6783-47d4-a970-4d941af2bcd8'] {{(pid=83259) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 16 15:03:18 devstack cinder-volume[83259]: DEBUG oslo_concurrency.lockutils [None req-c93a84c0-b402-4446-9d53-8b725310d82e tempest-AttachVolumeNegativeTest-1792000208 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83259) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 16 15:03:18 devstack cinder-volume[83259]: DEBUG oslo_concurrency.lockutils [None req-c93a84c0-b402-4446-9d53-8b725310d82e tempest-AttachVolumeNegativeTest-1792000208 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.007s {{(pid=83259) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 16 15:03:18 devstack cinder-volume[83259]: DEBUG cinder.volume.drivers.quobyte [None req-c93a84c0-b402-4446-9d53-8b725310d82e tempest-AttachVolumeNegativeTest-1792000208 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-61f585ac-f8e2-4d19-a890-7ebc2726cc72': None} {{(pid=83259) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:639}} Sep 16 15:03:18 devstack cinder-volume[83259]: DEBUG cinder.volume.drivers.quobyte [None req-c93a84c0-b402-4446-9d53-8b725310d82e tempest-AttachVolumeNegativeTest-1792000208 None] Available shares ['10.10.41.181/cinder-vol-61f585ac-f8e2-4d19-a890-7ebc2726cc72'] {{(pid=83259) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:669}} Sep 16 15:03:18 devstack cinder-volume[83259]: DEBUG oslo_concurrency.lockutils [None req-c93a84c0-b402-4446-9d53-8b725310d82e tempest-AttachVolumeNegativeTest-1792000208 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=83259) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 16 15:03:18 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [None req-c93a84c0-b402-4446-9d53-8b725310d82e tempest-AttachVolumeNegativeTest-1792000208 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 15:03:18 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [None req-c93a84c0-b402-4446-9d53-8b725310d82e tempest-AttachVolumeNegativeTest-1792000208 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c" returned: 0 in 0.196s {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 15:03:18 devstack cinder-volume[83259]: DEBUG cinder.manager [None req-c93a84c0-b402-4446-9d53-8b725310d82e tempest-AttachVolumeNegativeTest-1792000208 None] Notifying Schedulers of capabilities ... {{(pid=83259) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 16 15:03:18 devstack cinder-volume[83259]: INFO cinder.volume.manager [None req-c93a84c0-b402-4446-9d53-8b725310d82e tempest-AttachVolumeNegativeTest-1792000208 None] Deleted volume successfully. Sep 16 15:03:19 devstack cinder-volume[83259]: DEBUG cinder.coordination [None req-c93a84c0-b402-4446-9d53-8b725310d82e tempest-AttachVolumeNegativeTest-1792000208 None] Lock "cinder-10a54a3e-06db-4c81-bdc1-a300a53d94c5-delete_volume" released by "delete_volume" :: held 3.289s {{(pid=83259) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 16 15:03:20 devstack sudo[92961]: pam_unix(sudo:session): session closed for user root Sep 16 15:03:20 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [None req-90f1ec2d-6162-4d7b-b3ca-e2914184fa5e tempest-VolumesImageMetadata-743707409 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_7786237f-0aff-46c8-bcd0-3b9486a0637a_yp8wgk3ndevstack@QuobyteHD /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c/volume-4177b4c2-59d6-4a2c-8cc7-d111884cbbbc" returned: 0 in 4.362s {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 15:03:20 devstack cinder-volume[83259]: DEBUG cinder.image.image_utils [None req-90f1ec2d-6162-4d7b-b3ca-e2914184fa5e tempest-VolumesImageMetadata-743707409 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_7786237f-0aff-46c8-bcd0-3b9486a0637a_yp8wgk3ndevstack@QuobyteHD, size 112.00 MB, duration 4.37 sec, destination /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c/volume-4177b4c2-59d6-4a2c-8cc7-d111884cbbbc {{(pid=83259) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:501}} Sep 16 15:03:20 devstack cinder-volume[83259]: INFO cinder.image.image_utils [None req-90f1ec2d-6162-4d7b-b3ca-e2914184fa5e tempest-VolumesImageMetadata-743707409 None] Converted 112.00 MB image at 25.64 MB/s Sep 16 15:03:20 devstack cinder-volume[83259]: DEBUG oslo.privsep.daemon [-] privsep: reply[e12db569-ee94-43a6-b1fa-ac46c65c2078]: (4, 'qcow2') {{(pid=84312) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 16 15:03:20 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [None req-90f1ec2d-6162-4d7b-b3ca-e2914184fa5e tempest-VolumesImageMetadata-743707409 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c/volume-4177b4c2-59d6-4a2c-8cc7-d111884cbbbc {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 15:03:20 devstack quobyte-client[83286]: System call of process 92979 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 16 15:03:20 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [None req-90f1ec2d-6162-4d7b-b3ca-e2914184fa5e tempest-VolumesImageMetadata-743707409 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c/volume-4177b4c2-59d6-4a2c-8cc7-d111884cbbbc" returned: 0 in 0.859s {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 15:03:20 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [None req-90f1ec2d-6162-4d7b-b3ca-e2914184fa5e tempest-VolumesImageMetadata-743707409 None] Running cmd (subprocess): qemu-img resize /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c/volume-4177b4c2-59d6-4a2c-8cc7-d111884cbbbc 1G {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 15:03:21 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [None req-90f1ec2d-6162-4d7b-b3ca-e2914184fa5e tempest-VolumesImageMetadata-743707409 None] CMD "qemu-img resize /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c/volume-4177b4c2-59d6-4a2c-8cc7-d111884cbbbc 1G" returned: 0 in 0.277s {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 15:03:21 devstack cinder-volume[83259]: DEBUG cinder.volume.volume_utils [None req-90f1ec2d-6162-4d7b-b3ca-e2914184fa5e tempest-VolumesImageMetadata-743707409 None] Downloaded image 7786237f-0aff-46c8-bcd0-3b9486a0637a ((None, [{'url': 'file:///opt/stack/data/glance/images/7786237f-0aff-46c8-bcd0-3b9486a0637a', 'metadata': {}}])) to volume 4177b4c2-59d6-4a2c-8cc7-d111884cbbbc successfully. {{(pid=83259) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1234}} Sep 16 15:03:21 devstack cinder-volume[83259]: DEBUG cinder.image.image_utils [None req-90f1ec2d-6162-4d7b-b3ca-e2914184fa5e tempest-VolumesImageMetadata-743707409 None] Temporary image 7786237f-0aff-46c8-bcd0-3b9486a0637a for user 39d51bb6aeb9488b91e48b254a4babbf is deleted. {{(pid=83259) fetch /opt/stack/cinder/cinder/image/image_utils.py:1403}} Sep 16 15:03:21 devstack cinder-volume[83259]: DEBUG cinder.volume.volume_utils [None req-90f1ec2d-6162-4d7b-b3ca-e2914184fa5e tempest-VolumesImageMetadata-743707409 None] Marking volume 4177b4c2-59d6-4a2c-8cc7-d111884cbbbc as bootable. {{(pid=83259) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1138}} Sep 16 15:03:21 devstack cinder-volume[83259]: DEBUG cinder.volume.flows.manager.create_volume [None req-90f1ec2d-6162-4d7b-b3ca-e2914184fa5e tempest-VolumesImageMetadata-743707409 None] Copying metadata from image 7786237f-0aff-46c8-bcd0-3b9486a0637a to 4177b4c2-59d6-4a2c-8cc7-d111884cbbbc. {{(pid=83259) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Sep 16 15:03:21 devstack cinder-volume[83259]: DEBUG cinder.volume.flows.manager.create_volume [None req-90f1ec2d-6162-4d7b-b3ca-e2914184fa5e tempest-VolumesImageMetadata-743707409 None] Creating volume glance metadata for volume 4177b4c2-59d6-4a2c-8cc7-d111884cbbbc backed by image 7786237f-0aff-46c8-bcd0-3b9486a0637a with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': '7786237f-0aff-46c8-bcd0-3b9486a0637a', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=83259) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Sep 16 15:03:21 devstack cinder-volume[83259]: DEBUG cinder.volume.manager [None req-90f1ec2d-6162-4d7b-b3ca-e2914184fa5e tempest-VolumesImageMetadata-743707409 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (eac1640f-5e48-43d8-9125-614e17e7d713) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4177b4c2-59d6-4a2c-8cc7-d111884cbbbc', 'volume_size': 1, 'image_id': '7786237f-0aff-46c8-bcd0-3b9486a0637a', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/7786237f-0aff-46c8-bcd0-3b9486a0637a', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '97738b7ffcbe49cbaad0099563a58435', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '7786237f-0aff-46c8-bcd0-3b9486a0637a', 'created_at': datetime.datetime(2025, 9, 16, 12, 35, 41, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2025, 9, 16, 12, 35, 42, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/7786237f-0aff-46c8-bcd0-3b9486a0637a/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=83259) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 15:03:21 devstack cinder-volume[83259]: DEBUG cinder.volume.manager [None req-90f1ec2d-6162-4d7b-b3ca-e2914184fa5e tempest-VolumesImageMetadata-743707409 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9d7da829-a3cb-4336-b2d6-d073164ed034) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83259) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 15:03:21 devstack cinder-volume[83259]: INFO cinder.volume.flows.manager.create_volume [None req-90f1ec2d-6162-4d7b-b3ca-e2914184fa5e tempest-VolumesImageMetadata-743707409 None] Volume volume-4177b4c2-59d6-4a2c-8cc7-d111884cbbbc (4177b4c2-59d6-4a2c-8cc7-d111884cbbbc): created successfully Sep 16 15:03:21 devstack cinder-volume[83259]: DEBUG cinder.volume.manager [None req-90f1ec2d-6162-4d7b-b3ca-e2914184fa5e tempest-VolumesImageMetadata-743707409 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9d7da829-a3cb-4336-b2d6-d073164ed034) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83259) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 15:03:21 devstack cinder-volume[83259]: DEBUG cinder.volume.manager [None req-90f1ec2d-6162-4d7b-b3ca-e2914184fa5e tempest-VolumesImageMetadata-743707409 None] Flow 'volume_create_manager' (18d54f65-8be7-4cb8-a956-3705e227e1ae) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83259) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 16 15:03:21 devstack cinder-volume[83259]: INFO cinder.volume.manager [None req-90f1ec2d-6162-4d7b-b3ca-e2914184fa5e tempest-VolumesImageMetadata-743707409 None] Created volume successfully. Sep 16 15:03:23 devstack cinder-volume[83259]: DEBUG cinder.coordination [None req-65b7f90c-232f-47df-9ae0-a3cc28eb298d tempest-VolumesImageMetadata-743707409 None] Acquiring lock "cinder-4177b4c2-59d6-4a2c-8cc7-d111884cbbbc-delete_volume" by "delete_volume" {{(pid=83259) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 16 15:03:23 devstack cinder-volume[83259]: DEBUG cinder.coordination [None req-65b7f90c-232f-47df-9ae0-a3cc28eb298d tempest-VolumesImageMetadata-743707409 None] Lock "cinder-4177b4c2-59d6-4a2c-8cc7-d111884cbbbc-delete_volume" acquired by "delete_volume" :: waited 0.087s {{(pid=83259) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 16 15:03:23 devstack cinder-volume[83259]: WARNING cinder.volume.volume_utils [None req-65b7f90c-232f-47df-9ae0-a3cc28eb298d tempest-VolumesImageMetadata-743707409 None] Volume driver (QuobyteDriver 1.2) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 16 15:03:23 devstack cinder-volume[83259]: DEBUG cinder.coordination [None req-65b7f90c-232f-47df-9ae0-a3cc28eb298d tempest-VolumesImageMetadata-743707409 None] Acquiring lock "cinder-quobyte-4177b4c2-59d6-4a2c-8cc7-d111884cbbbc" by "delete_volume" {{(pid=83259) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 16 15:03:23 devstack cinder-volume[83259]: DEBUG cinder.coordination [None req-65b7f90c-232f-47df-9ae0-a3cc28eb298d tempest-VolumesImageMetadata-743707409 None] Lock "cinder-quobyte-4177b4c2-59d6-4a2c-8cc7-d111884cbbbc" acquired by "delete_volume" :: waited 0.024s {{(pid=83259) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 16 15:03:23 devstack cinder-volume[83259]: DEBUG oslo.privsep.daemon [-] privsep: reply[92e73138-6ce2-427a-ad52-1b8974ef1639]: (4, 'qcow2') {{(pid=84312) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 16 15:03:23 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [None req-65b7f90c-232f-47df-9ae0-a3cc28eb298d tempest-VolumesImageMetadata-743707409 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c/volume-4177b4c2-59d6-4a2c-8cc7-d111884cbbbc {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 15:03:24 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [None req-65b7f90c-232f-47df-9ae0-a3cc28eb298d tempest-VolumesImageMetadata-743707409 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c/volume-4177b4c2-59d6-4a2c-8cc7-d111884cbbbc" returned: 0 in 0.741s {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 15:03:24 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [None req-65b7f90c-232f-47df-9ae0-a3cc28eb298d tempest-VolumesImageMetadata-743707409 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c/volume-4177b4c2-59d6-4a2c-8cc7-d111884cbbbc {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 15:03:24 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [None req-65b7f90c-232f-47df-9ae0-a3cc28eb298d tempest-VolumesImageMetadata-743707409 None] CMD "rm -f /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c/volume-4177b4c2-59d6-4a2c-8cc7-d111884cbbbc" returned: 0 in 0.137s {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 15:03:24 devstack cinder-volume[83259]: DEBUG cinder.coordination [None req-65b7f90c-232f-47df-9ae0-a3cc28eb298d tempest-VolumesImageMetadata-743707409 None] Lock "cinder-quobyte-4177b4c2-59d6-4a2c-8cc7-d111884cbbbc" released by "delete_volume" :: held 1.108s {{(pid=83259) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 16 15:03:25 devstack cinder-volume[83259]: DEBUG cinder.quota [None req-65b7f90c-232f-47df-9ae0-a3cc28eb298d tempest-VolumesImageMetadata-743707409 None] Created reservations ['dfa0a7b7-82f7-4ecb-bf40-51c59a7c189f', 'c5ef9094-5f62-4ec4-b391-f770de43d4f3', '56832819-7a5c-4c1a-acdf-34ade585df7f', 'b42dc3b3-8d78-48f8-b074-41bdc5bf18b0'] {{(pid=83259) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 16 15:03:25 devstack cinder-volume[83259]: DEBUG oslo_concurrency.lockutils [None req-65b7f90c-232f-47df-9ae0-a3cc28eb298d tempest-VolumesImageMetadata-743707409 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83259) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 16 15:03:25 devstack cinder-volume[83259]: DEBUG oslo_concurrency.lockutils [None req-65b7f90c-232f-47df-9ae0-a3cc28eb298d tempest-VolumesImageMetadata-743707409 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.006s {{(pid=83259) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 16 15:03:25 devstack cinder-volume[83259]: DEBUG cinder.volume.drivers.quobyte [None req-65b7f90c-232f-47df-9ae0-a3cc28eb298d tempest-VolumesImageMetadata-743707409 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-61f585ac-f8e2-4d19-a890-7ebc2726cc72': None} {{(pid=83259) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:639}} Sep 16 15:03:25 devstack cinder-volume[83259]: DEBUG cinder.volume.drivers.quobyte [None req-65b7f90c-232f-47df-9ae0-a3cc28eb298d tempest-VolumesImageMetadata-743707409 None] Available shares ['10.10.41.181/cinder-vol-61f585ac-f8e2-4d19-a890-7ebc2726cc72'] {{(pid=83259) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:669}} Sep 16 15:03:25 devstack cinder-volume[83259]: DEBUG oslo_concurrency.lockutils [None req-65b7f90c-232f-47df-9ae0-a3cc28eb298d tempest-VolumesImageMetadata-743707409 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=83259) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 16 15:03:25 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [None req-65b7f90c-232f-47df-9ae0-a3cc28eb298d tempest-VolumesImageMetadata-743707409 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 15:03:25 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [None req-65b7f90c-232f-47df-9ae0-a3cc28eb298d tempest-VolumesImageMetadata-743707409 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c" returned: 0 in 0.109s {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 15:03:25 devstack cinder-volume[83259]: DEBUG cinder.manager [None req-65b7f90c-232f-47df-9ae0-a3cc28eb298d tempest-VolumesImageMetadata-743707409 None] Notifying Schedulers of capabilities ... {{(pid=83259) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 16 15:03:25 devstack cinder-volume[83259]: INFO cinder.volume.manager [None req-65b7f90c-232f-47df-9ae0-a3cc28eb298d tempest-VolumesImageMetadata-743707409 None] Deleted volume successfully. Sep 16 15:03:25 devstack cinder-volume[83259]: DEBUG cinder.coordination [None req-65b7f90c-232f-47df-9ae0-a3cc28eb298d tempest-VolumesImageMetadata-743707409 None] Lock "cinder-4177b4c2-59d6-4a2c-8cc7-d111884cbbbc-delete_volume" released by "delete_volume" :: held 2.401s {{(pid=83259) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 16 15:03:28 devstack cinder-volume[83259]: WARNING cinder.volume.volume_utils [None req-abcc138e-a01a-402f-816d-b85112f6ee2d tempest-GroupSnapshotsTest-952387378 None] Volume driver (QuobyteDriver 1.2) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 16 15:03:28 devstack cinder-volume[83259]: INFO cinder.volume.manager [None req-abcc138e-a01a-402f-816d-b85112f6ee2d tempest-GroupSnapshotsTest-952387378 None] Group tempest-GroupSnapshotsTest-Group-289821561: creating Sep 16 15:03:28 devstack cinder-volume[83259]: INFO cinder.volume.manager [None req-abcc138e-a01a-402f-816d-b85112f6ee2d tempest-GroupSnapshotsTest-952387378 None] Group tempest-GroupSnapshotsTest-Group-289821561: created successfully Sep 16 15:03:28 devstack cinder-volume[83259]: INFO cinder.volume.manager [None req-abcc138e-a01a-402f-816d-b85112f6ee2d tempest-GroupSnapshotsTest-952387378 None] Create group completed successfully. Sep 16 15:03:29 devstack cinder-volume[83259]: WARNING cinder.volume.volume_utils [None req-ae5ba4ba-426d-49d2-a00e-476daf35dea8 tempest-GroupSnapshotsTest-952387378 None] Volume driver (QuobyteDriver 1.2) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 16 15:03:29 devstack cinder-volume[83259]: DEBUG cinder.volume.flows.manager.create_volume [None req-ae5ba4ba-426d-49d2-a00e-476daf35dea8 tempest-GroupSnapshotsTest-952387378 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#Quobyte'], 'hosts': ['devstack@QuobyteHD#Quobyte']} {{(pid=83259) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1387}} Sep 16 15:03:29 devstack cinder-volume[83259]: DEBUG cinder.volume.manager [None req-ae5ba4ba-426d-49d2-a00e-476daf35dea8 tempest-GroupSnapshotsTest-952387378 None] Flow 'volume_create_manager' (03be984e-797d-4cc4-b55f-9601d4001759) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83259) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 16 15:03:29 devstack cinder-volume[83259]: DEBUG cinder.volume.manager [None req-ae5ba4ba-426d-49d2-a00e-476daf35dea8 tempest-GroupSnapshotsTest-952387378 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ee6494ff-d2c6-48df-a72e-9960c4650b76) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83259) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 15:03:30 devstack cinder-volume[83259]: DEBUG cinder.volume.manager [None req-ae5ba4ba-426d-49d2-a00e-476daf35dea8 tempest-GroupSnapshotsTest-952387378 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ee6494ff-d2c6-48df-a72e-9960c4650b76) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-16T13:03:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-886552197',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=44f22eb4-895c-493e-9ba2-e86edff4a812,host='devstack@QuobyteHD#Quobyte',id=c07926ec-05c1-427f-ae0e-3b1c733903ea,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cec359ace651434bb4df79a6dcce9dbd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-16T13:03:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-16T13:03:30Z,use_quota=True,user_id='9e798fd1532a42df8e251d9d64138963',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(dae95775-8f00-4c1d-ad27-a6ee7167b106),volume_type_id=dae95775-8f00-4c1d-ad27-a6ee7167b106)' {{(pid=83259) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 15:03:30 devstack cinder-volume[83259]: DEBUG cinder.volume.manager [None req-ae5ba4ba-426d-49d2-a00e-476daf35dea8 tempest-GroupSnapshotsTest-952387378 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9ce38da9-6f65-46ab-b39a-8725efb543c5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83259) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 15:03:30 devstack cinder-volume[83259]: DEBUG cinder.volume.manager [None req-ae5ba4ba-426d-49d2-a00e-476daf35dea8 tempest-GroupSnapshotsTest-952387378 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9ce38da9-6f65-46ab-b39a-8725efb543c5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83259) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 15:03:30 devstack cinder-volume[83259]: DEBUG cinder.volume.manager [None req-ae5ba4ba-426d-49d2-a00e-476daf35dea8 tempest-GroupSnapshotsTest-952387378 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9c2279d0-0d09-49f2-992a-b02c69b790cc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83259) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 15:03:30 devstack cinder-volume[83259]: DEBUG cinder.volume.manager [None req-ae5ba4ba-426d-49d2-a00e-476daf35dea8 tempest-GroupSnapshotsTest-952387378 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9c2279d0-0d09-49f2-992a-b02c69b790cc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c07926ec-05c1-427f-ae0e-3b1c733903ea', 'volume_name': 'volume-c07926ec-05c1-427f-ae0e-3b1c733903ea', 'volume_size': 1}' {{(pid=83259) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 15:03:30 devstack cinder-volume[83259]: DEBUG cinder.volume.manager [None req-ae5ba4ba-426d-49d2-a00e-476daf35dea8 tempest-GroupSnapshotsTest-952387378 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5300ca5e-10d9-40ec-a182-5f35f031ed74) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83259) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 15:03:30 devstack cinder-volume[83259]: DEBUG cinder.volume.manager [None req-ae5ba4ba-426d-49d2-a00e-476daf35dea8 tempest-GroupSnapshotsTest-952387378 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5300ca5e-10d9-40ec-a182-5f35f031ed74) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83259) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 15:03:30 devstack cinder-volume[83259]: DEBUG cinder.volume.manager [None req-ae5ba4ba-426d-49d2-a00e-476daf35dea8 tempest-GroupSnapshotsTest-952387378 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0f883485-6e06-45d3-b6dc-3c4b56d98227) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83259) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 15:03:30 devstack cinder-volume[83259]: INFO cinder.volume.flows.manager.create_volume [None req-ae5ba4ba-426d-49d2-a00e-476daf35dea8 tempest-GroupSnapshotsTest-952387378 None] Volume c07926ec-05c1-427f-ae0e-3b1c733903ea: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c07926ec-05c1-427f-ae0e-3b1c733903ea', 'volume_size': 1} Sep 16 15:03:30 devstack cinder-volume[83259]: DEBUG oslo_concurrency.lockutils [None req-ae5ba4ba-426d-49d2-a00e-476daf35dea8 tempest-GroupSnapshotsTest-952387378 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83259) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 16 15:03:30 devstack cinder-volume[83259]: DEBUG oslo_concurrency.lockutils [None req-ae5ba4ba-426d-49d2-a00e-476daf35dea8 tempest-GroupSnapshotsTest-952387378 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=83259) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 16 15:03:30 devstack cinder-volume[83259]: DEBUG cinder.volume.drivers.quobyte [None req-ae5ba4ba-426d-49d2-a00e-476daf35dea8 tempest-GroupSnapshotsTest-952387378 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=44f22eb4-895c-493e-9ba2-e86edff4a812,created_at=2025-09-16T13:03:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-886552197',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=44f22eb4-895c-493e-9ba2-e86edff4a812,host='devstack@QuobyteHD#Quobyte',id=c07926ec-05c1-427f-ae0e-3b1c733903ea,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cec359ace651434bb4df79a6dcce9dbd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-16T13:03:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-16T13:03:30Z,use_quota=True,user_id='9e798fd1532a42df8e251d9d64138963',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(dae95775-8f00-4c1d-ad27-a6ee7167b106),volume_type_id=dae95775-8f00-4c1d-ad27-a6ee7167b106)}" {{(pid=83259) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Sep 16 15:03:30 devstack cinder-volume[83259]: DEBUG cinder.volume.drivers.remotefs [None req-ae5ba4ba-426d-49d2-a00e-476daf35dea8 tempest-GroupSnapshotsTest-952387378 None] Creating volume c07926ec-05c1-427f-ae0e-3b1c733903ea {{(pid=83259) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}} Sep 16 15:03:30 devstack cinder-volume[83259]: DEBUG oslo_concurrency.lockutils [None req-ae5ba4ba-426d-49d2-a00e-476daf35dea8 tempest-GroupSnapshotsTest-952387378 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83259) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 16 15:03:30 devstack cinder-volume[83259]: DEBUG oslo_concurrency.lockutils [None req-ae5ba4ba-426d-49d2-a00e-476daf35dea8 tempest-GroupSnapshotsTest-952387378 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83259) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 16 15:03:30 devstack cinder-volume[83259]: DEBUG cinder.volume.drivers.quobyte [None req-ae5ba4ba-426d-49d2-a00e-476daf35dea8 tempest-GroupSnapshotsTest-952387378 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-61f585ac-f8e2-4d19-a890-7ebc2726cc72': None} {{(pid=83259) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:639}} Sep 16 15:03:30 devstack cinder-volume[83259]: DEBUG cinder.volume.drivers.quobyte [None req-ae5ba4ba-426d-49d2-a00e-476daf35dea8 tempest-GroupSnapshotsTest-952387378 None] Available shares ['10.10.41.181/cinder-vol-61f585ac-f8e2-4d19-a890-7ebc2726cc72'] {{(pid=83259) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:669}} Sep 16 15:03:30 devstack cinder-volume[83259]: DEBUG oslo_concurrency.lockutils [None req-ae5ba4ba-426d-49d2-a00e-476daf35dea8 tempest-GroupSnapshotsTest-952387378 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=83259) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 16 15:03:30 devstack cinder-volume[83259]: DEBUG cinder.volume.drivers.quobyte [None req-ae5ba4ba-426d-49d2-a00e-476daf35dea8 tempest-GroupSnapshotsTest-952387378 None] Selected 10.10.41.181/cinder-vol-61f585ac-f8e2-4d19-a890-7ebc2726cc72 as target Quobyte volume. {{(pid=83259) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:690}} Sep 16 15:03:30 devstack cinder-volume[83259]: INFO cinder.volume.drivers.remotefs [None req-ae5ba4ba-426d-49d2-a00e-476daf35dea8 tempest-GroupSnapshotsTest-952387378 None] casted to 10.10.41.181/cinder-vol-61f585ac-f8e2-4d19-a890-7ebc2726cc72 Sep 16 15:03:30 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [None req-ae5ba4ba-426d-49d2-a00e-476daf35dea8 tempest-GroupSnapshotsTest-952387378 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c/volume-c07926ec-05c1-427f-ae0e-3b1c733903ea 1073741824 {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 15:03:30 devstack quobyte-client[83286]: The server volume:87712ffe-8a69-446d-9ed6-4430c7ee9792@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=87712ffe-8a69-446d-9ed6-4430c7ee9792, inode=30, name=volume-c07926ec-05c1-427f-ae0e-3b1c733903ea, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.206), requestorAccessMask=0 Sep 16 15:03:30 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [None req-ae5ba4ba-426d-49d2-a00e-476daf35dea8 tempest-GroupSnapshotsTest-952387378 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c/volume-c07926ec-05c1-427f-ae0e-3b1c733903ea 1073741824" returned: 0 in 0.359s {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 15:03:30 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [None req-ae5ba4ba-426d-49d2-a00e-476daf35dea8 tempest-GroupSnapshotsTest-952387378 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c/volume-c07926ec-05c1-427f-ae0e-3b1c733903ea {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 15:03:30 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [None req-ae5ba4ba-426d-49d2-a00e-476daf35dea8 tempest-GroupSnapshotsTest-952387378 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c/volume-c07926ec-05c1-427f-ae0e-3b1c733903ea" returned: 0 in 0.091s {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 15:03:30 devstack cinder-volume[83259]: DEBUG cinder.volume.drivers.quobyte [None req-ae5ba4ba-426d-49d2-a00e-476daf35dea8 tempest-GroupSnapshotsTest-952387378 None] <== create_volume: return (543ms) {'provider_location': '10.10.41.181/cinder-vol-61f585ac-f8e2-4d19-a890-7ebc2726cc72'} {{(pid=83259) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Sep 16 15:03:30 devstack cinder-volume[83259]: DEBUG oslo_concurrency.lockutils [None req-ae5ba4ba-426d-49d2-a00e-476daf35dea8 tempest-GroupSnapshotsTest-952387378 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.565s {{(pid=83259) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 16 15:03:31 devstack cinder-volume[83259]: DEBUG cinder.volume.manager [None req-ae5ba4ba-426d-49d2-a00e-476daf35dea8 tempest-GroupSnapshotsTest-952387378 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0f883485-6e06-45d3-b6dc-3c4b56d98227) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c07926ec-05c1-427f-ae0e-3b1c733903ea', 'volume_size': 1}' {{(pid=83259) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 15:03:31 devstack cinder-volume[83259]: DEBUG cinder.volume.manager [None req-ae5ba4ba-426d-49d2-a00e-476daf35dea8 tempest-GroupSnapshotsTest-952387378 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a7f38ef3-67f0-48a4-9716-916690312364) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83259) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 15:03:31 devstack cinder-volume[83259]: INFO cinder.volume.flows.manager.create_volume [None req-ae5ba4ba-426d-49d2-a00e-476daf35dea8 tempest-GroupSnapshotsTest-952387378 None] Volume volume-c07926ec-05c1-427f-ae0e-3b1c733903ea (c07926ec-05c1-427f-ae0e-3b1c733903ea): created successfully Sep 16 15:03:31 devstack cinder-volume[83259]: DEBUG cinder.volume.manager [None req-ae5ba4ba-426d-49d2-a00e-476daf35dea8 tempest-GroupSnapshotsTest-952387378 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a7f38ef3-67f0-48a4-9716-916690312364) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83259) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 15:03:31 devstack cinder-volume[83259]: DEBUG cinder.volume.manager [None req-ae5ba4ba-426d-49d2-a00e-476daf35dea8 tempest-GroupSnapshotsTest-952387378 None] Flow 'volume_create_manager' (03be984e-797d-4cc4-b55f-9601d4001759) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83259) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 16 15:03:31 devstack cinder-volume[83259]: INFO cinder.volume.manager [None req-ae5ba4ba-426d-49d2-a00e-476daf35dea8 tempest-GroupSnapshotsTest-952387378 None] Created volume successfully. Sep 16 15:03:31 devstack cinder-volume[83259]: WARNING cinder.volume.volume_utils [None req-005d2ad2-667b-4807-b3c4-316de79fbe6c tempest-SnapshotMetadataTestJSON-181553794 None] Volume driver (QuobyteDriver 1.2) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 16 15:03:32 devstack cinder-volume[83259]: DEBUG cinder.volume.flows.manager.create_volume [None req-005d2ad2-667b-4807-b3c4-316de79fbe6c tempest-SnapshotMetadataTestJSON-181553794 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#Quobyte'], 'hosts': ['devstack@QuobyteHD#Quobyte']} {{(pid=83259) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1387}} Sep 16 15:03:32 devstack cinder-volume[83259]: DEBUG cinder.volume.manager [None req-005d2ad2-667b-4807-b3c4-316de79fbe6c tempest-SnapshotMetadataTestJSON-181553794 None] Flow 'volume_create_manager' (54dfff06-bea2-4060-a5aa-8faa8b83b75d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83259) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 16 15:03:32 devstack cinder-volume[83259]: DEBUG cinder.volume.manager [None req-005d2ad2-667b-4807-b3c4-316de79fbe6c tempest-SnapshotMetadataTestJSON-181553794 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (10964d90-6075-46ca-980e-3d9988db02bb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83259) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 15:03:32 devstack cinder-volume[83259]: WARNING cinder.volume.volume_utils [req-987180d5-0da2-4548-bb62-37a081f24add req-d65a1fb0-3d94-49d5-86db-c859097db0e2 tempest-VolumesSnapshotsTestJSON-348981508 None] Volume driver (QuobyteDriver 1.2) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 16 15:03:32 devstack cinder-volume[83259]: DEBUG cinder.volume.flows.manager.create_volume [req-987180d5-0da2-4548-bb62-37a081f24add req-d65a1fb0-3d94-49d5-86db-c859097db0e2 tempest-VolumesSnapshotsTestJSON-348981508 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#Quobyte'], 'hosts': ['devstack@QuobyteHD#Quobyte']} {{(pid=83259) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1387}} Sep 16 15:03:32 devstack cinder-volume[83259]: DEBUG cinder.volume.manager [req-987180d5-0da2-4548-bb62-37a081f24add req-d65a1fb0-3d94-49d5-86db-c859097db0e2 tempest-VolumesSnapshotsTestJSON-348981508 None] Flow 'volume_create_manager' (7d08d24f-900f-4802-a7d7-2fcd0fad25ca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83259) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 16 15:03:32 devstack cinder-volume[83259]: DEBUG cinder.volume.manager [req-987180d5-0da2-4548-bb62-37a081f24add req-d65a1fb0-3d94-49d5-86db-c859097db0e2 tempest-VolumesSnapshotsTestJSON-348981508 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6bef693b-ae88-40a9-b535-ac8ba8c22846) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83259) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 15:03:32 devstack cinder-volume[83259]: DEBUG cinder.volume.manager [req-987180d5-0da2-4548-bb62-37a081f24add req-d65a1fb0-3d94-49d5-86db-c859097db0e2 tempest-VolumesSnapshotsTestJSON-348981508 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6bef693b-ae88-40a9-b535-ac8ba8c22846) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-16T13:03:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotsTestJSON-volume-523620668',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#Quobyte',id=c3a2e2ba-2fb4-42c7-bca0-b8e5e6de1d5d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6fbd7cc78d1a46829ecc27c495b5edb7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-16T13:03:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-16T13:03:32Z,use_quota=True,user_id='83138bccc0e44a03a78ac66976c92af6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(485ead50-3df8-4d76-8d34-a4db136c980a),volume_type_id=485ead50-3df8-4d76-8d34-a4db136c980a)' {{(pid=83259) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 15:03:32 devstack cinder-volume[83259]: DEBUG cinder.volume.manager [req-987180d5-0da2-4548-bb62-37a081f24add req-d65a1fb0-3d94-49d5-86db-c859097db0e2 tempest-VolumesSnapshotsTestJSON-348981508 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a6a31882-b338-4591-9c76-fa21090833c9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83259) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 15:03:32 devstack cinder-volume[83259]: DEBUG cinder.volume.manager [req-987180d5-0da2-4548-bb62-37a081f24add req-d65a1fb0-3d94-49d5-86db-c859097db0e2 tempest-VolumesSnapshotsTestJSON-348981508 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a6a31882-b338-4591-9c76-fa21090833c9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83259) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 15:03:32 devstack cinder-volume[83259]: DEBUG cinder.volume.manager [req-987180d5-0da2-4548-bb62-37a081f24add req-d65a1fb0-3d94-49d5-86db-c859097db0e2 tempest-VolumesSnapshotsTestJSON-348981508 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7cab3ffa-0dbf-429e-8d72-c427170f3cd7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83259) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 15:03:32 devstack cinder-volume[83259]: DEBUG cinder.volume.manager [req-987180d5-0da2-4548-bb62-37a081f24add req-d65a1fb0-3d94-49d5-86db-c859097db0e2 tempest-VolumesSnapshotsTestJSON-348981508 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7cab3ffa-0dbf-429e-8d72-c427170f3cd7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c3a2e2ba-2fb4-42c7-bca0-b8e5e6de1d5d', 'volume_name': 'volume-c3a2e2ba-2fb4-42c7-bca0-b8e5e6de1d5d', 'volume_size': 1}' {{(pid=83259) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 15:03:32 devstack cinder-volume[83259]: DEBUG cinder.volume.manager [req-987180d5-0da2-4548-bb62-37a081f24add req-d65a1fb0-3d94-49d5-86db-c859097db0e2 tempest-VolumesSnapshotsTestJSON-348981508 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0a574c13-f081-4e05-940b-23a06eb1a99a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83259) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 15:03:32 devstack cinder-volume[83259]: DEBUG cinder.volume.manager [req-987180d5-0da2-4548-bb62-37a081f24add req-d65a1fb0-3d94-49d5-86db-c859097db0e2 tempest-VolumesSnapshotsTestJSON-348981508 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0a574c13-f081-4e05-940b-23a06eb1a99a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83259) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 15:03:32 devstack cinder-volume[83259]: DEBUG cinder.volume.manager [req-987180d5-0da2-4548-bb62-37a081f24add req-d65a1fb0-3d94-49d5-86db-c859097db0e2 tempest-VolumesSnapshotsTestJSON-348981508 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e7d18bfa-7175-4f12-9ed7-da626e2c0313) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83259) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 15:03:32 devstack cinder-volume[83259]: INFO cinder.volume.flows.manager.create_volume [req-987180d5-0da2-4548-bb62-37a081f24add req-d65a1fb0-3d94-49d5-86db-c859097db0e2 tempest-VolumesSnapshotsTestJSON-348981508 None] Volume c3a2e2ba-2fb4-42c7-bca0-b8e5e6de1d5d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c3a2e2ba-2fb4-42c7-bca0-b8e5e6de1d5d', 'volume_size': 1} Sep 16 15:03:32 devstack cinder-volume[83259]: DEBUG oslo_concurrency.lockutils [req-987180d5-0da2-4548-bb62-37a081f24add req-d65a1fb0-3d94-49d5-86db-c859097db0e2 tempest-VolumesSnapshotsTestJSON-348981508 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83259) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 16 15:03:32 devstack cinder-volume[83259]: DEBUG oslo_concurrency.lockutils [req-987180d5-0da2-4548-bb62-37a081f24add req-d65a1fb0-3d94-49d5-86db-c859097db0e2 tempest-VolumesSnapshotsTestJSON-348981508 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=83259) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 16 15:03:32 devstack cinder-volume[83259]: DEBUG cinder.volume.drivers.quobyte [req-987180d5-0da2-4548-bb62-37a081f24add req-d65a1fb0-3d94-49d5-86db-c859097db0e2 tempest-VolumesSnapshotsTestJSON-348981508 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-16T13:03:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotsTestJSON-volume-523620668',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#Quobyte',id=c3a2e2ba-2fb4-42c7-bca0-b8e5e6de1d5d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6fbd7cc78d1a46829ecc27c495b5edb7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-16T13:03:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-16T13:03:32Z,use_quota=True,user_id='83138bccc0e44a03a78ac66976c92af6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(485ead50-3df8-4d76-8d34-a4db136c980a),volume_type_id=485ead50-3df8-4d76-8d34-a4db136c980a)}" {{(pid=83259) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Sep 16 15:03:32 devstack cinder-volume[83259]: DEBUG cinder.volume.drivers.remotefs [req-987180d5-0da2-4548-bb62-37a081f24add req-d65a1fb0-3d94-49d5-86db-c859097db0e2 tempest-VolumesSnapshotsTestJSON-348981508 None] Creating volume c3a2e2ba-2fb4-42c7-bca0-b8e5e6de1d5d {{(pid=83259) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}} Sep 16 15:03:32 devstack cinder-volume[83259]: DEBUG oslo_concurrency.lockutils [req-987180d5-0da2-4548-bb62-37a081f24add req-d65a1fb0-3d94-49d5-86db-c859097db0e2 tempest-VolumesSnapshotsTestJSON-348981508 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83259) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 16 15:03:32 devstack cinder-volume[83259]: DEBUG oslo_concurrency.lockutils [req-987180d5-0da2-4548-bb62-37a081f24add req-d65a1fb0-3d94-49d5-86db-c859097db0e2 tempest-VolumesSnapshotsTestJSON-348981508 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83259) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 16 15:03:32 devstack cinder-volume[83259]: DEBUG cinder.volume.drivers.quobyte [req-987180d5-0da2-4548-bb62-37a081f24add req-d65a1fb0-3d94-49d5-86db-c859097db0e2 tempest-VolumesSnapshotsTestJSON-348981508 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-61f585ac-f8e2-4d19-a890-7ebc2726cc72': None} {{(pid=83259) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:639}} Sep 16 15:03:32 devstack cinder-volume[83259]: DEBUG cinder.volume.drivers.quobyte [req-987180d5-0da2-4548-bb62-37a081f24add req-d65a1fb0-3d94-49d5-86db-c859097db0e2 tempest-VolumesSnapshotsTestJSON-348981508 None] Available shares ['10.10.41.181/cinder-vol-61f585ac-f8e2-4d19-a890-7ebc2726cc72'] {{(pid=83259) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:669}} Sep 16 15:03:32 devstack cinder-volume[83259]: DEBUG oslo_concurrency.lockutils [req-987180d5-0da2-4548-bb62-37a081f24add req-d65a1fb0-3d94-49d5-86db-c859097db0e2 tempest-VolumesSnapshotsTestJSON-348981508 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=83259) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 16 15:03:32 devstack cinder-volume[83259]: DEBUG cinder.volume.drivers.quobyte [req-987180d5-0da2-4548-bb62-37a081f24add req-d65a1fb0-3d94-49d5-86db-c859097db0e2 tempest-VolumesSnapshotsTestJSON-348981508 None] Selected 10.10.41.181/cinder-vol-61f585ac-f8e2-4d19-a890-7ebc2726cc72 as target Quobyte volume. {{(pid=83259) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:690}} Sep 16 15:03:32 devstack cinder-volume[83259]: INFO cinder.volume.drivers.remotefs [req-987180d5-0da2-4548-bb62-37a081f24add req-d65a1fb0-3d94-49d5-86db-c859097db0e2 tempest-VolumesSnapshotsTestJSON-348981508 None] casted to 10.10.41.181/cinder-vol-61f585ac-f8e2-4d19-a890-7ebc2726cc72 Sep 16 15:03:32 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [req-987180d5-0da2-4548-bb62-37a081f24add req-d65a1fb0-3d94-49d5-86db-c859097db0e2 tempest-VolumesSnapshotsTestJSON-348981508 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c/volume-c3a2e2ba-2fb4-42c7-bca0-b8e5e6de1d5d 1073741824 {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 15:03:32 devstack quobyte-client[83286]: System call of process 93000 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 16 15:03:32 devstack cinder-volume[83259]: DEBUG cinder.volume.manager [None req-005d2ad2-667b-4807-b3c4-316de79fbe6c tempest-SnapshotMetadataTestJSON-181553794 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (10964d90-6075-46ca-980e-3d9988db02bb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-16T13:03:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotMetadataTestJSON-Volume-1453186870',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#Quobyte',id=77ff9cd7-5ae7-4ee1-bcde-4d803f035927,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='92e5142b7a0c4c39b8c88ce8778bf83b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-16T13:03:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-16T13:03:32Z,use_quota=True,user_id='10cba3b5ea704250a138b75bddaed5c5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(485ead50-3df8-4d76-8d34-a4db136c980a),volume_type_id=485ead50-3df8-4d76-8d34-a4db136c980a)' {{(pid=83259) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 15:03:32 devstack quobyte-client[83286]: The server volume:87712ffe-8a69-446d-9ed6-4430c7ee9792@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=87712ffe-8a69-446d-9ed6-4430c7ee9792, inode=31, name=volume-c3a2e2ba-2fb4-42c7-bca0-b8e5e6de1d5d, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.206), requestorAccessMask=0 Sep 16 15:03:32 devstack cinder-volume[83259]: DEBUG cinder.volume.manager [None req-005d2ad2-667b-4807-b3c4-316de79fbe6c tempest-SnapshotMetadataTestJSON-181553794 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (218c8352-e9b2-47bc-859f-56fadeec5e87) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83259) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 15:03:32 devstack cinder-volume[83259]: DEBUG cinder.volume.manager [None req-005d2ad2-667b-4807-b3c4-316de79fbe6c tempest-SnapshotMetadataTestJSON-181553794 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (218c8352-e9b2-47bc-859f-56fadeec5e87) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83259) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 15:03:32 devstack cinder-volume[83259]: DEBUG cinder.volume.manager [None req-005d2ad2-667b-4807-b3c4-316de79fbe6c tempest-SnapshotMetadataTestJSON-181553794 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7117bf73-8170-4e90-8edb-e6931453eee4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83259) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 15:03:32 devstack cinder-volume[83259]: DEBUG cinder.volume.manager [None req-005d2ad2-667b-4807-b3c4-316de79fbe6c tempest-SnapshotMetadataTestJSON-181553794 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7117bf73-8170-4e90-8edb-e6931453eee4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '77ff9cd7-5ae7-4ee1-bcde-4d803f035927', 'volume_name': 'volume-77ff9cd7-5ae7-4ee1-bcde-4d803f035927', 'volume_size': 1}' {{(pid=83259) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 15:03:32 devstack cinder-volume[83259]: DEBUG cinder.volume.manager [None req-005d2ad2-667b-4807-b3c4-316de79fbe6c tempest-SnapshotMetadataTestJSON-181553794 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (349d6dfe-82db-4e91-b73d-39842f11baa2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83259) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 15:03:32 devstack cinder-volume[83259]: DEBUG cinder.volume.manager [None req-005d2ad2-667b-4807-b3c4-316de79fbe6c tempest-SnapshotMetadataTestJSON-181553794 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (349d6dfe-82db-4e91-b73d-39842f11baa2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83259) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 15:03:32 devstack cinder-volume[83259]: DEBUG cinder.volume.manager [None req-005d2ad2-667b-4807-b3c4-316de79fbe6c tempest-SnapshotMetadataTestJSON-181553794 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (33a94d20-ac75-4baa-a5af-257b5671579f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83259) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 15:03:32 devstack cinder-volume[83259]: INFO cinder.volume.flows.manager.create_volume [None req-005d2ad2-667b-4807-b3c4-316de79fbe6c tempest-SnapshotMetadataTestJSON-181553794 None] Volume 77ff9cd7-5ae7-4ee1-bcde-4d803f035927: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-77ff9cd7-5ae7-4ee1-bcde-4d803f035927', 'volume_size': 1} Sep 16 15:03:32 devstack cinder-volume[83259]: DEBUG oslo_concurrency.lockutils [None req-005d2ad2-667b-4807-b3c4-316de79fbe6c tempest-SnapshotMetadataTestJSON-181553794 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83259) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 16 15:03:32 devstack cinder-volume[83259]: INFO cinder.volume.manager [None req-eabfc16a-e549-4447-8de7-965c77be5d56 tempest-GroupSnapshotsTest-952387378 None] GroupSnapshot f6e4d3bc-5ad6-43e8-916d-44233e143490: creating. Sep 16 15:03:32 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [req-987180d5-0da2-4548-bb62-37a081f24add req-d65a1fb0-3d94-49d5-86db-c859097db0e2 tempest-VolumesSnapshotsTestJSON-348981508 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c/volume-c3a2e2ba-2fb4-42c7-bca0-b8e5e6de1d5d 1073741824" returned: 0 in 0.604s {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 15:03:32 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [req-987180d5-0da2-4548-bb62-37a081f24add req-d65a1fb0-3d94-49d5-86db-c859097db0e2 tempest-VolumesSnapshotsTestJSON-348981508 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c/volume-c3a2e2ba-2fb4-42c7-bca0-b8e5e6de1d5d {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 15:03:32 devstack cinder-volume[83259]: WARNING cinder.volume.volume_utils [None req-eabfc16a-e549-4447-8de7-965c77be5d56 tempest-GroupSnapshotsTest-952387378 None] Volume driver (QuobyteDriver 1.2) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 16 15:03:32 devstack cinder-volume[83259]: DEBUG cinder.volume.manager [None req-eabfc16a-e549-4447-8de7-965c77be5d56 tempest-GroupSnapshotsTest-952387378 None] Group snapshot f6e4d3bc-5ad6-43e8-916d-44233e143490: creating. {{(pid=83259) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4142}} Sep 16 15:03:33 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [req-987180d5-0da2-4548-bb62-37a081f24add req-d65a1fb0-3d94-49d5-86db-c859097db0e2 tempest-VolumesSnapshotsTestJSON-348981508 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c/volume-c3a2e2ba-2fb4-42c7-bca0-b8e5e6de1d5d" returned: 0 in 0.310s {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 15:03:33 devstack cinder-volume[83259]: DEBUG cinder.volume.drivers.quobyte [req-987180d5-0da2-4548-bb62-37a081f24add req-d65a1fb0-3d94-49d5-86db-c859097db0e2 tempest-VolumesSnapshotsTestJSON-348981508 None] <== create_volume: return (929ms) {'provider_location': '10.10.41.181/cinder-vol-61f585ac-f8e2-4d19-a890-7ebc2726cc72'} {{(pid=83259) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Sep 16 15:03:33 devstack cinder-volume[83259]: DEBUG oslo_concurrency.lockutils [req-987180d5-0da2-4548-bb62-37a081f24add req-d65a1fb0-3d94-49d5-86db-c859097db0e2 tempest-VolumesSnapshotsTestJSON-348981508 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.937s {{(pid=83259) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 16 15:03:33 devstack cinder-volume[83259]: DEBUG oslo_concurrency.lockutils [None req-005d2ad2-667b-4807-b3c4-316de79fbe6c tempest-SnapshotMetadataTestJSON-181553794 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.720s {{(pid=83259) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 16 15:03:33 devstack cinder-volume[83259]: DEBUG cinder.volume.drivers.quobyte [None req-005d2ad2-667b-4807-b3c4-316de79fbe6c tempest-SnapshotMetadataTestJSON-181553794 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-16T13:03:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotMetadataTestJSON-Volume-1453186870',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#Quobyte',id=77ff9cd7-5ae7-4ee1-bcde-4d803f035927,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='92e5142b7a0c4c39b8c88ce8778bf83b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-16T13:03:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-16T13:03:32Z,use_quota=True,user_id='10cba3b5ea704250a138b75bddaed5c5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(485ead50-3df8-4d76-8d34-a4db136c980a),volume_type_id=485ead50-3df8-4d76-8d34-a4db136c980a)}" {{(pid=83259) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Sep 16 15:03:33 devstack cinder-volume[83259]: DEBUG cinder.volume.drivers.remotefs [None req-005d2ad2-667b-4807-b3c4-316de79fbe6c tempest-SnapshotMetadataTestJSON-181553794 None] Creating volume 77ff9cd7-5ae7-4ee1-bcde-4d803f035927 {{(pid=83259) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}} Sep 16 15:03:33 devstack cinder-volume[83259]: DEBUG oslo_concurrency.lockutils [None req-005d2ad2-667b-4807-b3c4-316de79fbe6c tempest-SnapshotMetadataTestJSON-181553794 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83259) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 16 15:03:33 devstack cinder-volume[83259]: DEBUG oslo_concurrency.lockutils [None req-005d2ad2-667b-4807-b3c4-316de79fbe6c tempest-SnapshotMetadataTestJSON-181553794 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=83259) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 16 15:03:33 devstack cinder-volume[83259]: DEBUG cinder.volume.drivers.quobyte [None req-005d2ad2-667b-4807-b3c4-316de79fbe6c tempest-SnapshotMetadataTestJSON-181553794 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-61f585ac-f8e2-4d19-a890-7ebc2726cc72': None} {{(pid=83259) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:639}} Sep 16 15:03:33 devstack cinder-volume[83259]: DEBUG cinder.volume.drivers.quobyte [None req-005d2ad2-667b-4807-b3c4-316de79fbe6c tempest-SnapshotMetadataTestJSON-181553794 None] Available shares ['10.10.41.181/cinder-vol-61f585ac-f8e2-4d19-a890-7ebc2726cc72'] {{(pid=83259) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:669}} Sep 16 15:03:33 devstack cinder-volume[83259]: DEBUG oslo_concurrency.lockutils [None req-005d2ad2-667b-4807-b3c4-316de79fbe6c tempest-SnapshotMetadataTestJSON-181553794 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=83259) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 16 15:03:33 devstack cinder-volume[83259]: DEBUG cinder.volume.drivers.quobyte [None req-005d2ad2-667b-4807-b3c4-316de79fbe6c tempest-SnapshotMetadataTestJSON-181553794 None] Selected 10.10.41.181/cinder-vol-61f585ac-f8e2-4d19-a890-7ebc2726cc72 as target Quobyte volume. {{(pid=83259) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:690}} Sep 16 15:03:33 devstack cinder-volume[83259]: INFO cinder.volume.drivers.remotefs [None req-005d2ad2-667b-4807-b3c4-316de79fbe6c tempest-SnapshotMetadataTestJSON-181553794 None] casted to 10.10.41.181/cinder-vol-61f585ac-f8e2-4d19-a890-7ebc2726cc72 Sep 16 15:03:33 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [None req-005d2ad2-667b-4807-b3c4-316de79fbe6c tempest-SnapshotMetadataTestJSON-181553794 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c/volume-77ff9cd7-5ae7-4ee1-bcde-4d803f035927 1073741824 {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 15:03:33 devstack cinder-volume[83259]: DEBUG oslo_concurrency.lockutils [None req-eabfc16a-e549-4447-8de7-965c77be5d56 tempest-GroupSnapshotsTest-952387378 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=83259) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 16 15:03:33 devstack quobyte-client[83286]: System call of process 93005 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 16 15:03:33 devstack quobyte-client[83286]: The server volume:87712ffe-8a69-446d-9ed6-4430c7ee9792@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=87712ffe-8a69-446d-9ed6-4430c7ee9792, inode=32, name=volume-77ff9cd7-5ae7-4ee1-bcde-4d803f035927, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.206), requestorAccessMask=0 Sep 16 15:03:33 devstack cinder-volume[83259]: DEBUG cinder.volume.manager [req-987180d5-0da2-4548-bb62-37a081f24add req-d65a1fb0-3d94-49d5-86db-c859097db0e2 tempest-VolumesSnapshotsTestJSON-348981508 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e7d18bfa-7175-4f12-9ed7-da626e2c0313) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c3a2e2ba-2fb4-42c7-bca0-b8e5e6de1d5d', 'volume_size': 1}' {{(pid=83259) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 15:03:33 devstack cinder-volume[83259]: DEBUG cinder.volume.manager [req-987180d5-0da2-4548-bb62-37a081f24add req-d65a1fb0-3d94-49d5-86db-c859097db0e2 tempest-VolumesSnapshotsTestJSON-348981508 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d22ebda2-750a-4a25-b286-6771e5cd7936) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83259) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 15:03:33 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [None req-005d2ad2-667b-4807-b3c4-316de79fbe6c tempest-SnapshotMetadataTestJSON-181553794 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c/volume-77ff9cd7-5ae7-4ee1-bcde-4d803f035927 1073741824" returned: 0 in 0.397s {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 15:03:33 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [None req-005d2ad2-667b-4807-b3c4-316de79fbe6c tempest-SnapshotMetadataTestJSON-181553794 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c/volume-77ff9cd7-5ae7-4ee1-bcde-4d803f035927 {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 15:03:33 devstack cinder-volume[83259]: INFO cinder.volume.flows.manager.create_volume [req-987180d5-0da2-4548-bb62-37a081f24add req-d65a1fb0-3d94-49d5-86db-c859097db0e2 tempest-VolumesSnapshotsTestJSON-348981508 None] Volume volume-c3a2e2ba-2fb4-42c7-bca0-b8e5e6de1d5d (c3a2e2ba-2fb4-42c7-bca0-b8e5e6de1d5d): created successfully Sep 16 15:03:33 devstack cinder-volume[83259]: DEBUG cinder.volume.manager [req-987180d5-0da2-4548-bb62-37a081f24add req-d65a1fb0-3d94-49d5-86db-c859097db0e2 tempest-VolumesSnapshotsTestJSON-348981508 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d22ebda2-750a-4a25-b286-6771e5cd7936) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83259) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 15:03:33 devstack cinder-volume[83259]: DEBUG cinder.volume.manager [req-987180d5-0da2-4548-bb62-37a081f24add req-d65a1fb0-3d94-49d5-86db-c859097db0e2 tempest-VolumesSnapshotsTestJSON-348981508 None] Flow 'volume_create_manager' (7d08d24f-900f-4802-a7d7-2fcd0fad25ca) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83259) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 16 15:03:33 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [None req-005d2ad2-667b-4807-b3c4-316de79fbe6c tempest-SnapshotMetadataTestJSON-181553794 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c/volume-77ff9cd7-5ae7-4ee1-bcde-4d803f035927" returned: 0 in 0.305s {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 15:03:33 devstack cinder-volume[83259]: DEBUG cinder.volume.drivers.quobyte [None req-005d2ad2-667b-4807-b3c4-316de79fbe6c tempest-SnapshotMetadataTestJSON-181553794 None] <== create_volume: return (726ms) {'provider_location': '10.10.41.181/cinder-vol-61f585ac-f8e2-4d19-a890-7ebc2726cc72'} {{(pid=83259) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Sep 16 15:03:33 devstack cinder-volume[83259]: DEBUG oslo_concurrency.lockutils [None req-005d2ad2-667b-4807-b3c4-316de79fbe6c tempest-SnapshotMetadataTestJSON-181553794 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.739s {{(pid=83259) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 16 15:03:33 devstack cinder-volume[83259]: DEBUG oslo_concurrency.lockutils [None req-eabfc16a-e549-4447-8de7-965c77be5d56 tempest-GroupSnapshotsTest-952387378 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.658s {{(pid=83259) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 16 15:03:33 devstack cinder-volume[83259]: INFO cinder.volume.manager [req-987180d5-0da2-4548-bb62-37a081f24add req-d65a1fb0-3d94-49d5-86db-c859097db0e2 tempest-VolumesSnapshotsTestJSON-348981508 None] Created volume successfully. Sep 16 15:03:33 devstack cinder-volume[83259]: DEBUG cinder.volume.drivers.remotefs [None req-eabfc16a-e549-4447-8de7-965c77be5d56 tempest-GroupSnapshotsTest-952387378 None] Creating offline snapshot 5111884f-1a7a-4a95-9996-66a41c0c1aad of volume c07926ec-05c1-427f-ae0e-3b1c733903ea {{(pid=83259) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1694}} Sep 16 15:03:34 devstack cinder-volume[83259]: DEBUG cinder.volume.manager [None req-005d2ad2-667b-4807-b3c4-316de79fbe6c tempest-SnapshotMetadataTestJSON-181553794 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (33a94d20-ac75-4baa-a5af-257b5671579f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-77ff9cd7-5ae7-4ee1-bcde-4d803f035927', 'volume_size': 1}' {{(pid=83259) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 15:03:34 devstack cinder-volume[83259]: DEBUG cinder.volume.manager [None req-005d2ad2-667b-4807-b3c4-316de79fbe6c tempest-SnapshotMetadataTestJSON-181553794 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dfb5056c-d390-4564-8547-cfdf334e0ebb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83259) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 15:03:34 devstack cinder-volume[83259]: DEBUG oslo.privsep.daemon [-] privsep: reply[37ec50ef-3cf9-469d-969a-4ccff74f60f7]: (4, 'qcow2') {{(pid=84312) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 16 15:03:34 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [None req-eabfc16a-e549-4447-8de7-965c77be5d56 tempest-GroupSnapshotsTest-952387378 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c/volume-c07926ec-05c1-427f-ae0e-3b1c733903ea {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 15:03:34 devstack cinder-volume[83259]: INFO cinder.volume.flows.manager.create_volume [None req-005d2ad2-667b-4807-b3c4-316de79fbe6c tempest-SnapshotMetadataTestJSON-181553794 None] Volume volume-77ff9cd7-5ae7-4ee1-bcde-4d803f035927 (77ff9cd7-5ae7-4ee1-bcde-4d803f035927): created successfully Sep 16 15:03:34 devstack cinder-volume[83259]: DEBUG cinder.volume.manager [None req-005d2ad2-667b-4807-b3c4-316de79fbe6c tempest-SnapshotMetadataTestJSON-181553794 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dfb5056c-d390-4564-8547-cfdf334e0ebb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83259) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 15:03:34 devstack cinder-volume[83259]: DEBUG cinder.volume.manager [None req-005d2ad2-667b-4807-b3c4-316de79fbe6c tempest-SnapshotMetadataTestJSON-181553794 None] Flow 'volume_create_manager' (54dfff06-bea2-4060-a5aa-8faa8b83b75d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83259) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 16 15:03:34 devstack cinder-volume[83259]: INFO cinder.volume.manager [None req-005d2ad2-667b-4807-b3c4-316de79fbe6c tempest-SnapshotMetadataTestJSON-181553794 None] Created volume successfully. Sep 16 15:03:34 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [None req-eabfc16a-e549-4447-8de7-965c77be5d56 tempest-GroupSnapshotsTest-952387378 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c/volume-c07926ec-05c1-427f-ae0e-3b1c733903ea" returned: 0 in 0.548s {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 15:03:34 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [None req-eabfc16a-e549-4447-8de7-965c77be5d56 tempest-GroupSnapshotsTest-952387378 None] Running cmd (subprocess): qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c/volume-c07926ec-05c1-427f-ae0e-3b1c733903ea,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c/volume-c07926ec-05c1-427f-ae0e-3b1c733903ea.5111884f-1a7a-4a95-9996-66a41c0c1aad 1G {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 15:03:34 devstack quobyte-client[83286]: The server volume:87712ffe-8a69-446d-9ed6-4430c7ee9792@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=87712ffe-8a69-446d-9ed6-4430c7ee9792, inode=33, name=volume-c07926ec-05c1-427f-ae0e-3b1c733903ea.5111884f-1a7a-4a95-9996-66a41c0c1aad, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.206), requestorAccessMask=0 Sep 16 15:03:35 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [None req-eabfc16a-e549-4447-8de7-965c77be5d56 tempest-GroupSnapshotsTest-952387378 None] CMD "qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c/volume-c07926ec-05c1-427f-ae0e-3b1c733903ea,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c/volume-c07926ec-05c1-427f-ae0e-3b1c733903ea.5111884f-1a7a-4a95-9996-66a41c0c1aad 1G" returned: 0 in 0.487s {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 15:03:35 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [None req-eabfc16a-e549-4447-8de7-965c77be5d56 tempest-GroupSnapshotsTest-952387378 None] Running cmd (subprocess): qemu-img rebase -u -b volume-c07926ec-05c1-427f-ae0e-3b1c733903ea -F qcow2 /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c/volume-c07926ec-05c1-427f-ae0e-3b1c733903ea.5111884f-1a7a-4a95-9996-66a41c0c1aad {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 15:03:35 devstack cinder-volume[83259]: WARNING cinder.volume.volume_utils [req-08faee23-95bb-4adb-b221-246ceaffe960 req-77e53807-05a8-42b9-97ce-f0aa86ca483c tempest-VolumesSnapshotsTestJSON-348981508 None] Volume driver (QuobyteDriver 1.2) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 16 15:03:35 devstack cinder-volume[83259]: DEBUG oslo_concurrency.lockutils [req-08faee23-95bb-4adb-b221-246ceaffe960 req-77e53807-05a8-42b9-97ce-f0aa86ca483c tempest-VolumesSnapshotsTestJSON-348981508 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=83259) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 16 15:03:35 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [None req-eabfc16a-e549-4447-8de7-965c77be5d56 tempest-GroupSnapshotsTest-952387378 None] CMD "qemu-img rebase -u -b volume-c07926ec-05c1-427f-ae0e-3b1c733903ea -F qcow2 /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c/volume-c07926ec-05c1-427f-ae0e-3b1c733903ea.5111884f-1a7a-4a95-9996-66a41c0c1aad" returned: 0 in 0.213s {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 15:03:35 devstack cinder-volume[83259]: DEBUG cinder.volume.drivers.remotefs [None req-eabfc16a-e549-4447-8de7-965c77be5d56 tempest-GroupSnapshotsTest-952387378 None] File path /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c/volume-c07926ec-05c1-427f-ae0e-3b1c733903ea.5111884f-1a7a-4a95-9996-66a41c0c1aad is being set with permissions: 660 {{(pid=83259) _set_rw_permissions /opt/stack/cinder/cinder/volume/drivers/remotefs.py:492}} Sep 16 15:03:35 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [None req-eabfc16a-e549-4447-8de7-965c77be5d56 tempest-GroupSnapshotsTest-952387378 None] Running cmd (subprocess): chmod 660 /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c/volume-c07926ec-05c1-427f-ae0e-3b1c733903ea.5111884f-1a7a-4a95-9996-66a41c0c1aad {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 15:03:35 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [None req-eabfc16a-e549-4447-8de7-965c77be5d56 tempest-GroupSnapshotsTest-952387378 None] CMD "chmod 660 /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c/volume-c07926ec-05c1-427f-ae0e-3b1c733903ea.5111884f-1a7a-4a95-9996-66a41c0c1aad" returned: 0 in 0.316s {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 15:03:35 devstack cinder-volume[83259]: DEBUG cinder.volume.drivers.remotefs [None req-eabfc16a-e549-4447-8de7-965c77be5d56 tempest-GroupSnapshotsTest-952387378 None] Setting permissions: /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c/volume-c07926ec-05c1-427f-ae0e-3b1c733903ea -> 1000:1000 {{(pid=83259) _do_create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1584}} Sep 16 15:03:35 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [None req-eabfc16a-e549-4447-8de7-965c77be5d56 tempest-GroupSnapshotsTest-952387378 None] Running cmd (subprocess): chown --reference=/opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c/volume-c07926ec-05c1-427f-ae0e-3b1c733903ea /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c/volume-c07926ec-05c1-427f-ae0e-3b1c733903ea.5111884f-1a7a-4a95-9996-66a41c0c1aad {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 15:03:35 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [None req-eabfc16a-e549-4447-8de7-965c77be5d56 tempest-GroupSnapshotsTest-952387378 None] CMD "chown --reference=/opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c/volume-c07926ec-05c1-427f-ae0e-3b1c733903ea /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c/volume-c07926ec-05c1-427f-ae0e-3b1c733903ea.5111884f-1a7a-4a95-9996-66a41c0c1aad" returned: 0 in 0.231s {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 15:03:35 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [None req-eabfc16a-e549-4447-8de7-965c77be5d56 tempest-GroupSnapshotsTest-952387378 None] Running cmd (subprocess): truncate -s0 /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c/volume-c07926ec-05c1-427f-ae0e-3b1c733903ea.info {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 15:03:36 devstack cinder-volume[83259]: WARNING cinder.volume.volume_utils [None req-0a738af1-3edc-4b7c-a75a-4dcd64af25f4 tempest-SnapshotMetadataTestJSON-181553794 None] Volume driver (QuobyteDriver 1.2) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 16 15:03:36 devstack cinder-volume[83259]: DEBUG oslo_concurrency.lockutils [None req-0a738af1-3edc-4b7c-a75a-4dcd64af25f4 tempest-SnapshotMetadataTestJSON-181553794 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=83259) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 16 15:03:36 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [None req-eabfc16a-e549-4447-8de7-965c77be5d56 tempest-GroupSnapshotsTest-952387378 None] CMD "truncate -s0 /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c/volume-c07926ec-05c1-427f-ae0e-3b1c733903ea.info" returned: 0 in 0.174s {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 15:03:36 devstack cinder-volume[83259]: DEBUG cinder.volume.drivers.remotefs [None req-eabfc16a-e549-4447-8de7-965c77be5d56 tempest-GroupSnapshotsTest-952387378 None] File path /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c/volume-c07926ec-05c1-427f-ae0e-3b1c733903ea.info is being set with permissions: 660 {{(pid=83259) _set_rw_permissions /opt/stack/cinder/cinder/volume/drivers/remotefs.py:492}} Sep 16 15:03:36 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [None req-eabfc16a-e549-4447-8de7-965c77be5d56 tempest-GroupSnapshotsTest-952387378 None] Running cmd (subprocess): chmod 660 /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c/volume-c07926ec-05c1-427f-ae0e-3b1c733903ea.info {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 15:03:36 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [None req-eabfc16a-e549-4447-8de7-965c77be5d56 tempest-GroupSnapshotsTest-952387378 None] CMD "chmod 660 /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c/volume-c07926ec-05c1-427f-ae0e-3b1c733903ea.info" returned: 0 in 0.080s {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 15:03:36 devstack cinder-volume[83259]: DEBUG oslo_concurrency.lockutils [None req-eabfc16a-e549-4447-8de7-965c77be5d56 tempest-GroupSnapshotsTest-952387378 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.343s {{(pid=83259) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 16 15:03:36 devstack cinder-volume[83259]: DEBUG oslo_concurrency.lockutils [req-08faee23-95bb-4adb-b221-246ceaffe960 req-77e53807-05a8-42b9-97ce-f0aa86ca483c tempest-VolumesSnapshotsTestJSON-348981508 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 1.238s {{(pid=83259) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 16 15:03:36 devstack cinder-volume[83259]: DEBUG cinder.volume.drivers.remotefs [req-08faee23-95bb-4adb-b221-246ceaffe960 req-77e53807-05a8-42b9-97ce-f0aa86ca483c tempest-VolumesSnapshotsTestJSON-348981508 None] Creating offline snapshot e9215fbd-b24f-48c7-ae19-e8d37d94c205 of volume c3a2e2ba-2fb4-42c7-bca0-b8e5e6de1d5d {{(pid=83259) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1694}} Sep 16 15:03:36 devstack cinder-volume[83259]: DEBUG oslo.privsep.daemon [-] privsep: reply[f906a961-7cc6-464c-9d16-5fcc669e7a91]: (4, 'qcow2') {{(pid=84312) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 16 15:03:36 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [req-08faee23-95bb-4adb-b221-246ceaffe960 req-77e53807-05a8-42b9-97ce-f0aa86ca483c tempest-VolumesSnapshotsTestJSON-348981508 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c/volume-c3a2e2ba-2fb4-42c7-bca0-b8e5e6de1d5d {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 15:03:37 devstack cinder-volume[83259]: INFO cinder.volume.manager [None req-eabfc16a-e549-4447-8de7-965c77be5d56 tempest-GroupSnapshotsTest-952387378 None] group_snapshot f6e4d3bc-5ad6-43e8-916d-44233e143490: created successfully Sep 16 15:03:37 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [req-08faee23-95bb-4adb-b221-246ceaffe960 req-77e53807-05a8-42b9-97ce-f0aa86ca483c tempest-VolumesSnapshotsTestJSON-348981508 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c/volume-c3a2e2ba-2fb4-42c7-bca0-b8e5e6de1d5d" returned: 0 in 0.570s {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 15:03:37 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [req-08faee23-95bb-4adb-b221-246ceaffe960 req-77e53807-05a8-42b9-97ce-f0aa86ca483c tempest-VolumesSnapshotsTestJSON-348981508 None] Running cmd (subprocess): qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c/volume-c3a2e2ba-2fb4-42c7-bca0-b8e5e6de1d5d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c/volume-c3a2e2ba-2fb4-42c7-bca0-b8e5e6de1d5d.e9215fbd-b24f-48c7-ae19-e8d37d94c205 1G {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 15:03:37 devstack quobyte-client[83286]: The server volume:87712ffe-8a69-446d-9ed6-4430c7ee9792@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=87712ffe-8a69-446d-9ed6-4430c7ee9792, inode=35, name=volume-c3a2e2ba-2fb4-42c7-bca0-b8e5e6de1d5d.e9215fbd-b24f-48c7-ae19-e8d37d94c205, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.206), requestorAccessMask=0 Sep 16 15:03:37 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [req-08faee23-95bb-4adb-b221-246ceaffe960 req-77e53807-05a8-42b9-97ce-f0aa86ca483c tempest-VolumesSnapshotsTestJSON-348981508 None] CMD "qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c/volume-c3a2e2ba-2fb4-42c7-bca0-b8e5e6de1d5d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c/volume-c3a2e2ba-2fb4-42c7-bca0-b8e5e6de1d5d.e9215fbd-b24f-48c7-ae19-e8d37d94c205 1G" returned: 0 in 0.202s {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 15:03:37 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [req-08faee23-95bb-4adb-b221-246ceaffe960 req-77e53807-05a8-42b9-97ce-f0aa86ca483c tempest-VolumesSnapshotsTestJSON-348981508 None] Running cmd (subprocess): qemu-img rebase -u -b volume-c3a2e2ba-2fb4-42c7-bca0-b8e5e6de1d5d -F qcow2 /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c/volume-c3a2e2ba-2fb4-42c7-bca0-b8e5e6de1d5d.e9215fbd-b24f-48c7-ae19-e8d37d94c205 {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 15:03:37 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [req-08faee23-95bb-4adb-b221-246ceaffe960 req-77e53807-05a8-42b9-97ce-f0aa86ca483c tempest-VolumesSnapshotsTestJSON-348981508 None] CMD "qemu-img rebase -u -b volume-c3a2e2ba-2fb4-42c7-bca0-b8e5e6de1d5d -F qcow2 /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c/volume-c3a2e2ba-2fb4-42c7-bca0-b8e5e6de1d5d.e9215fbd-b24f-48c7-ae19-e8d37d94c205" returned: 0 in 0.163s {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 15:03:37 devstack cinder-volume[83259]: DEBUG cinder.volume.drivers.remotefs [req-08faee23-95bb-4adb-b221-246ceaffe960 req-77e53807-05a8-42b9-97ce-f0aa86ca483c tempest-VolumesSnapshotsTestJSON-348981508 None] File path /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c/volume-c3a2e2ba-2fb4-42c7-bca0-b8e5e6de1d5d.e9215fbd-b24f-48c7-ae19-e8d37d94c205 is being set with permissions: 660 {{(pid=83259) _set_rw_permissions /opt/stack/cinder/cinder/volume/drivers/remotefs.py:492}} Sep 16 15:03:37 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [req-08faee23-95bb-4adb-b221-246ceaffe960 req-77e53807-05a8-42b9-97ce-f0aa86ca483c tempest-VolumesSnapshotsTestJSON-348981508 None] Running cmd (subprocess): chmod 660 /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c/volume-c3a2e2ba-2fb4-42c7-bca0-b8e5e6de1d5d.e9215fbd-b24f-48c7-ae19-e8d37d94c205 {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 15:03:37 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [req-08faee23-95bb-4adb-b221-246ceaffe960 req-77e53807-05a8-42b9-97ce-f0aa86ca483c tempest-VolumesSnapshotsTestJSON-348981508 None] CMD "chmod 660 /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c/volume-c3a2e2ba-2fb4-42c7-bca0-b8e5e6de1d5d.e9215fbd-b24f-48c7-ae19-e8d37d94c205" returned: 0 in 0.087s {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 15:03:37 devstack cinder-volume[83259]: DEBUG cinder.volume.drivers.remotefs [req-08faee23-95bb-4adb-b221-246ceaffe960 req-77e53807-05a8-42b9-97ce-f0aa86ca483c tempest-VolumesSnapshotsTestJSON-348981508 None] Setting permissions: /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c/volume-c3a2e2ba-2fb4-42c7-bca0-b8e5e6de1d5d -> 1000:1000 {{(pid=83259) _do_create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1584}} Sep 16 15:03:37 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [req-08faee23-95bb-4adb-b221-246ceaffe960 req-77e53807-05a8-42b9-97ce-f0aa86ca483c tempest-VolumesSnapshotsTestJSON-348981508 None] Running cmd (subprocess): chown --reference=/opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c/volume-c3a2e2ba-2fb4-42c7-bca0-b8e5e6de1d5d /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c/volume-c3a2e2ba-2fb4-42c7-bca0-b8e5e6de1d5d.e9215fbd-b24f-48c7-ae19-e8d37d94c205 {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 15:03:37 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [req-08faee23-95bb-4adb-b221-246ceaffe960 req-77e53807-05a8-42b9-97ce-f0aa86ca483c tempest-VolumesSnapshotsTestJSON-348981508 None] CMD "chown --reference=/opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c/volume-c3a2e2ba-2fb4-42c7-bca0-b8e5e6de1d5d /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c/volume-c3a2e2ba-2fb4-42c7-bca0-b8e5e6de1d5d.e9215fbd-b24f-48c7-ae19-e8d37d94c205" returned: 0 in 0.087s {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 15:03:37 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [req-08faee23-95bb-4adb-b221-246ceaffe960 req-77e53807-05a8-42b9-97ce-f0aa86ca483c tempest-VolumesSnapshotsTestJSON-348981508 None] Running cmd (subprocess): truncate -s0 /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c/volume-c3a2e2ba-2fb4-42c7-bca0-b8e5e6de1d5d.info {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 15:03:38 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [req-08faee23-95bb-4adb-b221-246ceaffe960 req-77e53807-05a8-42b9-97ce-f0aa86ca483c tempest-VolumesSnapshotsTestJSON-348981508 None] CMD "truncate -s0 /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c/volume-c3a2e2ba-2fb4-42c7-bca0-b8e5e6de1d5d.info" returned: 0 in 0.113s {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 15:03:38 devstack cinder-volume[83259]: DEBUG cinder.volume.drivers.remotefs [req-08faee23-95bb-4adb-b221-246ceaffe960 req-77e53807-05a8-42b9-97ce-f0aa86ca483c tempest-VolumesSnapshotsTestJSON-348981508 None] File path /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c/volume-c3a2e2ba-2fb4-42c7-bca0-b8e5e6de1d5d.info is being set with permissions: 660 {{(pid=83259) _set_rw_permissions /opt/stack/cinder/cinder/volume/drivers/remotefs.py:492}} Sep 16 15:03:38 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [req-08faee23-95bb-4adb-b221-246ceaffe960 req-77e53807-05a8-42b9-97ce-f0aa86ca483c tempest-VolumesSnapshotsTestJSON-348981508 None] Running cmd (subprocess): chmod 660 /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c/volume-c3a2e2ba-2fb4-42c7-bca0-b8e5e6de1d5d.info {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 15:03:38 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [req-08faee23-95bb-4adb-b221-246ceaffe960 req-77e53807-05a8-42b9-97ce-f0aa86ca483c tempest-VolumesSnapshotsTestJSON-348981508 None] CMD "chmod 660 /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c/volume-c3a2e2ba-2fb4-42c7-bca0-b8e5e6de1d5d.info" returned: 0 in 0.103s {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 15:03:38 devstack cinder-volume[83259]: DEBUG oslo_concurrency.lockutils [req-08faee23-95bb-4adb-b221-246ceaffe960 req-77e53807-05a8-42b9-97ce-f0aa86ca483c tempest-VolumesSnapshotsTestJSON-348981508 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.656s {{(pid=83259) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 16 15:03:38 devstack cinder-volume[83259]: DEBUG oslo_concurrency.lockutils [None req-0a738af1-3edc-4b7c-a75a-4dcd64af25f4 tempest-SnapshotMetadataTestJSON-181553794 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 2.239s {{(pid=83259) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 16 15:03:38 devstack cinder-volume[83259]: DEBUG cinder.volume.drivers.remotefs [None req-0a738af1-3edc-4b7c-a75a-4dcd64af25f4 tempest-SnapshotMetadataTestJSON-181553794 None] Creating offline snapshot e02567ea-abba-476d-b457-e3f21a76b1b5 of volume 77ff9cd7-5ae7-4ee1-bcde-4d803f035927 {{(pid=83259) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1694}} Sep 16 15:03:38 devstack cinder-volume[83259]: DEBUG oslo.privsep.daemon [-] privsep: reply[18dc42e3-b5f8-41f1-a5e0-9e4f60dd209d]: (4, 'qcow2') {{(pid=84312) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 16 15:03:38 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [None req-0a738af1-3edc-4b7c-a75a-4dcd64af25f4 tempest-SnapshotMetadataTestJSON-181553794 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c/volume-77ff9cd7-5ae7-4ee1-bcde-4d803f035927 {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 15:03:38 devstack cinder-volume[83259]: INFO cinder.volume.manager [req-08faee23-95bb-4adb-b221-246ceaffe960 req-77e53807-05a8-42b9-97ce-f0aa86ca483c tempest-VolumesSnapshotsTestJSON-348981508 None] Create snapshot completed successfully Sep 16 15:03:38 devstack quobyte-client[83286]: System call of process 93044 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 16 15:03:38 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [None req-0a738af1-3edc-4b7c-a75a-4dcd64af25f4 tempest-SnapshotMetadataTestJSON-181553794 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c/volume-77ff9cd7-5ae7-4ee1-bcde-4d803f035927" returned: 0 in 0.524s {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 15:03:38 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [None req-0a738af1-3edc-4b7c-a75a-4dcd64af25f4 tempest-SnapshotMetadataTestJSON-181553794 None] Running cmd (subprocess): qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c/volume-77ff9cd7-5ae7-4ee1-bcde-4d803f035927,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c/volume-77ff9cd7-5ae7-4ee1-bcde-4d803f035927.e02567ea-abba-476d-b457-e3f21a76b1b5 1G {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 15:03:39 devstack quobyte-client[83286]: The server volume:87712ffe-8a69-446d-9ed6-4430c7ee9792@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=87712ffe-8a69-446d-9ed6-4430c7ee9792, inode=37, name=volume-77ff9cd7-5ae7-4ee1-bcde-4d803f035927.e02567ea-abba-476d-b457-e3f21a76b1b5, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.206), requestorAccessMask=0 Sep 16 15:03:39 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [None req-0a738af1-3edc-4b7c-a75a-4dcd64af25f4 tempest-SnapshotMetadataTestJSON-181553794 None] CMD "qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c/volume-77ff9cd7-5ae7-4ee1-bcde-4d803f035927,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c/volume-77ff9cd7-5ae7-4ee1-bcde-4d803f035927.e02567ea-abba-476d-b457-e3f21a76b1b5 1G" returned: 0 in 0.230s {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 15:03:39 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [None req-0a738af1-3edc-4b7c-a75a-4dcd64af25f4 tempest-SnapshotMetadataTestJSON-181553794 None] Running cmd (subprocess): qemu-img rebase -u -b volume-77ff9cd7-5ae7-4ee1-bcde-4d803f035927 -F qcow2 /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c/volume-77ff9cd7-5ae7-4ee1-bcde-4d803f035927.e02567ea-abba-476d-b457-e3f21a76b1b5 {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 15:03:39 devstack cinder-volume[83259]: DEBUG cinder.coordination [req-44a25713-e2ab-41cf-a3b0-799f75f78ddc req-2c39ce91-d699-4c19-bd09-72e0efb672da tempest-VolumesSnapshotsTestJSON-348981508 None] Acquiring lock "cinder-e9215fbd-b24f-48c7-ae19-e8d37d94c205-delete_snapshot" by "delete_snapshot" {{(pid=83259) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 16 15:03:39 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [None req-0a738af1-3edc-4b7c-a75a-4dcd64af25f4 tempest-SnapshotMetadataTestJSON-181553794 None] CMD "qemu-img rebase -u -b volume-77ff9cd7-5ae7-4ee1-bcde-4d803f035927 -F qcow2 /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c/volume-77ff9cd7-5ae7-4ee1-bcde-4d803f035927.e02567ea-abba-476d-b457-e3f21a76b1b5" returned: 0 in 0.491s {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 15:03:39 devstack cinder-volume[83259]: DEBUG cinder.volume.drivers.remotefs [None req-0a738af1-3edc-4b7c-a75a-4dcd64af25f4 tempest-SnapshotMetadataTestJSON-181553794 None] File path /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c/volume-77ff9cd7-5ae7-4ee1-bcde-4d803f035927.e02567ea-abba-476d-b457-e3f21a76b1b5 is being set with permissions: 660 {{(pid=83259) _set_rw_permissions /opt/stack/cinder/cinder/volume/drivers/remotefs.py:492}} Sep 16 15:03:39 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [None req-0a738af1-3edc-4b7c-a75a-4dcd64af25f4 tempest-SnapshotMetadataTestJSON-181553794 None] Running cmd (subprocess): chmod 660 /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c/volume-77ff9cd7-5ae7-4ee1-bcde-4d803f035927.e02567ea-abba-476d-b457-e3f21a76b1b5 {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 15:03:40 devstack cinder-volume[83259]: WARNING cinder.volume.volume_utils [None req-f72a8f59-e018-4047-9a81-cf31f8b66434 tempest-GroupSnapshotsTest-952387378 None] Volume driver (QuobyteDriver 1.2) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 16 15:03:40 devstack cinder-volume[83259]: DEBUG cinder.coordination [req-44a25713-e2ab-41cf-a3b0-799f75f78ddc req-2c39ce91-d699-4c19-bd09-72e0efb672da tempest-VolumesSnapshotsTestJSON-348981508 None] Lock "cinder-e9215fbd-b24f-48c7-ae19-e8d37d94c205-delete_snapshot" acquired by "delete_snapshot" :: waited 0.706s {{(pid=83259) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 16 15:03:40 devstack cinder-volume[83259]: WARNING cinder.volume.volume_utils [req-44a25713-e2ab-41cf-a3b0-799f75f78ddc req-2c39ce91-d699-4c19-bd09-72e0efb672da tempest-VolumesSnapshotsTestJSON-348981508 None] Volume driver (QuobyteDriver 1.2) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 16 15:03:40 devstack cinder-volume[83259]: DEBUG cinder.coordination [req-44a25713-e2ab-41cf-a3b0-799f75f78ddc req-2c39ce91-d699-4c19-bd09-72e0efb672da tempest-VolumesSnapshotsTestJSON-348981508 None] Acquiring lock "cinder-quobyte-c3a2e2ba-2fb4-42c7-bca0-b8e5e6de1d5d" by "delete_snapshot" {{(pid=83259) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 16 15:03:40 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [None req-0a738af1-3edc-4b7c-a75a-4dcd64af25f4 tempest-SnapshotMetadataTestJSON-181553794 None] CMD "chmod 660 /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c/volume-77ff9cd7-5ae7-4ee1-bcde-4d803f035927.e02567ea-abba-476d-b457-e3f21a76b1b5" returned: 0 in 0.656s {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 15:03:40 devstack cinder-volume[83259]: DEBUG cinder.volume.drivers.remotefs [None req-0a738af1-3edc-4b7c-a75a-4dcd64af25f4 tempest-SnapshotMetadataTestJSON-181553794 None] Setting permissions: /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c/volume-77ff9cd7-5ae7-4ee1-bcde-4d803f035927 -> 1000:1000 {{(pid=83259) _do_create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1584}} Sep 16 15:03:40 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [None req-0a738af1-3edc-4b7c-a75a-4dcd64af25f4 tempest-SnapshotMetadataTestJSON-181553794 None] Running cmd (subprocess): chown --reference=/opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c/volume-77ff9cd7-5ae7-4ee1-bcde-4d803f035927 /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c/volume-77ff9cd7-5ae7-4ee1-bcde-4d803f035927.e02567ea-abba-476d-b457-e3f21a76b1b5 {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 15:03:40 devstack cinder-volume[83259]: DEBUG oslo_concurrency.lockutils [None req-f72a8f59-e018-4047-9a81-cf31f8b66434 tempest-GroupSnapshotsTest-952387378 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=83259) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 16 15:03:40 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [None req-0a738af1-3edc-4b7c-a75a-4dcd64af25f4 tempest-SnapshotMetadataTestJSON-181553794 None] CMD "chown --reference=/opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c/volume-77ff9cd7-5ae7-4ee1-bcde-4d803f035927 /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c/volume-77ff9cd7-5ae7-4ee1-bcde-4d803f035927.e02567ea-abba-476d-b457-e3f21a76b1b5" returned: 0 in 0.276s {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 15:03:40 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [None req-0a738af1-3edc-4b7c-a75a-4dcd64af25f4 tempest-SnapshotMetadataTestJSON-181553794 None] Running cmd (subprocess): truncate -s0 /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c/volume-77ff9cd7-5ae7-4ee1-bcde-4d803f035927.info {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 15:03:40 devstack cinder-volume[83259]: DEBUG cinder.coordination [req-44a25713-e2ab-41cf-a3b0-799f75f78ddc req-2c39ce91-d699-4c19-bd09-72e0efb672da tempest-VolumesSnapshotsTestJSON-348981508 None] Lock "cinder-quobyte-c3a2e2ba-2fb4-42c7-bca0-b8e5e6de1d5d" acquired by "delete_snapshot" :: waited 0.407s {{(pid=83259) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 16 15:03:40 devstack cinder-volume[83259]: DEBUG cinder.coordination [req-44a25713-e2ab-41cf-a3b0-799f75f78ddc req-2c39ce91-d699-4c19-bd09-72e0efb672da tempest-VolumesSnapshotsTestJSON-348981508 None] Acquiring lock "cinder-quobyte-e9215fbd-b24f-48c7-ae19-e8d37d94c205" by "_delete_snapshot" {{(pid=83259) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 16 15:03:40 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [None req-0a738af1-3edc-4b7c-a75a-4dcd64af25f4 tempest-SnapshotMetadataTestJSON-181553794 None] CMD "truncate -s0 /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c/volume-77ff9cd7-5ae7-4ee1-bcde-4d803f035927.info" returned: 0 in 0.199s {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 15:03:40 devstack cinder-volume[83259]: DEBUG cinder.volume.drivers.remotefs [None req-0a738af1-3edc-4b7c-a75a-4dcd64af25f4 tempest-SnapshotMetadataTestJSON-181553794 None] File path /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c/volume-77ff9cd7-5ae7-4ee1-bcde-4d803f035927.info is being set with permissions: 660 {{(pid=83259) _set_rw_permissions /opt/stack/cinder/cinder/volume/drivers/remotefs.py:492}} Sep 16 15:03:40 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [None req-0a738af1-3edc-4b7c-a75a-4dcd64af25f4 tempest-SnapshotMetadataTestJSON-181553794 None] Running cmd (subprocess): chmod 660 /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c/volume-77ff9cd7-5ae7-4ee1-bcde-4d803f035927.info {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 15:03:41 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [None req-0a738af1-3edc-4b7c-a75a-4dcd64af25f4 tempest-SnapshotMetadataTestJSON-181553794 None] CMD "chmod 660 /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c/volume-77ff9cd7-5ae7-4ee1-bcde-4d803f035927.info" returned: 0 in 0.126s {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 15:03:41 devstack cinder-volume[83259]: DEBUG oslo_concurrency.lockutils [None req-0a738af1-3edc-4b7c-a75a-4dcd64af25f4 tempest-SnapshotMetadataTestJSON-181553794 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.756s {{(pid=83259) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 16 15:03:41 devstack cinder-volume[83259]: DEBUG cinder.coordination [req-44a25713-e2ab-41cf-a3b0-799f75f78ddc req-2c39ce91-d699-4c19-bd09-72e0efb672da tempest-VolumesSnapshotsTestJSON-348981508 None] Lock "cinder-quobyte-e9215fbd-b24f-48c7-ae19-e8d37d94c205" acquired by "_delete_snapshot" :: waited 0.412s {{(pid=83259) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 16 15:03:41 devstack cinder-volume[83259]: DEBUG cinder.volume.drivers.remotefs [req-44a25713-e2ab-41cf-a3b0-799f75f78ddc req-2c39ce91-d699-4c19-bd09-72e0efb672da tempest-VolumesSnapshotsTestJSON-348981508 None] Deleting offline snapshot e9215fbd-b24f-48c7-ae19-e8d37d94c205 of volume c3a2e2ba-2fb4-42c7-bca0-b8e5e6de1d5d {{(pid=83259) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1278}} Sep 16 15:03:41 devstack cinder-volume[83259]: DEBUG cinder.volume.drivers.remotefs [req-44a25713-e2ab-41cf-a3b0-799f75f78ddc req-2c39ce91-d699-4c19-bd09-72e0efb672da tempest-VolumesSnapshotsTestJSON-348981508 None] snapshot_file for this snap is: volume-c3a2e2ba-2fb4-42c7-bca0-b8e5e6de1d5d.e9215fbd-b24f-48c7-ae19-e8d37d94c205 {{(pid=83259) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1307}} Sep 16 15:03:41 devstack cinder-volume[83259]: DEBUG oslo_concurrency.lockutils [None req-f72a8f59-e018-4047-9a81-cf31f8b66434 tempest-GroupSnapshotsTest-952387378 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.625s {{(pid=83259) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 16 15:03:41 devstack cinder-volume[83259]: DEBUG cinder.coordination [None req-f72a8f59-e018-4047-9a81-cf31f8b66434 tempest-GroupSnapshotsTest-952387378 None] Acquiring lock "cinder-quobyte-5111884f-1a7a-4a95-9996-66a41c0c1aad-4da12494-bdf5-4350-9384-301bf200e7c8" by "_create_volume_from_snapshot" {{(pid=83259) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 16 15:03:41 devstack cinder-volume[83259]: DEBUG oslo.privsep.daemon [-] privsep: reply[9f8f2be6-c195-44e3-84bc-81a9cce0967a]: (4, 'qcow2') {{(pid=84312) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 16 15:03:41 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [req-44a25713-e2ab-41cf-a3b0-799f75f78ddc req-2c39ce91-d699-4c19-bd09-72e0efb672da tempest-VolumesSnapshotsTestJSON-348981508 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c/volume-c3a2e2ba-2fb4-42c7-bca0-b8e5e6de1d5d.e9215fbd-b24f-48c7-ae19-e8d37d94c205 {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 15:03:41 devstack cinder-volume[83259]: INFO cinder.volume.manager [None req-0a738af1-3edc-4b7c-a75a-4dcd64af25f4 tempest-SnapshotMetadataTestJSON-181553794 None] Create snapshot completed successfully Sep 16 15:03:41 devstack cinder-volume[83259]: DEBUG cinder.coordination [None req-f72a8f59-e018-4047-9a81-cf31f8b66434 tempest-GroupSnapshotsTest-952387378 None] Lock "cinder-quobyte-5111884f-1a7a-4a95-9996-66a41c0c1aad-4da12494-bdf5-4350-9384-301bf200e7c8" acquired by "_create_volume_from_snapshot" :: waited 0.355s {{(pid=83259) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 16 15:03:41 devstack cinder-volume[83259]: DEBUG cinder.volume.drivers.quobyte [None req-f72a8f59-e018-4047-9a81-cf31f8b66434 tempest-GroupSnapshotsTest-952387378 None] Creating volume 4da12494-bdf5-4350-9384-301bf200e7c8 from snapshot 5111884f-1a7a-4a95-9996-66a41c0c1aad {{(pid=83259) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:361}} Sep 16 15:03:41 devstack cinder-volume[83259]: DEBUG oslo_concurrency.lockutils [None req-f72a8f59-e018-4047-9a81-cf31f8b66434 tempest-GroupSnapshotsTest-952387378 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83259) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 16 15:03:41 devstack cinder-volume[83259]: DEBUG oslo_concurrency.lockutils [None req-f72a8f59-e018-4047-9a81-cf31f8b66434 tempest-GroupSnapshotsTest-952387378 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=83259) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 16 15:03:41 devstack cinder-volume[83259]: DEBUG cinder.volume.drivers.quobyte [None req-f72a8f59-e018-4047-9a81-cf31f8b66434 tempest-GroupSnapshotsTest-952387378 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-61f585ac-f8e2-4d19-a890-7ebc2726cc72': None} {{(pid=83259) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:639}} Sep 16 15:03:41 devstack cinder-volume[83259]: DEBUG cinder.volume.drivers.quobyte [None req-f72a8f59-e018-4047-9a81-cf31f8b66434 tempest-GroupSnapshotsTest-952387378 None] Available shares ['10.10.41.181/cinder-vol-61f585ac-f8e2-4d19-a890-7ebc2726cc72'] {{(pid=83259) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:669}} Sep 16 15:03:41 devstack cinder-volume[83259]: DEBUG oslo_concurrency.lockutils [None req-f72a8f59-e018-4047-9a81-cf31f8b66434 tempest-GroupSnapshotsTest-952387378 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=83259) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 16 15:03:41 devstack cinder-volume[83259]: DEBUG cinder.volume.drivers.quobyte [None req-f72a8f59-e018-4047-9a81-cf31f8b66434 tempest-GroupSnapshotsTest-952387378 None] Selected 10.10.41.181/cinder-vol-61f585ac-f8e2-4d19-a890-7ebc2726cc72 as target Quobyte volume. {{(pid=83259) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:690}} Sep 16 15:03:41 devstack cinder-volume[83259]: DEBUG cinder.coordination [None req-f72a8f59-e018-4047-9a81-cf31f8b66434 tempest-GroupSnapshotsTest-952387378 None] Acquiring lock "cinder-quobyte-4da12494-bdf5-4350-9384-301bf200e7c8" by "_copy_volume_from_snapshot" {{(pid=83259) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 16 15:03:41 devstack cinder-volume[83259]: DEBUG cinder.coordination [None req-f72a8f59-e018-4047-9a81-cf31f8b66434 tempest-GroupSnapshotsTest-952387378 None] Lock "cinder-quobyte-4da12494-bdf5-4350-9384-301bf200e7c8" acquired by "_copy_volume_from_snapshot" :: waited 0.038s {{(pid=83259) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 16 15:03:41 devstack cinder-volume[83259]: DEBUG cinder.volume.drivers.quobyte [None req-f72a8f59-e018-4047-9a81-cf31f8b66434 tempest-GroupSnapshotsTest-952387378 None] snapshot: 5111884f-1a7a-4a95-9996-66a41c0c1aad, volume: 4da12494-bdf5-4350-9384-301bf200e7c8, {{(pid=83259) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:406}} Sep 16 15:03:41 devstack cinder-volume[83259]: DEBUG oslo_concurrency.lockutils [None req-f72a8f59-e018-4047-9a81-cf31f8b66434 tempest-GroupSnapshotsTest-952387378 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83259) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 16 15:03:41 devstack cinder-volume[83259]: DEBUG oslo_concurrency.lockutils [None req-f72a8f59-e018-4047-9a81-cf31f8b66434 tempest-GroupSnapshotsTest-952387378 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83259) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 16 15:03:41 devstack cinder-volume[83259]: DEBUG cinder.volume.drivers.quobyte [None req-f72a8f59-e018-4047-9a81-cf31f8b66434 tempest-GroupSnapshotsTest-952387378 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-61f585ac-f8e2-4d19-a890-7ebc2726cc72': None} {{(pid=83259) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:639}} Sep 16 15:03:41 devstack cinder-volume[83259]: DEBUG cinder.volume.drivers.quobyte [None req-f72a8f59-e018-4047-9a81-cf31f8b66434 tempest-GroupSnapshotsTest-952387378 None] Available shares ['10.10.41.181/cinder-vol-61f585ac-f8e2-4d19-a890-7ebc2726cc72'] {{(pid=83259) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:669}} Sep 16 15:03:41 devstack cinder-volume[83259]: DEBUG oslo_concurrency.lockutils [None req-f72a8f59-e018-4047-9a81-cf31f8b66434 tempest-GroupSnapshotsTest-952387378 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.002s {{(pid=83259) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 16 15:03:41 devstack cinder-volume[83259]: DEBUG oslo.privsep.daemon [-] privsep: reply[25cefb42-d3e2-4732-8d3a-77ee048ed5a6]: (4, 'qcow2') {{(pid=84312) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 16 15:03:41 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [None req-f72a8f59-e018-4047-9a81-cf31f8b66434 tempest-GroupSnapshotsTest-952387378 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c/volume-c07926ec-05c1-427f-ae0e-3b1c733903ea.5111884f-1a7a-4a95-9996-66a41c0c1aad {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 15:03:42 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [req-44a25713-e2ab-41cf-a3b0-799f75f78ddc req-2c39ce91-d699-4c19-bd09-72e0efb672da tempest-VolumesSnapshotsTestJSON-348981508 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c/volume-c3a2e2ba-2fb4-42c7-bca0-b8e5e6de1d5d.e9215fbd-b24f-48c7-ae19-e8d37d94c205" returned: 0 in 0.718s {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 15:03:42 devstack cinder-volume[83259]: DEBUG cinder.volume.drivers.remotefs [req-44a25713-e2ab-41cf-a3b0-799f75f78ddc req-2c39ce91-d699-4c19-bd09-72e0efb672da tempest-VolumesSnapshotsTestJSON-348981508 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-c3a2e2ba-2fb4-42c7-bca0-b8e5e6de1d5d(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83259) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:886}} Sep 16 15:03:42 devstack cinder-volume[83259]: DEBUG oslo.privsep.daemon [-] privsep: reply[b190f247-9378-426d-965e-25e411e5d47e]: (4, 'qcow2') {{(pid=84312) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 16 15:03:42 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [req-44a25713-e2ab-41cf-a3b0-799f75f78ddc req-2c39ce91-d699-4c19-bd09-72e0efb672da tempest-VolumesSnapshotsTestJSON-348981508 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c/volume-c3a2e2ba-2fb4-42c7-bca0-b8e5e6de1d5d {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 15:03:42 devstack quobyte-client[83286]: System call of process 93058 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 16 15:03:42 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [None req-f72a8f59-e018-4047-9a81-cf31f8b66434 tempest-GroupSnapshotsTest-952387378 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c/volume-c07926ec-05c1-427f-ae0e-3b1c733903ea.5111884f-1a7a-4a95-9996-66a41c0c1aad" returned: 0 in 0.649s {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 15:03:42 devstack cinder-volume[83259]: DEBUG cinder.volume.drivers.remotefs [None req-f72a8f59-e018-4047-9a81-cf31f8b66434 tempest-GroupSnapshotsTest-952387378 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-c07926ec-05c1-427f-ae0e-3b1c733903ea(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83259) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:886}} Sep 16 15:03:42 devstack cinder-volume[83259]: DEBUG cinder.volume.drivers.quobyte [None req-f72a8f59-e018-4047-9a81-cf31f8b66434 tempest-GroupSnapshotsTest-952387378 None] will copy from snapshot at /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c/volume-c07926ec-05c1-427f-ae0e-3b1c733903ea {{(pid=83259) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:425}} Sep 16 15:03:42 devstack cinder-volume[83259]: DEBUG cinder.volume.drivers.quobyte [None req-f72a8f59-e018-4047-9a81-cf31f8b66434 tempest-GroupSnapshotsTest-952387378 None] Creating direct copy from snapshot {{(pid=83259) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:433}} Sep 16 15:03:42 devstack cinder-volume[83259]: DEBUG oslo.privsep.daemon [-] privsep: reply[f56bc099-42ed-4708-a55a-accf7ab19e16]: (4, 'qcow2') {{(pid=84312) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 16 15:03:42 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [None req-f72a8f59-e018-4047-9a81-cf31f8b66434 tempest-GroupSnapshotsTest-952387378 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c/volume-c07926ec-05c1-427f-ae0e-3b1c733903ea {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 15:03:42 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [req-44a25713-e2ab-41cf-a3b0-799f75f78ddc req-2c39ce91-d699-4c19-bd09-72e0efb672da tempest-VolumesSnapshotsTestJSON-348981508 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c/volume-c3a2e2ba-2fb4-42c7-bca0-b8e5e6de1d5d" returned: 0 in 0.678s {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 15:03:42 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [req-44a25713-e2ab-41cf-a3b0-799f75f78ddc req-2c39ce91-d699-4c19-bd09-72e0efb672da tempest-VolumesSnapshotsTestJSON-348981508 None] Running cmd (subprocess): qemu-img commit -d /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c/volume-c3a2e2ba-2fb4-42c7-bca0-b8e5e6de1d5d.e9215fbd-b24f-48c7-ae19-e8d37d94c205 {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 15:03:43 devstack cinder-volume[83259]: DEBUG cinder.coordination [None req-4d0379cf-f661-4e1f-adda-716e18e863da tempest-SnapshotMetadataTestJSON-181553794 None] Acquiring lock "cinder-e02567ea-abba-476d-b457-e3f21a76b1b5-delete_snapshot" by "delete_snapshot" {{(pid=83259) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 16 15:03:43 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [req-44a25713-e2ab-41cf-a3b0-799f75f78ddc req-2c39ce91-d699-4c19-bd09-72e0efb672da tempest-VolumesSnapshotsTestJSON-348981508 None] CMD "qemu-img commit -d /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c/volume-c3a2e2ba-2fb4-42c7-bca0-b8e5e6de1d5d.e9215fbd-b24f-48c7-ae19-e8d37d94c205" returned: 0 in 0.579s {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 15:03:43 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [None req-f72a8f59-e018-4047-9a81-cf31f8b66434 tempest-GroupSnapshotsTest-952387378 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c/volume-c07926ec-05c1-427f-ae0e-3b1c733903ea" returned: 0 in 0.848s {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 15:03:43 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [req-44a25713-e2ab-41cf-a3b0-799f75f78ddc req-2c39ce91-d699-4c19-bd09-72e0efb672da tempest-VolumesSnapshotsTestJSON-348981508 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c/volume-c3a2e2ba-2fb4-42c7-bca0-b8e5e6de1d5d.e9215fbd-b24f-48c7-ae19-e8d37d94c205 {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 15:03:43 devstack cinder-volume[83259]: DEBUG cinder.utils [None req-f72a8f59-e018-4047-9a81-cf31f8b66434 tempest-GroupSnapshotsTest-952387378 None] Path /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c/volume-4da12494-bdf5-4350-9384-301bf200e7c8 not found in is_blk_device check {{(pid=83259) is_blk_device /opt/stack/cinder/cinder/utils.py:591}} Sep 16 15:03:43 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [None req-f72a8f59-e018-4047-9a81-cf31f8b66434 tempest-GroupSnapshotsTest-952387378 None] Running cmd (subprocess): qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c/volume-c07926ec-05c1-427f-ae0e-3b1c733903ea /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c/volume-4da12494-bdf5-4350-9384-301bf200e7c8 {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 15:03:43 devstack quobyte-client[83286]: System call of process 93074 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 16 15:03:43 devstack cinder-volume[83259]: DEBUG cinder.coordination [None req-4d0379cf-f661-4e1f-adda-716e18e863da tempest-SnapshotMetadataTestJSON-181553794 None] Lock "cinder-e02567ea-abba-476d-b457-e3f21a76b1b5-delete_snapshot" acquired by "delete_snapshot" :: waited 0.318s {{(pid=83259) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 16 15:03:43 devstack cinder-volume[83259]: WARNING cinder.volume.volume_utils [None req-4d0379cf-f661-4e1f-adda-716e18e863da tempest-SnapshotMetadataTestJSON-181553794 None] Volume driver (QuobyteDriver 1.2) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 16 15:03:43 devstack cinder-volume[83259]: DEBUG cinder.coordination [None req-4d0379cf-f661-4e1f-adda-716e18e863da tempest-SnapshotMetadataTestJSON-181553794 None] Acquiring lock "cinder-quobyte-77ff9cd7-5ae7-4ee1-bcde-4d803f035927" by "delete_snapshot" {{(pid=83259) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 16 15:03:43 devstack quobyte-client[83286]: The server volume:87712ffe-8a69-446d-9ed6-4430c7ee9792@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=87712ffe-8a69-446d-9ed6-4430c7ee9792, inode=39, name=volume-4da12494-bdf5-4350-9384-301bf200e7c8, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.206), requestorAccessMask=0 Sep 16 15:03:43 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [req-44a25713-e2ab-41cf-a3b0-799f75f78ddc req-2c39ce91-d699-4c19-bd09-72e0efb672da tempest-VolumesSnapshotsTestJSON-348981508 None] CMD "rm -f /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c/volume-c3a2e2ba-2fb4-42c7-bca0-b8e5e6de1d5d.e9215fbd-b24f-48c7-ae19-e8d37d94c205" returned: 0 in 0.338s {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 15:03:43 devstack cinder-volume[83259]: DEBUG cinder.coordination [req-44a25713-e2ab-41cf-a3b0-799f75f78ddc req-2c39ce91-d699-4c19-bd09-72e0efb672da tempest-VolumesSnapshotsTestJSON-348981508 None] Lock "cinder-quobyte-e9215fbd-b24f-48c7-ae19-e8d37d94c205" released by "_delete_snapshot" :: held 2.664s {{(pid=83259) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 16 15:03:43 devstack cinder-volume[83259]: DEBUG cinder.coordination [None req-4d0379cf-f661-4e1f-adda-716e18e863da tempest-SnapshotMetadataTestJSON-181553794 None] Lock "cinder-quobyte-77ff9cd7-5ae7-4ee1-bcde-4d803f035927" acquired by "delete_snapshot" :: waited 0.101s {{(pid=83259) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 16 15:03:43 devstack cinder-volume[83259]: DEBUG cinder.coordination [None req-4d0379cf-f661-4e1f-adda-716e18e863da tempest-SnapshotMetadataTestJSON-181553794 None] Acquiring lock "cinder-quobyte-e02567ea-abba-476d-b457-e3f21a76b1b5" by "_delete_snapshot" {{(pid=83259) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 16 15:03:43 devstack cinder-volume[83259]: DEBUG cinder.coordination [req-44a25713-e2ab-41cf-a3b0-799f75f78ddc req-2c39ce91-d699-4c19-bd09-72e0efb672da tempest-VolumesSnapshotsTestJSON-348981508 None] Lock "cinder-quobyte-c3a2e2ba-2fb4-42c7-bca0-b8e5e6de1d5d" released by "delete_snapshot" :: held 3.124s {{(pid=83259) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 16 15:03:44 devstack cinder-volume[83259]: DEBUG cinder.coordination [None req-4d0379cf-f661-4e1f-adda-716e18e863da tempest-SnapshotMetadataTestJSON-181553794 None] Lock "cinder-quobyte-e02567ea-abba-476d-b457-e3f21a76b1b5" acquired by "_delete_snapshot" :: waited 0.357s {{(pid=83259) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 16 15:03:44 devstack cinder-volume[83259]: DEBUG cinder.volume.drivers.remotefs [None req-4d0379cf-f661-4e1f-adda-716e18e863da tempest-SnapshotMetadataTestJSON-181553794 None] Deleting offline snapshot e02567ea-abba-476d-b457-e3f21a76b1b5 of volume 77ff9cd7-5ae7-4ee1-bcde-4d803f035927 {{(pid=83259) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1278}} Sep 16 15:03:44 devstack cinder-volume[83259]: DEBUG cinder.volume.drivers.remotefs [None req-4d0379cf-f661-4e1f-adda-716e18e863da tempest-SnapshotMetadataTestJSON-181553794 None] snapshot_file for this snap is: volume-77ff9cd7-5ae7-4ee1-bcde-4d803f035927.e02567ea-abba-476d-b457-e3f21a76b1b5 {{(pid=83259) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1307}} Sep 16 15:03:44 devstack cinder-volume[83259]: DEBUG oslo.privsep.daemon [-] privsep: reply[b79ce61d-b066-4e1b-b65b-3ab1f40dd69e]: (4, 'qcow2') {{(pid=84312) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 16 15:03:44 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [None req-4d0379cf-f661-4e1f-adda-716e18e863da tempest-SnapshotMetadataTestJSON-181553794 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c/volume-77ff9cd7-5ae7-4ee1-bcde-4d803f035927.e02567ea-abba-476d-b457-e3f21a76b1b5 {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 15:03:45 devstack cinder-volume[83259]: DEBUG oslo_service.periodic_task [None req-050ec8a1-6ffd-499d-95ad-d548a84437e2 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=83259) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} Sep 16 15:03:45 devstack cinder-volume[83259]: DEBUG oslo_concurrency.lockutils [None req-050ec8a1-6ffd-499d-95ad-d548a84437e2 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83259) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 16 15:03:45 devstack cinder-volume[83259]: DEBUG oslo_concurrency.lockutils [None req-050ec8a1-6ffd-499d-95ad-d548a84437e2 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.006s {{(pid=83259) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 16 15:03:45 devstack cinder-volume[83259]: DEBUG cinder.volume.drivers.quobyte [None req-050ec8a1-6ffd-499d-95ad-d548a84437e2 None None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-61f585ac-f8e2-4d19-a890-7ebc2726cc72': None} {{(pid=83259) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:639}} Sep 16 15:03:45 devstack cinder-volume[83259]: DEBUG cinder.volume.drivers.quobyte [None req-050ec8a1-6ffd-499d-95ad-d548a84437e2 None None] Available shares ['10.10.41.181/cinder-vol-61f585ac-f8e2-4d19-a890-7ebc2726cc72'] {{(pid=83259) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:669}} Sep 16 15:03:45 devstack cinder-volume[83259]: DEBUG oslo_concurrency.lockutils [None req-050ec8a1-6ffd-499d-95ad-d548a84437e2 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.048s {{(pid=83259) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 16 15:03:45 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [None req-050ec8a1-6ffd-499d-95ad-d548a84437e2 None None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 15:03:46 devstack cinder-volume[83259]: DEBUG dbcounter [-] [83259] Writing DB stats cinder:SELECT=48,cinder:UPDATE=66,cinder:INSERT=15,cinder:DELETE=6 {{(pid=83259) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Sep 16 15:03:46 devstack quobyte-client[83286]: System call of process 93097 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 16 15:03:46 devstack cinder-volume[83259]: DEBUG dbcounter [-] [83259] Writing DB stats cinder:SELECT=65,cinder:INSERT=22,cinder:UPDATE=58,cinder:DELETE=6 {{(pid=83259) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Sep 16 15:03:46 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [None req-050ec8a1-6ffd-499d-95ad-d548a84437e2 None None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c" returned: 0 in 1.411s {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 15:03:46 devstack cinder-volume[83259]: DEBUG cinder.manager [None req-050ec8a1-6ffd-499d-95ad-d548a84437e2 None None] Notifying Schedulers of capabilities ... {{(pid=83259) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 16 15:03:47 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [None req-4d0379cf-f661-4e1f-adda-716e18e863da tempest-SnapshotMetadataTestJSON-181553794 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c/volume-77ff9cd7-5ae7-4ee1-bcde-4d803f035927.e02567ea-abba-476d-b457-e3f21a76b1b5" returned: 0 in 2.645s {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 15:03:47 devstack cinder-volume[83259]: DEBUG cinder.volume.drivers.remotefs [None req-4d0379cf-f661-4e1f-adda-716e18e863da tempest-SnapshotMetadataTestJSON-181553794 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-77ff9cd7-5ae7-4ee1-bcde-4d803f035927(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83259) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:886}} Sep 16 15:03:47 devstack cinder-volume[83259]: DEBUG oslo.privsep.daemon [-] privsep: reply[f3b75b00-e6c9-4de8-9e9e-71245c6889ef]: (4, 'qcow2') {{(pid=84312) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 16 15:03:47 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [None req-4d0379cf-f661-4e1f-adda-716e18e863da tempest-SnapshotMetadataTestJSON-181553794 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c/volume-77ff9cd7-5ae7-4ee1-bcde-4d803f035927 {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 15:03:48 devstack quobyte-client[83286]: System call of process 93102 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 16 15:03:48 devstack cinder-volume[83259]: DEBUG cinder.quota [req-44a25713-e2ab-41cf-a3b0-799f75f78ddc req-2c39ce91-d699-4c19-bd09-72e0efb672da tempest-VolumesSnapshotsTestJSON-348981508 None] Created reservations ['5b41247c-6c48-489f-812f-9ef20da06b62', 'ac5a7c53-e2ac-46ac-8224-59dbe70e08fa', '1e2c69fd-f31b-4635-8958-16ab6c0d285f', '333afff2-0e70-4938-b97d-a1410bc1d25f'] {{(pid=83259) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 16 15:03:48 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [None req-4d0379cf-f661-4e1f-adda-716e18e863da tempest-SnapshotMetadataTestJSON-181553794 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c/volume-77ff9cd7-5ae7-4ee1-bcde-4d803f035927" returned: 0 in 1.616s {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 15:03:48 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [None req-4d0379cf-f661-4e1f-adda-716e18e863da tempest-SnapshotMetadataTestJSON-181553794 None] Running cmd (subprocess): qemu-img commit -d /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c/volume-77ff9cd7-5ae7-4ee1-bcde-4d803f035927.e02567ea-abba-476d-b457-e3f21a76b1b5 {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 15:03:50 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [None req-4d0379cf-f661-4e1f-adda-716e18e863da tempest-SnapshotMetadataTestJSON-181553794 None] CMD "qemu-img commit -d /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c/volume-77ff9cd7-5ae7-4ee1-bcde-4d803f035927.e02567ea-abba-476d-b457-e3f21a76b1b5" returned: 0 in 1.068s {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 15:03:50 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [None req-4d0379cf-f661-4e1f-adda-716e18e863da tempest-SnapshotMetadataTestJSON-181553794 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c/volume-77ff9cd7-5ae7-4ee1-bcde-4d803f035927.e02567ea-abba-476d-b457-e3f21a76b1b5 {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 15:03:50 devstack cinder-volume[83259]: INFO cinder.volume.manager [req-44a25713-e2ab-41cf-a3b0-799f75f78ddc req-2c39ce91-d699-4c19-bd09-72e0efb672da tempest-VolumesSnapshotsTestJSON-348981508 None] Delete snapshot completed successfully. Sep 16 15:03:50 devstack cinder-volume[83259]: DEBUG cinder.coordination [req-44a25713-e2ab-41cf-a3b0-799f75f78ddc req-2c39ce91-d699-4c19-bd09-72e0efb672da tempest-VolumesSnapshotsTestJSON-348981508 None] Lock "cinder-e9215fbd-b24f-48c7-ae19-e8d37d94c205-delete_snapshot" released by "delete_snapshot" :: held 10.539s {{(pid=83259) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 16 15:03:51 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [None req-4d0379cf-f661-4e1f-adda-716e18e863da tempest-SnapshotMetadataTestJSON-181553794 None] CMD "rm -f /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c/volume-77ff9cd7-5ae7-4ee1-bcde-4d803f035927.e02567ea-abba-476d-b457-e3f21a76b1b5" returned: 0 in 1.046s {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 15:03:51 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [None req-f72a8f59-e018-4047-9a81-cf31f8b66434 tempest-GroupSnapshotsTest-952387378 None] CMD "qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c/volume-c07926ec-05c1-427f-ae0e-3b1c733903ea /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c/volume-4da12494-bdf5-4350-9384-301bf200e7c8" returned: 0 in 7.481s {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 15:03:51 devstack cinder-volume[83259]: DEBUG cinder.coordination [None req-4d0379cf-f661-4e1f-adda-716e18e863da tempest-SnapshotMetadataTestJSON-181553794 None] Lock "cinder-quobyte-e02567ea-abba-476d-b457-e3f21a76b1b5" released by "_delete_snapshot" :: held 6.853s {{(pid=83259) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 16 15:03:51 devstack cinder-volume[83259]: DEBUG oslo.privsep.daemon [-] privsep: reply[c42d6073-8181-4cf9-be86-8f9d68b772ef]: (4, 'qcow2') {{(pid=84312) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 16 15:03:51 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [None req-f72a8f59-e018-4047-9a81-cf31f8b66434 tempest-GroupSnapshotsTest-952387378 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c/volume-c07926ec-05c1-427f-ae0e-3b1c733903ea {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 15:03:51 devstack cinder-volume[83259]: DEBUG cinder.coordination [None req-4d0379cf-f661-4e1f-adda-716e18e863da tempest-SnapshotMetadataTestJSON-181553794 None] Lock "cinder-quobyte-77ff9cd7-5ae7-4ee1-bcde-4d803f035927" released by "delete_snapshot" :: held 7.331s {{(pid=83259) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 16 15:03:51 devstack cinder-volume[83259]: DEBUG cinder.coordination [req-a4cde697-c140-4a6c-9aa5-fdda1267e84c req-d8f84024-4813-4ed2-bc55-d35941d2e8d9 tempest-VolumesSnapshotsTestJSON-348981508 None] Acquiring lock "cinder-c3a2e2ba-2fb4-42c7-bca0-b8e5e6de1d5d-delete_volume" by "delete_volume" {{(pid=83259) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 16 15:03:51 devstack cinder-volume[83259]: DEBUG cinder.coordination [req-a4cde697-c140-4a6c-9aa5-fdda1267e84c req-d8f84024-4813-4ed2-bc55-d35941d2e8d9 tempest-VolumesSnapshotsTestJSON-348981508 None] Lock "cinder-c3a2e2ba-2fb4-42c7-bca0-b8e5e6de1d5d-delete_volume" acquired by "delete_volume" :: waited 0.038s {{(pid=83259) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 16 15:03:51 devstack cinder-volume[83259]: DEBUG cinder.quota [None req-4d0379cf-f661-4e1f-adda-716e18e863da tempest-SnapshotMetadataTestJSON-181553794 None] Created reservations ['3c2f09dc-a47f-4d1e-9a36-af7d3cc17cb5', '0abc13c0-0c2c-4929-8fe0-fbaa04e52de1', '57ed0abd-8a7c-4adf-9927-73178b0ddac6', '0848bc97-1c30-4451-b87d-97fba5d1b921'] {{(pid=83259) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 16 15:03:51 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [None req-f72a8f59-e018-4047-9a81-cf31f8b66434 tempest-GroupSnapshotsTest-952387378 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c/volume-c07926ec-05c1-427f-ae0e-3b1c733903ea" returned: 0 in 0.710s {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 15:03:51 devstack cinder-volume[83259]: DEBUG cinder.image.image_utils [None req-f72a8f59-e018-4047-9a81-cf31f8b66434 tempest-GroupSnapshotsTest-952387378 None] Image conversion details: src /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c/volume-c07926ec-05c1-427f-ae0e-3b1c733903ea, size 1024.00 MB, duration 7.49 sec, destination /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c/volume-4da12494-bdf5-4350-9384-301bf200e7c8 {{(pid=83259) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:501}} Sep 16 15:03:51 devstack cinder-volume[83259]: INFO cinder.image.image_utils [None req-f72a8f59-e018-4047-9a81-cf31f8b66434 tempest-GroupSnapshotsTest-952387378 None] Converted 1024.00 MB image at 136.78 MB/s Sep 16 15:03:51 devstack cinder-volume[83259]: DEBUG cinder.volume.drivers.remotefs [None req-f72a8f59-e018-4047-9a81-cf31f8b66434 tempest-GroupSnapshotsTest-952387378 None] File path /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c/volume-4da12494-bdf5-4350-9384-301bf200e7c8 is being set with permissions: 660 {{(pid=83259) _set_rw_permissions /opt/stack/cinder/cinder/volume/drivers/remotefs.py:492}} Sep 16 15:03:51 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [None req-f72a8f59-e018-4047-9a81-cf31f8b66434 tempest-GroupSnapshotsTest-952387378 None] Running cmd (subprocess): chmod 660 /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c/volume-4da12494-bdf5-4350-9384-301bf200e7c8 {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 15:03:52 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [None req-f72a8f59-e018-4047-9a81-cf31f8b66434 tempest-GroupSnapshotsTest-952387378 None] CMD "chmod 660 /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c/volume-4da12494-bdf5-4350-9384-301bf200e7c8" returned: 0 in 0.370s {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 15:03:52 devstack cinder-volume[83259]: WARNING cinder.volume.volume_utils [req-a4cde697-c140-4a6c-9aa5-fdda1267e84c req-d8f84024-4813-4ed2-bc55-d35941d2e8d9 tempest-VolumesSnapshotsTestJSON-348981508 None] Volume driver (QuobyteDriver 1.2) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 16 15:03:52 devstack cinder-volume[83259]: DEBUG cinder.coordination [req-a4cde697-c140-4a6c-9aa5-fdda1267e84c req-d8f84024-4813-4ed2-bc55-d35941d2e8d9 tempest-VolumesSnapshotsTestJSON-348981508 None] Acquiring lock "cinder-quobyte-c3a2e2ba-2fb4-42c7-bca0-b8e5e6de1d5d" by "delete_volume" {{(pid=83259) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 16 15:03:52 devstack cinder-volume[83259]: DEBUG cinder.coordination [None req-f72a8f59-e018-4047-9a81-cf31f8b66434 tempest-GroupSnapshotsTest-952387378 None] Lock "cinder-quobyte-4da12494-bdf5-4350-9384-301bf200e7c8" released by "_copy_volume_from_snapshot" :: held 10.625s {{(pid=83259) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 16 15:03:52 devstack cinder-volume[83259]: DEBUG cinder.coordination [None req-f72a8f59-e018-4047-9a81-cf31f8b66434 tempest-GroupSnapshotsTest-952387378 None] Lock "cinder-quobyte-5111884f-1a7a-4a95-9996-66a41c0c1aad-4da12494-bdf5-4350-9384-301bf200e7c8" released by "_create_volume_from_snapshot" :: held 10.764s {{(pid=83259) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 16 15:03:52 devstack cinder-volume[83259]: DEBUG oslo_concurrency.lockutils [None req-f72a8f59-e018-4047-9a81-cf31f8b66434 tempest-GroupSnapshotsTest-952387378 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 11.131s {{(pid=83259) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 16 15:03:52 devstack cinder-volume[83259]: DEBUG cinder.coordination [req-a4cde697-c140-4a6c-9aa5-fdda1267e84c req-d8f84024-4813-4ed2-bc55-d35941d2e8d9 tempest-VolumesSnapshotsTestJSON-348981508 None] Lock "cinder-quobyte-c3a2e2ba-2fb4-42c7-bca0-b8e5e6de1d5d" acquired by "delete_volume" :: waited 0.132s {{(pid=83259) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 16 15:03:52 devstack cinder-volume[83259]: INFO cinder.volume.manager [None req-4d0379cf-f661-4e1f-adda-716e18e863da tempest-SnapshotMetadataTestJSON-181553794 None] Delete snapshot completed successfully. Sep 16 15:03:52 devstack cinder-volume[83259]: DEBUG oslo.privsep.daemon [-] privsep: reply[e976c078-0a74-4eea-a5c7-5a6ea30de6dd]: (4, 'qcow2') {{(pid=84312) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 16 15:03:52 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [req-a4cde697-c140-4a6c-9aa5-fdda1267e84c req-d8f84024-4813-4ed2-bc55-d35941d2e8d9 tempest-VolumesSnapshotsTestJSON-348981508 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c/volume-c3a2e2ba-2fb4-42c7-bca0-b8e5e6de1d5d {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 15:03:52 devstack cinder-volume[83259]: DEBUG cinder.coordination [None req-4d0379cf-f661-4e1f-adda-716e18e863da tempest-SnapshotMetadataTestJSON-181553794 None] Lock "cinder-e02567ea-abba-476d-b457-e3f21a76b1b5-delete_snapshot" released by "delete_snapshot" :: held 8.939s {{(pid=83259) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 16 15:03:53 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [req-a4cde697-c140-4a6c-9aa5-fdda1267e84c req-d8f84024-4813-4ed2-bc55-d35941d2e8d9 tempest-VolumesSnapshotsTestJSON-348981508 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c/volume-c3a2e2ba-2fb4-42c7-bca0-b8e5e6de1d5d" returned: 0 in 0.650s {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 15:03:53 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [req-a4cde697-c140-4a6c-9aa5-fdda1267e84c req-d8f84024-4813-4ed2-bc55-d35941d2e8d9 tempest-VolumesSnapshotsTestJSON-348981508 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c/volume-c3a2e2ba-2fb4-42c7-bca0-b8e5e6de1d5d {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 15:03:53 devstack cinder-volume[83259]: DEBUG cinder.coordination [None req-f646a3d4-6872-4bfe-b1cb-fcf996be09aa tempest-SnapshotMetadataTestJSON-181553794 None] Acquiring lock "cinder-77ff9cd7-5ae7-4ee1-bcde-4d803f035927-delete_volume" by "delete_volume" {{(pid=83259) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 16 15:03:53 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [req-a4cde697-c140-4a6c-9aa5-fdda1267e84c req-d8f84024-4813-4ed2-bc55-d35941d2e8d9 tempest-VolumesSnapshotsTestJSON-348981508 None] CMD "rm -f /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c/volume-c3a2e2ba-2fb4-42c7-bca0-b8e5e6de1d5d" returned: 0 in 0.446s {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 15:03:53 devstack cinder-volume[83259]: INFO cinder.volume.manager [None req-f72a8f59-e018-4047-9a81-cf31f8b66434 tempest-GroupSnapshotsTest-952387378 None] Create group from source-snapshot-f6e4d3bc-5ad6-43e8-916d-44233e143490 completed successfully. Sep 16 15:03:53 devstack cinder-volume[83259]: DEBUG cinder.coordination [req-a4cde697-c140-4a6c-9aa5-fdda1267e84c req-d8f84024-4813-4ed2-bc55-d35941d2e8d9 tempest-VolumesSnapshotsTestJSON-348981508 None] Lock "cinder-quobyte-c3a2e2ba-2fb4-42c7-bca0-b8e5e6de1d5d" released by "delete_volume" :: held 1.276s {{(pid=83259) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 16 15:03:53 devstack cinder-volume[83259]: DEBUG cinder.coordination [None req-f646a3d4-6872-4bfe-b1cb-fcf996be09aa tempest-SnapshotMetadataTestJSON-181553794 None] Lock "cinder-77ff9cd7-5ae7-4ee1-bcde-4d803f035927-delete_volume" acquired by "delete_volume" :: waited 0.307s {{(pid=83259) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 16 15:03:53 devstack cinder-volume[83259]: WARNING cinder.volume.volume_utils [None req-f646a3d4-6872-4bfe-b1cb-fcf996be09aa tempest-SnapshotMetadataTestJSON-181553794 None] Volume driver (QuobyteDriver 1.2) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 16 15:03:53 devstack cinder-volume[83259]: DEBUG cinder.coordination [None req-f646a3d4-6872-4bfe-b1cb-fcf996be09aa tempest-SnapshotMetadataTestJSON-181553794 None] Acquiring lock "cinder-quobyte-77ff9cd7-5ae7-4ee1-bcde-4d803f035927" by "delete_volume" {{(pid=83259) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 16 15:03:53 devstack cinder-volume[83259]: WARNING cinder.volume.volume_utils [None req-107da10e-7272-4026-b64c-3de299a08f60 tempest-GroupSnapshotsTest-952387378 None] Volume driver (QuobyteDriver 1.2) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 16 15:03:53 devstack cinder-volume[83259]: DEBUG cinder.coordination [None req-107da10e-7272-4026-b64c-3de299a08f60 tempest-GroupSnapshotsTest-952387378 None] Acquiring lock "cinder-quobyte-4da12494-bdf5-4350-9384-301bf200e7c8" by "delete_volume" {{(pid=83259) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 16 15:03:53 devstack cinder-volume[83259]: DEBUG cinder.coordination [None req-f646a3d4-6872-4bfe-b1cb-fcf996be09aa tempest-SnapshotMetadataTestJSON-181553794 None] Lock "cinder-quobyte-77ff9cd7-5ae7-4ee1-bcde-4d803f035927" acquired by "delete_volume" :: waited 0.081s {{(pid=83259) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 16 15:03:53 devstack cinder-volume[83259]: DEBUG oslo.privsep.daemon [-] privsep: reply[f5bdc9ec-4ddf-4eff-a4a6-d4856a19d4af]: (4, 'qcow2') {{(pid=84312) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 16 15:03:53 devstack cinder-volume[83259]: DEBUG cinder.coordination [None req-107da10e-7272-4026-b64c-3de299a08f60 tempest-GroupSnapshotsTest-952387378 None] Lock "cinder-quobyte-4da12494-bdf5-4350-9384-301bf200e7c8" acquired by "delete_volume" :: waited 0.104s {{(pid=83259) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 16 15:03:54 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [None req-f646a3d4-6872-4bfe-b1cb-fcf996be09aa tempest-SnapshotMetadataTestJSON-181553794 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c/volume-77ff9cd7-5ae7-4ee1-bcde-4d803f035927 {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 15:03:54 devstack cinder-volume[83259]: DEBUG oslo.privsep.daemon [-] privsep: reply[1f7ba17c-b0a1-48f3-b8be-169741e62fc2]: (4, 'qcow2') {{(pid=84312) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 16 15:03:54 devstack cinder-volume[83259]: DEBUG cinder.quota [req-a4cde697-c140-4a6c-9aa5-fdda1267e84c req-d8f84024-4813-4ed2-bc55-d35941d2e8d9 tempest-VolumesSnapshotsTestJSON-348981508 None] Created reservations ['42d54f49-7b57-4f17-960e-5f283847d2ff', '03eae014-0533-46c2-a561-901802604b57', 'd2c4ef3b-5430-41f1-a454-15a7f1e88f99', '1d1f7838-8481-42c6-8803-4e82c2b324e7'] {{(pid=83259) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 16 15:03:54 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [None req-107da10e-7272-4026-b64c-3de299a08f60 tempest-GroupSnapshotsTest-952387378 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c/volume-4da12494-bdf5-4350-9384-301bf200e7c8 {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 15:03:54 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [None req-f646a3d4-6872-4bfe-b1cb-fcf996be09aa tempest-SnapshotMetadataTestJSON-181553794 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c/volume-77ff9cd7-5ae7-4ee1-bcde-4d803f035927" returned: 0 in 0.628s {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 15:03:54 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [None req-f646a3d4-6872-4bfe-b1cb-fcf996be09aa tempest-SnapshotMetadataTestJSON-181553794 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c/volume-77ff9cd7-5ae7-4ee1-bcde-4d803f035927 {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 15:03:55 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [None req-f646a3d4-6872-4bfe-b1cb-fcf996be09aa tempest-SnapshotMetadataTestJSON-181553794 None] CMD "rm -f /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c/volume-77ff9cd7-5ae7-4ee1-bcde-4d803f035927" returned: 0 in 0.383s {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 15:03:55 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [None req-107da10e-7272-4026-b64c-3de299a08f60 tempest-GroupSnapshotsTest-952387378 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c/volume-4da12494-bdf5-4350-9384-301bf200e7c8" returned: 0 in 0.763s {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 15:03:55 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [None req-107da10e-7272-4026-b64c-3de299a08f60 tempest-GroupSnapshotsTest-952387378 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c/volume-4da12494-bdf5-4350-9384-301bf200e7c8 {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 15:03:55 devstack cinder-volume[83259]: DEBUG cinder.coordination [None req-f646a3d4-6872-4bfe-b1cb-fcf996be09aa tempest-SnapshotMetadataTestJSON-181553794 None] Lock "cinder-quobyte-77ff9cd7-5ae7-4ee1-bcde-4d803f035927" released by "delete_volume" :: held 1.415s {{(pid=83259) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 16 15:03:55 devstack cinder-volume[83259]: DEBUG oslo_concurrency.lockutils [req-a4cde697-c140-4a6c-9aa5-fdda1267e84c req-d8f84024-4813-4ed2-bc55-d35941d2e8d9 tempest-VolumesSnapshotsTestJSON-348981508 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83259) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 16 15:03:55 devstack cinder-volume[83259]: DEBUG oslo_concurrency.lockutils [req-a4cde697-c140-4a6c-9aa5-fdda1267e84c req-d8f84024-4813-4ed2-bc55-d35941d2e8d9 tempest-VolumesSnapshotsTestJSON-348981508 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=83259) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 16 15:03:55 devstack cinder-volume[83259]: DEBUG cinder.volume.drivers.quobyte [req-a4cde697-c140-4a6c-9aa5-fdda1267e84c req-d8f84024-4813-4ed2-bc55-d35941d2e8d9 tempest-VolumesSnapshotsTestJSON-348981508 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-61f585ac-f8e2-4d19-a890-7ebc2726cc72': None} {{(pid=83259) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:639}} Sep 16 15:03:55 devstack cinder-volume[83259]: DEBUG cinder.volume.drivers.quobyte [req-a4cde697-c140-4a6c-9aa5-fdda1267e84c req-d8f84024-4813-4ed2-bc55-d35941d2e8d9 tempest-VolumesSnapshotsTestJSON-348981508 None] Available shares ['10.10.41.181/cinder-vol-61f585ac-f8e2-4d19-a890-7ebc2726cc72'] {{(pid=83259) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:669}} Sep 16 15:03:55 devstack cinder-volume[83259]: DEBUG oslo_concurrency.lockutils [req-a4cde697-c140-4a6c-9aa5-fdda1267e84c req-d8f84024-4813-4ed2-bc55-d35941d2e8d9 tempest-VolumesSnapshotsTestJSON-348981508 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=83259) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 16 15:03:55 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [req-a4cde697-c140-4a6c-9aa5-fdda1267e84c req-d8f84024-4813-4ed2-bc55-d35941d2e8d9 tempest-VolumesSnapshotsTestJSON-348981508 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 15:03:55 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [None req-107da10e-7272-4026-b64c-3de299a08f60 tempest-GroupSnapshotsTest-952387378 None] CMD "rm -f /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c/volume-4da12494-bdf5-4350-9384-301bf200e7c8" returned: 0 in 0.718s {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 15:03:55 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [req-a4cde697-c140-4a6c-9aa5-fdda1267e84c req-d8f84024-4813-4ed2-bc55-d35941d2e8d9 tempest-VolumesSnapshotsTestJSON-348981508 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c" returned: 0 in 0.379s {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 15:03:55 devstack cinder-volume[83259]: DEBUG cinder.coordination [None req-107da10e-7272-4026-b64c-3de299a08f60 tempest-GroupSnapshotsTest-952387378 None] Lock "cinder-quobyte-4da12494-bdf5-4350-9384-301bf200e7c8" released by "delete_volume" :: held 1.912s {{(pid=83259) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 16 15:03:55 devstack cinder-volume[83259]: DEBUG cinder.manager [req-a4cde697-c140-4a6c-9aa5-fdda1267e84c req-d8f84024-4813-4ed2-bc55-d35941d2e8d9 tempest-VolumesSnapshotsTestJSON-348981508 None] Notifying Schedulers of capabilities ... {{(pid=83259) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 16 15:03:56 devstack cinder-volume[83259]: INFO cinder.volume.manager [req-a4cde697-c140-4a6c-9aa5-fdda1267e84c req-d8f84024-4813-4ed2-bc55-d35941d2e8d9 tempest-VolumesSnapshotsTestJSON-348981508 None] Deleted volume successfully. Sep 16 15:03:56 devstack cinder-volume[83259]: DEBUG cinder.coordination [req-a4cde697-c140-4a6c-9aa5-fdda1267e84c req-d8f84024-4813-4ed2-bc55-d35941d2e8d9 tempest-VolumesSnapshotsTestJSON-348981508 None] Lock "cinder-c3a2e2ba-2fb4-42c7-bca0-b8e5e6de1d5d-delete_volume" released by "delete_volume" :: held 4.333s {{(pid=83259) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 16 15:03:56 devstack cinder-volume[83259]: DEBUG cinder.quota [None req-107da10e-7272-4026-b64c-3de299a08f60 tempest-GroupSnapshotsTest-952387378 None] Created reservations ['caf9b45e-5a3b-4587-bc13-04c729f0dbb4'] {{(pid=83259) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 16 15:03:56 devstack cinder-volume[83259]: DEBUG cinder.quota [None req-f646a3d4-6872-4bfe-b1cb-fcf996be09aa tempest-SnapshotMetadataTestJSON-181553794 None] Created reservations ['9459801a-dd5c-4f6b-9e64-2b0e428e5ed4', '7f49a90f-b675-4208-b1ad-94703593fbe4', 'a0c8147a-2f70-4e2d-8a20-ce253f33b85b', '42c86ffa-89e0-42c6-b7cc-15110c79b673'] {{(pid=83259) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 16 15:03:56 devstack cinder-volume[83259]: WARNING cinder.quota [None req-107da10e-7272-4026-b64c-3de299a08f60 tempest-GroupSnapshotsTest-952387378 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-719524181 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-719524181, it is now deprecated. Please use the default quota class for default quota. Sep 16 15:03:56 devstack cinder-volume[83259]: WARNING cinder.quota [None req-107da10e-7272-4026-b64c-3de299a08f60 tempest-GroupSnapshotsTest-952387378 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-719524181 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-719524181, it is now deprecated. Please use the default quota class for default quota. Sep 16 15:03:56 devstack cinder-volume[83259]: DEBUG cinder.quota [None req-107da10e-7272-4026-b64c-3de299a08f60 tempest-GroupSnapshotsTest-952387378 None] Created reservations ['2d496073-d06b-4a46-ab33-7b72895a79ac', '6eb2cb70-a7b2-4ea9-adea-4c312ecf9eed', '9a25794e-6d1c-4402-b385-96c06fbf4693', 'c83d452d-23df-43b3-80f2-3b06a05be83e'] {{(pid=83259) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 16 15:03:56 devstack cinder-volume[83259]: DEBUG oslo_concurrency.lockutils [None req-f646a3d4-6872-4bfe-b1cb-fcf996be09aa tempest-SnapshotMetadataTestJSON-181553794 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83259) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 16 15:03:56 devstack cinder-volume[83259]: DEBUG oslo_concurrency.lockutils [None req-f646a3d4-6872-4bfe-b1cb-fcf996be09aa tempest-SnapshotMetadataTestJSON-181553794 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=83259) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 16 15:03:56 devstack cinder-volume[83259]: DEBUG cinder.volume.drivers.quobyte [None req-f646a3d4-6872-4bfe-b1cb-fcf996be09aa tempest-SnapshotMetadataTestJSON-181553794 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-61f585ac-f8e2-4d19-a890-7ebc2726cc72': None} {{(pid=83259) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:639}} Sep 16 15:03:56 devstack cinder-volume[83259]: DEBUG cinder.volume.drivers.quobyte [None req-f646a3d4-6872-4bfe-b1cb-fcf996be09aa tempest-SnapshotMetadataTestJSON-181553794 None] Available shares ['10.10.41.181/cinder-vol-61f585ac-f8e2-4d19-a890-7ebc2726cc72'] {{(pid=83259) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:669}} Sep 16 15:03:56 devstack cinder-volume[83259]: DEBUG oslo_concurrency.lockutils [None req-f646a3d4-6872-4bfe-b1cb-fcf996be09aa tempest-SnapshotMetadataTestJSON-181553794 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=83259) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 16 15:03:56 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [None req-f646a3d4-6872-4bfe-b1cb-fcf996be09aa tempest-SnapshotMetadataTestJSON-181553794 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 15:03:56 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [None req-f646a3d4-6872-4bfe-b1cb-fcf996be09aa tempest-SnapshotMetadataTestJSON-181553794 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c" returned: 0 in 0.344s {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 15:03:56 devstack cinder-volume[83259]: DEBUG cinder.manager [None req-f646a3d4-6872-4bfe-b1cb-fcf996be09aa tempest-SnapshotMetadataTestJSON-181553794 None] Notifying Schedulers of capabilities ... {{(pid=83259) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 16 15:03:56 devstack cinder-volume[83259]: INFO cinder.volume.manager [None req-f646a3d4-6872-4bfe-b1cb-fcf996be09aa tempest-SnapshotMetadataTestJSON-181553794 None] Deleted volume successfully. Sep 16 15:03:56 devstack cinder-volume[83259]: DEBUG cinder.coordination [None req-f646a3d4-6872-4bfe-b1cb-fcf996be09aa tempest-SnapshotMetadataTestJSON-181553794 None] Lock "cinder-77ff9cd7-5ae7-4ee1-bcde-4d803f035927-delete_volume" released by "delete_volume" :: held 3.175s {{(pid=83259) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 16 15:03:56 devstack cinder-volume[83259]: DEBUG oslo_concurrency.lockutils [None req-107da10e-7272-4026-b64c-3de299a08f60 tempest-GroupSnapshotsTest-952387378 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83259) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 16 15:03:56 devstack cinder-volume[83259]: DEBUG oslo_concurrency.lockutils [None req-107da10e-7272-4026-b64c-3de299a08f60 tempest-GroupSnapshotsTest-952387378 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=83259) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 16 15:03:56 devstack cinder-volume[83259]: DEBUG cinder.volume.drivers.quobyte [None req-107da10e-7272-4026-b64c-3de299a08f60 tempest-GroupSnapshotsTest-952387378 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-61f585ac-f8e2-4d19-a890-7ebc2726cc72': None} {{(pid=83259) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:639}} Sep 16 15:03:57 devstack cinder-volume[83259]: DEBUG cinder.volume.drivers.quobyte [None req-107da10e-7272-4026-b64c-3de299a08f60 tempest-GroupSnapshotsTest-952387378 None] Available shares ['10.10.41.181/cinder-vol-61f585ac-f8e2-4d19-a890-7ebc2726cc72'] {{(pid=83259) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:669}} Sep 16 15:03:57 devstack cinder-volume[83259]: DEBUG oslo_concurrency.lockutils [None req-107da10e-7272-4026-b64c-3de299a08f60 tempest-GroupSnapshotsTest-952387378 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=83259) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 16 15:03:57 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [None req-107da10e-7272-4026-b64c-3de299a08f60 tempest-GroupSnapshotsTest-952387378 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 15:03:57 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [None req-107da10e-7272-4026-b64c-3de299a08f60 tempest-GroupSnapshotsTest-952387378 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c" returned: 0 in 0.126s {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 15:03:57 devstack cinder-volume[83259]: DEBUG cinder.manager [None req-107da10e-7272-4026-b64c-3de299a08f60 tempest-GroupSnapshotsTest-952387378 None] Notifying Schedulers of capabilities ... {{(pid=83259) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 16 15:03:57 devstack cinder-volume[83259]: INFO cinder.volume.manager [None req-107da10e-7272-4026-b64c-3de299a08f60 tempest-GroupSnapshotsTest-952387378 None] Delete group completed successfully. Sep 16 15:03:57 devstack cinder-volume[83259]: INFO cinder.volume.manager [None req-139f28e9-1b0a-42c0-b92e-4260a0d7b2aa tempest-GroupSnapshotsTest-952387378 None] group_snapshot f6e4d3bc-5ad6-43e8-916d-44233e143490: deleting Sep 16 15:03:57 devstack cinder-volume[83259]: WARNING cinder.volume.volume_utils [None req-139f28e9-1b0a-42c0-b92e-4260a0d7b2aa tempest-GroupSnapshotsTest-952387378 None] Volume driver (QuobyteDriver 1.2) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 16 15:03:57 devstack cinder-volume[83259]: DEBUG cinder.volume.manager [None req-139f28e9-1b0a-42c0-b92e-4260a0d7b2aa tempest-GroupSnapshotsTest-952387378 None] group_snapshot f6e4d3bc-5ad6-43e8-916d-44233e143490: deleting {{(pid=83259) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4317}} Sep 16 15:03:57 devstack cinder-volume[83259]: DEBUG cinder.coordination [None req-139f28e9-1b0a-42c0-b92e-4260a0d7b2aa tempest-GroupSnapshotsTest-952387378 None] Acquiring lock "cinder-quobyte-c07926ec-05c1-427f-ae0e-3b1c733903ea" by "delete_snapshot" {{(pid=83259) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 16 15:03:57 devstack cinder-volume[83259]: DEBUG cinder.coordination [None req-139f28e9-1b0a-42c0-b92e-4260a0d7b2aa tempest-GroupSnapshotsTest-952387378 None] Lock "cinder-quobyte-c07926ec-05c1-427f-ae0e-3b1c733903ea" acquired by "delete_snapshot" :: waited 0.057s {{(pid=83259) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 16 15:03:57 devstack cinder-volume[83259]: DEBUG cinder.coordination [None req-139f28e9-1b0a-42c0-b92e-4260a0d7b2aa tempest-GroupSnapshotsTest-952387378 None] Acquiring lock "cinder-quobyte-5111884f-1a7a-4a95-9996-66a41c0c1aad" by "_delete_snapshot" {{(pid=83259) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 16 15:03:57 devstack cinder-volume[83259]: DEBUG cinder.coordination [None req-139f28e9-1b0a-42c0-b92e-4260a0d7b2aa tempest-GroupSnapshotsTest-952387378 None] Lock "cinder-quobyte-5111884f-1a7a-4a95-9996-66a41c0c1aad" acquired by "_delete_snapshot" :: waited 0.020s {{(pid=83259) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 16 15:03:57 devstack cinder-volume[83259]: DEBUG cinder.volume.drivers.remotefs [None req-139f28e9-1b0a-42c0-b92e-4260a0d7b2aa tempest-GroupSnapshotsTest-952387378 None] Deleting offline snapshot 5111884f-1a7a-4a95-9996-66a41c0c1aad of volume c07926ec-05c1-427f-ae0e-3b1c733903ea {{(pid=83259) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1278}} Sep 16 15:03:57 devstack cinder-volume[83259]: DEBUG cinder.volume.drivers.remotefs [None req-139f28e9-1b0a-42c0-b92e-4260a0d7b2aa tempest-GroupSnapshotsTest-952387378 None] snapshot_file for this snap is: volume-c07926ec-05c1-427f-ae0e-3b1c733903ea.5111884f-1a7a-4a95-9996-66a41c0c1aad {{(pid=83259) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1307}} Sep 16 15:03:57 devstack cinder-volume[83259]: DEBUG oslo.privsep.daemon [-] privsep: reply[35843235-ae33-48a5-befa-06e22f7c9e65]: (4, 'qcow2') {{(pid=84312) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 16 15:03:57 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [None req-139f28e9-1b0a-42c0-b92e-4260a0d7b2aa tempest-GroupSnapshotsTest-952387378 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c/volume-c07926ec-05c1-427f-ae0e-3b1c733903ea.5111884f-1a7a-4a95-9996-66a41c0c1aad {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 15:03:58 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [None req-139f28e9-1b0a-42c0-b92e-4260a0d7b2aa tempest-GroupSnapshotsTest-952387378 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c/volume-c07926ec-05c1-427f-ae0e-3b1c733903ea.5111884f-1a7a-4a95-9996-66a41c0c1aad" returned: 0 in 0.512s {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 15:03:58 devstack cinder-volume[83259]: DEBUG cinder.volume.drivers.remotefs [None req-139f28e9-1b0a-42c0-b92e-4260a0d7b2aa tempest-GroupSnapshotsTest-952387378 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-c07926ec-05c1-427f-ae0e-3b1c733903ea(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83259) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:886}} Sep 16 15:03:58 devstack cinder-volume[83259]: DEBUG oslo.privsep.daemon [-] privsep: reply[81e3f898-15a2-481d-8102-63e9b9bb36aa]: (4, 'qcow2') {{(pid=84312) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 16 15:03:58 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [None req-139f28e9-1b0a-42c0-b92e-4260a0d7b2aa tempest-GroupSnapshotsTest-952387378 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c/volume-c07926ec-05c1-427f-ae0e-3b1c733903ea {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 15:03:59 devstack quobyte-client[83286]: System call of process 93132 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 16 15:03:59 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [None req-139f28e9-1b0a-42c0-b92e-4260a0d7b2aa tempest-GroupSnapshotsTest-952387378 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c/volume-c07926ec-05c1-427f-ae0e-3b1c733903ea" returned: 0 in 0.594s {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 15:03:59 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [None req-139f28e9-1b0a-42c0-b92e-4260a0d7b2aa tempest-GroupSnapshotsTest-952387378 None] Running cmd (subprocess): qemu-img commit -d /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c/volume-c07926ec-05c1-427f-ae0e-3b1c733903ea.5111884f-1a7a-4a95-9996-66a41c0c1aad {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 15:03:59 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [None req-139f28e9-1b0a-42c0-b92e-4260a0d7b2aa tempest-GroupSnapshotsTest-952387378 None] CMD "qemu-img commit -d /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c/volume-c07926ec-05c1-427f-ae0e-3b1c733903ea.5111884f-1a7a-4a95-9996-66a41c0c1aad" returned: 0 in 0.414s {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 15:03:59 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [None req-139f28e9-1b0a-42c0-b92e-4260a0d7b2aa tempest-GroupSnapshotsTest-952387378 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c/volume-c07926ec-05c1-427f-ae0e-3b1c733903ea.5111884f-1a7a-4a95-9996-66a41c0c1aad {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 15:03:59 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [None req-139f28e9-1b0a-42c0-b92e-4260a0d7b2aa tempest-GroupSnapshotsTest-952387378 None] CMD "rm -f /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c/volume-c07926ec-05c1-427f-ae0e-3b1c733903ea.5111884f-1a7a-4a95-9996-66a41c0c1aad" returned: 0 in 0.182s {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 15:04:00 devstack cinder-volume[83259]: DEBUG cinder.coordination [None req-139f28e9-1b0a-42c0-b92e-4260a0d7b2aa tempest-GroupSnapshotsTest-952387378 None] Lock "cinder-quobyte-5111884f-1a7a-4a95-9996-66a41c0c1aad" released by "_delete_snapshot" :: held 2.123s {{(pid=83259) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 16 15:04:00 devstack cinder-volume[83259]: DEBUG cinder.coordination [None req-139f28e9-1b0a-42c0-b92e-4260a0d7b2aa tempest-GroupSnapshotsTest-952387378 None] Lock "cinder-quobyte-c07926ec-05c1-427f-ae0e-3b1c733903ea" released by "delete_snapshot" :: held 2.154s {{(pid=83259) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 16 15:04:00 devstack cinder-volume[83259]: WARNING cinder.quota [None req-139f28e9-1b0a-42c0-b92e-4260a0d7b2aa tempest-GroupSnapshotsTest-952387378 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-719524181 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-719524181, it is now deprecated. Please use the default quota class for default quota. Sep 16 15:04:00 devstack cinder-volume[83259]: DEBUG cinder.quota [None req-139f28e9-1b0a-42c0-b92e-4260a0d7b2aa tempest-GroupSnapshotsTest-952387378 None] Created reservations ['f377f228-7f1e-4797-a332-5b7f1b3855eb', '92b9567d-4052-4235-8c77-75c664c041e2', '84e0bc2b-e1ba-487b-9ad7-0dfe260084dd', '0828dfda-d2aa-48ed-80ce-4cc010e5fc50'] {{(pid=83259) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 16 15:04:00 devstack cinder-volume[83259]: INFO cinder.volume.manager [None req-139f28e9-1b0a-42c0-b92e-4260a0d7b2aa tempest-GroupSnapshotsTest-952387378 None] group_snapshot f6e4d3bc-5ad6-43e8-916d-44233e143490: deleted successfully Sep 16 15:04:00 devstack cinder-volume[83259]: WARNING cinder.volume.volume_utils [req-a92a9d51-5b4c-43f1-8e1a-8eb137b28d9f req-6d3a5f20-8ad8-4348-bb35-3310299e4c32 tempest-VolumesGetTestJSON-880902680 None] Volume driver (QuobyteDriver 1.2) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 16 15:04:00 devstack cinder-volume[83259]: DEBUG cinder.volume.flows.manager.create_volume [req-a92a9d51-5b4c-43f1-8e1a-8eb137b28d9f req-6d3a5f20-8ad8-4348-bb35-3310299e4c32 tempest-VolumesGetTestJSON-880902680 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#Quobyte'], 'hosts': ['devstack@QuobyteHD#Quobyte']} {{(pid=83259) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1387}} Sep 16 15:04:00 devstack cinder-volume[83259]: DEBUG cinder.volume.manager [req-a92a9d51-5b4c-43f1-8e1a-8eb137b28d9f req-6d3a5f20-8ad8-4348-bb35-3310299e4c32 tempest-VolumesGetTestJSON-880902680 None] Flow 'volume_create_manager' (5754f09d-eef3-483c-8b04-74d6cfd486f7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83259) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 16 15:04:00 devstack cinder-volume[83259]: DEBUG cinder.volume.manager [req-a92a9d51-5b4c-43f1-8e1a-8eb137b28d9f req-6d3a5f20-8ad8-4348-bb35-3310299e4c32 tempest-VolumesGetTestJSON-880902680 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ca537625-c130-4020-ac7d-06dd9ec998b8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83259) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 15:04:00 devstack cinder-volume[83259]: DEBUG cinder.volume.manager [req-a92a9d51-5b4c-43f1-8e1a-8eb137b28d9f req-6d3a5f20-8ad8-4348-bb35-3310299e4c32 tempest-VolumesGetTestJSON-880902680 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ca537625-c130-4020-ac7d-06dd9ec998b8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-16T13:04:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTestJSON-Volume-363656168',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#Quobyte',id=bdda4aa8-fb23-47da-8a72-94228782da1d,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='8e3143e516804d919b7f523d985c1e1e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-16T13:04:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-16T13:04:01Z,use_quota=True,user_id='3aa8a7576f764ae8826b0e543d55aec8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(485ead50-3df8-4d76-8d34-a4db136c980a),volume_type_id=485ead50-3df8-4d76-8d34-a4db136c980a)' {{(pid=83259) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 15:04:00 devstack cinder-volume[83259]: DEBUG cinder.volume.manager [req-a92a9d51-5b4c-43f1-8e1a-8eb137b28d9f req-6d3a5f20-8ad8-4348-bb35-3310299e4c32 tempest-VolumesGetTestJSON-880902680 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f080e5d5-4048-4515-bc1f-4bfd1e970667) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83259) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 15:04:00 devstack cinder-volume[83259]: DEBUG cinder.volume.manager [req-a92a9d51-5b4c-43f1-8e1a-8eb137b28d9f req-6d3a5f20-8ad8-4348-bb35-3310299e4c32 tempest-VolumesGetTestJSON-880902680 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f080e5d5-4048-4515-bc1f-4bfd1e970667) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83259) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 15:04:00 devstack cinder-volume[83259]: DEBUG cinder.volume.manager [req-a92a9d51-5b4c-43f1-8e1a-8eb137b28d9f req-6d3a5f20-8ad8-4348-bb35-3310299e4c32 tempest-VolumesGetTestJSON-880902680 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (11c2540d-bc1d-4bb6-a1db-aab889b48be1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83259) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 15:04:00 devstack cinder-volume[83259]: DEBUG cinder.volume.manager [req-a92a9d51-5b4c-43f1-8e1a-8eb137b28d9f req-6d3a5f20-8ad8-4348-bb35-3310299e4c32 tempest-VolumesGetTestJSON-880902680 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (11c2540d-bc1d-4bb6-a1db-aab889b48be1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'bdda4aa8-fb23-47da-8a72-94228782da1d', 'volume_name': 'volume-bdda4aa8-fb23-47da-8a72-94228782da1d', 'volume_size': 1}' {{(pid=83259) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 15:04:00 devstack cinder-volume[83259]: DEBUG cinder.volume.manager [req-a92a9d51-5b4c-43f1-8e1a-8eb137b28d9f req-6d3a5f20-8ad8-4348-bb35-3310299e4c32 tempest-VolumesGetTestJSON-880902680 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (66751f6a-362a-4c20-9b47-b588fd541067) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83259) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 15:04:00 devstack cinder-volume[83259]: DEBUG cinder.volume.manager [req-a92a9d51-5b4c-43f1-8e1a-8eb137b28d9f req-6d3a5f20-8ad8-4348-bb35-3310299e4c32 tempest-VolumesGetTestJSON-880902680 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (66751f6a-362a-4c20-9b47-b588fd541067) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83259) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 15:04:00 devstack cinder-volume[83259]: DEBUG cinder.volume.manager [req-a92a9d51-5b4c-43f1-8e1a-8eb137b28d9f req-6d3a5f20-8ad8-4348-bb35-3310299e4c32 tempest-VolumesGetTestJSON-880902680 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e45e2a31-f385-440f-a3ac-dc981ae12f90) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83259) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 15:04:00 devstack cinder-volume[83259]: INFO cinder.volume.flows.manager.create_volume [req-a92a9d51-5b4c-43f1-8e1a-8eb137b28d9f req-6d3a5f20-8ad8-4348-bb35-3310299e4c32 tempest-VolumesGetTestJSON-880902680 None] Volume bdda4aa8-fb23-47da-8a72-94228782da1d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-bdda4aa8-fb23-47da-8a72-94228782da1d', 'volume_size': 1} Sep 16 15:04:00 devstack cinder-volume[83259]: DEBUG oslo_concurrency.lockutils [req-a92a9d51-5b4c-43f1-8e1a-8eb137b28d9f req-6d3a5f20-8ad8-4348-bb35-3310299e4c32 tempest-VolumesGetTestJSON-880902680 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83259) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 16 15:04:00 devstack cinder-volume[83259]: DEBUG oslo_concurrency.lockutils [req-a92a9d51-5b4c-43f1-8e1a-8eb137b28d9f req-6d3a5f20-8ad8-4348-bb35-3310299e4c32 tempest-VolumesGetTestJSON-880902680 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.003s {{(pid=83259) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 16 15:04:00 devstack cinder-volume[83259]: DEBUG cinder.volume.drivers.quobyte [req-a92a9d51-5b4c-43f1-8e1a-8eb137b28d9f req-6d3a5f20-8ad8-4348-bb35-3310299e4c32 tempest-VolumesGetTestJSON-880902680 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-16T13:04:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTestJSON-Volume-363656168',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#Quobyte',id=bdda4aa8-fb23-47da-8a72-94228782da1d,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='8e3143e516804d919b7f523d985c1e1e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-16T13:04:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-16T13:04:01Z,use_quota=True,user_id='3aa8a7576f764ae8826b0e543d55aec8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(485ead50-3df8-4d76-8d34-a4db136c980a),volume_type_id=485ead50-3df8-4d76-8d34-a4db136c980a)}" {{(pid=83259) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Sep 16 15:04:01 devstack cinder-volume[83259]: DEBUG cinder.volume.drivers.remotefs [req-a92a9d51-5b4c-43f1-8e1a-8eb137b28d9f req-6d3a5f20-8ad8-4348-bb35-3310299e4c32 tempest-VolumesGetTestJSON-880902680 None] Creating volume bdda4aa8-fb23-47da-8a72-94228782da1d {{(pid=83259) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}} Sep 16 15:04:01 devstack cinder-volume[83259]: DEBUG oslo_concurrency.lockutils [req-a92a9d51-5b4c-43f1-8e1a-8eb137b28d9f req-6d3a5f20-8ad8-4348-bb35-3310299e4c32 tempest-VolumesGetTestJSON-880902680 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83259) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 16 15:04:01 devstack cinder-volume[83259]: DEBUG oslo_concurrency.lockutils [req-a92a9d51-5b4c-43f1-8e1a-8eb137b28d9f req-6d3a5f20-8ad8-4348-bb35-3310299e4c32 tempest-VolumesGetTestJSON-880902680 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83259) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 16 15:04:01 devstack cinder-volume[83259]: DEBUG cinder.volume.drivers.quobyte [req-a92a9d51-5b4c-43f1-8e1a-8eb137b28d9f req-6d3a5f20-8ad8-4348-bb35-3310299e4c32 tempest-VolumesGetTestJSON-880902680 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-61f585ac-f8e2-4d19-a890-7ebc2726cc72': None} {{(pid=83259) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:639}} Sep 16 15:04:01 devstack cinder-volume[83259]: DEBUG cinder.volume.drivers.quobyte [req-a92a9d51-5b4c-43f1-8e1a-8eb137b28d9f req-6d3a5f20-8ad8-4348-bb35-3310299e4c32 tempest-VolumesGetTestJSON-880902680 None] Available shares ['10.10.41.181/cinder-vol-61f585ac-f8e2-4d19-a890-7ebc2726cc72'] {{(pid=83259) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:669}} Sep 16 15:04:01 devstack cinder-volume[83259]: DEBUG oslo_concurrency.lockutils [req-a92a9d51-5b4c-43f1-8e1a-8eb137b28d9f req-6d3a5f20-8ad8-4348-bb35-3310299e4c32 tempest-VolumesGetTestJSON-880902680 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=83259) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 16 15:04:01 devstack cinder-volume[83259]: DEBUG cinder.volume.drivers.quobyte [req-a92a9d51-5b4c-43f1-8e1a-8eb137b28d9f req-6d3a5f20-8ad8-4348-bb35-3310299e4c32 tempest-VolumesGetTestJSON-880902680 None] Selected 10.10.41.181/cinder-vol-61f585ac-f8e2-4d19-a890-7ebc2726cc72 as target Quobyte volume. {{(pid=83259) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:690}} Sep 16 15:04:01 devstack cinder-volume[83259]: INFO cinder.volume.drivers.remotefs [req-a92a9d51-5b4c-43f1-8e1a-8eb137b28d9f req-6d3a5f20-8ad8-4348-bb35-3310299e4c32 tempest-VolumesGetTestJSON-880902680 None] casted to 10.10.41.181/cinder-vol-61f585ac-f8e2-4d19-a890-7ebc2726cc72 Sep 16 15:04:01 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [req-a92a9d51-5b4c-43f1-8e1a-8eb137b28d9f req-6d3a5f20-8ad8-4348-bb35-3310299e4c32 tempest-VolumesGetTestJSON-880902680 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c/volume-bdda4aa8-fb23-47da-8a72-94228782da1d 1073741824 {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 15:04:01 devstack quobyte-client[83286]: System call of process 93139 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 16 15:04:01 devstack quobyte-client[83286]: The server volume:87712ffe-8a69-446d-9ed6-4430c7ee9792@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=87712ffe-8a69-446d-9ed6-4430c7ee9792, inode=40, name=volume-bdda4aa8-fb23-47da-8a72-94228782da1d, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.206), requestorAccessMask=0 Sep 16 15:04:01 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [req-a92a9d51-5b4c-43f1-8e1a-8eb137b28d9f req-6d3a5f20-8ad8-4348-bb35-3310299e4c32 tempest-VolumesGetTestJSON-880902680 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c/volume-bdda4aa8-fb23-47da-8a72-94228782da1d 1073741824" returned: 0 in 0.684s {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 15:04:01 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [req-a92a9d51-5b4c-43f1-8e1a-8eb137b28d9f req-6d3a5f20-8ad8-4348-bb35-3310299e4c32 tempest-VolumesGetTestJSON-880902680 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c/volume-bdda4aa8-fb23-47da-8a72-94228782da1d {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 15:04:02 devstack cinder-volume[83259]: WARNING cinder.volume.volume_utils [None req-9b7caf8c-f461-46c8-bc2b-ea606fe725d6 tempest-GroupSnapshotsTest-952387378 None] Volume driver (QuobyteDriver 1.2) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 16 15:04:02 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [req-a92a9d51-5b4c-43f1-8e1a-8eb137b28d9f req-6d3a5f20-8ad8-4348-bb35-3310299e4c32 tempest-VolumesGetTestJSON-880902680 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c/volume-bdda4aa8-fb23-47da-8a72-94228782da1d" returned: 0 in 0.422s {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 15:04:02 devstack cinder-volume[83259]: DEBUG cinder.coordination [None req-9b7caf8c-f461-46c8-bc2b-ea606fe725d6 tempest-GroupSnapshotsTest-952387378 None] Acquiring lock "cinder-quobyte-c07926ec-05c1-427f-ae0e-3b1c733903ea" by "delete_volume" {{(pid=83259) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 16 15:04:02 devstack cinder-volume[83259]: DEBUG cinder.volume.drivers.quobyte [req-a92a9d51-5b4c-43f1-8e1a-8eb137b28d9f req-6d3a5f20-8ad8-4348-bb35-3310299e4c32 tempest-VolumesGetTestJSON-880902680 None] <== create_volume: return (1152ms) {'provider_location': '10.10.41.181/cinder-vol-61f585ac-f8e2-4d19-a890-7ebc2726cc72'} {{(pid=83259) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Sep 16 15:04:02 devstack cinder-volume[83259]: DEBUG oslo_concurrency.lockutils [req-a92a9d51-5b4c-43f1-8e1a-8eb137b28d9f req-6d3a5f20-8ad8-4348-bb35-3310299e4c32 tempest-VolumesGetTestJSON-880902680 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.166s {{(pid=83259) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 16 15:04:02 devstack cinder-volume[83259]: WARNING cinder.volume.volume_utils [None req-d254bb78-2e95-41f7-96ee-b7aeaa1efadc tempest-VolumesSnapshotNegativeTestJSON-4318571 None] Volume driver (QuobyteDriver 1.2) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 16 15:04:02 devstack cinder-volume[83259]: DEBUG cinder.volume.flows.manager.create_volume [None req-d254bb78-2e95-41f7-96ee-b7aeaa1efadc tempest-VolumesSnapshotNegativeTestJSON-4318571 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#Quobyte'], 'hosts': ['devstack@QuobyteHD#Quobyte']} {{(pid=83259) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1387}} Sep 16 15:04:02 devstack cinder-volume[83259]: DEBUG cinder.volume.manager [None req-d254bb78-2e95-41f7-96ee-b7aeaa1efadc tempest-VolumesSnapshotNegativeTestJSON-4318571 None] Flow 'volume_create_manager' (04bcd70d-44fa-46b0-b504-97258a955e74) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83259) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 16 15:04:02 devstack cinder-volume[83259]: DEBUG cinder.volume.manager [None req-d254bb78-2e95-41f7-96ee-b7aeaa1efadc tempest-VolumesSnapshotNegativeTestJSON-4318571 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (62281bc5-2259-4be7-ae9b-1963a43d73c2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83259) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 15:04:02 devstack cinder-volume[83259]: DEBUG cinder.coordination [None req-9b7caf8c-f461-46c8-bc2b-ea606fe725d6 tempest-GroupSnapshotsTest-952387378 None] Lock "cinder-quobyte-c07926ec-05c1-427f-ae0e-3b1c733903ea" acquired by "delete_volume" :: waited 0.124s {{(pid=83259) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 16 15:04:02 devstack cinder-volume[83259]: DEBUG cinder.volume.manager [req-a92a9d51-5b4c-43f1-8e1a-8eb137b28d9f req-6d3a5f20-8ad8-4348-bb35-3310299e4c32 tempest-VolumesGetTestJSON-880902680 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e45e2a31-f385-440f-a3ac-dc981ae12f90) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-bdda4aa8-fb23-47da-8a72-94228782da1d', 'volume_size': 1}' {{(pid=83259) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 15:04:02 devstack cinder-volume[83259]: DEBUG cinder.volume.manager [req-a92a9d51-5b4c-43f1-8e1a-8eb137b28d9f req-6d3a5f20-8ad8-4348-bb35-3310299e4c32 tempest-VolumesGetTestJSON-880902680 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (07fc1de7-0f67-4c34-a959-9bf286c1513a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83259) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 15:04:02 devstack cinder-volume[83259]: DEBUG oslo.privsep.daemon [-] privsep: reply[8fb30802-8ec2-4055-a407-dfb8a28aca18]: (4, 'qcow2') {{(pid=84312) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 16 15:04:02 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [None req-9b7caf8c-f461-46c8-bc2b-ea606fe725d6 tempest-GroupSnapshotsTest-952387378 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c/volume-c07926ec-05c1-427f-ae0e-3b1c733903ea {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 15:04:02 devstack cinder-volume[83259]: INFO cinder.volume.flows.manager.create_volume [req-a92a9d51-5b4c-43f1-8e1a-8eb137b28d9f req-6d3a5f20-8ad8-4348-bb35-3310299e4c32 tempest-VolumesGetTestJSON-880902680 None] Volume volume-bdda4aa8-fb23-47da-8a72-94228782da1d (bdda4aa8-fb23-47da-8a72-94228782da1d): created successfully Sep 16 15:04:02 devstack cinder-volume[83259]: DEBUG cinder.volume.manager [req-a92a9d51-5b4c-43f1-8e1a-8eb137b28d9f req-6d3a5f20-8ad8-4348-bb35-3310299e4c32 tempest-VolumesGetTestJSON-880902680 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (07fc1de7-0f67-4c34-a959-9bf286c1513a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83259) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 15:04:02 devstack cinder-volume[83259]: DEBUG cinder.volume.manager [req-a92a9d51-5b4c-43f1-8e1a-8eb137b28d9f req-6d3a5f20-8ad8-4348-bb35-3310299e4c32 tempest-VolumesGetTestJSON-880902680 None] Flow 'volume_create_manager' (5754f09d-eef3-483c-8b04-74d6cfd486f7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83259) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 16 15:04:02 devstack cinder-volume[83259]: DEBUG cinder.volume.manager [None req-d254bb78-2e95-41f7-96ee-b7aeaa1efadc tempest-VolumesSnapshotNegativeTestJSON-4318571 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (62281bc5-2259-4be7-ae9b-1963a43d73c2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-16T13:04:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotNegativeTestJSON-Volume-1386925091',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#Quobyte',id=19c4081c-c888-4244-b9a8-3a82ffcbe57a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d649413edaaa4bca92b00879ed407eff',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-16T13:04:02Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-16T13:04:02Z,use_quota=True,user_id='745d70eb066649f69a72cdae49e297ba',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(485ead50-3df8-4d76-8d34-a4db136c980a),volume_type_id=485ead50-3df8-4d76-8d34-a4db136c980a)' {{(pid=83259) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 15:04:02 devstack cinder-volume[83259]: DEBUG cinder.volume.manager [None req-d254bb78-2e95-41f7-96ee-b7aeaa1efadc tempest-VolumesSnapshotNegativeTestJSON-4318571 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (74f110f1-74f8-49d1-9225-64bc0b184833) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83259) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 15:04:02 devstack cinder-volume[83259]: DEBUG cinder.volume.manager [None req-d254bb78-2e95-41f7-96ee-b7aeaa1efadc tempest-VolumesSnapshotNegativeTestJSON-4318571 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (74f110f1-74f8-49d1-9225-64bc0b184833) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83259) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 15:04:02 devstack cinder-volume[83259]: DEBUG cinder.volume.manager [None req-d254bb78-2e95-41f7-96ee-b7aeaa1efadc tempest-VolumesSnapshotNegativeTestJSON-4318571 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (eb2c8237-bbfe-4532-ae41-6204ce9cf391) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83259) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 15:04:02 devstack cinder-volume[83259]: DEBUG cinder.volume.manager [None req-d254bb78-2e95-41f7-96ee-b7aeaa1efadc tempest-VolumesSnapshotNegativeTestJSON-4318571 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (eb2c8237-bbfe-4532-ae41-6204ce9cf391) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '19c4081c-c888-4244-b9a8-3a82ffcbe57a', 'volume_name': 'volume-19c4081c-c888-4244-b9a8-3a82ffcbe57a', 'volume_size': 2}' {{(pid=83259) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 15:04:02 devstack cinder-volume[83259]: DEBUG cinder.volume.manager [None req-d254bb78-2e95-41f7-96ee-b7aeaa1efadc tempest-VolumesSnapshotNegativeTestJSON-4318571 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (efe6a902-328c-41f2-ae46-e3376793be9a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83259) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 15:04:02 devstack cinder-volume[83259]: DEBUG cinder.volume.manager [None req-d254bb78-2e95-41f7-96ee-b7aeaa1efadc tempest-VolumesSnapshotNegativeTestJSON-4318571 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (efe6a902-328c-41f2-ae46-e3376793be9a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83259) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 15:04:02 devstack cinder-volume[83259]: DEBUG cinder.volume.manager [None req-d254bb78-2e95-41f7-96ee-b7aeaa1efadc tempest-VolumesSnapshotNegativeTestJSON-4318571 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6b3ba5db-4708-4cf9-98d2-a041d1d4fdd1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83259) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 15:04:02 devstack cinder-volume[83259]: INFO cinder.volume.flows.manager.create_volume [None req-d254bb78-2e95-41f7-96ee-b7aeaa1efadc tempest-VolumesSnapshotNegativeTestJSON-4318571 None] Volume 19c4081c-c888-4244-b9a8-3a82ffcbe57a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-19c4081c-c888-4244-b9a8-3a82ffcbe57a', 'volume_size': 2} Sep 16 15:04:02 devstack cinder-volume[83259]: DEBUG oslo_concurrency.lockutils [None req-d254bb78-2e95-41f7-96ee-b7aeaa1efadc tempest-VolumesSnapshotNegativeTestJSON-4318571 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83259) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 16 15:04:02 devstack cinder-volume[83259]: DEBUG oslo_concurrency.lockutils [None req-d254bb78-2e95-41f7-96ee-b7aeaa1efadc tempest-VolumesSnapshotNegativeTestJSON-4318571 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.004s {{(pid=83259) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 16 15:04:02 devstack cinder-volume[83259]: DEBUG cinder.volume.drivers.quobyte [None req-d254bb78-2e95-41f7-96ee-b7aeaa1efadc tempest-VolumesSnapshotNegativeTestJSON-4318571 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-16T13:04:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotNegativeTestJSON-Volume-1386925091',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#Quobyte',id=19c4081c-c888-4244-b9a8-3a82ffcbe57a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d649413edaaa4bca92b00879ed407eff',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-16T13:04:02Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-16T13:04:02Z,use_quota=True,user_id='745d70eb066649f69a72cdae49e297ba',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(485ead50-3df8-4d76-8d34-a4db136c980a),volume_type_id=485ead50-3df8-4d76-8d34-a4db136c980a)}" {{(pid=83259) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Sep 16 15:04:02 devstack cinder-volume[83259]: DEBUG cinder.volume.drivers.remotefs [None req-d254bb78-2e95-41f7-96ee-b7aeaa1efadc tempest-VolumesSnapshotNegativeTestJSON-4318571 None] Creating volume 19c4081c-c888-4244-b9a8-3a82ffcbe57a {{(pid=83259) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}} Sep 16 15:04:02 devstack cinder-volume[83259]: DEBUG oslo_concurrency.lockutils [None req-d254bb78-2e95-41f7-96ee-b7aeaa1efadc tempest-VolumesSnapshotNegativeTestJSON-4318571 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83259) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 16 15:04:02 devstack cinder-volume[83259]: DEBUG oslo_concurrency.lockutils [None req-d254bb78-2e95-41f7-96ee-b7aeaa1efadc tempest-VolumesSnapshotNegativeTestJSON-4318571 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83259) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 16 15:04:02 devstack cinder-volume[83259]: DEBUG cinder.volume.drivers.quobyte [None req-d254bb78-2e95-41f7-96ee-b7aeaa1efadc tempest-VolumesSnapshotNegativeTestJSON-4318571 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-61f585ac-f8e2-4d19-a890-7ebc2726cc72': None} {{(pid=83259) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:639}} Sep 16 15:04:02 devstack cinder-volume[83259]: DEBUG cinder.volume.drivers.quobyte [None req-d254bb78-2e95-41f7-96ee-b7aeaa1efadc tempest-VolumesSnapshotNegativeTestJSON-4318571 None] Available shares ['10.10.41.181/cinder-vol-61f585ac-f8e2-4d19-a890-7ebc2726cc72'] {{(pid=83259) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:669}} Sep 16 15:04:02 devstack cinder-volume[83259]: DEBUG oslo_concurrency.lockutils [None req-d254bb78-2e95-41f7-96ee-b7aeaa1efadc tempest-VolumesSnapshotNegativeTestJSON-4318571 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.043s {{(pid=83259) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 16 15:04:02 devstack cinder-volume[83259]: DEBUG cinder.volume.drivers.quobyte [None req-d254bb78-2e95-41f7-96ee-b7aeaa1efadc tempest-VolumesSnapshotNegativeTestJSON-4318571 None] Selected 10.10.41.181/cinder-vol-61f585ac-f8e2-4d19-a890-7ebc2726cc72 as target Quobyte volume. {{(pid=83259) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:690}} Sep 16 15:04:02 devstack cinder-volume[83259]: INFO cinder.volume.drivers.remotefs [None req-d254bb78-2e95-41f7-96ee-b7aeaa1efadc tempest-VolumesSnapshotNegativeTestJSON-4318571 None] casted to 10.10.41.181/cinder-vol-61f585ac-f8e2-4d19-a890-7ebc2726cc72 Sep 16 15:04:02 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [None req-d254bb78-2e95-41f7-96ee-b7aeaa1efadc tempest-VolumesSnapshotNegativeTestJSON-4318571 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c/volume-19c4081c-c888-4244-b9a8-3a82ffcbe57a 2147483648 {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 15:04:03 devstack quobyte-client[83286]: System call of process 93144 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 16 15:04:03 devstack quobyte-client[83286]: The server volume:87712ffe-8a69-446d-9ed6-4430c7ee9792@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=87712ffe-8a69-446d-9ed6-4430c7ee9792, inode=41, name=volume-19c4081c-c888-4244-b9a8-3a82ffcbe57a, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.206), requestorAccessMask=0 Sep 16 15:04:03 devstack cinder-volume[83259]: INFO cinder.volume.manager [req-a92a9d51-5b4c-43f1-8e1a-8eb137b28d9f req-6d3a5f20-8ad8-4348-bb35-3310299e4c32 tempest-VolumesGetTestJSON-880902680 None] Created volume successfully. Sep 16 15:04:03 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [None req-9b7caf8c-f461-46c8-bc2b-ea606fe725d6 tempest-GroupSnapshotsTest-952387378 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c/volume-c07926ec-05c1-427f-ae0e-3b1c733903ea" returned: 0 in 0.915s {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 15:04:03 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [None req-9b7caf8c-f461-46c8-bc2b-ea606fe725d6 tempest-GroupSnapshotsTest-952387378 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c/volume-c07926ec-05c1-427f-ae0e-3b1c733903ea {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 15:04:03 devstack cinder-volume[83259]: DEBUG cinder.coordination [req-b8248425-d25d-4640-831c-2a9261f446da req-ca566166-ec07-458c-a53e-caece50dc679 tempest-VolumesGetTestJSON-880902680 None] Acquiring lock "cinder-bdda4aa8-fb23-47da-8a72-94228782da1d-delete_volume" by "delete_volume" {{(pid=83259) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 16 15:04:03 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [None req-d254bb78-2e95-41f7-96ee-b7aeaa1efadc tempest-VolumesSnapshotNegativeTestJSON-4318571 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c/volume-19c4081c-c888-4244-b9a8-3a82ffcbe57a 2147483648" returned: 0 in 0.803s {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 15:04:03 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [None req-9b7caf8c-f461-46c8-bc2b-ea606fe725d6 tempest-GroupSnapshotsTest-952387378 None] CMD "rm -f /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c/volume-c07926ec-05c1-427f-ae0e-3b1c733903ea" returned: 0 in 0.352s {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 15:04:03 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [None req-d254bb78-2e95-41f7-96ee-b7aeaa1efadc tempest-VolumesSnapshotNegativeTestJSON-4318571 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c/volume-19c4081c-c888-4244-b9a8-3a82ffcbe57a {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 15:04:03 devstack cinder-volume[83259]: DEBUG cinder.coordination [None req-9b7caf8c-f461-46c8-bc2b-ea606fe725d6 tempest-GroupSnapshotsTest-952387378 None] Lock "cinder-quobyte-c07926ec-05c1-427f-ae0e-3b1c733903ea" released by "delete_volume" :: held 1.566s {{(pid=83259) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 16 15:04:04 devstack cinder-volume[83259]: DEBUG cinder.coordination [req-b8248425-d25d-4640-831c-2a9261f446da req-ca566166-ec07-458c-a53e-caece50dc679 tempest-VolumesGetTestJSON-880902680 None] Lock "cinder-bdda4aa8-fb23-47da-8a72-94228782da1d-delete_volume" acquired by "delete_volume" :: waited 0.505s {{(pid=83259) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 16 15:04:04 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [None req-d254bb78-2e95-41f7-96ee-b7aeaa1efadc tempest-VolumesSnapshotNegativeTestJSON-4318571 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c/volume-19c4081c-c888-4244-b9a8-3a82ffcbe57a" returned: 0 in 0.441s {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 15:04:04 devstack cinder-volume[83259]: DEBUG cinder.volume.drivers.quobyte [None req-d254bb78-2e95-41f7-96ee-b7aeaa1efadc tempest-VolumesSnapshotNegativeTestJSON-4318571 None] <== create_volume: return (1301ms) {'provider_location': '10.10.41.181/cinder-vol-61f585ac-f8e2-4d19-a890-7ebc2726cc72'} {{(pid=83259) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Sep 16 15:04:04 devstack cinder-volume[83259]: DEBUG oslo_concurrency.lockutils [None req-d254bb78-2e95-41f7-96ee-b7aeaa1efadc tempest-VolumesSnapshotNegativeTestJSON-4318571 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.313s {{(pid=83259) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 16 15:04:04 devstack cinder-volume[83259]: DEBUG cinder.volume.manager [None req-d254bb78-2e95-41f7-96ee-b7aeaa1efadc tempest-VolumesSnapshotNegativeTestJSON-4318571 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6b3ba5db-4708-4cf9-98d2-a041d1d4fdd1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-19c4081c-c888-4244-b9a8-3a82ffcbe57a', 'volume_size': 2}' {{(pid=83259) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 15:04:04 devstack cinder-volume[83259]: DEBUG cinder.volume.manager [None req-d254bb78-2e95-41f7-96ee-b7aeaa1efadc tempest-VolumesSnapshotNegativeTestJSON-4318571 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (af6010e5-3ba1-4f36-8c32-af8b66f5b327) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83259) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 15:04:04 devstack cinder-volume[83259]: WARNING cinder.volume.volume_utils [req-b8248425-d25d-4640-831c-2a9261f446da req-ca566166-ec07-458c-a53e-caece50dc679 tempest-VolumesGetTestJSON-880902680 None] Volume driver (QuobyteDriver 1.2) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 16 15:04:04 devstack cinder-volume[83259]: DEBUG cinder.coordination [req-b8248425-d25d-4640-831c-2a9261f446da req-ca566166-ec07-458c-a53e-caece50dc679 tempest-VolumesGetTestJSON-880902680 None] Acquiring lock "cinder-quobyte-bdda4aa8-fb23-47da-8a72-94228782da1d" by "delete_volume" {{(pid=83259) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 16 15:04:04 devstack cinder-volume[83259]: INFO cinder.volume.flows.manager.create_volume [None req-d254bb78-2e95-41f7-96ee-b7aeaa1efadc tempest-VolumesSnapshotNegativeTestJSON-4318571 None] Volume volume-19c4081c-c888-4244-b9a8-3a82ffcbe57a (19c4081c-c888-4244-b9a8-3a82ffcbe57a): created successfully Sep 16 15:04:04 devstack cinder-volume[83259]: DEBUG cinder.volume.manager [None req-d254bb78-2e95-41f7-96ee-b7aeaa1efadc tempest-VolumesSnapshotNegativeTestJSON-4318571 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (af6010e5-3ba1-4f36-8c32-af8b66f5b327) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83259) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 15:04:04 devstack cinder-volume[83259]: DEBUG cinder.volume.manager [None req-d254bb78-2e95-41f7-96ee-b7aeaa1efadc tempest-VolumesSnapshotNegativeTestJSON-4318571 None] Flow 'volume_create_manager' (04bcd70d-44fa-46b0-b504-97258a955e74) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83259) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 16 15:04:04 devstack cinder-volume[83259]: DEBUG cinder.coordination [req-b8248425-d25d-4640-831c-2a9261f446da req-ca566166-ec07-458c-a53e-caece50dc679 tempest-VolumesGetTestJSON-880902680 None] Lock "cinder-quobyte-bdda4aa8-fb23-47da-8a72-94228782da1d" acquired by "delete_volume" :: waited 0.044s {{(pid=83259) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 16 15:04:04 devstack cinder-volume[83259]: DEBUG oslo.privsep.daemon [-] privsep: reply[a8599898-d019-474a-90f8-ef8977b6c284]: (4, 'qcow2') {{(pid=84312) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 16 15:04:04 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [req-b8248425-d25d-4640-831c-2a9261f446da req-ca566166-ec07-458c-a53e-caece50dc679 tempest-VolumesGetTestJSON-880902680 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c/volume-bdda4aa8-fb23-47da-8a72-94228782da1d {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 15:04:04 devstack cinder-volume[83259]: INFO cinder.volume.manager [None req-d254bb78-2e95-41f7-96ee-b7aeaa1efadc tempest-VolumesSnapshotNegativeTestJSON-4318571 None] Created volume successfully. Sep 16 15:04:04 devstack cinder-volume[83259]: DEBUG cinder.quota [None req-9b7caf8c-f461-46c8-bc2b-ea606fe725d6 tempest-GroupSnapshotsTest-952387378 None] Created reservations ['63eee38d-1b88-47bc-a99c-7f53f75940f7'] {{(pid=83259) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 16 15:04:04 devstack cinder-volume[83259]: WARNING cinder.db.sqlalchemy.api [None req-9b7caf8c-f461-46c8-bc2b-ea606fe725d6 tempest-GroupSnapshotsTest-952387378 None] Reservation would make usage less than 0 for the following resources, so on commit they will be limited to prevent going below 0: ['gigabytes', 'gigabytes_tempest-GroupSnapshotsTest-volume-type-719524181'] Sep 16 15:04:04 devstack cinder-volume[83259]: DEBUG cinder.quota [None req-9b7caf8c-f461-46c8-bc2b-ea606fe725d6 tempest-GroupSnapshotsTest-952387378 None] Created reservations ['5a295ee5-14c3-4877-a89a-35a2842d1e8a', '37fe17ac-c6d1-41de-ae2a-4a133724c4c3', '54af710a-9caf-48cf-ab26-12ebbe6b23dd', 'f7d1dee8-20bd-4741-8ca6-9e154a95de28'] {{(pid=83259) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 16 15:04:04 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [req-b8248425-d25d-4640-831c-2a9261f446da req-ca566166-ec07-458c-a53e-caece50dc679 tempest-VolumesGetTestJSON-880902680 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c/volume-bdda4aa8-fb23-47da-8a72-94228782da1d" returned: 0 in 0.567s {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 15:04:04 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [req-b8248425-d25d-4640-831c-2a9261f446da req-ca566166-ec07-458c-a53e-caece50dc679 tempest-VolumesGetTestJSON-880902680 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c/volume-bdda4aa8-fb23-47da-8a72-94228782da1d {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 15:04:05 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [req-b8248425-d25d-4640-831c-2a9261f446da req-ca566166-ec07-458c-a53e-caece50dc679 tempest-VolumesGetTestJSON-880902680 None] CMD "rm -f /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c/volume-bdda4aa8-fb23-47da-8a72-94228782da1d" returned: 0 in 0.316s {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 15:04:05 devstack cinder-volume[83259]: DEBUG cinder.coordination [req-b8248425-d25d-4640-831c-2a9261f446da req-ca566166-ec07-458c-a53e-caece50dc679 tempest-VolumesGetTestJSON-880902680 None] Lock "cinder-quobyte-bdda4aa8-fb23-47da-8a72-94228782da1d" released by "delete_volume" :: held 1.028s {{(pid=83259) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 16 15:04:05 devstack cinder-volume[83259]: DEBUG cinder.quota [req-b8248425-d25d-4640-831c-2a9261f446da req-ca566166-ec07-458c-a53e-caece50dc679 tempest-VolumesGetTestJSON-880902680 None] Created reservations ['45c19ae2-0e9b-4226-a874-e709f6131b00', '74b9dd86-a7fa-43f3-bd8d-0f1bc806f2ad', '9e80adfd-19d1-400a-8e7a-b73d310721a7', 'b29c1dea-8a59-4f6a-bae9-7e30cb7b2138'] {{(pid=83259) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 16 15:04:05 devstack cinder-volume[83259]: DEBUG oslo_concurrency.lockutils [None req-9b7caf8c-f461-46c8-bc2b-ea606fe725d6 tempest-GroupSnapshotsTest-952387378 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83259) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 16 15:04:05 devstack cinder-volume[83259]: DEBUG oslo_concurrency.lockutils [None req-9b7caf8c-f461-46c8-bc2b-ea606fe725d6 tempest-GroupSnapshotsTest-952387378 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=83259) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 16 15:04:05 devstack cinder-volume[83259]: DEBUG cinder.volume.drivers.quobyte [None req-9b7caf8c-f461-46c8-bc2b-ea606fe725d6 tempest-GroupSnapshotsTest-952387378 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-61f585ac-f8e2-4d19-a890-7ebc2726cc72': None} {{(pid=83259) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:639}} Sep 16 15:04:05 devstack cinder-volume[83259]: DEBUG cinder.volume.drivers.quobyte [None req-9b7caf8c-f461-46c8-bc2b-ea606fe725d6 tempest-GroupSnapshotsTest-952387378 None] Available shares ['10.10.41.181/cinder-vol-61f585ac-f8e2-4d19-a890-7ebc2726cc72'] {{(pid=83259) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:669}} Sep 16 15:04:05 devstack cinder-volume[83259]: DEBUG oslo_concurrency.lockutils [None req-9b7caf8c-f461-46c8-bc2b-ea606fe725d6 tempest-GroupSnapshotsTest-952387378 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=83259) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 16 15:04:05 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [None req-9b7caf8c-f461-46c8-bc2b-ea606fe725d6 tempest-GroupSnapshotsTest-952387378 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 15:04:05 devstack cinder-volume[83259]: WARNING cinder.volume.volume_utils [None req-b41c6b59-e74a-4f3f-8276-77e286e1d872 tempest-VolumesSnapshotNegativeTestJSON-4318571 None] Volume driver (QuobyteDriver 1.2) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 16 15:04:05 devstack cinder-volume[83259]: DEBUG oslo_concurrency.lockutils [None req-b41c6b59-e74a-4f3f-8276-77e286e1d872 tempest-VolumesSnapshotNegativeTestJSON-4318571 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=83259) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 16 15:04:05 devstack cinder-volume[83259]: DEBUG oslo_concurrency.lockutils [None req-b41c6b59-e74a-4f3f-8276-77e286e1d872 tempest-VolumesSnapshotNegativeTestJSON-4318571 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.007s {{(pid=83259) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 16 15:04:06 devstack cinder-volume[83259]: DEBUG cinder.volume.drivers.remotefs [None req-b41c6b59-e74a-4f3f-8276-77e286e1d872 tempest-VolumesSnapshotNegativeTestJSON-4318571 None] Creating offline snapshot 215a2f8b-5b97-4da6-b766-08ad1d9efc86 of volume 19c4081c-c888-4244-b9a8-3a82ffcbe57a {{(pid=83259) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1694}} Sep 16 15:04:06 devstack cinder-volume[83259]: DEBUG oslo_concurrency.lockutils [req-b8248425-d25d-4640-831c-2a9261f446da req-ca566166-ec07-458c-a53e-caece50dc679 tempest-VolumesGetTestJSON-880902680 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83259) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 16 15:04:06 devstack cinder-volume[83259]: DEBUG oslo_concurrency.lockutils [req-b8248425-d25d-4640-831c-2a9261f446da req-ca566166-ec07-458c-a53e-caece50dc679 tempest-VolumesGetTestJSON-880902680 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83259) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 16 15:04:06 devstack cinder-volume[83259]: DEBUG cinder.volume.drivers.quobyte [req-b8248425-d25d-4640-831c-2a9261f446da req-ca566166-ec07-458c-a53e-caece50dc679 tempest-VolumesGetTestJSON-880902680 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-61f585ac-f8e2-4d19-a890-7ebc2726cc72': None} {{(pid=83259) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:639}} Sep 16 15:04:06 devstack cinder-volume[83259]: DEBUG cinder.volume.drivers.quobyte [req-b8248425-d25d-4640-831c-2a9261f446da req-ca566166-ec07-458c-a53e-caece50dc679 tempest-VolumesGetTestJSON-880902680 None] Available shares ['10.10.41.181/cinder-vol-61f585ac-f8e2-4d19-a890-7ebc2726cc72'] {{(pid=83259) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:669}} Sep 16 15:04:06 devstack cinder-volume[83259]: DEBUG oslo_concurrency.lockutils [req-b8248425-d25d-4640-831c-2a9261f446da req-ca566166-ec07-458c-a53e-caece50dc679 tempest-VolumesGetTestJSON-880902680 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=83259) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 16 15:04:06 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [req-b8248425-d25d-4640-831c-2a9261f446da req-ca566166-ec07-458c-a53e-caece50dc679 tempest-VolumesGetTestJSON-880902680 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 15:04:06 devstack cinder-volume[83259]: DEBUG oslo.privsep.daemon [-] privsep: reply[42c4af8d-16dd-4227-94d8-a05779b2f6c3]: (4, 'qcow2') {{(pid=84312) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 16 15:04:06 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [None req-b41c6b59-e74a-4f3f-8276-77e286e1d872 tempest-VolumesSnapshotNegativeTestJSON-4318571 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c/volume-19c4081c-c888-4244-b9a8-3a82ffcbe57a {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 15:04:06 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [None req-9b7caf8c-f461-46c8-bc2b-ea606fe725d6 tempest-GroupSnapshotsTest-952387378 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c" returned: 0 in 0.899s {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 15:04:06 devstack cinder-volume[83259]: DEBUG cinder.manager [None req-9b7caf8c-f461-46c8-bc2b-ea606fe725d6 tempest-GroupSnapshotsTest-952387378 None] Notifying Schedulers of capabilities ... {{(pid=83259) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 16 15:04:06 devstack cinder-volume[83259]: INFO cinder.volume.manager [None req-9b7caf8c-f461-46c8-bc2b-ea606fe725d6 tempest-GroupSnapshotsTest-952387378 None] Delete group completed successfully. Sep 16 15:04:06 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [req-b8248425-d25d-4640-831c-2a9261f446da req-ca566166-ec07-458c-a53e-caece50dc679 tempest-VolumesGetTestJSON-880902680 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c" returned: 0 in 0.710s {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 15:04:06 devstack cinder-volume[83259]: DEBUG cinder.manager [req-b8248425-d25d-4640-831c-2a9261f446da req-ca566166-ec07-458c-a53e-caece50dc679 tempest-VolumesGetTestJSON-880902680 None] Notifying Schedulers of capabilities ... {{(pid=83259) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 16 15:04:06 devstack cinder-volume[83259]: INFO cinder.volume.manager [req-b8248425-d25d-4640-831c-2a9261f446da req-ca566166-ec07-458c-a53e-caece50dc679 tempest-VolumesGetTestJSON-880902680 None] Deleted volume successfully. Sep 16 15:04:06 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [None req-b41c6b59-e74a-4f3f-8276-77e286e1d872 tempest-VolumesSnapshotNegativeTestJSON-4318571 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c/volume-19c4081c-c888-4244-b9a8-3a82ffcbe57a" returned: 0 in 0.674s {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 15:04:06 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [None req-b41c6b59-e74a-4f3f-8276-77e286e1d872 tempest-VolumesSnapshotNegativeTestJSON-4318571 None] Running cmd (subprocess): qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c/volume-19c4081c-c888-4244-b9a8-3a82ffcbe57a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c/volume-19c4081c-c888-4244-b9a8-3a82ffcbe57a.215a2f8b-5b97-4da6-b766-08ad1d9efc86 2G {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 15:04:07 devstack quobyte-client[83286]: The server volume:87712ffe-8a69-446d-9ed6-4430c7ee9792@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=87712ffe-8a69-446d-9ed6-4430c7ee9792, inode=42, name=volume-19c4081c-c888-4244-b9a8-3a82ffcbe57a.215a2f8b-5b97-4da6-b766-08ad1d9efc86, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.206), requestorAccessMask=0 Sep 16 15:04:07 devstack cinder-volume[83259]: WARNING cinder.volume.volume_utils [None req-dac25b16-077e-4313-a8ed-5e2ff3adc877 tempest-GroupSnapshotsTest-952387378 None] Volume driver (QuobyteDriver 1.2) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 16 15:04:07 devstack cinder-volume[83259]: INFO cinder.volume.manager [None req-dac25b16-077e-4313-a8ed-5e2ff3adc877 tempest-GroupSnapshotsTest-952387378 None] Group tempest-GroupSnapshotsTest-Group-194800997: creating Sep 16 15:04:07 devstack cinder-volume[83259]: DEBUG cinder.coordination [req-b8248425-d25d-4640-831c-2a9261f446da req-ca566166-ec07-458c-a53e-caece50dc679 tempest-VolumesGetTestJSON-880902680 None] Lock "cinder-bdda4aa8-fb23-47da-8a72-94228782da1d-delete_volume" released by "delete_volume" :: held 3.491s {{(pid=83259) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 16 15:04:07 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [None req-b41c6b59-e74a-4f3f-8276-77e286e1d872 tempest-VolumesSnapshotNegativeTestJSON-4318571 None] CMD "qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c/volume-19c4081c-c888-4244-b9a8-3a82ffcbe57a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c/volume-19c4081c-c888-4244-b9a8-3a82ffcbe57a.215a2f8b-5b97-4da6-b766-08ad1d9efc86 2G" returned: 0 in 0.619s {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 15:04:07 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [None req-b41c6b59-e74a-4f3f-8276-77e286e1d872 tempest-VolumesSnapshotNegativeTestJSON-4318571 None] Running cmd (subprocess): qemu-img rebase -u -b volume-19c4081c-c888-4244-b9a8-3a82ffcbe57a -F qcow2 /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c/volume-19c4081c-c888-4244-b9a8-3a82ffcbe57a.215a2f8b-5b97-4da6-b766-08ad1d9efc86 {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 15:04:07 devstack cinder-volume[83259]: INFO cinder.volume.manager [None req-dac25b16-077e-4313-a8ed-5e2ff3adc877 tempest-GroupSnapshotsTest-952387378 None] Group tempest-GroupSnapshotsTest-Group-194800997: created successfully Sep 16 15:04:07 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [None req-b41c6b59-e74a-4f3f-8276-77e286e1d872 tempest-VolumesSnapshotNegativeTestJSON-4318571 None] CMD "qemu-img rebase -u -b volume-19c4081c-c888-4244-b9a8-3a82ffcbe57a -F qcow2 /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c/volume-19c4081c-c888-4244-b9a8-3a82ffcbe57a.215a2f8b-5b97-4da6-b766-08ad1d9efc86" returned: 0 in 0.367s {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 15:04:07 devstack cinder-volume[83259]: DEBUG cinder.volume.drivers.remotefs [None req-b41c6b59-e74a-4f3f-8276-77e286e1d872 tempest-VolumesSnapshotNegativeTestJSON-4318571 None] File path /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c/volume-19c4081c-c888-4244-b9a8-3a82ffcbe57a.215a2f8b-5b97-4da6-b766-08ad1d9efc86 is being set with permissions: 660 {{(pid=83259) _set_rw_permissions /opt/stack/cinder/cinder/volume/drivers/remotefs.py:492}} Sep 16 15:04:07 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [None req-b41c6b59-e74a-4f3f-8276-77e286e1d872 tempest-VolumesSnapshotNegativeTestJSON-4318571 None] Running cmd (subprocess): chmod 660 /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c/volume-19c4081c-c888-4244-b9a8-3a82ffcbe57a.215a2f8b-5b97-4da6-b766-08ad1d9efc86 {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 15:04:08 devstack cinder-volume[83259]: INFO cinder.volume.manager [None req-dac25b16-077e-4313-a8ed-5e2ff3adc877 tempest-GroupSnapshotsTest-952387378 None] Create group completed successfully. Sep 16 15:04:08 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [None req-b41c6b59-e74a-4f3f-8276-77e286e1d872 tempest-VolumesSnapshotNegativeTestJSON-4318571 None] CMD "chmod 660 /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c/volume-19c4081c-c888-4244-b9a8-3a82ffcbe57a.215a2f8b-5b97-4da6-b766-08ad1d9efc86" returned: 0 in 0.344s {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 15:04:08 devstack cinder-volume[83259]: DEBUG cinder.volume.drivers.remotefs [None req-b41c6b59-e74a-4f3f-8276-77e286e1d872 tempest-VolumesSnapshotNegativeTestJSON-4318571 None] Setting permissions: /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c/volume-19c4081c-c888-4244-b9a8-3a82ffcbe57a -> 1000:1000 {{(pid=83259) _do_create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1584}} Sep 16 15:04:08 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [None req-b41c6b59-e74a-4f3f-8276-77e286e1d872 tempest-VolumesSnapshotNegativeTestJSON-4318571 None] Running cmd (subprocess): chown --reference=/opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c/volume-19c4081c-c888-4244-b9a8-3a82ffcbe57a /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c/volume-19c4081c-c888-4244-b9a8-3a82ffcbe57a.215a2f8b-5b97-4da6-b766-08ad1d9efc86 {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 15:04:08 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [None req-b41c6b59-e74a-4f3f-8276-77e286e1d872 tempest-VolumesSnapshotNegativeTestJSON-4318571 None] CMD "chown --reference=/opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c/volume-19c4081c-c888-4244-b9a8-3a82ffcbe57a /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c/volume-19c4081c-c888-4244-b9a8-3a82ffcbe57a.215a2f8b-5b97-4da6-b766-08ad1d9efc86" returned: 0 in 0.141s {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 15:04:08 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [None req-b41c6b59-e74a-4f3f-8276-77e286e1d872 tempest-VolumesSnapshotNegativeTestJSON-4318571 None] Running cmd (subprocess): truncate -s0 /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c/volume-19c4081c-c888-4244-b9a8-3a82ffcbe57a.info {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 15:04:08 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [None req-b41c6b59-e74a-4f3f-8276-77e286e1d872 tempest-VolumesSnapshotNegativeTestJSON-4318571 None] CMD "truncate -s0 /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c/volume-19c4081c-c888-4244-b9a8-3a82ffcbe57a.info" returned: 0 in 0.121s {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 15:04:08 devstack cinder-volume[83259]: DEBUG cinder.volume.drivers.remotefs [None req-b41c6b59-e74a-4f3f-8276-77e286e1d872 tempest-VolumesSnapshotNegativeTestJSON-4318571 None] File path /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c/volume-19c4081c-c888-4244-b9a8-3a82ffcbe57a.info is being set with permissions: 660 {{(pid=83259) _set_rw_permissions /opt/stack/cinder/cinder/volume/drivers/remotefs.py:492}} Sep 16 15:04:08 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [None req-b41c6b59-e74a-4f3f-8276-77e286e1d872 tempest-VolumesSnapshotNegativeTestJSON-4318571 None] Running cmd (subprocess): chmod 660 /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c/volume-19c4081c-c888-4244-b9a8-3a82ffcbe57a.info {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 15:04:08 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [None req-b41c6b59-e74a-4f3f-8276-77e286e1d872 tempest-VolumesSnapshotNegativeTestJSON-4318571 None] CMD "chmod 660 /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c/volume-19c4081c-c888-4244-b9a8-3a82ffcbe57a.info" returned: 0 in 0.150s {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 15:04:08 devstack cinder-volume[83259]: DEBUG oslo_concurrency.lockutils [None req-b41c6b59-e74a-4f3f-8276-77e286e1d872 tempest-VolumesSnapshotNegativeTestJSON-4318571 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.157s {{(pid=83259) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 16 15:04:09 devstack cinder-volume[83259]: INFO cinder.volume.manager [None req-b41c6b59-e74a-4f3f-8276-77e286e1d872 tempest-VolumesSnapshotNegativeTestJSON-4318571 None] Create snapshot completed successfully Sep 16 15:04:09 devstack cinder-volume[83259]: WARNING cinder.volume.volume_utils [None req-dfb5f077-60ca-4a15-a505-83c35769b1f0 tempest-GroupSnapshotsTest-952387378 None] Volume driver (QuobyteDriver 1.2) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 16 15:04:09 devstack cinder-volume[83259]: DEBUG cinder.volume.flows.manager.create_volume [None req-dfb5f077-60ca-4a15-a505-83c35769b1f0 tempest-GroupSnapshotsTest-952387378 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#Quobyte'], 'hosts': ['devstack@QuobyteHD#Quobyte']} {{(pid=83259) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1387}} Sep 16 15:04:09 devstack cinder-volume[83259]: DEBUG cinder.volume.manager [None req-dfb5f077-60ca-4a15-a505-83c35769b1f0 tempest-GroupSnapshotsTest-952387378 None] Flow 'volume_create_manager' (03581f98-a8cf-46c1-bf0c-d9a6a45a4abb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83259) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 16 15:04:09 devstack cinder-volume[83259]: DEBUG cinder.volume.manager [None req-dfb5f077-60ca-4a15-a505-83c35769b1f0 tempest-GroupSnapshotsTest-952387378 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7b99231d-87cc-4d2c-b246-311515f54c37) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83259) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 15:04:09 devstack cinder-volume[83259]: DEBUG cinder.volume.manager [None req-dfb5f077-60ca-4a15-a505-83c35769b1f0 tempest-GroupSnapshotsTest-952387378 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7b99231d-87cc-4d2c-b246-311515f54c37) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-16T13:04:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1156649595',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=28bf7895-6e2c-4b3b-97df-b57e908c9065,host='devstack@QuobyteHD#Quobyte',id=ceafecc8-d8a4-447f-9ff7-7fc9f8c88f95,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cec359ace651434bb4df79a6dcce9dbd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-16T13:04:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-16T13:04:09Z,use_quota=True,user_id='9e798fd1532a42df8e251d9d64138963',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(358ed9f1-9dd3-4855-89b5-430cf8099cbc),volume_type_id=358ed9f1-9dd3-4855-89b5-430cf8099cbc)' {{(pid=83259) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 15:04:09 devstack cinder-volume[83259]: DEBUG cinder.volume.manager [None req-dfb5f077-60ca-4a15-a505-83c35769b1f0 tempest-GroupSnapshotsTest-952387378 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (002920e2-7035-4150-88f2-3cef97b33ffb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83259) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 15:04:09 devstack cinder-volume[83259]: DEBUG cinder.volume.manager [None req-dfb5f077-60ca-4a15-a505-83c35769b1f0 tempest-GroupSnapshotsTest-952387378 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (002920e2-7035-4150-88f2-3cef97b33ffb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83259) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 15:04:09 devstack cinder-volume[83259]: DEBUG cinder.volume.manager [None req-dfb5f077-60ca-4a15-a505-83c35769b1f0 tempest-GroupSnapshotsTest-952387378 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2b8c0387-f67c-42aa-a4a0-e3d7b5610b3e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83259) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 15:04:09 devstack cinder-volume[83259]: DEBUG cinder.volume.manager [None req-dfb5f077-60ca-4a15-a505-83c35769b1f0 tempest-GroupSnapshotsTest-952387378 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2b8c0387-f67c-42aa-a4a0-e3d7b5610b3e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ceafecc8-d8a4-447f-9ff7-7fc9f8c88f95', 'volume_name': 'volume-ceafecc8-d8a4-447f-9ff7-7fc9f8c88f95', 'volume_size': 1}' {{(pid=83259) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 15:04:09 devstack cinder-volume[83259]: DEBUG cinder.volume.manager [None req-dfb5f077-60ca-4a15-a505-83c35769b1f0 tempest-GroupSnapshotsTest-952387378 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (697a9f1a-0503-4119-9837-07068cd512d5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83259) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 15:04:09 devstack cinder-volume[83259]: DEBUG cinder.volume.manager [None req-dfb5f077-60ca-4a15-a505-83c35769b1f0 tempest-GroupSnapshotsTest-952387378 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (697a9f1a-0503-4119-9837-07068cd512d5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83259) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 15:04:09 devstack cinder-volume[83259]: DEBUG cinder.volume.manager [None req-dfb5f077-60ca-4a15-a505-83c35769b1f0 tempest-GroupSnapshotsTest-952387378 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1e51f54a-7302-4999-968b-b2870579c165) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83259) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 15:04:09 devstack cinder-volume[83259]: INFO cinder.volume.flows.manager.create_volume [None req-dfb5f077-60ca-4a15-a505-83c35769b1f0 tempest-GroupSnapshotsTest-952387378 None] Volume ceafecc8-d8a4-447f-9ff7-7fc9f8c88f95: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ceafecc8-d8a4-447f-9ff7-7fc9f8c88f95', 'volume_size': 1} Sep 16 15:04:09 devstack cinder-volume[83259]: DEBUG oslo_concurrency.lockutils [None req-dfb5f077-60ca-4a15-a505-83c35769b1f0 tempest-GroupSnapshotsTest-952387378 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83259) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 16 15:04:09 devstack cinder-volume[83259]: DEBUG oslo_concurrency.lockutils [None req-dfb5f077-60ca-4a15-a505-83c35769b1f0 tempest-GroupSnapshotsTest-952387378 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.003s {{(pid=83259) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 16 15:04:09 devstack cinder-volume[83259]: DEBUG cinder.volume.drivers.quobyte [None req-dfb5f077-60ca-4a15-a505-83c35769b1f0 tempest-GroupSnapshotsTest-952387378 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=28bf7895-6e2c-4b3b-97df-b57e908c9065,created_at=2025-09-16T13:04:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1156649595',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=28bf7895-6e2c-4b3b-97df-b57e908c9065,host='devstack@QuobyteHD#Quobyte',id=ceafecc8-d8a4-447f-9ff7-7fc9f8c88f95,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cec359ace651434bb4df79a6dcce9dbd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-16T13:04:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-16T13:04:09Z,use_quota=True,user_id='9e798fd1532a42df8e251d9d64138963',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(358ed9f1-9dd3-4855-89b5-430cf8099cbc),volume_type_id=358ed9f1-9dd3-4855-89b5-430cf8099cbc)}" {{(pid=83259) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Sep 16 15:04:09 devstack cinder-volume[83259]: DEBUG cinder.volume.drivers.remotefs [None req-dfb5f077-60ca-4a15-a505-83c35769b1f0 tempest-GroupSnapshotsTest-952387378 None] Creating volume ceafecc8-d8a4-447f-9ff7-7fc9f8c88f95 {{(pid=83259) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}} Sep 16 15:04:09 devstack cinder-volume[83259]: DEBUG oslo_concurrency.lockutils [None req-dfb5f077-60ca-4a15-a505-83c35769b1f0 tempest-GroupSnapshotsTest-952387378 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83259) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 16 15:04:09 devstack cinder-volume[83259]: DEBUG oslo_concurrency.lockutils [None req-dfb5f077-60ca-4a15-a505-83c35769b1f0 tempest-GroupSnapshotsTest-952387378 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83259) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 16 15:04:09 devstack cinder-volume[83259]: DEBUG cinder.volume.drivers.quobyte [None req-dfb5f077-60ca-4a15-a505-83c35769b1f0 tempest-GroupSnapshotsTest-952387378 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-61f585ac-f8e2-4d19-a890-7ebc2726cc72': None} {{(pid=83259) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:639}} Sep 16 15:04:09 devstack cinder-volume[83259]: DEBUG cinder.volume.drivers.quobyte [None req-dfb5f077-60ca-4a15-a505-83c35769b1f0 tempest-GroupSnapshotsTest-952387378 None] Available shares ['10.10.41.181/cinder-vol-61f585ac-f8e2-4d19-a890-7ebc2726cc72'] {{(pid=83259) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:669}} Sep 16 15:04:09 devstack cinder-volume[83259]: DEBUG oslo_concurrency.lockutils [None req-dfb5f077-60ca-4a15-a505-83c35769b1f0 tempest-GroupSnapshotsTest-952387378 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=83259) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 16 15:04:09 devstack cinder-volume[83259]: DEBUG cinder.volume.drivers.quobyte [None req-dfb5f077-60ca-4a15-a505-83c35769b1f0 tempest-GroupSnapshotsTest-952387378 None] Selected 10.10.41.181/cinder-vol-61f585ac-f8e2-4d19-a890-7ebc2726cc72 as target Quobyte volume. {{(pid=83259) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:690}} Sep 16 15:04:09 devstack cinder-volume[83259]: INFO cinder.volume.drivers.remotefs [None req-dfb5f077-60ca-4a15-a505-83c35769b1f0 tempest-GroupSnapshotsTest-952387378 None] casted to 10.10.41.181/cinder-vol-61f585ac-f8e2-4d19-a890-7ebc2726cc72 Sep 16 15:04:09 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [None req-dfb5f077-60ca-4a15-a505-83c35769b1f0 tempest-GroupSnapshotsTest-952387378 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c/volume-ceafecc8-d8a4-447f-9ff7-7fc9f8c88f95 1073741824 {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 15:04:09 devstack quobyte-client[83286]: The server volume:87712ffe-8a69-446d-9ed6-4430c7ee9792@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=87712ffe-8a69-446d-9ed6-4430c7ee9792, inode=44, name=volume-ceafecc8-d8a4-447f-9ff7-7fc9f8c88f95, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.206), requestorAccessMask=0 Sep 16 15:04:10 devstack cinder-volume[83259]: DEBUG cinder.coordination [None req-2d5bfacd-2afc-4ac0-8d59-09136c417fd9 tempest-VolumesSnapshotNegativeTestJSON-4318571 None] Acquiring lock "cinder-215a2f8b-5b97-4da6-b766-08ad1d9efc86-delete_snapshot" by "delete_snapshot" {{(pid=83259) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 16 15:04:10 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [None req-dfb5f077-60ca-4a15-a505-83c35769b1f0 tempest-GroupSnapshotsTest-952387378 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c/volume-ceafecc8-d8a4-447f-9ff7-7fc9f8c88f95 1073741824" returned: 0 in 0.940s {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 15:04:10 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [None req-dfb5f077-60ca-4a15-a505-83c35769b1f0 tempest-GroupSnapshotsTest-952387378 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c/volume-ceafecc8-d8a4-447f-9ff7-7fc9f8c88f95 {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 15:04:10 devstack cinder-volume[83259]: DEBUG cinder.coordination [None req-2d5bfacd-2afc-4ac0-8d59-09136c417fd9 tempest-VolumesSnapshotNegativeTestJSON-4318571 None] Lock "cinder-215a2f8b-5b97-4da6-b766-08ad1d9efc86-delete_snapshot" acquired by "delete_snapshot" :: waited 0.311s {{(pid=83259) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 16 15:04:10 devstack cinder-volume[83259]: WARNING cinder.volume.volume_utils [None req-2d5bfacd-2afc-4ac0-8d59-09136c417fd9 tempest-VolumesSnapshotNegativeTestJSON-4318571 None] Volume driver (QuobyteDriver 1.2) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 16 15:04:10 devstack cinder-volume[83259]: DEBUG cinder.coordination [None req-2d5bfacd-2afc-4ac0-8d59-09136c417fd9 tempest-VolumesSnapshotNegativeTestJSON-4318571 None] Acquiring lock "cinder-quobyte-19c4081c-c888-4244-b9a8-3a82ffcbe57a" by "delete_snapshot" {{(pid=83259) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 16 15:04:10 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [None req-dfb5f077-60ca-4a15-a505-83c35769b1f0 tempest-GroupSnapshotsTest-952387378 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c/volume-ceafecc8-d8a4-447f-9ff7-7fc9f8c88f95" returned: 0 in 0.343s {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 15:04:10 devstack cinder-volume[83259]: DEBUG cinder.volume.drivers.quobyte [None req-dfb5f077-60ca-4a15-a505-83c35769b1f0 tempest-GroupSnapshotsTest-952387378 None] <== create_volume: return (1315ms) {'provider_location': '10.10.41.181/cinder-vol-61f585ac-f8e2-4d19-a890-7ebc2726cc72'} {{(pid=83259) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Sep 16 15:04:10 devstack cinder-volume[83259]: DEBUG oslo_concurrency.lockutils [None req-dfb5f077-60ca-4a15-a505-83c35769b1f0 tempest-GroupSnapshotsTest-952387378 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.331s {{(pid=83259) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 16 15:04:10 devstack cinder-volume[83259]: DEBUG cinder.coordination [None req-2d5bfacd-2afc-4ac0-8d59-09136c417fd9 tempest-VolumesSnapshotNegativeTestJSON-4318571 None] Lock "cinder-quobyte-19c4081c-c888-4244-b9a8-3a82ffcbe57a" acquired by "delete_snapshot" :: waited 0.221s {{(pid=83259) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 16 15:04:10 devstack cinder-volume[83259]: DEBUG cinder.coordination [None req-2d5bfacd-2afc-4ac0-8d59-09136c417fd9 tempest-VolumesSnapshotNegativeTestJSON-4318571 None] Acquiring lock "cinder-quobyte-215a2f8b-5b97-4da6-b766-08ad1d9efc86" by "_delete_snapshot" {{(pid=83259) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 16 15:04:11 devstack cinder-volume[83259]: DEBUG cinder.coordination [None req-2d5bfacd-2afc-4ac0-8d59-09136c417fd9 tempest-VolumesSnapshotNegativeTestJSON-4318571 None] Lock "cinder-quobyte-215a2f8b-5b97-4da6-b766-08ad1d9efc86" acquired by "_delete_snapshot" :: waited 0.012s {{(pid=83259) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 16 15:04:11 devstack cinder-volume[83259]: DEBUG cinder.volume.drivers.remotefs [None req-2d5bfacd-2afc-4ac0-8d59-09136c417fd9 tempest-VolumesSnapshotNegativeTestJSON-4318571 None] Deleting offline snapshot 215a2f8b-5b97-4da6-b766-08ad1d9efc86 of volume 19c4081c-c888-4244-b9a8-3a82ffcbe57a {{(pid=83259) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1278}} Sep 16 15:04:11 devstack cinder-volume[83259]: DEBUG cinder.volume.drivers.remotefs [None req-2d5bfacd-2afc-4ac0-8d59-09136c417fd9 tempest-VolumesSnapshotNegativeTestJSON-4318571 None] snapshot_file for this snap is: volume-19c4081c-c888-4244-b9a8-3a82ffcbe57a.215a2f8b-5b97-4da6-b766-08ad1d9efc86 {{(pid=83259) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1307}} Sep 16 15:04:11 devstack cinder-volume[83259]: DEBUG cinder.volume.manager [None req-dfb5f077-60ca-4a15-a505-83c35769b1f0 tempest-GroupSnapshotsTest-952387378 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1e51f54a-7302-4999-968b-b2870579c165) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ceafecc8-d8a4-447f-9ff7-7fc9f8c88f95', 'volume_size': 1}' {{(pid=83259) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 15:04:11 devstack cinder-volume[83259]: DEBUG cinder.volume.manager [None req-dfb5f077-60ca-4a15-a505-83c35769b1f0 tempest-GroupSnapshotsTest-952387378 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5be7a705-c75a-4eea-9048-f1ea5d801985) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83259) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 15:04:11 devstack cinder-volume[83259]: DEBUG oslo.privsep.daemon [-] privsep: reply[e386e651-47ea-4cd8-8c57-c923db929163]: (4, 'qcow2') {{(pid=84312) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 16 15:04:11 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [None req-2d5bfacd-2afc-4ac0-8d59-09136c417fd9 tempest-VolumesSnapshotNegativeTestJSON-4318571 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c/volume-19c4081c-c888-4244-b9a8-3a82ffcbe57a.215a2f8b-5b97-4da6-b766-08ad1d9efc86 {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 15:04:11 devstack cinder-volume[83259]: INFO cinder.volume.flows.manager.create_volume [None req-dfb5f077-60ca-4a15-a505-83c35769b1f0 tempest-GroupSnapshotsTest-952387378 None] Volume volume-ceafecc8-d8a4-447f-9ff7-7fc9f8c88f95 (ceafecc8-d8a4-447f-9ff7-7fc9f8c88f95): created successfully Sep 16 15:04:11 devstack cinder-volume[83259]: DEBUG cinder.volume.manager [None req-dfb5f077-60ca-4a15-a505-83c35769b1f0 tempest-GroupSnapshotsTest-952387378 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5be7a705-c75a-4eea-9048-f1ea5d801985) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83259) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 15:04:11 devstack cinder-volume[83259]: DEBUG cinder.volume.manager [None req-dfb5f077-60ca-4a15-a505-83c35769b1f0 tempest-GroupSnapshotsTest-952387378 None] Flow 'volume_create_manager' (03581f98-a8cf-46c1-bf0c-d9a6a45a4abb) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83259) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 16 15:04:11 devstack cinder-volume[83259]: INFO cinder.volume.manager [None req-dfb5f077-60ca-4a15-a505-83c35769b1f0 tempest-GroupSnapshotsTest-952387378 None] Created volume successfully. Sep 16 15:04:11 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [None req-2d5bfacd-2afc-4ac0-8d59-09136c417fd9 tempest-VolumesSnapshotNegativeTestJSON-4318571 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c/volume-19c4081c-c888-4244-b9a8-3a82ffcbe57a.215a2f8b-5b97-4da6-b766-08ad1d9efc86" returned: 0 in 0.690s {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 15:04:11 devstack cinder-volume[83259]: DEBUG cinder.volume.drivers.remotefs [None req-2d5bfacd-2afc-4ac0-8d59-09136c417fd9 tempest-VolumesSnapshotNegativeTestJSON-4318571 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-19c4081c-c888-4244-b9a8-3a82ffcbe57a(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83259) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:886}} Sep 16 15:04:11 devstack cinder-volume[83259]: DEBUG oslo.privsep.daemon [-] privsep: reply[13a4c05b-f924-4e17-889a-9f8c05da7b7f]: (4, 'qcow2') {{(pid=84312) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 16 15:04:11 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [None req-2d5bfacd-2afc-4ac0-8d59-09136c417fd9 tempest-VolumesSnapshotNegativeTestJSON-4318571 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c/volume-19c4081c-c888-4244-b9a8-3a82ffcbe57a {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 15:04:12 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [None req-2d5bfacd-2afc-4ac0-8d59-09136c417fd9 tempest-VolumesSnapshotNegativeTestJSON-4318571 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c/volume-19c4081c-c888-4244-b9a8-3a82ffcbe57a" returned: 0 in 0.468s {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 15:04:12 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [None req-2d5bfacd-2afc-4ac0-8d59-09136c417fd9 tempest-VolumesSnapshotNegativeTestJSON-4318571 None] Running cmd (subprocess): qemu-img commit -d /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c/volume-19c4081c-c888-4244-b9a8-3a82ffcbe57a.215a2f8b-5b97-4da6-b766-08ad1d9efc86 {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 15:04:12 devstack quobyte-client[83286]: System call of process 93213 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 16 15:04:12 devstack cinder-volume[83259]: WARNING cinder.volume.volume_utils [None req-219c2673-9e4b-40b0-96dc-8aab65bc780b tempest-GroupSnapshotsV319Test-1837239241 None] Volume driver (QuobyteDriver 1.2) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 16 15:04:12 devstack cinder-volume[83259]: INFO cinder.volume.manager [None req-219c2673-9e4b-40b0-96dc-8aab65bc780b tempest-GroupSnapshotsV319Test-1837239241 None] Group tempest-GroupSnapshotsV319Test-Group-1438469142: creating Sep 16 15:04:12 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [None req-2d5bfacd-2afc-4ac0-8d59-09136c417fd9 tempest-VolumesSnapshotNegativeTestJSON-4318571 None] CMD "qemu-img commit -d /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c/volume-19c4081c-c888-4244-b9a8-3a82ffcbe57a.215a2f8b-5b97-4da6-b766-08ad1d9efc86" returned: 0 in 0.434s {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 15:04:12 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [None req-2d5bfacd-2afc-4ac0-8d59-09136c417fd9 tempest-VolumesSnapshotNegativeTestJSON-4318571 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c/volume-19c4081c-c888-4244-b9a8-3a82ffcbe57a.215a2f8b-5b97-4da6-b766-08ad1d9efc86 {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 15:04:13 devstack cinder-volume[83259]: WARNING cinder.volume.volume_utils [None req-e3870919-54c8-414f-957c-aa0dd96e7202 tempest-GroupSnapshotsTest-952387378 None] Volume driver (QuobyteDriver 1.2) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 16 15:04:13 devstack cinder-volume[83259]: DEBUG cinder.volume.flows.manager.create_volume [None req-e3870919-54c8-414f-957c-aa0dd96e7202 tempest-GroupSnapshotsTest-952387378 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#Quobyte'], 'hosts': ['devstack@QuobyteHD#Quobyte']} {{(pid=83259) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1387}} Sep 16 15:04:13 devstack cinder-volume[83259]: DEBUG cinder.volume.manager [None req-e3870919-54c8-414f-957c-aa0dd96e7202 tempest-GroupSnapshotsTest-952387378 None] Flow 'volume_create_manager' (099ab1b9-7a15-4343-a12c-a5ca6b5dd68f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83259) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 16 15:04:13 devstack cinder-volume[83259]: DEBUG cinder.volume.manager [None req-e3870919-54c8-414f-957c-aa0dd96e7202 tempest-GroupSnapshotsTest-952387378 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (37c3a97f-8dbe-4fce-bb7c-122c6a9a0aea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83259) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 15:04:13 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [None req-2d5bfacd-2afc-4ac0-8d59-09136c417fd9 tempest-VolumesSnapshotNegativeTestJSON-4318571 None] CMD "rm -f /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c/volume-19c4081c-c888-4244-b9a8-3a82ffcbe57a.215a2f8b-5b97-4da6-b766-08ad1d9efc86" returned: 0 in 0.503s {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 15:04:13 devstack cinder-volume[83259]: DEBUG cinder.volume.manager [None req-e3870919-54c8-414f-957c-aa0dd96e7202 tempest-GroupSnapshotsTest-952387378 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (37c3a97f-8dbe-4fce-bb7c-122c6a9a0aea) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-16T13:04:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-886729684',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=28bf7895-6e2c-4b3b-97df-b57e908c9065,host='devstack@QuobyteHD#Quobyte',id=4efde0d8-8e7b-43fe-a588-f71f487cf420,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cec359ace651434bb4df79a6dcce9dbd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-16T13:04:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-16T13:04:12Z,use_quota=True,user_id='9e798fd1532a42df8e251d9d64138963',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(358ed9f1-9dd3-4855-89b5-430cf8099cbc),volume_type_id=358ed9f1-9dd3-4855-89b5-430cf8099cbc)' {{(pid=83259) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 15:04:13 devstack cinder-volume[83259]: DEBUG cinder.volume.manager [None req-e3870919-54c8-414f-957c-aa0dd96e7202 tempest-GroupSnapshotsTest-952387378 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a0cdeb63-dcc1-456d-9c3a-6f6a2e3094f0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83259) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 15:04:13 devstack cinder-volume[83259]: DEBUG cinder.volume.manager [None req-e3870919-54c8-414f-957c-aa0dd96e7202 tempest-GroupSnapshotsTest-952387378 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a0cdeb63-dcc1-456d-9c3a-6f6a2e3094f0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83259) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 15:04:13 devstack cinder-volume[83259]: DEBUG cinder.volume.manager [None req-e3870919-54c8-414f-957c-aa0dd96e7202 tempest-GroupSnapshotsTest-952387378 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4d50a86e-6b65-4725-a5f8-71afda65be51) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83259) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 15:04:13 devstack cinder-volume[83259]: DEBUG cinder.volume.manager [None req-e3870919-54c8-414f-957c-aa0dd96e7202 tempest-GroupSnapshotsTest-952387378 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4d50a86e-6b65-4725-a5f8-71afda65be51) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4efde0d8-8e7b-43fe-a588-f71f487cf420', 'volume_name': 'volume-4efde0d8-8e7b-43fe-a588-f71f487cf420', 'volume_size': 1}' {{(pid=83259) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 15:04:13 devstack cinder-volume[83259]: DEBUG cinder.volume.manager [None req-e3870919-54c8-414f-957c-aa0dd96e7202 tempest-GroupSnapshotsTest-952387378 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bdf5e328-1261-4805-b840-0ac62cc76962) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83259) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 15:04:13 devstack cinder-volume[83259]: DEBUG cinder.volume.manager [None req-e3870919-54c8-414f-957c-aa0dd96e7202 tempest-GroupSnapshotsTest-952387378 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bdf5e328-1261-4805-b840-0ac62cc76962) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83259) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 15:04:13 devstack cinder-volume[83259]: DEBUG cinder.volume.manager [None req-e3870919-54c8-414f-957c-aa0dd96e7202 tempest-GroupSnapshotsTest-952387378 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (69f2d9ea-05bb-4ef4-906a-f621bb18fedf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83259) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 15:04:13 devstack cinder-volume[83259]: INFO cinder.volume.flows.manager.create_volume [None req-e3870919-54c8-414f-957c-aa0dd96e7202 tempest-GroupSnapshotsTest-952387378 None] Volume 4efde0d8-8e7b-43fe-a588-f71f487cf420: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4efde0d8-8e7b-43fe-a588-f71f487cf420', 'volume_size': 1} Sep 16 15:04:13 devstack cinder-volume[83259]: DEBUG oslo_concurrency.lockutils [None req-e3870919-54c8-414f-957c-aa0dd96e7202 tempest-GroupSnapshotsTest-952387378 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83259) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 16 15:04:13 devstack cinder-volume[83259]: DEBUG oslo_concurrency.lockutils [None req-e3870919-54c8-414f-957c-aa0dd96e7202 tempest-GroupSnapshotsTest-952387378 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=83259) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 16 15:04:13 devstack cinder-volume[83259]: DEBUG cinder.volume.drivers.quobyte [None req-e3870919-54c8-414f-957c-aa0dd96e7202 tempest-GroupSnapshotsTest-952387378 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=28bf7895-6e2c-4b3b-97df-b57e908c9065,created_at=2025-09-16T13:04:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-886729684',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=28bf7895-6e2c-4b3b-97df-b57e908c9065,host='devstack@QuobyteHD#Quobyte',id=4efde0d8-8e7b-43fe-a588-f71f487cf420,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cec359ace651434bb4df79a6dcce9dbd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-16T13:04:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-16T13:04:12Z,use_quota=True,user_id='9e798fd1532a42df8e251d9d64138963',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(358ed9f1-9dd3-4855-89b5-430cf8099cbc),volume_type_id=358ed9f1-9dd3-4855-89b5-430cf8099cbc)}" {{(pid=83259) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Sep 16 15:04:13 devstack cinder-volume[83259]: DEBUG cinder.volume.drivers.remotefs [None req-e3870919-54c8-414f-957c-aa0dd96e7202 tempest-GroupSnapshotsTest-952387378 None] Creating volume 4efde0d8-8e7b-43fe-a588-f71f487cf420 {{(pid=83259) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}} Sep 16 15:04:13 devstack cinder-volume[83259]: DEBUG oslo_concurrency.lockutils [None req-e3870919-54c8-414f-957c-aa0dd96e7202 tempest-GroupSnapshotsTest-952387378 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83259) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 16 15:04:13 devstack cinder-volume[83259]: DEBUG oslo_concurrency.lockutils [None req-e3870919-54c8-414f-957c-aa0dd96e7202 tempest-GroupSnapshotsTest-952387378 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83259) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 16 15:04:13 devstack cinder-volume[83259]: DEBUG cinder.volume.drivers.quobyte [None req-e3870919-54c8-414f-957c-aa0dd96e7202 tempest-GroupSnapshotsTest-952387378 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-61f585ac-f8e2-4d19-a890-7ebc2726cc72': None} {{(pid=83259) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:639}} Sep 16 15:04:13 devstack cinder-volume[83259]: DEBUG cinder.volume.drivers.quobyte [None req-e3870919-54c8-414f-957c-aa0dd96e7202 tempest-GroupSnapshotsTest-952387378 None] Available shares ['10.10.41.181/cinder-vol-61f585ac-f8e2-4d19-a890-7ebc2726cc72'] {{(pid=83259) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:669}} Sep 16 15:04:13 devstack cinder-volume[83259]: DEBUG oslo_concurrency.lockutils [None req-e3870919-54c8-414f-957c-aa0dd96e7202 tempest-GroupSnapshotsTest-952387378 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=83259) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 16 15:04:13 devstack cinder-volume[83259]: DEBUG cinder.volume.drivers.quobyte [None req-e3870919-54c8-414f-957c-aa0dd96e7202 tempest-GroupSnapshotsTest-952387378 None] Selected 10.10.41.181/cinder-vol-61f585ac-f8e2-4d19-a890-7ebc2726cc72 as target Quobyte volume. {{(pid=83259) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:690}} Sep 16 15:04:13 devstack cinder-volume[83259]: INFO cinder.volume.drivers.remotefs [None req-e3870919-54c8-414f-957c-aa0dd96e7202 tempest-GroupSnapshotsTest-952387378 None] casted to 10.10.41.181/cinder-vol-61f585ac-f8e2-4d19-a890-7ebc2726cc72 Sep 16 15:04:13 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [None req-e3870919-54c8-414f-957c-aa0dd96e7202 tempest-GroupSnapshotsTest-952387378 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c/volume-4efde0d8-8e7b-43fe-a588-f71f487cf420 1073741824 {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 15:04:13 devstack quobyte-client[83286]: The server volume:87712ffe-8a69-446d-9ed6-4430c7ee9792@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=87712ffe-8a69-446d-9ed6-4430c7ee9792, inode=45, name=volume-4efde0d8-8e7b-43fe-a588-f71f487cf420, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.206), requestorAccessMask=0 Sep 16 15:04:13 devstack cinder-volume[83259]: DEBUG cinder.coordination [None req-2d5bfacd-2afc-4ac0-8d59-09136c417fd9 tempest-VolumesSnapshotNegativeTestJSON-4318571 None] Lock "cinder-quobyte-215a2f8b-5b97-4da6-b766-08ad1d9efc86" released by "_delete_snapshot" :: held 2.675s {{(pid=83259) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 16 15:04:13 devstack cinder-volume[83259]: DEBUG cinder.coordination [None req-2d5bfacd-2afc-4ac0-8d59-09136c417fd9 tempest-VolumesSnapshotNegativeTestJSON-4318571 None] Lock "cinder-quobyte-19c4081c-c888-4244-b9a8-3a82ffcbe57a" released by "delete_snapshot" :: held 2.831s {{(pid=83259) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 16 15:04:13 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [None req-e3870919-54c8-414f-957c-aa0dd96e7202 tempest-GroupSnapshotsTest-952387378 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c/volume-4efde0d8-8e7b-43fe-a588-f71f487cf420 1073741824" returned: 0 in 0.488s {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 15:04:13 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [None req-e3870919-54c8-414f-957c-aa0dd96e7202 tempest-GroupSnapshotsTest-952387378 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c/volume-4efde0d8-8e7b-43fe-a588-f71f487cf420 {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 15:04:14 devstack cinder-volume[83259]: INFO cinder.volume.manager [None req-219c2673-9e4b-40b0-96dc-8aab65bc780b tempest-GroupSnapshotsV319Test-1837239241 None] Group tempest-GroupSnapshotsV319Test-Group-1438469142: created successfully Sep 16 15:04:14 devstack cinder-volume[83259]: INFO cinder.volume.manager [None req-219c2673-9e4b-40b0-96dc-8aab65bc780b tempest-GroupSnapshotsV319Test-1837239241 None] Create group completed successfully. Sep 16 15:04:14 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [None req-e3870919-54c8-414f-957c-aa0dd96e7202 tempest-GroupSnapshotsTest-952387378 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c/volume-4efde0d8-8e7b-43fe-a588-f71f487cf420" returned: 0 in 0.344s {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 15:04:14 devstack cinder-volume[83259]: DEBUG cinder.volume.drivers.quobyte [None req-e3870919-54c8-414f-957c-aa0dd96e7202 tempest-GroupSnapshotsTest-952387378 None] <== create_volume: return (851ms) {'provider_location': '10.10.41.181/cinder-vol-61f585ac-f8e2-4d19-a890-7ebc2726cc72'} {{(pid=83259) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Sep 16 15:04:14 devstack cinder-volume[83259]: DEBUG oslo_concurrency.lockutils [None req-e3870919-54c8-414f-957c-aa0dd96e7202 tempest-GroupSnapshotsTest-952387378 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.860s {{(pid=83259) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 16 15:04:14 devstack cinder-volume[83259]: DEBUG cinder.volume.manager [None req-e3870919-54c8-414f-957c-aa0dd96e7202 tempest-GroupSnapshotsTest-952387378 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (69f2d9ea-05bb-4ef4-906a-f621bb18fedf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4efde0d8-8e7b-43fe-a588-f71f487cf420', 'volume_size': 1}' {{(pid=83259) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 15:04:14 devstack cinder-volume[83259]: DEBUG cinder.volume.manager [None req-e3870919-54c8-414f-957c-aa0dd96e7202 tempest-GroupSnapshotsTest-952387378 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c8277c4e-84c0-49ef-98da-955ac68003a0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83259) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 15:04:14 devstack cinder-volume[83259]: INFO cinder.volume.flows.manager.create_volume [None req-e3870919-54c8-414f-957c-aa0dd96e7202 tempest-GroupSnapshotsTest-952387378 None] Volume volume-4efde0d8-8e7b-43fe-a588-f71f487cf420 (4efde0d8-8e7b-43fe-a588-f71f487cf420): created successfully Sep 16 15:04:14 devstack cinder-volume[83259]: DEBUG cinder.volume.manager [None req-e3870919-54c8-414f-957c-aa0dd96e7202 tempest-GroupSnapshotsTest-952387378 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c8277c4e-84c0-49ef-98da-955ac68003a0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83259) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 15:04:14 devstack cinder-volume[83259]: DEBUG cinder.volume.manager [None req-e3870919-54c8-414f-957c-aa0dd96e7202 tempest-GroupSnapshotsTest-952387378 None] Flow 'volume_create_manager' (099ab1b9-7a15-4343-a12c-a5ca6b5dd68f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83259) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 16 15:04:14 devstack cinder-volume[83259]: DEBUG cinder.quota [None req-2d5bfacd-2afc-4ac0-8d59-09136c417fd9 tempest-VolumesSnapshotNegativeTestJSON-4318571 None] Created reservations ['371c0f7f-753f-4d1e-abba-cf33cce8b1c5', '09f44833-ff32-4398-b982-403dfbf47b00', 'b96cc631-216f-4869-8f69-3c28d9c3fc9b', '13f946aa-1e45-4424-a2e7-5a52c7e45646'] {{(pid=83259) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 16 15:04:14 devstack cinder-volume[83259]: INFO cinder.volume.manager [None req-e3870919-54c8-414f-957c-aa0dd96e7202 tempest-GroupSnapshotsTest-952387378 None] Created volume successfully. Sep 16 15:04:14 devstack cinder-volume[83259]: INFO cinder.volume.manager [None req-2d5bfacd-2afc-4ac0-8d59-09136c417fd9 tempest-VolumesSnapshotNegativeTestJSON-4318571 None] Delete snapshot completed successfully. Sep 16 15:04:14 devstack cinder-volume[83259]: DEBUG cinder.coordination [None req-2d5bfacd-2afc-4ac0-8d59-09136c417fd9 tempest-VolumesSnapshotNegativeTestJSON-4318571 None] Lock "cinder-215a2f8b-5b97-4da6-b766-08ad1d9efc86-delete_snapshot" released by "delete_snapshot" :: held 3.993s {{(pid=83259) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 16 15:04:15 devstack cinder-volume[83259]: WARNING cinder.volume.volume_utils [None req-82b87b76-0e85-49aa-bd32-ee544f696840 tempest-GroupSnapshotsV319Test-1837239241 None] Volume driver (QuobyteDriver 1.2) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 16 15:04:15 devstack cinder-volume[83259]: DEBUG cinder.volume.flows.manager.create_volume [None req-82b87b76-0e85-49aa-bd32-ee544f696840 tempest-GroupSnapshotsV319Test-1837239241 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#Quobyte'], 'hosts': ['devstack@QuobyteHD#Quobyte']} {{(pid=83259) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1387}} Sep 16 15:04:15 devstack cinder-volume[83259]: DEBUG cinder.volume.manager [None req-82b87b76-0e85-49aa-bd32-ee544f696840 tempest-GroupSnapshotsV319Test-1837239241 None] Flow 'volume_create_manager' (3fdf0e95-6e4a-42a5-9bd0-d1d48d20f846) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83259) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 16 15:04:15 devstack cinder-volume[83259]: DEBUG cinder.volume.manager [None req-82b87b76-0e85-49aa-bd32-ee544f696840 tempest-GroupSnapshotsV319Test-1837239241 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (feecb831-8943-4a0a-a035-1fc3af85f121) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83259) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 15:04:15 devstack cinder-volume[83259]: DEBUG cinder.volume.manager [None req-82b87b76-0e85-49aa-bd32-ee544f696840 tempest-GroupSnapshotsV319Test-1837239241 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (feecb831-8943-4a0a-a035-1fc3af85f121) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-16T13:04:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-694736938',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=c8378693-524d-4bdf-89e8-e091b75bec97,host='devstack@QuobyteHD#Quobyte',id=2fcdd18d-6ddb-4ae9-b61f-1d974de0b628,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='742d79c4a07d49d0a1b94b14d61382f3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-16T13:04:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-16T13:04:15Z,use_quota=True,user_id='9a7d3b843989465c81c076b16e566974',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f4021b1e-ad01-4589-b763-312ba0a97693),volume_type_id=f4021b1e-ad01-4589-b763-312ba0a97693)' {{(pid=83259) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 15:04:15 devstack cinder-volume[83259]: DEBUG cinder.volume.manager [None req-82b87b76-0e85-49aa-bd32-ee544f696840 tempest-GroupSnapshotsV319Test-1837239241 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7ba013e6-b067-4e3f-b5ff-f5ac5a19efbc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83259) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 15:04:15 devstack cinder-volume[83259]: DEBUG cinder.volume.manager [None req-82b87b76-0e85-49aa-bd32-ee544f696840 tempest-GroupSnapshotsV319Test-1837239241 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7ba013e6-b067-4e3f-b5ff-f5ac5a19efbc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83259) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 15:04:15 devstack cinder-volume[83259]: DEBUG cinder.volume.manager [None req-82b87b76-0e85-49aa-bd32-ee544f696840 tempest-GroupSnapshotsV319Test-1837239241 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c1211963-846c-413c-9197-4bd9a0f0dd5b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83259) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 15:04:15 devstack cinder-volume[83259]: DEBUG cinder.volume.manager [None req-82b87b76-0e85-49aa-bd32-ee544f696840 tempest-GroupSnapshotsV319Test-1837239241 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c1211963-846c-413c-9197-4bd9a0f0dd5b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2fcdd18d-6ddb-4ae9-b61f-1d974de0b628', 'volume_name': 'volume-2fcdd18d-6ddb-4ae9-b61f-1d974de0b628', 'volume_size': 1}' {{(pid=83259) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 15:04:15 devstack cinder-volume[83259]: DEBUG cinder.volume.manager [None req-82b87b76-0e85-49aa-bd32-ee544f696840 tempest-GroupSnapshotsV319Test-1837239241 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (eb3e9283-be27-4f7b-a9f3-301e8709e223) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83259) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 15:04:15 devstack cinder-volume[83259]: DEBUG cinder.volume.manager [None req-82b87b76-0e85-49aa-bd32-ee544f696840 tempest-GroupSnapshotsV319Test-1837239241 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (eb3e9283-be27-4f7b-a9f3-301e8709e223) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83259) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 15:04:15 devstack cinder-volume[83259]: DEBUG cinder.volume.manager [None req-82b87b76-0e85-49aa-bd32-ee544f696840 tempest-GroupSnapshotsV319Test-1837239241 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d630e6a2-8cc5-48d5-86f8-472417f649cc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83259) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 15:04:15 devstack cinder-volume[83259]: INFO cinder.volume.flows.manager.create_volume [None req-82b87b76-0e85-49aa-bd32-ee544f696840 tempest-GroupSnapshotsV319Test-1837239241 None] Volume 2fcdd18d-6ddb-4ae9-b61f-1d974de0b628: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2fcdd18d-6ddb-4ae9-b61f-1d974de0b628', 'volume_size': 1} Sep 16 15:04:15 devstack cinder-volume[83259]: DEBUG oslo_concurrency.lockutils [None req-82b87b76-0e85-49aa-bd32-ee544f696840 tempest-GroupSnapshotsV319Test-1837239241 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83259) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 16 15:04:15 devstack cinder-volume[83259]: DEBUG oslo_concurrency.lockutils [None req-82b87b76-0e85-49aa-bd32-ee544f696840 tempest-GroupSnapshotsV319Test-1837239241 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=83259) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 16 15:04:15 devstack cinder-volume[83259]: DEBUG cinder.volume.drivers.quobyte [None req-82b87b76-0e85-49aa-bd32-ee544f696840 tempest-GroupSnapshotsV319Test-1837239241 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=c8378693-524d-4bdf-89e8-e091b75bec97,created_at=2025-09-16T13:04:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-694736938',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=c8378693-524d-4bdf-89e8-e091b75bec97,host='devstack@QuobyteHD#Quobyte',id=2fcdd18d-6ddb-4ae9-b61f-1d974de0b628,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='742d79c4a07d49d0a1b94b14d61382f3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-16T13:04:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-16T13:04:15Z,use_quota=True,user_id='9a7d3b843989465c81c076b16e566974',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f4021b1e-ad01-4589-b763-312ba0a97693),volume_type_id=f4021b1e-ad01-4589-b763-312ba0a97693)}" {{(pid=83259) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Sep 16 15:04:15 devstack cinder-volume[83259]: DEBUG cinder.volume.drivers.remotefs [None req-82b87b76-0e85-49aa-bd32-ee544f696840 tempest-GroupSnapshotsV319Test-1837239241 None] Creating volume 2fcdd18d-6ddb-4ae9-b61f-1d974de0b628 {{(pid=83259) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}} Sep 16 15:04:15 devstack cinder-volume[83259]: DEBUG oslo_concurrency.lockutils [None req-82b87b76-0e85-49aa-bd32-ee544f696840 tempest-GroupSnapshotsV319Test-1837239241 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83259) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 16 15:04:15 devstack cinder-volume[83259]: DEBUG oslo_concurrency.lockutils [None req-82b87b76-0e85-49aa-bd32-ee544f696840 tempest-GroupSnapshotsV319Test-1837239241 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83259) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 16 15:04:15 devstack cinder-volume[83259]: DEBUG cinder.volume.drivers.quobyte [None req-82b87b76-0e85-49aa-bd32-ee544f696840 tempest-GroupSnapshotsV319Test-1837239241 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-61f585ac-f8e2-4d19-a890-7ebc2726cc72': None} {{(pid=83259) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:639}} Sep 16 15:04:15 devstack cinder-volume[83259]: DEBUG cinder.volume.drivers.quobyte [None req-82b87b76-0e85-49aa-bd32-ee544f696840 tempest-GroupSnapshotsV319Test-1837239241 None] Available shares ['10.10.41.181/cinder-vol-61f585ac-f8e2-4d19-a890-7ebc2726cc72'] {{(pid=83259) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:669}} Sep 16 15:04:15 devstack cinder-volume[83259]: DEBUG oslo_concurrency.lockutils [None req-82b87b76-0e85-49aa-bd32-ee544f696840 tempest-GroupSnapshotsV319Test-1837239241 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=83259) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 16 15:04:15 devstack cinder-volume[83259]: DEBUG cinder.volume.drivers.quobyte [None req-82b87b76-0e85-49aa-bd32-ee544f696840 tempest-GroupSnapshotsV319Test-1837239241 None] Selected 10.10.41.181/cinder-vol-61f585ac-f8e2-4d19-a890-7ebc2726cc72 as target Quobyte volume. {{(pid=83259) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:690}} Sep 16 15:04:15 devstack cinder-volume[83259]: INFO cinder.volume.drivers.remotefs [None req-82b87b76-0e85-49aa-bd32-ee544f696840 tempest-GroupSnapshotsV319Test-1837239241 None] casted to 10.10.41.181/cinder-vol-61f585ac-f8e2-4d19-a890-7ebc2726cc72 Sep 16 15:04:15 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [None req-82b87b76-0e85-49aa-bd32-ee544f696840 tempest-GroupSnapshotsV319Test-1837239241 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c/volume-2fcdd18d-6ddb-4ae9-b61f-1d974de0b628 1073741824 {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 15:04:15 devstack quobyte-client[83286]: System call of process 93222 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 16 15:04:15 devstack quobyte-client[83286]: The server volume:87712ffe-8a69-446d-9ed6-4430c7ee9792@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=87712ffe-8a69-446d-9ed6-4430c7ee9792, inode=46, name=volume-2fcdd18d-6ddb-4ae9-b61f-1d974de0b628, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.206), requestorAccessMask=0 Sep 16 15:04:15 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [None req-82b87b76-0e85-49aa-bd32-ee544f696840 tempest-GroupSnapshotsV319Test-1837239241 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c/volume-2fcdd18d-6ddb-4ae9-b61f-1d974de0b628 1073741824" returned: 0 in 0.350s {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 15:04:15 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [None req-82b87b76-0e85-49aa-bd32-ee544f696840 tempest-GroupSnapshotsV319Test-1837239241 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c/volume-2fcdd18d-6ddb-4ae9-b61f-1d974de0b628 {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 15:04:15 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [None req-82b87b76-0e85-49aa-bd32-ee544f696840 tempest-GroupSnapshotsV319Test-1837239241 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c/volume-2fcdd18d-6ddb-4ae9-b61f-1d974de0b628" returned: 0 in 0.104s {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 15:04:15 devstack cinder-volume[83259]: DEBUG cinder.volume.drivers.quobyte [None req-82b87b76-0e85-49aa-bd32-ee544f696840 tempest-GroupSnapshotsV319Test-1837239241 None] <== create_volume: return (540ms) {'provider_location': '10.10.41.181/cinder-vol-61f585ac-f8e2-4d19-a890-7ebc2726cc72'} {{(pid=83259) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Sep 16 15:04:15 devstack cinder-volume[83259]: DEBUG oslo_concurrency.lockutils [None req-82b87b76-0e85-49aa-bd32-ee544f696840 tempest-GroupSnapshotsV319Test-1837239241 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.554s {{(pid=83259) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 16 15:04:15 devstack cinder-volume[83259]: DEBUG cinder.coordination [None req-db1f4cb0-8942-40e1-a990-311f5c6a9ccd tempest-VolumesSnapshotNegativeTestJSON-4318571 None] Acquiring lock "cinder-19c4081c-c888-4244-b9a8-3a82ffcbe57a-delete_volume" by "delete_volume" {{(pid=83259) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 16 15:04:16 devstack cinder-volume[83259]: DEBUG cinder.volume.manager [None req-82b87b76-0e85-49aa-bd32-ee544f696840 tempest-GroupSnapshotsV319Test-1837239241 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d630e6a2-8cc5-48d5-86f8-472417f649cc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2fcdd18d-6ddb-4ae9-b61f-1d974de0b628', 'volume_size': 1}' {{(pid=83259) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 15:04:16 devstack cinder-volume[83259]: DEBUG cinder.volume.manager [None req-82b87b76-0e85-49aa-bd32-ee544f696840 tempest-GroupSnapshotsV319Test-1837239241 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e231a11e-0f84-4044-ab87-3a3e82636ab4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83259) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 15:04:16 devstack cinder-volume[83259]: WARNING cinder.volume.volume_utils [None req-00b3a6b6-607c-4e05-bae8-b5e3d093245e tempest-GroupSnapshotsTest-952387378 None] Volume driver (QuobyteDriver 1.2) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 16 15:04:16 devstack cinder-volume[83259]: INFO cinder.volume.flows.manager.create_volume [None req-82b87b76-0e85-49aa-bd32-ee544f696840 tempest-GroupSnapshotsV319Test-1837239241 None] Volume volume-2fcdd18d-6ddb-4ae9-b61f-1d974de0b628 (2fcdd18d-6ddb-4ae9-b61f-1d974de0b628): created successfully Sep 16 15:04:16 devstack cinder-volume[83259]: DEBUG cinder.volume.manager [None req-82b87b76-0e85-49aa-bd32-ee544f696840 tempest-GroupSnapshotsV319Test-1837239241 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e231a11e-0f84-4044-ab87-3a3e82636ab4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83259) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 15:04:16 devstack cinder-volume[83259]: DEBUG cinder.volume.manager [None req-82b87b76-0e85-49aa-bd32-ee544f696840 tempest-GroupSnapshotsV319Test-1837239241 None] Flow 'volume_create_manager' (3fdf0e95-6e4a-42a5-9bd0-d1d48d20f846) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83259) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 16 15:04:16 devstack cinder-volume[83259]: DEBUG cinder.coordination [None req-db1f4cb0-8942-40e1-a990-311f5c6a9ccd tempest-VolumesSnapshotNegativeTestJSON-4318571 None] Lock "cinder-19c4081c-c888-4244-b9a8-3a82ffcbe57a-delete_volume" acquired by "delete_volume" :: waited 0.229s {{(pid=83259) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 16 15:04:16 devstack cinder-volume[83259]: INFO cinder.volume.manager [None req-82b87b76-0e85-49aa-bd32-ee544f696840 tempest-GroupSnapshotsV319Test-1837239241 None] Created volume successfully. Sep 16 15:04:16 devstack cinder-volume[83259]: WARNING cinder.volume.volume_utils [None req-db1f4cb0-8942-40e1-a990-311f5c6a9ccd tempest-VolumesSnapshotNegativeTestJSON-4318571 None] Volume driver (QuobyteDriver 1.2) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 16 15:04:16 devstack cinder-volume[83259]: DEBUG cinder.coordination [None req-db1f4cb0-8942-40e1-a990-311f5c6a9ccd tempest-VolumesSnapshotNegativeTestJSON-4318571 None] Acquiring lock "cinder-quobyte-19c4081c-c888-4244-b9a8-3a82ffcbe57a" by "delete_volume" {{(pid=83259) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 16 15:04:16 devstack cinder-volume[83259]: DEBUG cinder.coordination [None req-db1f4cb0-8942-40e1-a990-311f5c6a9ccd tempest-VolumesSnapshotNegativeTestJSON-4318571 None] Lock "cinder-quobyte-19c4081c-c888-4244-b9a8-3a82ffcbe57a" acquired by "delete_volume" :: waited 0.013s {{(pid=83259) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 16 15:04:16 devstack cinder-volume[83259]: DEBUG oslo.privsep.daemon [-] privsep: reply[f29275f2-9422-4096-81fe-081f588fd19d]: (4, 'qcow2') {{(pid=84312) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 16 15:04:16 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [None req-db1f4cb0-8942-40e1-a990-311f5c6a9ccd tempest-VolumesSnapshotNegativeTestJSON-4318571 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c/volume-19c4081c-c888-4244-b9a8-3a82ffcbe57a {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 15:04:16 devstack cinder-volume[83259]: INFO cinder.volume.manager [None req-00b3a6b6-607c-4e05-bae8-b5e3d093245e tempest-GroupSnapshotsTest-952387378 None] Update group completed successfully. Sep 16 15:04:16 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [None req-db1f4cb0-8942-40e1-a990-311f5c6a9ccd tempest-VolumesSnapshotNegativeTestJSON-4318571 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c/volume-19c4081c-c888-4244-b9a8-3a82ffcbe57a" returned: 0 in 0.462s {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 15:04:16 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [None req-db1f4cb0-8942-40e1-a990-311f5c6a9ccd tempest-VolumesSnapshotNegativeTestJSON-4318571 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c/volume-19c4081c-c888-4244-b9a8-3a82ffcbe57a {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 15:04:16 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [None req-db1f4cb0-8942-40e1-a990-311f5c6a9ccd tempest-VolumesSnapshotNegativeTestJSON-4318571 None] CMD "rm -f /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c/volume-19c4081c-c888-4244-b9a8-3a82ffcbe57a" returned: 0 in 0.097s {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 15:04:17 devstack cinder-volume[83259]: DEBUG cinder.coordination [None req-db1f4cb0-8942-40e1-a990-311f5c6a9ccd tempest-VolumesSnapshotNegativeTestJSON-4318571 None] Lock "cinder-quobyte-19c4081c-c888-4244-b9a8-3a82ffcbe57a" released by "delete_volume" :: held 0.907s {{(pid=83259) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 16 15:04:17 devstack cinder-volume[83259]: WARNING cinder.volume.volume_utils [None req-9d66f435-a0fa-4047-8106-f2e5891234e7 tempest-GroupSnapshotsTest-952387378 None] Volume driver (QuobyteDriver 1.2) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 16 15:04:17 devstack cinder-volume[83259]: INFO cinder.volume.manager [None req-9d66f435-a0fa-4047-8106-f2e5891234e7 tempest-GroupSnapshotsTest-952387378 None] Update group completed successfully. Sep 16 15:04:17 devstack cinder-volume[83259]: DEBUG cinder.quota [None req-db1f4cb0-8942-40e1-a990-311f5c6a9ccd tempest-VolumesSnapshotNegativeTestJSON-4318571 None] Created reservations ['8f93dd7b-99da-4038-ac0a-d84a9823b703', 'e335c88e-849f-4b0c-8b62-ca68816c5655', 'bc83e16a-00c9-4443-b3ef-3daf254159c9', 'a4d9fb0d-7ff3-4dc6-a36f-17624499abf3'] {{(pid=83259) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 16 15:04:17 devstack cinder-volume[83259]: INFO cinder.volume.manager [None req-0c211a66-b7e5-4850-9ed5-e0cb4bda615f tempest-GroupSnapshotsV319Test-1837239241 None] GroupSnapshot 4536f473-d490-4be5-b119-7aead8c7525c: creating. Sep 16 15:04:17 devstack cinder-volume[83259]: WARNING cinder.volume.volume_utils [None req-0c211a66-b7e5-4850-9ed5-e0cb4bda615f tempest-GroupSnapshotsV319Test-1837239241 None] Volume driver (QuobyteDriver 1.2) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 16 15:04:17 devstack cinder-volume[83259]: DEBUG cinder.volume.manager [None req-0c211a66-b7e5-4850-9ed5-e0cb4bda615f tempest-GroupSnapshotsV319Test-1837239241 None] Group snapshot 4536f473-d490-4be5-b119-7aead8c7525c: creating. {{(pid=83259) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4142}} Sep 16 15:04:17 devstack cinder-volume[83259]: DEBUG oslo_concurrency.lockutils [None req-0c211a66-b7e5-4850-9ed5-e0cb4bda615f tempest-GroupSnapshotsV319Test-1837239241 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=83259) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 16 15:04:17 devstack cinder-volume[83259]: DEBUG oslo_concurrency.lockutils [None req-0c211a66-b7e5-4850-9ed5-e0cb4bda615f tempest-GroupSnapshotsV319Test-1837239241 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.004s {{(pid=83259) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 16 15:04:17 devstack cinder-volume[83259]: DEBUG cinder.volume.drivers.remotefs [None req-0c211a66-b7e5-4850-9ed5-e0cb4bda615f tempest-GroupSnapshotsV319Test-1837239241 None] Creating offline snapshot 064af65d-06bf-42a7-b1ea-f35d3be806d6 of volume 2fcdd18d-6ddb-4ae9-b61f-1d974de0b628 {{(pid=83259) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1694}} Sep 16 15:04:17 devstack cinder-volume[83259]: DEBUG oslo.privsep.daemon [-] privsep: reply[57c2ea32-c028-4d1c-95ca-e39584fe3aa8]: (4, 'qcow2') {{(pid=84312) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 16 15:04:17 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [None req-0c211a66-b7e5-4850-9ed5-e0cb4bda615f tempest-GroupSnapshotsV319Test-1837239241 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c/volume-2fcdd18d-6ddb-4ae9-b61f-1d974de0b628 {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 15:04:17 devstack cinder-volume[83259]: DEBUG oslo_concurrency.lockutils [None req-db1f4cb0-8942-40e1-a990-311f5c6a9ccd tempest-VolumesSnapshotNegativeTestJSON-4318571 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83259) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 16 15:04:17 devstack cinder-volume[83259]: DEBUG oslo_concurrency.lockutils [None req-db1f4cb0-8942-40e1-a990-311f5c6a9ccd tempest-VolumesSnapshotNegativeTestJSON-4318571 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.029s {{(pid=83259) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 16 15:04:17 devstack cinder-volume[83259]: DEBUG cinder.volume.drivers.quobyte [None req-db1f4cb0-8942-40e1-a990-311f5c6a9ccd tempest-VolumesSnapshotNegativeTestJSON-4318571 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-61f585ac-f8e2-4d19-a890-7ebc2726cc72': None} {{(pid=83259) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:639}} Sep 16 15:04:18 devstack cinder-volume[83259]: DEBUG cinder.volume.drivers.quobyte [None req-db1f4cb0-8942-40e1-a990-311f5c6a9ccd tempest-VolumesSnapshotNegativeTestJSON-4318571 None] Available shares ['10.10.41.181/cinder-vol-61f585ac-f8e2-4d19-a890-7ebc2726cc72'] {{(pid=83259) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:669}} Sep 16 15:04:18 devstack cinder-volume[83259]: DEBUG oslo_concurrency.lockutils [None req-db1f4cb0-8942-40e1-a990-311f5c6a9ccd tempest-VolumesSnapshotNegativeTestJSON-4318571 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.046s {{(pid=83259) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 16 15:04:18 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [None req-db1f4cb0-8942-40e1-a990-311f5c6a9ccd tempest-VolumesSnapshotNegativeTestJSON-4318571 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 15:04:18 devstack cinder-volume[83259]: WARNING cinder.volume.volume_utils [None req-b6020852-5d58-4399-8d60-417346ffab9d tempest-GroupSnapshotsTest-952387378 None] Volume driver (QuobyteDriver 1.2) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 16 15:04:18 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [None req-0c211a66-b7e5-4850-9ed5-e0cb4bda615f tempest-GroupSnapshotsV319Test-1837239241 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c/volume-2fcdd18d-6ddb-4ae9-b61f-1d974de0b628" returned: 0 in 1.174s {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 15:04:18 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [None req-0c211a66-b7e5-4850-9ed5-e0cb4bda615f tempest-GroupSnapshotsV319Test-1837239241 None] Running cmd (subprocess): qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c/volume-2fcdd18d-6ddb-4ae9-b61f-1d974de0b628,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c/volume-2fcdd18d-6ddb-4ae9-b61f-1d974de0b628.064af65d-06bf-42a7-b1ea-f35d3be806d6 1G {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 15:04:19 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [None req-db1f4cb0-8942-40e1-a990-311f5c6a9ccd tempest-VolumesSnapshotNegativeTestJSON-4318571 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c" returned: 0 in 1.028s {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 15:04:19 devstack quobyte-client[83286]: System call of process 93235 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 16 15:04:19 devstack cinder-volume[83259]: DEBUG cinder.manager [None req-db1f4cb0-8942-40e1-a990-311f5c6a9ccd tempest-VolumesSnapshotNegativeTestJSON-4318571 None] Notifying Schedulers of capabilities ... {{(pid=83259) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 16 15:04:19 devstack quobyte-client[83286]: The server volume:87712ffe-8a69-446d-9ed6-4430c7ee9792@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=87712ffe-8a69-446d-9ed6-4430c7ee9792, inode=47, name=volume-2fcdd18d-6ddb-4ae9-b61f-1d974de0b628.064af65d-06bf-42a7-b1ea-f35d3be806d6, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.206), requestorAccessMask=0 Sep 16 15:04:19 devstack cinder-volume[83259]: INFO cinder.volume.manager [None req-db1f4cb0-8942-40e1-a990-311f5c6a9ccd tempest-VolumesSnapshotNegativeTestJSON-4318571 None] Deleted volume successfully. Sep 16 15:04:19 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [None req-0c211a66-b7e5-4850-9ed5-e0cb4bda615f tempest-GroupSnapshotsV319Test-1837239241 None] CMD "qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c/volume-2fcdd18d-6ddb-4ae9-b61f-1d974de0b628,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c/volume-2fcdd18d-6ddb-4ae9-b61f-1d974de0b628.064af65d-06bf-42a7-b1ea-f35d3be806d6 1G" returned: 0 in 0.617s {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 15:04:19 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [None req-0c211a66-b7e5-4850-9ed5-e0cb4bda615f tempest-GroupSnapshotsV319Test-1837239241 None] Running cmd (subprocess): qemu-img rebase -u -b volume-2fcdd18d-6ddb-4ae9-b61f-1d974de0b628 -F qcow2 /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c/volume-2fcdd18d-6ddb-4ae9-b61f-1d974de0b628.064af65d-06bf-42a7-b1ea-f35d3be806d6 {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 15:04:19 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [None req-0c211a66-b7e5-4850-9ed5-e0cb4bda615f tempest-GroupSnapshotsV319Test-1837239241 None] CMD "qemu-img rebase -u -b volume-2fcdd18d-6ddb-4ae9-b61f-1d974de0b628 -F qcow2 /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c/volume-2fcdd18d-6ddb-4ae9-b61f-1d974de0b628.064af65d-06bf-42a7-b1ea-f35d3be806d6" returned: 0 in 0.352s {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 15:04:19 devstack cinder-volume[83259]: DEBUG cinder.volume.drivers.remotefs [None req-0c211a66-b7e5-4850-9ed5-e0cb4bda615f tempest-GroupSnapshotsV319Test-1837239241 None] File path /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c/volume-2fcdd18d-6ddb-4ae9-b61f-1d974de0b628.064af65d-06bf-42a7-b1ea-f35d3be806d6 is being set with permissions: 660 {{(pid=83259) _set_rw_permissions /opt/stack/cinder/cinder/volume/drivers/remotefs.py:492}} Sep 16 15:04:19 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [None req-0c211a66-b7e5-4850-9ed5-e0cb4bda615f tempest-GroupSnapshotsV319Test-1837239241 None] Running cmd (subprocess): chmod 660 /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c/volume-2fcdd18d-6ddb-4ae9-b61f-1d974de0b628.064af65d-06bf-42a7-b1ea-f35d3be806d6 {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 15:04:20 devstack cinder-volume[83259]: DEBUG cinder.coordination [None req-db1f4cb0-8942-40e1-a990-311f5c6a9ccd tempest-VolumesSnapshotNegativeTestJSON-4318571 None] Lock "cinder-19c4081c-c888-4244-b9a8-3a82ffcbe57a-delete_volume" released by "delete_volume" :: held 3.877s {{(pid=83259) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 16 15:04:20 devstack cinder-volume[83259]: INFO cinder.volume.manager [None req-b6020852-5d58-4399-8d60-417346ffab9d tempest-GroupSnapshotsTest-952387378 None] Update group completed successfully. Sep 16 15:04:20 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [None req-0c211a66-b7e5-4850-9ed5-e0cb4bda615f tempest-GroupSnapshotsV319Test-1837239241 None] CMD "chmod 660 /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c/volume-2fcdd18d-6ddb-4ae9-b61f-1d974de0b628.064af65d-06bf-42a7-b1ea-f35d3be806d6" returned: 0 in 0.428s {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 15:04:20 devstack cinder-volume[83259]: DEBUG cinder.volume.drivers.remotefs [None req-0c211a66-b7e5-4850-9ed5-e0cb4bda615f tempest-GroupSnapshotsV319Test-1837239241 None] Setting permissions: /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c/volume-2fcdd18d-6ddb-4ae9-b61f-1d974de0b628 -> 1000:1000 {{(pid=83259) _do_create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1584}} Sep 16 15:04:20 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [None req-0c211a66-b7e5-4850-9ed5-e0cb4bda615f tempest-GroupSnapshotsV319Test-1837239241 None] Running cmd (subprocess): chown --reference=/opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c/volume-2fcdd18d-6ddb-4ae9-b61f-1d974de0b628 /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c/volume-2fcdd18d-6ddb-4ae9-b61f-1d974de0b628.064af65d-06bf-42a7-b1ea-f35d3be806d6 {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 15:04:20 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [None req-0c211a66-b7e5-4850-9ed5-e0cb4bda615f tempest-GroupSnapshotsV319Test-1837239241 None] CMD "chown --reference=/opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c/volume-2fcdd18d-6ddb-4ae9-b61f-1d974de0b628 /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c/volume-2fcdd18d-6ddb-4ae9-b61f-1d974de0b628.064af65d-06bf-42a7-b1ea-f35d3be806d6" returned: 0 in 0.100s {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 15:04:20 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [None req-0c211a66-b7e5-4850-9ed5-e0cb4bda615f tempest-GroupSnapshotsV319Test-1837239241 None] Running cmd (subprocess): truncate -s0 /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c/volume-2fcdd18d-6ddb-4ae9-b61f-1d974de0b628.info {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 15:04:20 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [None req-0c211a66-b7e5-4850-9ed5-e0cb4bda615f tempest-GroupSnapshotsV319Test-1837239241 None] CMD "truncate -s0 /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c/volume-2fcdd18d-6ddb-4ae9-b61f-1d974de0b628.info" returned: 0 in 0.165s {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 15:04:20 devstack cinder-volume[83259]: DEBUG cinder.volume.drivers.remotefs [None req-0c211a66-b7e5-4850-9ed5-e0cb4bda615f tempest-GroupSnapshotsV319Test-1837239241 None] File path /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c/volume-2fcdd18d-6ddb-4ae9-b61f-1d974de0b628.info is being set with permissions: 660 {{(pid=83259) _set_rw_permissions /opt/stack/cinder/cinder/volume/drivers/remotefs.py:492}} Sep 16 15:04:20 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [None req-0c211a66-b7e5-4850-9ed5-e0cb4bda615f tempest-GroupSnapshotsV319Test-1837239241 None] Running cmd (subprocess): chmod 660 /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c/volume-2fcdd18d-6ddb-4ae9-b61f-1d974de0b628.info {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 15:04:20 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [None req-0c211a66-b7e5-4850-9ed5-e0cb4bda615f tempest-GroupSnapshotsV319Test-1837239241 None] CMD "chmod 660 /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c/volume-2fcdd18d-6ddb-4ae9-b61f-1d974de0b628.info" returned: 0 in 0.185s {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 15:04:20 devstack cinder-volume[83259]: DEBUG oslo_concurrency.lockutils [None req-0c211a66-b7e5-4850-9ed5-e0cb4bda615f tempest-GroupSnapshotsV319Test-1837239241 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.275s {{(pid=83259) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 16 15:04:21 devstack cinder-volume[83259]: WARNING cinder.volume.volume_utils [None req-90556642-33d5-4718-af06-7bef0393e435 tempest-GroupSnapshotsTest-952387378 None] Volume driver (QuobyteDriver 1.2) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 16 15:04:21 devstack cinder-volume[83259]: INFO cinder.volume.manager [None req-90556642-33d5-4718-af06-7bef0393e435 tempest-GroupSnapshotsTest-952387378 None] Update group completed successfully. Sep 16 15:04:21 devstack cinder-volume[83259]: INFO cinder.volume.manager [None req-0c211a66-b7e5-4850-9ed5-e0cb4bda615f tempest-GroupSnapshotsV319Test-1837239241 None] group_snapshot 4536f473-d490-4be5-b119-7aead8c7525c: created successfully Sep 16 15:04:22 devstack cinder-volume[83259]: INFO cinder.volume.manager [None req-2485f9e7-a84d-4a10-bebc-6345ebfe3477 tempest-GroupSnapshotsV319Test-1837239241 None] group_snapshot 4536f473-d490-4be5-b119-7aead8c7525c: deleting Sep 16 15:04:22 devstack cinder-volume[83259]: WARNING cinder.volume.volume_utils [None req-2485f9e7-a84d-4a10-bebc-6345ebfe3477 tempest-GroupSnapshotsV319Test-1837239241 None] Volume driver (QuobyteDriver 1.2) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 16 15:04:22 devstack cinder-volume[83259]: DEBUG cinder.volume.manager [None req-2485f9e7-a84d-4a10-bebc-6345ebfe3477 tempest-GroupSnapshotsV319Test-1837239241 None] group_snapshot 4536f473-d490-4be5-b119-7aead8c7525c: deleting {{(pid=83259) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4317}} Sep 16 15:04:22 devstack cinder-volume[83259]: DEBUG cinder.coordination [None req-2485f9e7-a84d-4a10-bebc-6345ebfe3477 tempest-GroupSnapshotsV319Test-1837239241 None] Acquiring lock "cinder-quobyte-2fcdd18d-6ddb-4ae9-b61f-1d974de0b628" by "delete_snapshot" {{(pid=83259) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 16 15:04:22 devstack cinder-volume[83259]: DEBUG cinder.coordination [None req-2485f9e7-a84d-4a10-bebc-6345ebfe3477 tempest-GroupSnapshotsV319Test-1837239241 None] Lock "cinder-quobyte-2fcdd18d-6ddb-4ae9-b61f-1d974de0b628" acquired by "delete_snapshot" :: waited 0.109s {{(pid=83259) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 16 15:04:22 devstack cinder-volume[83259]: DEBUG cinder.coordination [None req-2485f9e7-a84d-4a10-bebc-6345ebfe3477 tempest-GroupSnapshotsV319Test-1837239241 None] Acquiring lock "cinder-quobyte-064af65d-06bf-42a7-b1ea-f35d3be806d6" by "_delete_snapshot" {{(pid=83259) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 16 15:04:22 devstack cinder-volume[83259]: DEBUG cinder.coordination [None req-2485f9e7-a84d-4a10-bebc-6345ebfe3477 tempest-GroupSnapshotsV319Test-1837239241 None] Lock "cinder-quobyte-064af65d-06bf-42a7-b1ea-f35d3be806d6" acquired by "_delete_snapshot" :: waited 0.017s {{(pid=83259) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 16 15:04:22 devstack cinder-volume[83259]: DEBUG cinder.volume.drivers.remotefs [None req-2485f9e7-a84d-4a10-bebc-6345ebfe3477 tempest-GroupSnapshotsV319Test-1837239241 None] Deleting offline snapshot 064af65d-06bf-42a7-b1ea-f35d3be806d6 of volume 2fcdd18d-6ddb-4ae9-b61f-1d974de0b628 {{(pid=83259) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1278}} Sep 16 15:04:22 devstack cinder-volume[83259]: DEBUG cinder.volume.drivers.remotefs [None req-2485f9e7-a84d-4a10-bebc-6345ebfe3477 tempest-GroupSnapshotsV319Test-1837239241 None] snapshot_file for this snap is: volume-2fcdd18d-6ddb-4ae9-b61f-1d974de0b628.064af65d-06bf-42a7-b1ea-f35d3be806d6 {{(pid=83259) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1307}} Sep 16 15:04:22 devstack cinder-volume[83259]: DEBUG oslo.privsep.daemon [-] privsep: reply[75025afa-bf6c-4b8d-8095-01c3547413f2]: (4, 'qcow2') {{(pid=84312) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 16 15:04:22 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [None req-2485f9e7-a84d-4a10-bebc-6345ebfe3477 tempest-GroupSnapshotsV319Test-1837239241 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c/volume-2fcdd18d-6ddb-4ae9-b61f-1d974de0b628.064af65d-06bf-42a7-b1ea-f35d3be806d6 {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 15:04:23 devstack cinder-volume[83259]: INFO cinder.volume.manager [None req-03baf2e5-76d8-4117-a975-1d84937fbef9 tempest-GroupSnapshotsTest-952387378 None] GroupSnapshot fa074eb9-580a-441c-90b1-5817f0e64e06: creating. Sep 16 15:04:23 devstack cinder-volume[83259]: WARNING cinder.volume.volume_utils [None req-03baf2e5-76d8-4117-a975-1d84937fbef9 tempest-GroupSnapshotsTest-952387378 None] Volume driver (QuobyteDriver 1.2) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 16 15:04:23 devstack cinder-volume[83259]: DEBUG cinder.volume.manager [None req-03baf2e5-76d8-4117-a975-1d84937fbef9 tempest-GroupSnapshotsTest-952387378 None] Group snapshot fa074eb9-580a-441c-90b1-5817f0e64e06: creating. {{(pid=83259) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4142}} Sep 16 15:04:23 devstack cinder-volume[83259]: DEBUG oslo_concurrency.lockutils [None req-03baf2e5-76d8-4117-a975-1d84937fbef9 tempest-GroupSnapshotsTest-952387378 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=83259) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 16 15:04:23 devstack cinder-volume[83259]: DEBUG oslo_concurrency.lockutils [None req-03baf2e5-76d8-4117-a975-1d84937fbef9 tempest-GroupSnapshotsTest-952387378 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.005s {{(pid=83259) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 16 15:04:23 devstack quobyte-client[83286]: System call of process 93245 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 16 15:04:23 devstack cinder-volume[83259]: DEBUG cinder.volume.drivers.remotefs [None req-03baf2e5-76d8-4117-a975-1d84937fbef9 tempest-GroupSnapshotsTest-952387378 None] Creating offline snapshot 8eeb749f-06b2-4a34-b884-9e08468b653e of volume 4efde0d8-8e7b-43fe-a588-f71f487cf420 {{(pid=83259) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1694}} Sep 16 15:04:23 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [None req-2485f9e7-a84d-4a10-bebc-6345ebfe3477 tempest-GroupSnapshotsV319Test-1837239241 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c/volume-2fcdd18d-6ddb-4ae9-b61f-1d974de0b628.064af65d-06bf-42a7-b1ea-f35d3be806d6" returned: 0 in 0.623s {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 15:04:23 devstack cinder-volume[83259]: DEBUG cinder.volume.drivers.remotefs [None req-2485f9e7-a84d-4a10-bebc-6345ebfe3477 tempest-GroupSnapshotsV319Test-1837239241 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-2fcdd18d-6ddb-4ae9-b61f-1d974de0b628(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83259) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:886}} Sep 16 15:04:23 devstack cinder-volume[83259]: DEBUG oslo.privsep.daemon [-] privsep: reply[e8ca79f3-8b6e-4c23-8fc0-c1e467e3af1f]: (4, 'qcow2') {{(pid=84312) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 16 15:04:23 devstack cinder-volume[83259]: DEBUG oslo.privsep.daemon [-] privsep: reply[3bae6c17-1609-407d-87d2-e21674b835d8]: (4, 'qcow2') {{(pid=84312) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 16 15:04:23 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [None req-03baf2e5-76d8-4117-a975-1d84937fbef9 tempest-GroupSnapshotsTest-952387378 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c/volume-4efde0d8-8e7b-43fe-a588-f71f487cf420 {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 15:04:23 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [None req-2485f9e7-a84d-4a10-bebc-6345ebfe3477 tempest-GroupSnapshotsV319Test-1837239241 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c/volume-2fcdd18d-6ddb-4ae9-b61f-1d974de0b628 {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 15:04:23 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [None req-03baf2e5-76d8-4117-a975-1d84937fbef9 tempest-GroupSnapshotsTest-952387378 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c/volume-4efde0d8-8e7b-43fe-a588-f71f487cf420" returned: 0 in 0.555s {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 15:04:24 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [None req-03baf2e5-76d8-4117-a975-1d84937fbef9 tempest-GroupSnapshotsTest-952387378 None] Running cmd (subprocess): qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c/volume-4efde0d8-8e7b-43fe-a588-f71f487cf420,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c/volume-4efde0d8-8e7b-43fe-a588-f71f487cf420.8eeb749f-06b2-4a34-b884-9e08468b653e 1G {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 15:04:24 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [None req-2485f9e7-a84d-4a10-bebc-6345ebfe3477 tempest-GroupSnapshotsV319Test-1837239241 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c/volume-2fcdd18d-6ddb-4ae9-b61f-1d974de0b628" returned: 0 in 0.692s {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 15:04:24 devstack quobyte-client[83286]: System call of process 93253 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 16 15:04:24 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [None req-2485f9e7-a84d-4a10-bebc-6345ebfe3477 tempest-GroupSnapshotsV319Test-1837239241 None] Running cmd (subprocess): qemu-img commit -d /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c/volume-2fcdd18d-6ddb-4ae9-b61f-1d974de0b628.064af65d-06bf-42a7-b1ea-f35d3be806d6 {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 15:04:24 devstack quobyte-client[83286]: The server volume:87712ffe-8a69-446d-9ed6-4430c7ee9792@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=87712ffe-8a69-446d-9ed6-4430c7ee9792, inode=49, name=volume-4efde0d8-8e7b-43fe-a588-f71f487cf420.8eeb749f-06b2-4a34-b884-9e08468b653e, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.206), requestorAccessMask=0 Sep 16 15:04:24 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [None req-03baf2e5-76d8-4117-a975-1d84937fbef9 tempest-GroupSnapshotsTest-952387378 None] CMD "qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c/volume-4efde0d8-8e7b-43fe-a588-f71f487cf420,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c/volume-4efde0d8-8e7b-43fe-a588-f71f487cf420.8eeb749f-06b2-4a34-b884-9e08468b653e 1G" returned: 0 in 0.406s {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 15:04:24 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [None req-03baf2e5-76d8-4117-a975-1d84937fbef9 tempest-GroupSnapshotsTest-952387378 None] Running cmd (subprocess): qemu-img rebase -u -b volume-4efde0d8-8e7b-43fe-a588-f71f487cf420 -F qcow2 /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c/volume-4efde0d8-8e7b-43fe-a588-f71f487cf420.8eeb749f-06b2-4a34-b884-9e08468b653e {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 15:04:24 devstack quobyte-client[83286]: System call of process 93261 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 16 15:04:24 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [None req-2485f9e7-a84d-4a10-bebc-6345ebfe3477 tempest-GroupSnapshotsV319Test-1837239241 None] CMD "qemu-img commit -d /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c/volume-2fcdd18d-6ddb-4ae9-b61f-1d974de0b628.064af65d-06bf-42a7-b1ea-f35d3be806d6" returned: 0 in 0.417s {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 15:04:24 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [None req-2485f9e7-a84d-4a10-bebc-6345ebfe3477 tempest-GroupSnapshotsV319Test-1837239241 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c/volume-2fcdd18d-6ddb-4ae9-b61f-1d974de0b628.064af65d-06bf-42a7-b1ea-f35d3be806d6 {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 15:04:24 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [None req-03baf2e5-76d8-4117-a975-1d84937fbef9 tempest-GroupSnapshotsTest-952387378 None] CMD "qemu-img rebase -u -b volume-4efde0d8-8e7b-43fe-a588-f71f487cf420 -F qcow2 /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c/volume-4efde0d8-8e7b-43fe-a588-f71f487cf420.8eeb749f-06b2-4a34-b884-9e08468b653e" returned: 0 in 0.359s {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 15:04:24 devstack cinder-volume[83259]: DEBUG cinder.volume.drivers.remotefs [None req-03baf2e5-76d8-4117-a975-1d84937fbef9 tempest-GroupSnapshotsTest-952387378 None] File path /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c/volume-4efde0d8-8e7b-43fe-a588-f71f487cf420.8eeb749f-06b2-4a34-b884-9e08468b653e is being set with permissions: 660 {{(pid=83259) _set_rw_permissions /opt/stack/cinder/cinder/volume/drivers/remotefs.py:492}} Sep 16 15:04:24 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [None req-03baf2e5-76d8-4117-a975-1d84937fbef9 tempest-GroupSnapshotsTest-952387378 None] Running cmd (subprocess): chmod 660 /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c/volume-4efde0d8-8e7b-43fe-a588-f71f487cf420.8eeb749f-06b2-4a34-b884-9e08468b653e {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 15:04:24 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [None req-2485f9e7-a84d-4a10-bebc-6345ebfe3477 tempest-GroupSnapshotsV319Test-1837239241 None] CMD "rm -f /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c/volume-2fcdd18d-6ddb-4ae9-b61f-1d974de0b628.064af65d-06bf-42a7-b1ea-f35d3be806d6" returned: 0 in 0.226s {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 15:04:25 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [None req-03baf2e5-76d8-4117-a975-1d84937fbef9 tempest-GroupSnapshotsTest-952387378 None] CMD "chmod 660 /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c/volume-4efde0d8-8e7b-43fe-a588-f71f487cf420.8eeb749f-06b2-4a34-b884-9e08468b653e" returned: 0 in 0.237s {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 15:04:25 devstack cinder-volume[83259]: DEBUG cinder.volume.drivers.remotefs [None req-03baf2e5-76d8-4117-a975-1d84937fbef9 tempest-GroupSnapshotsTest-952387378 None] Setting permissions: /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c/volume-4efde0d8-8e7b-43fe-a588-f71f487cf420 -> 1000:1000 {{(pid=83259) _do_create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1584}} Sep 16 15:04:25 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [None req-03baf2e5-76d8-4117-a975-1d84937fbef9 tempest-GroupSnapshotsTest-952387378 None] Running cmd (subprocess): chown --reference=/opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c/volume-4efde0d8-8e7b-43fe-a588-f71f487cf420 /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c/volume-4efde0d8-8e7b-43fe-a588-f71f487cf420.8eeb749f-06b2-4a34-b884-9e08468b653e {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 15:04:25 devstack cinder-volume[83259]: DEBUG cinder.coordination [None req-2485f9e7-a84d-4a10-bebc-6345ebfe3477 tempest-GroupSnapshotsV319Test-1837239241 None] Lock "cinder-quobyte-064af65d-06bf-42a7-b1ea-f35d3be806d6" released by "_delete_snapshot" :: held 2.568s {{(pid=83259) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 16 15:04:25 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [None req-03baf2e5-76d8-4117-a975-1d84937fbef9 tempest-GroupSnapshotsTest-952387378 None] CMD "chown --reference=/opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c/volume-4efde0d8-8e7b-43fe-a588-f71f487cf420 /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c/volume-4efde0d8-8e7b-43fe-a588-f71f487cf420.8eeb749f-06b2-4a34-b884-9e08468b653e" returned: 0 in 0.233s {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 15:04:25 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [None req-03baf2e5-76d8-4117-a975-1d84937fbef9 tempest-GroupSnapshotsTest-952387378 None] Running cmd (subprocess): truncate -s0 /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c/volume-4efde0d8-8e7b-43fe-a588-f71f487cf420.info {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 15:04:25 devstack cinder-volume[83259]: DEBUG cinder.coordination [None req-2485f9e7-a84d-4a10-bebc-6345ebfe3477 tempest-GroupSnapshotsV319Test-1837239241 None] Lock "cinder-quobyte-2fcdd18d-6ddb-4ae9-b61f-1d974de0b628" released by "delete_snapshot" :: held 2.812s {{(pid=83259) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 16 15:04:25 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [None req-03baf2e5-76d8-4117-a975-1d84937fbef9 tempest-GroupSnapshotsTest-952387378 None] CMD "truncate -s0 /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c/volume-4efde0d8-8e7b-43fe-a588-f71f487cf420.info" returned: 0 in 0.349s {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 15:04:25 devstack cinder-volume[83259]: DEBUG cinder.volume.drivers.remotefs [None req-03baf2e5-76d8-4117-a975-1d84937fbef9 tempest-GroupSnapshotsTest-952387378 None] File path /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c/volume-4efde0d8-8e7b-43fe-a588-f71f487cf420.info is being set with permissions: 660 {{(pid=83259) _set_rw_permissions /opt/stack/cinder/cinder/volume/drivers/remotefs.py:492}} Sep 16 15:04:25 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [None req-03baf2e5-76d8-4117-a975-1d84937fbef9 tempest-GroupSnapshotsTest-952387378 None] Running cmd (subprocess): chmod 660 /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c/volume-4efde0d8-8e7b-43fe-a588-f71f487cf420.info {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 15:04:26 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [None req-03baf2e5-76d8-4117-a975-1d84937fbef9 tempest-GroupSnapshotsTest-952387378 None] CMD "chmod 660 /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c/volume-4efde0d8-8e7b-43fe-a588-f71f487cf420.info" returned: 0 in 0.310s {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 15:04:26 devstack cinder-volume[83259]: DEBUG oslo_concurrency.lockutils [None req-03baf2e5-76d8-4117-a975-1d84937fbef9 tempest-GroupSnapshotsTest-952387378 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.783s {{(pid=83259) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 16 15:04:26 devstack cinder-volume[83259]: DEBUG oslo_concurrency.lockutils [None req-03baf2e5-76d8-4117-a975-1d84937fbef9 tempest-GroupSnapshotsTest-952387378 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=83259) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 16 15:04:26 devstack cinder-volume[83259]: DEBUG oslo_concurrency.lockutils [None req-03baf2e5-76d8-4117-a975-1d84937fbef9 tempest-GroupSnapshotsTest-952387378 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.003s {{(pid=83259) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 16 15:04:26 devstack cinder-volume[83259]: DEBUG cinder.volume.drivers.remotefs [None req-03baf2e5-76d8-4117-a975-1d84937fbef9 tempest-GroupSnapshotsTest-952387378 None] Creating offline snapshot e2f510a9-992e-4b0b-8b95-e3508acc36ef of volume ceafecc8-d8a4-447f-9ff7-7fc9f8c88f95 {{(pid=83259) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1694}} Sep 16 15:04:26 devstack cinder-volume[83259]: DEBUG oslo.privsep.daemon [-] privsep: reply[54b8beec-c9e7-40a5-ab8c-7f6e8f7ea54a]: (4, 'qcow2') {{(pid=84312) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 16 15:04:26 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [None req-03baf2e5-76d8-4117-a975-1d84937fbef9 tempest-GroupSnapshotsTest-952387378 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c/volume-ceafecc8-d8a4-447f-9ff7-7fc9f8c88f95 {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 15:04:26 devstack cinder-volume[83259]: WARNING cinder.quota [None req-2485f9e7-a84d-4a10-bebc-6345ebfe3477 tempest-GroupSnapshotsV319Test-1837239241 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsV319Test-volume-type-528798284 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsV319Test-volume-type-528798284, it is now deprecated. Please use the default quota class for default quota. Sep 16 15:04:26 devstack cinder-volume[83259]: WARNING cinder.quota [None req-2485f9e7-a84d-4a10-bebc-6345ebfe3477 tempest-GroupSnapshotsV319Test-1837239241 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsV319Test-volume-type-528798284 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsV319Test-volume-type-528798284, it is now deprecated. Please use the default quota class for default quota. Sep 16 15:04:26 devstack cinder-volume[83259]: DEBUG cinder.quota [None req-2485f9e7-a84d-4a10-bebc-6345ebfe3477 tempest-GroupSnapshotsV319Test-1837239241 None] Created reservations ['2a1d2735-dafd-4f49-934c-0e8fc353f721', 'fff403d4-f4de-4cf6-8011-686b85d9b376', '7983af75-0fed-4d74-ac35-b9483ffa8fec', 'e01614e9-ed58-4d8a-ae84-570628735bda'] {{(pid=83259) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 16 15:04:26 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [None req-03baf2e5-76d8-4117-a975-1d84937fbef9 tempest-GroupSnapshotsTest-952387378 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c/volume-ceafecc8-d8a4-447f-9ff7-7fc9f8c88f95" returned: 0 in 0.633s {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 15:04:26 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [None req-03baf2e5-76d8-4117-a975-1d84937fbef9 tempest-GroupSnapshotsTest-952387378 None] Running cmd (subprocess): qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c/volume-ceafecc8-d8a4-447f-9ff7-7fc9f8c88f95,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c/volume-ceafecc8-d8a4-447f-9ff7-7fc9f8c88f95.e2f510a9-992e-4b0b-8b95-e3508acc36ef 1G {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 15:04:27 devstack quobyte-client[83286]: The server volume:87712ffe-8a69-446d-9ed6-4430c7ee9792@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=87712ffe-8a69-446d-9ed6-4430c7ee9792, inode=51, name=volume-ceafecc8-d8a4-447f-9ff7-7fc9f8c88f95.e2f510a9-992e-4b0b-8b95-e3508acc36ef, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.206), requestorAccessMask=0 Sep 16 15:04:27 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [None req-03baf2e5-76d8-4117-a975-1d84937fbef9 tempest-GroupSnapshotsTest-952387378 None] CMD "qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c/volume-ceafecc8-d8a4-447f-9ff7-7fc9f8c88f95,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c/volume-ceafecc8-d8a4-447f-9ff7-7fc9f8c88f95.e2f510a9-992e-4b0b-8b95-e3508acc36ef 1G" returned: 0 in 0.327s {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 15:04:27 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [None req-03baf2e5-76d8-4117-a975-1d84937fbef9 tempest-GroupSnapshotsTest-952387378 None] Running cmd (subprocess): qemu-img rebase -u -b volume-ceafecc8-d8a4-447f-9ff7-7fc9f8c88f95 -F qcow2 /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c/volume-ceafecc8-d8a4-447f-9ff7-7fc9f8c88f95.e2f510a9-992e-4b0b-8b95-e3508acc36ef {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 15:04:27 devstack quobyte-client[83286]: System call of process 93275 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 16 15:04:27 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [None req-03baf2e5-76d8-4117-a975-1d84937fbef9 tempest-GroupSnapshotsTest-952387378 None] CMD "qemu-img rebase -u -b volume-ceafecc8-d8a4-447f-9ff7-7fc9f8c88f95 -F qcow2 /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c/volume-ceafecc8-d8a4-447f-9ff7-7fc9f8c88f95.e2f510a9-992e-4b0b-8b95-e3508acc36ef" returned: 0 in 0.299s {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 15:04:27 devstack cinder-volume[83259]: DEBUG cinder.volume.drivers.remotefs [None req-03baf2e5-76d8-4117-a975-1d84937fbef9 tempest-GroupSnapshotsTest-952387378 None] File path /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c/volume-ceafecc8-d8a4-447f-9ff7-7fc9f8c88f95.e2f510a9-992e-4b0b-8b95-e3508acc36ef is being set with permissions: 660 {{(pid=83259) _set_rw_permissions /opt/stack/cinder/cinder/volume/drivers/remotefs.py:492}} Sep 16 15:04:27 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [None req-03baf2e5-76d8-4117-a975-1d84937fbef9 tempest-GroupSnapshotsTest-952387378 None] Running cmd (subprocess): chmod 660 /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c/volume-ceafecc8-d8a4-447f-9ff7-7fc9f8c88f95.e2f510a9-992e-4b0b-8b95-e3508acc36ef {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 15:04:27 devstack cinder-volume[83259]: INFO cinder.volume.manager [None req-2485f9e7-a84d-4a10-bebc-6345ebfe3477 tempest-GroupSnapshotsV319Test-1837239241 None] group_snapshot 4536f473-d490-4be5-b119-7aead8c7525c: deleted successfully Sep 16 15:04:27 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [None req-03baf2e5-76d8-4117-a975-1d84937fbef9 tempest-GroupSnapshotsTest-952387378 None] CMD "chmod 660 /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c/volume-ceafecc8-d8a4-447f-9ff7-7fc9f8c88f95.e2f510a9-992e-4b0b-8b95-e3508acc36ef" returned: 0 in 0.201s {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 15:04:27 devstack cinder-volume[83259]: DEBUG cinder.volume.drivers.remotefs [None req-03baf2e5-76d8-4117-a975-1d84937fbef9 tempest-GroupSnapshotsTest-952387378 None] Setting permissions: /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c/volume-ceafecc8-d8a4-447f-9ff7-7fc9f8c88f95 -> 1000:1000 {{(pid=83259) _do_create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1584}} Sep 16 15:04:27 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [None req-03baf2e5-76d8-4117-a975-1d84937fbef9 tempest-GroupSnapshotsTest-952387378 None] Running cmd (subprocess): chown --reference=/opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c/volume-ceafecc8-d8a4-447f-9ff7-7fc9f8c88f95 /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c/volume-ceafecc8-d8a4-447f-9ff7-7fc9f8c88f95.e2f510a9-992e-4b0b-8b95-e3508acc36ef {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 15:04:27 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [None req-03baf2e5-76d8-4117-a975-1d84937fbef9 tempest-GroupSnapshotsTest-952387378 None] CMD "chown --reference=/opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c/volume-ceafecc8-d8a4-447f-9ff7-7fc9f8c88f95 /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c/volume-ceafecc8-d8a4-447f-9ff7-7fc9f8c88f95.e2f510a9-992e-4b0b-8b95-e3508acc36ef" returned: 0 in 0.124s {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 15:04:27 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [None req-03baf2e5-76d8-4117-a975-1d84937fbef9 tempest-GroupSnapshotsTest-952387378 None] Running cmd (subprocess): truncate -s0 /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c/volume-ceafecc8-d8a4-447f-9ff7-7fc9f8c88f95.info {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 15:04:28 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [None req-03baf2e5-76d8-4117-a975-1d84937fbef9 tempest-GroupSnapshotsTest-952387378 None] CMD "truncate -s0 /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c/volume-ceafecc8-d8a4-447f-9ff7-7fc9f8c88f95.info" returned: 0 in 0.114s {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 15:04:28 devstack cinder-volume[83259]: DEBUG cinder.volume.drivers.remotefs [None req-03baf2e5-76d8-4117-a975-1d84937fbef9 tempest-GroupSnapshotsTest-952387378 None] File path /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c/volume-ceafecc8-d8a4-447f-9ff7-7fc9f8c88f95.info is being set with permissions: 660 {{(pid=83259) _set_rw_permissions /opt/stack/cinder/cinder/volume/drivers/remotefs.py:492}} Sep 16 15:04:28 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [None req-03baf2e5-76d8-4117-a975-1d84937fbef9 tempest-GroupSnapshotsTest-952387378 None] Running cmd (subprocess): chmod 660 /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c/volume-ceafecc8-d8a4-447f-9ff7-7fc9f8c88f95.info {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 15:04:28 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [None req-03baf2e5-76d8-4117-a975-1d84937fbef9 tempest-GroupSnapshotsTest-952387378 None] CMD "chmod 660 /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c/volume-ceafecc8-d8a4-447f-9ff7-7fc9f8c88f95.info" returned: 0 in 0.107s {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 15:04:28 devstack cinder-volume[83259]: DEBUG oslo_concurrency.lockutils [None req-03baf2e5-76d8-4117-a975-1d84937fbef9 tempest-GroupSnapshotsTest-952387378 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.143s {{(pid=83259) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 16 15:04:28 devstack cinder-volume[83259]: WARNING cinder.volume.volume_utils [None req-821de7eb-6c37-44dd-8203-dae657ad12a3 tempest-GroupSnapshotsV319Test-1837239241 None] Volume driver (QuobyteDriver 1.2) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 16 15:04:28 devstack cinder-volume[83259]: DEBUG cinder.coordination [None req-821de7eb-6c37-44dd-8203-dae657ad12a3 tempest-GroupSnapshotsV319Test-1837239241 None] Acquiring lock "cinder-quobyte-2fcdd18d-6ddb-4ae9-b61f-1d974de0b628" by "delete_volume" {{(pid=83259) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 16 15:04:28 devstack cinder-volume[83259]: DEBUG cinder.coordination [None req-821de7eb-6c37-44dd-8203-dae657ad12a3 tempest-GroupSnapshotsV319Test-1837239241 None] Lock "cinder-quobyte-2fcdd18d-6ddb-4ae9-b61f-1d974de0b628" acquired by "delete_volume" :: waited 0.069s {{(pid=83259) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 16 15:04:28 devstack cinder-volume[83259]: DEBUG oslo.privsep.daemon [-] privsep: reply[05e1b096-810f-4e12-85f0-15fd4b076d9c]: (4, 'qcow2') {{(pid=84312) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 16 15:04:28 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [None req-821de7eb-6c37-44dd-8203-dae657ad12a3 tempest-GroupSnapshotsV319Test-1837239241 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c/volume-2fcdd18d-6ddb-4ae9-b61f-1d974de0b628 {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 15:04:29 devstack cinder-volume[83259]: INFO cinder.volume.manager [None req-03baf2e5-76d8-4117-a975-1d84937fbef9 tempest-GroupSnapshotsTest-952387378 None] group_snapshot fa074eb9-580a-441c-90b1-5817f0e64e06: created successfully Sep 16 15:04:29 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [None req-821de7eb-6c37-44dd-8203-dae657ad12a3 tempest-GroupSnapshotsV319Test-1837239241 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c/volume-2fcdd18d-6ddb-4ae9-b61f-1d974de0b628" returned: 0 in 0.648s {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 15:04:29 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [None req-821de7eb-6c37-44dd-8203-dae657ad12a3 tempest-GroupSnapshotsV319Test-1837239241 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c/volume-2fcdd18d-6ddb-4ae9-b61f-1d974de0b628 {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 15:04:29 devstack cinder-volume[83259]: INFO cinder.volume.manager [None req-072f4684-2fbe-4cab-ac35-071e9df6d4aa tempest-GroupSnapshotsTest-952387378 None] group_snapshot fa074eb9-580a-441c-90b1-5817f0e64e06: deleting Sep 16 15:04:30 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [None req-821de7eb-6c37-44dd-8203-dae657ad12a3 tempest-GroupSnapshotsV319Test-1837239241 None] CMD "rm -f /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c/volume-2fcdd18d-6ddb-4ae9-b61f-1d974de0b628" returned: 0 in 0.484s {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 15:04:30 devstack cinder-volume[83259]: WARNING cinder.volume.volume_utils [None req-072f4684-2fbe-4cab-ac35-071e9df6d4aa tempest-GroupSnapshotsTest-952387378 None] Volume driver (QuobyteDriver 1.2) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 16 15:04:30 devstack cinder-volume[83259]: DEBUG cinder.volume.manager [None req-072f4684-2fbe-4cab-ac35-071e9df6d4aa tempest-GroupSnapshotsTest-952387378 None] group_snapshot fa074eb9-580a-441c-90b1-5817f0e64e06: deleting {{(pid=83259) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4317}} Sep 16 15:04:30 devstack cinder-volume[83259]: DEBUG cinder.coordination [None req-821de7eb-6c37-44dd-8203-dae657ad12a3 tempest-GroupSnapshotsV319Test-1837239241 None] Lock "cinder-quobyte-2fcdd18d-6ddb-4ae9-b61f-1d974de0b628" released by "delete_volume" :: held 1.286s {{(pid=83259) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 16 15:04:30 devstack cinder-volume[83259]: DEBUG cinder.coordination [None req-072f4684-2fbe-4cab-ac35-071e9df6d4aa tempest-GroupSnapshotsTest-952387378 None] Acquiring lock "cinder-quobyte-4efde0d8-8e7b-43fe-a588-f71f487cf420" by "delete_snapshot" {{(pid=83259) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 16 15:04:30 devstack cinder-volume[83259]: DEBUG cinder.coordination [None req-072f4684-2fbe-4cab-ac35-071e9df6d4aa tempest-GroupSnapshotsTest-952387378 None] Lock "cinder-quobyte-4efde0d8-8e7b-43fe-a588-f71f487cf420" acquired by "delete_snapshot" :: waited 0.045s {{(pid=83259) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 16 15:04:30 devstack cinder-volume[83259]: DEBUG cinder.coordination [None req-072f4684-2fbe-4cab-ac35-071e9df6d4aa tempest-GroupSnapshotsTest-952387378 None] Acquiring lock "cinder-quobyte-8eeb749f-06b2-4a34-b884-9e08468b653e" by "_delete_snapshot" {{(pid=83259) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 16 15:04:30 devstack cinder-volume[83259]: DEBUG cinder.coordination [None req-072f4684-2fbe-4cab-ac35-071e9df6d4aa tempest-GroupSnapshotsTest-952387378 None] Lock "cinder-quobyte-8eeb749f-06b2-4a34-b884-9e08468b653e" acquired by "_delete_snapshot" :: waited 0.013s {{(pid=83259) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 16 15:04:30 devstack cinder-volume[83259]: DEBUG cinder.volume.drivers.remotefs [None req-072f4684-2fbe-4cab-ac35-071e9df6d4aa tempest-GroupSnapshotsTest-952387378 None] Deleting offline snapshot 8eeb749f-06b2-4a34-b884-9e08468b653e of volume 4efde0d8-8e7b-43fe-a588-f71f487cf420 {{(pid=83259) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1278}} Sep 16 15:04:30 devstack cinder-volume[83259]: DEBUG cinder.volume.drivers.remotefs [None req-072f4684-2fbe-4cab-ac35-071e9df6d4aa tempest-GroupSnapshotsTest-952387378 None] snapshot_file for this snap is: volume-4efde0d8-8e7b-43fe-a588-f71f487cf420.8eeb749f-06b2-4a34-b884-9e08468b653e {{(pid=83259) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1307}} Sep 16 15:04:30 devstack cinder-volume[83259]: DEBUG oslo.privsep.daemon [-] privsep: reply[1e78f8d4-ffd6-4340-9067-c15acb385561]: (4, 'qcow2') {{(pid=84312) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 16 15:04:30 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [None req-072f4684-2fbe-4cab-ac35-071e9df6d4aa tempest-GroupSnapshotsTest-952387378 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c/volume-4efde0d8-8e7b-43fe-a588-f71f487cf420.8eeb749f-06b2-4a34-b884-9e08468b653e {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 15:04:31 devstack cinder-volume[83259]: DEBUG cinder.quota [None req-821de7eb-6c37-44dd-8203-dae657ad12a3 tempest-GroupSnapshotsV319Test-1837239241 None] Created reservations ['98fcfa14-adec-4bb4-b6c5-2bbadc5b4e01'] {{(pid=83259) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 16 15:04:31 devstack cinder-volume[83259]: WARNING cinder.quota [None req-821de7eb-6c37-44dd-8203-dae657ad12a3 tempest-GroupSnapshotsV319Test-1837239241 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsV319Test-volume-type-528798284 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsV319Test-volume-type-528798284, it is now deprecated. Please use the default quota class for default quota. Sep 16 15:04:31 devstack quobyte-client[83286]: System call of process 93287 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 16 15:04:31 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [None req-072f4684-2fbe-4cab-ac35-071e9df6d4aa tempest-GroupSnapshotsTest-952387378 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c/volume-4efde0d8-8e7b-43fe-a588-f71f487cf420.8eeb749f-06b2-4a34-b884-9e08468b653e" returned: 0 in 0.816s {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 15:04:31 devstack cinder-volume[83259]: DEBUG cinder.volume.drivers.remotefs [None req-072f4684-2fbe-4cab-ac35-071e9df6d4aa tempest-GroupSnapshotsTest-952387378 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-4efde0d8-8e7b-43fe-a588-f71f487cf420(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83259) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:886}} Sep 16 15:04:31 devstack cinder-volume[83259]: DEBUG cinder.quota [None req-821de7eb-6c37-44dd-8203-dae657ad12a3 tempest-GroupSnapshotsV319Test-1837239241 None] Created reservations ['9c8a2922-15f7-4825-8354-ee4aabd1e15b', 'eb9b9679-0bd4-40ae-89c5-ec2d6683c04a', 'ceec27d1-5326-4b38-af3e-268caad9b02c', '2cb46f3f-5341-463a-bda3-07f65686332a'] {{(pid=83259) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 16 15:04:31 devstack cinder-volume[83259]: DEBUG oslo.privsep.daemon [-] privsep: reply[5342fcce-d0d4-4708-bc99-9d9328f6eaa7]: (4, 'qcow2') {{(pid=84312) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 16 15:04:31 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [None req-072f4684-2fbe-4cab-ac35-071e9df6d4aa tempest-GroupSnapshotsTest-952387378 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c/volume-4efde0d8-8e7b-43fe-a588-f71f487cf420 {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 15:04:32 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [None req-072f4684-2fbe-4cab-ac35-071e9df6d4aa tempest-GroupSnapshotsTest-952387378 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c/volume-4efde0d8-8e7b-43fe-a588-f71f487cf420" returned: 0 in 0.617s {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 15:04:32 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [None req-072f4684-2fbe-4cab-ac35-071e9df6d4aa tempest-GroupSnapshotsTest-952387378 None] Running cmd (subprocess): qemu-img commit -d /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c/volume-4efde0d8-8e7b-43fe-a588-f71f487cf420.8eeb749f-06b2-4a34-b884-9e08468b653e {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 15:04:32 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [None req-072f4684-2fbe-4cab-ac35-071e9df6d4aa tempest-GroupSnapshotsTest-952387378 None] CMD "qemu-img commit -d /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c/volume-4efde0d8-8e7b-43fe-a588-f71f487cf420.8eeb749f-06b2-4a34-b884-9e08468b653e" returned: 0 in 0.494s {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 15:04:32 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [None req-072f4684-2fbe-4cab-ac35-071e9df6d4aa tempest-GroupSnapshotsTest-952387378 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c/volume-4efde0d8-8e7b-43fe-a588-f71f487cf420.8eeb749f-06b2-4a34-b884-9e08468b653e {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 15:04:32 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [None req-072f4684-2fbe-4cab-ac35-071e9df6d4aa tempest-GroupSnapshotsTest-952387378 None] CMD "rm -f /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c/volume-4efde0d8-8e7b-43fe-a588-f71f487cf420.8eeb749f-06b2-4a34-b884-9e08468b653e" returned: 0 in 0.356s {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 15:04:33 devstack cinder-volume[83259]: DEBUG oslo_concurrency.lockutils [None req-821de7eb-6c37-44dd-8203-dae657ad12a3 tempest-GroupSnapshotsV319Test-1837239241 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83259) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 16 15:04:33 devstack cinder-volume[83259]: DEBUG oslo_concurrency.lockutils [None req-821de7eb-6c37-44dd-8203-dae657ad12a3 tempest-GroupSnapshotsV319Test-1837239241 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.012s {{(pid=83259) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 16 15:04:33 devstack cinder-volume[83259]: DEBUG cinder.volume.drivers.quobyte [None req-821de7eb-6c37-44dd-8203-dae657ad12a3 tempest-GroupSnapshotsV319Test-1837239241 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-61f585ac-f8e2-4d19-a890-7ebc2726cc72': None} {{(pid=83259) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:639}} Sep 16 15:04:33 devstack cinder-volume[83259]: DEBUG cinder.volume.drivers.quobyte [None req-821de7eb-6c37-44dd-8203-dae657ad12a3 tempest-GroupSnapshotsV319Test-1837239241 None] Available shares ['10.10.41.181/cinder-vol-61f585ac-f8e2-4d19-a890-7ebc2726cc72'] {{(pid=83259) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:669}} Sep 16 15:04:33 devstack cinder-volume[83259]: DEBUG oslo_concurrency.lockutils [None req-821de7eb-6c37-44dd-8203-dae657ad12a3 tempest-GroupSnapshotsV319Test-1837239241 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.024s {{(pid=83259) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 16 15:04:33 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [None req-821de7eb-6c37-44dd-8203-dae657ad12a3 tempest-GroupSnapshotsV319Test-1837239241 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 15:04:33 devstack cinder-volume[83259]: DEBUG cinder.coordination [None req-072f4684-2fbe-4cab-ac35-071e9df6d4aa tempest-GroupSnapshotsTest-952387378 None] Lock "cinder-quobyte-8eeb749f-06b2-4a34-b884-9e08468b653e" released by "_delete_snapshot" :: held 2.894s {{(pid=83259) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 16 15:04:33 devstack cinder-volume[83259]: DEBUG cinder.coordination [None req-072f4684-2fbe-4cab-ac35-071e9df6d4aa tempest-GroupSnapshotsTest-952387378 None] Lock "cinder-quobyte-4efde0d8-8e7b-43fe-a588-f71f487cf420" released by "delete_snapshot" :: held 2.986s {{(pid=83259) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 16 15:04:33 devstack cinder-volume[83259]: DEBUG cinder.coordination [None req-072f4684-2fbe-4cab-ac35-071e9df6d4aa tempest-GroupSnapshotsTest-952387378 None] Acquiring lock "cinder-quobyte-ceafecc8-d8a4-447f-9ff7-7fc9f8c88f95" by "delete_snapshot" {{(pid=83259) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 16 15:04:33 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [None req-821de7eb-6c37-44dd-8203-dae657ad12a3 tempest-GroupSnapshotsV319Test-1837239241 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c" returned: 0 in 0.532s {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 15:04:33 devstack cinder-volume[83259]: DEBUG cinder.manager [None req-821de7eb-6c37-44dd-8203-dae657ad12a3 tempest-GroupSnapshotsV319Test-1837239241 None] Notifying Schedulers of capabilities ... {{(pid=83259) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 16 15:04:33 devstack cinder-volume[83259]: INFO cinder.volume.manager [None req-821de7eb-6c37-44dd-8203-dae657ad12a3 tempest-GroupSnapshotsV319Test-1837239241 None] Delete group completed successfully. Sep 16 15:04:33 devstack cinder-volume[83259]: DEBUG cinder.coordination [None req-072f4684-2fbe-4cab-ac35-071e9df6d4aa tempest-GroupSnapshotsTest-952387378 None] Lock "cinder-quobyte-ceafecc8-d8a4-447f-9ff7-7fc9f8c88f95" acquired by "delete_snapshot" :: waited 0.213s {{(pid=83259) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 16 15:04:33 devstack cinder-volume[83259]: DEBUG cinder.coordination [None req-072f4684-2fbe-4cab-ac35-071e9df6d4aa tempest-GroupSnapshotsTest-952387378 None] Acquiring lock "cinder-quobyte-e2f510a9-992e-4b0b-8b95-e3508acc36ef" by "_delete_snapshot" {{(pid=83259) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 16 15:04:33 devstack cinder-volume[83259]: DEBUG cinder.coordination [None req-072f4684-2fbe-4cab-ac35-071e9df6d4aa tempest-GroupSnapshotsTest-952387378 None] Lock "cinder-quobyte-e2f510a9-992e-4b0b-8b95-e3508acc36ef" acquired by "_delete_snapshot" :: waited 0.016s {{(pid=83259) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 16 15:04:33 devstack cinder-volume[83259]: DEBUG cinder.volume.drivers.remotefs [None req-072f4684-2fbe-4cab-ac35-071e9df6d4aa tempest-GroupSnapshotsTest-952387378 None] Deleting offline snapshot e2f510a9-992e-4b0b-8b95-e3508acc36ef of volume ceafecc8-d8a4-447f-9ff7-7fc9f8c88f95 {{(pid=83259) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1278}} Sep 16 15:04:33 devstack cinder-volume[83259]: DEBUG cinder.volume.drivers.remotefs [None req-072f4684-2fbe-4cab-ac35-071e9df6d4aa tempest-GroupSnapshotsTest-952387378 None] snapshot_file for this snap is: volume-ceafecc8-d8a4-447f-9ff7-7fc9f8c88f95.e2f510a9-992e-4b0b-8b95-e3508acc36ef {{(pid=83259) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1307}} Sep 16 15:04:33 devstack cinder-volume[83259]: DEBUG oslo.privsep.daemon [-] privsep: reply[1ce160e8-d86e-4dd3-b152-e420ad478efa]: (4, 'qcow2') {{(pid=84312) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 16 15:04:33 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [None req-072f4684-2fbe-4cab-ac35-071e9df6d4aa tempest-GroupSnapshotsTest-952387378 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c/volume-ceafecc8-d8a4-447f-9ff7-7fc9f8c88f95.e2f510a9-992e-4b0b-8b95-e3508acc36ef {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 15:04:34 devstack quobyte-client[83286]: System call of process 93299 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 16 15:04:34 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [None req-072f4684-2fbe-4cab-ac35-071e9df6d4aa tempest-GroupSnapshotsTest-952387378 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c/volume-ceafecc8-d8a4-447f-9ff7-7fc9f8c88f95.e2f510a9-992e-4b0b-8b95-e3508acc36ef" returned: 0 in 0.613s {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 15:04:34 devstack cinder-volume[83259]: DEBUG cinder.volume.drivers.remotefs [None req-072f4684-2fbe-4cab-ac35-071e9df6d4aa tempest-GroupSnapshotsTest-952387378 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-ceafecc8-d8a4-447f-9ff7-7fc9f8c88f95(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83259) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:886}} Sep 16 15:04:34 devstack cinder-volume[83259]: DEBUG oslo.privsep.daemon [-] privsep: reply[01a98294-dddc-48cb-aa48-4f0caf4a4cb5]: (4, 'qcow2') {{(pid=84312) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 16 15:04:34 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [None req-072f4684-2fbe-4cab-ac35-071e9df6d4aa tempest-GroupSnapshotsTest-952387378 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c/volume-ceafecc8-d8a4-447f-9ff7-7fc9f8c88f95 {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 15:04:35 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [None req-072f4684-2fbe-4cab-ac35-071e9df6d4aa tempest-GroupSnapshotsTest-952387378 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c/volume-ceafecc8-d8a4-447f-9ff7-7fc9f8c88f95" returned: 0 in 0.473s {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 15:04:35 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [None req-072f4684-2fbe-4cab-ac35-071e9df6d4aa tempest-GroupSnapshotsTest-952387378 None] Running cmd (subprocess): qemu-img commit -d /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c/volume-ceafecc8-d8a4-447f-9ff7-7fc9f8c88f95.e2f510a9-992e-4b0b-8b95-e3508acc36ef {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 15:04:35 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [None req-072f4684-2fbe-4cab-ac35-071e9df6d4aa tempest-GroupSnapshotsTest-952387378 None] CMD "qemu-img commit -d /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c/volume-ceafecc8-d8a4-447f-9ff7-7fc9f8c88f95.e2f510a9-992e-4b0b-8b95-e3508acc36ef" returned: 0 in 0.228s {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 15:04:35 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [None req-072f4684-2fbe-4cab-ac35-071e9df6d4aa tempest-GroupSnapshotsTest-952387378 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c/volume-ceafecc8-d8a4-447f-9ff7-7fc9f8c88f95.e2f510a9-992e-4b0b-8b95-e3508acc36ef {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 15:04:35 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [None req-072f4684-2fbe-4cab-ac35-071e9df6d4aa tempest-GroupSnapshotsTest-952387378 None] CMD "rm -f /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c/volume-ceafecc8-d8a4-447f-9ff7-7fc9f8c88f95.e2f510a9-992e-4b0b-8b95-e3508acc36ef" returned: 0 in 0.140s {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 15:04:35 devstack cinder-volume[83259]: DEBUG cinder.coordination [None req-072f4684-2fbe-4cab-ac35-071e9df6d4aa tempest-GroupSnapshotsTest-952387378 None] Lock "cinder-quobyte-e2f510a9-992e-4b0b-8b95-e3508acc36ef" released by "_delete_snapshot" :: held 1.842s {{(pid=83259) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 16 15:04:35 devstack cinder-volume[83259]: DEBUG cinder.coordination [None req-072f4684-2fbe-4cab-ac35-071e9df6d4aa tempest-GroupSnapshotsTest-952387378 None] Lock "cinder-quobyte-ceafecc8-d8a4-447f-9ff7-7fc9f8c88f95" released by "delete_snapshot" :: held 1.875s {{(pid=83259) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 16 15:04:36 devstack cinder-volume[83259]: WARNING cinder.quota [None req-072f4684-2fbe-4cab-ac35-071e9df6d4aa tempest-GroupSnapshotsTest-952387378 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-1227816657 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-1227816657, it is now deprecated. Please use the default quota class for default quota. Sep 16 15:04:36 devstack cinder-volume[83259]: WARNING cinder.quota [None req-072f4684-2fbe-4cab-ac35-071e9df6d4aa tempest-GroupSnapshotsTest-952387378 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-1227816657 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-1227816657, it is now deprecated. Please use the default quota class for default quota. Sep 16 15:04:36 devstack cinder-volume[83259]: DEBUG cinder.quota [None req-072f4684-2fbe-4cab-ac35-071e9df6d4aa tempest-GroupSnapshotsTest-952387378 None] Created reservations ['c5c057d1-3f5b-4bd0-827b-e21d19cb30f3', '0a2c7fc9-8699-448f-ab67-8ade434ab5be', 'be76d8df-e8ce-4e3e-b03a-4382cf1d9a4b', '0d6c509e-9b58-4272-831b-18d4f4d8b750'] {{(pid=83259) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 16 15:04:36 devstack cinder-volume[83259]: DEBUG cinder.quota [None req-072f4684-2fbe-4cab-ac35-071e9df6d4aa tempest-GroupSnapshotsTest-952387378 None] Created reservations ['b0dbe41e-d0d4-4595-aaf6-f3f1b01593f9', '11a64837-7de6-40e9-8180-fae8947b3611', '48cafc48-f699-48fb-b6c8-b046307f824d', 'df74cd53-0064-4a06-88b3-9b75e6ed48d0'] {{(pid=83259) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 16 15:04:36 devstack cinder-volume[83259]: INFO cinder.volume.manager [None req-072f4684-2fbe-4cab-ac35-071e9df6d4aa tempest-GroupSnapshotsTest-952387378 None] group_snapshot fa074eb9-580a-441c-90b1-5817f0e64e06: deleted successfully Sep 16 15:04:38 devstack cinder-volume[83259]: WARNING cinder.volume.volume_utils [None req-c81040b2-dab0-4e76-bbfa-9e4d4865a08e tempest-GroupSnapshotsTest-952387378 None] Volume driver (QuobyteDriver 1.2) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 16 15:04:38 devstack cinder-volume[83259]: DEBUG cinder.coordination [None req-c81040b2-dab0-4e76-bbfa-9e4d4865a08e tempest-GroupSnapshotsTest-952387378 None] Acquiring lock "cinder-quobyte-4efde0d8-8e7b-43fe-a588-f71f487cf420" by "delete_volume" {{(pid=83259) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 16 15:04:38 devstack cinder-volume[83259]: DEBUG cinder.coordination [None req-c81040b2-dab0-4e76-bbfa-9e4d4865a08e tempest-GroupSnapshotsTest-952387378 None] Lock "cinder-quobyte-4efde0d8-8e7b-43fe-a588-f71f487cf420" acquired by "delete_volume" :: waited 0.021s {{(pid=83259) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 16 15:04:38 devstack cinder-volume[83259]: DEBUG oslo.privsep.daemon [-] privsep: reply[7913143d-6652-4ee9-b32d-41b4ff0b6137]: (4, 'qcow2') {{(pid=84312) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 16 15:04:38 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [None req-c81040b2-dab0-4e76-bbfa-9e4d4865a08e tempest-GroupSnapshotsTest-952387378 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c/volume-4efde0d8-8e7b-43fe-a588-f71f487cf420 {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 15:04:39 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [None req-c81040b2-dab0-4e76-bbfa-9e4d4865a08e tempest-GroupSnapshotsTest-952387378 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c/volume-4efde0d8-8e7b-43fe-a588-f71f487cf420" returned: 0 in 0.606s {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 15:04:39 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [None req-c81040b2-dab0-4e76-bbfa-9e4d4865a08e tempest-GroupSnapshotsTest-952387378 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c/volume-4efde0d8-8e7b-43fe-a588-f71f487cf420 {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 15:04:39 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [None req-c81040b2-dab0-4e76-bbfa-9e4d4865a08e tempest-GroupSnapshotsTest-952387378 None] CMD "rm -f /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c/volume-4efde0d8-8e7b-43fe-a588-f71f487cf420" returned: 0 in 0.122s {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 15:04:39 devstack cinder-volume[83259]: DEBUG cinder.coordination [None req-c81040b2-dab0-4e76-bbfa-9e4d4865a08e tempest-GroupSnapshotsTest-952387378 None] Lock "cinder-quobyte-4efde0d8-8e7b-43fe-a588-f71f487cf420" released by "delete_volume" :: held 0.935s {{(pid=83259) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 16 15:04:39 devstack cinder-volume[83259]: DEBUG cinder.coordination [None req-c81040b2-dab0-4e76-bbfa-9e4d4865a08e tempest-GroupSnapshotsTest-952387378 None] Acquiring lock "cinder-quobyte-ceafecc8-d8a4-447f-9ff7-7fc9f8c88f95" by "delete_volume" {{(pid=83259) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 16 15:04:39 devstack cinder-volume[83259]: DEBUG cinder.coordination [None req-c81040b2-dab0-4e76-bbfa-9e4d4865a08e tempest-GroupSnapshotsTest-952387378 None] Lock "cinder-quobyte-ceafecc8-d8a4-447f-9ff7-7fc9f8c88f95" acquired by "delete_volume" :: waited 0.036s {{(pid=83259) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 16 15:04:39 devstack cinder-volume[83259]: DEBUG oslo.privsep.daemon [-] privsep: reply[8b064100-b81e-4178-bf29-2f03f675225e]: (4, 'qcow2') {{(pid=84312) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 16 15:04:39 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [None req-c81040b2-dab0-4e76-bbfa-9e4d4865a08e tempest-GroupSnapshotsTest-952387378 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c/volume-ceafecc8-d8a4-447f-9ff7-7fc9f8c88f95 {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 15:04:39 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [None req-c81040b2-dab0-4e76-bbfa-9e4d4865a08e tempest-GroupSnapshotsTest-952387378 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c/volume-ceafecc8-d8a4-447f-9ff7-7fc9f8c88f95" returned: 0 in 0.495s {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 15:04:39 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [None req-c81040b2-dab0-4e76-bbfa-9e4d4865a08e tempest-GroupSnapshotsTest-952387378 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c/volume-ceafecc8-d8a4-447f-9ff7-7fc9f8c88f95 {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 15:04:40 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [None req-c81040b2-dab0-4e76-bbfa-9e4d4865a08e tempest-GroupSnapshotsTest-952387378 None] CMD "rm -f /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c/volume-ceafecc8-d8a4-447f-9ff7-7fc9f8c88f95" returned: 0 in 0.126s {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 15:04:40 devstack cinder-volume[83259]: DEBUG cinder.coordination [None req-c81040b2-dab0-4e76-bbfa-9e4d4865a08e tempest-GroupSnapshotsTest-952387378 None] Lock "cinder-quobyte-ceafecc8-d8a4-447f-9ff7-7fc9f8c88f95" released by "delete_volume" :: held 0.825s {{(pid=83259) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 16 15:04:40 devstack cinder-volume[83259]: DEBUG cinder.quota [None req-c81040b2-dab0-4e76-bbfa-9e4d4865a08e tempest-GroupSnapshotsTest-952387378 None] Created reservations ['0b54bfb5-b24d-4ae4-bcfd-55fbcaa24c74'] {{(pid=83259) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 16 15:04:40 devstack cinder-volume[83259]: WARNING cinder.quota [None req-c81040b2-dab0-4e76-bbfa-9e4d4865a08e tempest-GroupSnapshotsTest-952387378 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-1227816657 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-1227816657, it is now deprecated. Please use the default quota class for default quota. Sep 16 15:04:40 devstack cinder-volume[83259]: DEBUG cinder.quota [None req-c81040b2-dab0-4e76-bbfa-9e4d4865a08e tempest-GroupSnapshotsTest-952387378 None] Created reservations ['1fda981d-e741-47cc-902d-6ca08466b3a1', '261c2ddb-89a9-45d2-9b8d-d866cdb26786', '9997cf00-8d5b-4be3-bead-6119cfc06ac0', 'a906e174-79fc-4c11-ad06-1468414a7204'] {{(pid=83259) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 16 15:04:40 devstack cinder-volume[83259]: DEBUG cinder.quota [None req-c81040b2-dab0-4e76-bbfa-9e4d4865a08e tempest-GroupSnapshotsTest-952387378 None] Created reservations ['7f9b7394-5dea-455a-b270-f5cab0d4e409', '93996114-f484-4adc-a323-88fdead79b77', '2e7e93be-9145-43e1-9cac-c7c1fa932246', '7b5cc02e-b852-4ae4-8a0e-c2fe91f2f382'] {{(pid=83259) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 16 15:04:41 devstack cinder-volume[83259]: DEBUG oslo_concurrency.lockutils [None req-c81040b2-dab0-4e76-bbfa-9e4d4865a08e tempest-GroupSnapshotsTest-952387378 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83259) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 16 15:04:41 devstack cinder-volume[83259]: DEBUG oslo_concurrency.lockutils [None req-c81040b2-dab0-4e76-bbfa-9e4d4865a08e tempest-GroupSnapshotsTest-952387378 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=83259) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 16 15:04:41 devstack cinder-volume[83259]: DEBUG cinder.volume.drivers.quobyte [None req-c81040b2-dab0-4e76-bbfa-9e4d4865a08e tempest-GroupSnapshotsTest-952387378 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-61f585ac-f8e2-4d19-a890-7ebc2726cc72': None} {{(pid=83259) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:639}} Sep 16 15:04:41 devstack cinder-volume[83259]: DEBUG cinder.volume.drivers.quobyte [None req-c81040b2-dab0-4e76-bbfa-9e4d4865a08e tempest-GroupSnapshotsTest-952387378 None] Available shares ['10.10.41.181/cinder-vol-61f585ac-f8e2-4d19-a890-7ebc2726cc72'] {{(pid=83259) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:669}} Sep 16 15:04:41 devstack cinder-volume[83259]: DEBUG oslo_concurrency.lockutils [None req-c81040b2-dab0-4e76-bbfa-9e4d4865a08e tempest-GroupSnapshotsTest-952387378 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=83259) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 16 15:04:41 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [None req-c81040b2-dab0-4e76-bbfa-9e4d4865a08e tempest-GroupSnapshotsTest-952387378 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 15:04:41 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [None req-c81040b2-dab0-4e76-bbfa-9e4d4865a08e tempest-GroupSnapshotsTest-952387378 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c" returned: 0 in 0.102s {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 15:04:41 devstack cinder-volume[83259]: DEBUG cinder.manager [None req-c81040b2-dab0-4e76-bbfa-9e4d4865a08e tempest-GroupSnapshotsTest-952387378 None] Notifying Schedulers of capabilities ... {{(pid=83259) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 16 15:04:41 devstack cinder-volume[83259]: INFO cinder.volume.manager [None req-c81040b2-dab0-4e76-bbfa-9e4d4865a08e tempest-GroupSnapshotsTest-952387378 None] Delete group completed successfully. Sep 16 15:04:42 devstack cinder-volume[83259]: WARNING cinder.volume.volume_utils [None req-d00bed04-3537-46dd-8456-7838ee8f33e5 tempest-GroupsV320Test-1686829832 None] Volume driver (QuobyteDriver 1.2) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 16 15:04:42 devstack cinder-volume[83259]: INFO cinder.volume.manager [None req-d00bed04-3537-46dd-8456-7838ee8f33e5 tempest-GroupsV320Test-1686829832 None] Group tempest-GroupsV320Test-Group-1438425715: creating Sep 16 15:04:42 devstack cinder-volume[83259]: WARNING cinder.volume.volume_utils [None req-7cddffc3-905e-4c01-a9d2-eaee3237521e tempest-GroupSnapshotsTest-952387378 None] Volume driver (QuobyteDriver 1.2) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 16 15:04:42 devstack cinder-volume[83259]: INFO cinder.volume.manager [None req-7cddffc3-905e-4c01-a9d2-eaee3237521e tempest-GroupSnapshotsTest-952387378 None] Group tempest-GroupSnapshotsTest-Group-870288256: creating Sep 16 15:04:42 devstack cinder-volume[83259]: INFO cinder.volume.manager [None req-d00bed04-3537-46dd-8456-7838ee8f33e5 tempest-GroupsV320Test-1686829832 None] Group tempest-GroupsV320Test-Group-1438425715: created successfully Sep 16 15:04:42 devstack cinder-volume[83259]: INFO cinder.volume.manager [None req-7cddffc3-905e-4c01-a9d2-eaee3237521e tempest-GroupSnapshotsTest-952387378 None] Group tempest-GroupSnapshotsTest-Group-870288256: created successfully Sep 16 15:04:42 devstack cinder-volume[83259]: INFO cinder.volume.manager [None req-d00bed04-3537-46dd-8456-7838ee8f33e5 tempest-GroupsV320Test-1686829832 None] Create group completed successfully. Sep 16 15:04:42 devstack cinder-volume[83259]: INFO cinder.volume.manager [None req-7cddffc3-905e-4c01-a9d2-eaee3237521e tempest-GroupSnapshotsTest-952387378 None] Create group completed successfully. Sep 16 15:04:44 devstack cinder-volume[83259]: WARNING cinder.volume.volume_utils [None req-e0f84c60-e84f-44a9-9980-df2a7d25b040 tempest-GroupSnapshotsTest-952387378 None] Volume driver (QuobyteDriver 1.2) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 16 15:04:44 devstack cinder-volume[83259]: DEBUG cinder.volume.flows.manager.create_volume [None req-e0f84c60-e84f-44a9-9980-df2a7d25b040 tempest-GroupSnapshotsTest-952387378 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#Quobyte'], 'hosts': ['devstack@QuobyteHD#Quobyte']} {{(pid=83259) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1387}} Sep 16 15:04:44 devstack cinder-volume[83259]: DEBUG cinder.volume.manager [None req-e0f84c60-e84f-44a9-9980-df2a7d25b040 tempest-GroupSnapshotsTest-952387378 None] Flow 'volume_create_manager' (7beb3a60-932d-4c15-b9bf-367939ac1419) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83259) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 16 15:04:44 devstack cinder-volume[83259]: DEBUG cinder.volume.manager [None req-e0f84c60-e84f-44a9-9980-df2a7d25b040 tempest-GroupSnapshotsTest-952387378 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (59fcf672-683a-4ece-a0d5-a0861707a217) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83259) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 15:04:44 devstack cinder-volume[83259]: DEBUG cinder.volume.manager [None req-e0f84c60-e84f-44a9-9980-df2a7d25b040 tempest-GroupSnapshotsTest-952387378 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (59fcf672-683a-4ece-a0d5-a0861707a217) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-16T13:04:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-927070229',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=61a59fe1-df57-4765-b6f0-7e26a2ae8748,host='devstack@QuobyteHD#Quobyte',id=3fce65ed-d5f7-4edc-91e3-25e3958112e0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cec359ace651434bb4df79a6dcce9dbd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-16T13:04:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-16T13:04:44Z,use_quota=True,user_id='9e798fd1532a42df8e251d9d64138963',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(af94ddc5-30cb-4a86-9caf-d3d21a84911f),volume_type_id=af94ddc5-30cb-4a86-9caf-d3d21a84911f)' {{(pid=83259) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 15:04:44 devstack cinder-volume[83259]: DEBUG cinder.volume.manager [None req-e0f84c60-e84f-44a9-9980-df2a7d25b040 tempest-GroupSnapshotsTest-952387378 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (614589c5-0a1c-4677-a64f-ec6b1c06b030) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83259) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 15:04:44 devstack cinder-volume[83259]: DEBUG cinder.volume.manager [None req-e0f84c60-e84f-44a9-9980-df2a7d25b040 tempest-GroupSnapshotsTest-952387378 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (614589c5-0a1c-4677-a64f-ec6b1c06b030) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83259) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 15:04:44 devstack cinder-volume[83259]: DEBUG cinder.volume.manager [None req-e0f84c60-e84f-44a9-9980-df2a7d25b040 tempest-GroupSnapshotsTest-952387378 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a5790b1b-2499-4e99-bddb-99cab23da47c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83259) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 15:04:44 devstack cinder-volume[83259]: DEBUG cinder.volume.manager [None req-e0f84c60-e84f-44a9-9980-df2a7d25b040 tempest-GroupSnapshotsTest-952387378 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a5790b1b-2499-4e99-bddb-99cab23da47c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3fce65ed-d5f7-4edc-91e3-25e3958112e0', 'volume_name': 'volume-3fce65ed-d5f7-4edc-91e3-25e3958112e0', 'volume_size': 1}' {{(pid=83259) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 15:04:44 devstack cinder-volume[83259]: DEBUG cinder.volume.manager [None req-e0f84c60-e84f-44a9-9980-df2a7d25b040 tempest-GroupSnapshotsTest-952387378 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d02a9e60-ecc3-4f4f-81ad-9017e8fda05d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83259) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 15:04:44 devstack cinder-volume[83259]: DEBUG cinder.volume.manager [None req-e0f84c60-e84f-44a9-9980-df2a7d25b040 tempest-GroupSnapshotsTest-952387378 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d02a9e60-ecc3-4f4f-81ad-9017e8fda05d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83259) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 15:04:44 devstack cinder-volume[83259]: DEBUG cinder.volume.manager [None req-e0f84c60-e84f-44a9-9980-df2a7d25b040 tempest-GroupSnapshotsTest-952387378 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fa4a0090-6fa4-41f6-9714-3a6d3a3d2c02) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83259) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 15:04:44 devstack cinder-volume[83259]: INFO cinder.volume.flows.manager.create_volume [None req-e0f84c60-e84f-44a9-9980-df2a7d25b040 tempest-GroupSnapshotsTest-952387378 None] Volume 3fce65ed-d5f7-4edc-91e3-25e3958112e0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3fce65ed-d5f7-4edc-91e3-25e3958112e0', 'volume_size': 1} Sep 16 15:04:44 devstack cinder-volume[83259]: DEBUG oslo_concurrency.lockutils [None req-e0f84c60-e84f-44a9-9980-df2a7d25b040 tempest-GroupSnapshotsTest-952387378 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83259) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 16 15:04:44 devstack cinder-volume[83259]: DEBUG oslo_concurrency.lockutils [None req-e0f84c60-e84f-44a9-9980-df2a7d25b040 tempest-GroupSnapshotsTest-952387378 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.006s {{(pid=83259) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 16 15:04:44 devstack cinder-volume[83259]: DEBUG cinder.volume.drivers.quobyte [None req-e0f84c60-e84f-44a9-9980-df2a7d25b040 tempest-GroupSnapshotsTest-952387378 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=61a59fe1-df57-4765-b6f0-7e26a2ae8748,created_at=2025-09-16T13:04:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-927070229',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=61a59fe1-df57-4765-b6f0-7e26a2ae8748,host='devstack@QuobyteHD#Quobyte',id=3fce65ed-d5f7-4edc-91e3-25e3958112e0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cec359ace651434bb4df79a6dcce9dbd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-16T13:04:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-16T13:04:44Z,use_quota=True,user_id='9e798fd1532a42df8e251d9d64138963',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(af94ddc5-30cb-4a86-9caf-d3d21a84911f),volume_type_id=af94ddc5-30cb-4a86-9caf-d3d21a84911f)}" {{(pid=83259) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Sep 16 15:04:44 devstack cinder-volume[83259]: DEBUG cinder.volume.drivers.remotefs [None req-e0f84c60-e84f-44a9-9980-df2a7d25b040 tempest-GroupSnapshotsTest-952387378 None] Creating volume 3fce65ed-d5f7-4edc-91e3-25e3958112e0 {{(pid=83259) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}} Sep 16 15:04:44 devstack cinder-volume[83259]: DEBUG oslo_concurrency.lockutils [None req-e0f84c60-e84f-44a9-9980-df2a7d25b040 tempest-GroupSnapshotsTest-952387378 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83259) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 16 15:04:44 devstack cinder-volume[83259]: DEBUG oslo_concurrency.lockutils [None req-e0f84c60-e84f-44a9-9980-df2a7d25b040 tempest-GroupSnapshotsTest-952387378 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83259) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 16 15:04:44 devstack cinder-volume[83259]: DEBUG cinder.volume.drivers.quobyte [None req-e0f84c60-e84f-44a9-9980-df2a7d25b040 tempest-GroupSnapshotsTest-952387378 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-61f585ac-f8e2-4d19-a890-7ebc2726cc72': None} {{(pid=83259) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:639}} Sep 16 15:04:44 devstack cinder-volume[83259]: DEBUG cinder.volume.drivers.quobyte [None req-e0f84c60-e84f-44a9-9980-df2a7d25b040 tempest-GroupSnapshotsTest-952387378 None] Available shares ['10.10.41.181/cinder-vol-61f585ac-f8e2-4d19-a890-7ebc2726cc72'] {{(pid=83259) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:669}} Sep 16 15:04:44 devstack cinder-volume[83259]: DEBUG oslo_concurrency.lockutils [None req-e0f84c60-e84f-44a9-9980-df2a7d25b040 tempest-GroupSnapshotsTest-952387378 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=83259) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 16 15:04:44 devstack cinder-volume[83259]: DEBUG cinder.volume.drivers.quobyte [None req-e0f84c60-e84f-44a9-9980-df2a7d25b040 tempest-GroupSnapshotsTest-952387378 None] Selected 10.10.41.181/cinder-vol-61f585ac-f8e2-4d19-a890-7ebc2726cc72 as target Quobyte volume. {{(pid=83259) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:690}} Sep 16 15:04:44 devstack cinder-volume[83259]: INFO cinder.volume.drivers.remotefs [None req-e0f84c60-e84f-44a9-9980-df2a7d25b040 tempest-GroupSnapshotsTest-952387378 None] casted to 10.10.41.181/cinder-vol-61f585ac-f8e2-4d19-a890-7ebc2726cc72 Sep 16 15:04:44 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [None req-e0f84c60-e84f-44a9-9980-df2a7d25b040 tempest-GroupSnapshotsTest-952387378 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c/volume-3fce65ed-d5f7-4edc-91e3-25e3958112e0 1073741824 {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 15:04:45 devstack quobyte-client[83286]: System call of process 93328 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 16 15:04:45 devstack quobyte-client[83286]: The server volume:87712ffe-8a69-446d-9ed6-4430c7ee9792@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=87712ffe-8a69-446d-9ed6-4430c7ee9792, inode=53, name=volume-3fce65ed-d5f7-4edc-91e3-25e3958112e0, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.206), requestorAccessMask=0 Sep 16 15:04:45 devstack cinder-volume[83259]: WARNING cinder.volume.volume_utils [None req-e878a11a-1507-4ee6-a40c-dda16653c4da tempest-GroupsV320Test-1686829832 None] Volume driver (QuobyteDriver 1.2) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 16 15:04:45 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [None req-e0f84c60-e84f-44a9-9980-df2a7d25b040 tempest-GroupSnapshotsTest-952387378 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c/volume-3fce65ed-d5f7-4edc-91e3-25e3958112e0 1073741824" returned: 0 in 0.532s {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 15:04:45 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [None req-e0f84c60-e84f-44a9-9980-df2a7d25b040 tempest-GroupSnapshotsTest-952387378 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c/volume-3fce65ed-d5f7-4edc-91e3-25e3958112e0 {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 15:04:45 devstack cinder-volume[83259]: DEBUG oslo_service.periodic_task [None req-050ec8a1-6ffd-499d-95ad-d548a84437e2 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=83259) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} Sep 16 15:04:45 devstack cinder-volume[83259]: DEBUG oslo_concurrency.lockutils [None req-050ec8a1-6ffd-499d-95ad-d548a84437e2 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83259) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 16 15:04:45 devstack cinder-volume[83259]: DEBUG oslo_concurrency.lockutils [None req-050ec8a1-6ffd-499d-95ad-d548a84437e2 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.006s {{(pid=83259) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 16 15:04:45 devstack cinder-volume[83259]: DEBUG cinder.volume.drivers.quobyte [None req-050ec8a1-6ffd-499d-95ad-d548a84437e2 None None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-61f585ac-f8e2-4d19-a890-7ebc2726cc72': None} {{(pid=83259) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:639}} Sep 16 15:04:45 devstack cinder-volume[83259]: DEBUG cinder.volume.drivers.quobyte [None req-050ec8a1-6ffd-499d-95ad-d548a84437e2 None None] Available shares ['10.10.41.181/cinder-vol-61f585ac-f8e2-4d19-a890-7ebc2726cc72'] {{(pid=83259) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:669}} Sep 16 15:04:45 devstack cinder-volume[83259]: DEBUG oslo_concurrency.lockutils [None req-050ec8a1-6ffd-499d-95ad-d548a84437e2 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=83259) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 16 15:04:45 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [None req-050ec8a1-6ffd-499d-95ad-d548a84437e2 None None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 15:04:45 devstack cinder-volume[83259]: DEBUG cinder.quota [None req-e878a11a-1507-4ee6-a40c-dda16653c4da tempest-GroupsV320Test-1686829832 None] Created reservations ['20f01c92-469f-4415-b9ec-df54ec21d8b4'] {{(pid=83259) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 16 15:04:45 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [None req-e0f84c60-e84f-44a9-9980-df2a7d25b040 tempest-GroupSnapshotsTest-952387378 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c/volume-3fce65ed-d5f7-4edc-91e3-25e3958112e0" returned: 0 in 0.615s {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 15:04:45 devstack cinder-volume[83259]: DEBUG cinder.volume.drivers.quobyte [None req-e0f84c60-e84f-44a9-9980-df2a7d25b040 tempest-GroupSnapshotsTest-952387378 None] <== create_volume: return (1165ms) {'provider_location': '10.10.41.181/cinder-vol-61f585ac-f8e2-4d19-a890-7ebc2726cc72'} {{(pid=83259) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Sep 16 15:04:45 devstack cinder-volume[83259]: DEBUG oslo_concurrency.lockutils [None req-e0f84c60-e84f-44a9-9980-df2a7d25b040 tempest-GroupSnapshotsTest-952387378 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.179s {{(pid=83259) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 16 15:04:46 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [None req-050ec8a1-6ffd-499d-95ad-d548a84437e2 None None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c" returned: 0 in 0.403s {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 15:04:46 devstack cinder-volume[83259]: DEBUG cinder.manager [None req-050ec8a1-6ffd-499d-95ad-d548a84437e2 None None] Notifying Schedulers of capabilities ... {{(pid=83259) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 16 15:04:46 devstack cinder-volume[83259]: DEBUG cinder.volume.manager [None req-e0f84c60-e84f-44a9-9980-df2a7d25b040 tempest-GroupSnapshotsTest-952387378 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fa4a0090-6fa4-41f6-9714-3a6d3a3d2c02) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3fce65ed-d5f7-4edc-91e3-25e3958112e0', 'volume_size': 1}' {{(pid=83259) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 15:04:46 devstack cinder-volume[83259]: DEBUG cinder.volume.manager [None req-e0f84c60-e84f-44a9-9980-df2a7d25b040 tempest-GroupSnapshotsTest-952387378 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f5820b58-beee-4113-ad08-e6fc11fa89db) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83259) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 15:04:46 devstack cinder-volume[83259]: INFO cinder.volume.flows.manager.create_volume [None req-e0f84c60-e84f-44a9-9980-df2a7d25b040 tempest-GroupSnapshotsTest-952387378 None] Volume volume-3fce65ed-d5f7-4edc-91e3-25e3958112e0 (3fce65ed-d5f7-4edc-91e3-25e3958112e0): created successfully Sep 16 15:04:46 devstack cinder-volume[83259]: DEBUG cinder.volume.manager [None req-e0f84c60-e84f-44a9-9980-df2a7d25b040 tempest-GroupSnapshotsTest-952387378 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f5820b58-beee-4113-ad08-e6fc11fa89db) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83259) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 15:04:46 devstack cinder-volume[83259]: DEBUG cinder.volume.manager [None req-e0f84c60-e84f-44a9-9980-df2a7d25b040 tempest-GroupSnapshotsTest-952387378 None] Flow 'volume_create_manager' (7beb3a60-932d-4c15-b9bf-367939ac1419) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83259) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 16 15:04:46 devstack cinder-volume[83259]: DEBUG oslo_concurrency.lockutils [None req-e878a11a-1507-4ee6-a40c-dda16653c4da tempest-GroupsV320Test-1686829832 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83259) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 16 15:04:46 devstack cinder-volume[83259]: DEBUG oslo_concurrency.lockutils [None req-e878a11a-1507-4ee6-a40c-dda16653c4da tempest-GroupsV320Test-1686829832 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=83259) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 16 15:04:46 devstack cinder-volume[83259]: DEBUG cinder.volume.drivers.quobyte [None req-e878a11a-1507-4ee6-a40c-dda16653c4da tempest-GroupsV320Test-1686829832 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-61f585ac-f8e2-4d19-a890-7ebc2726cc72': None} {{(pid=83259) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:639}} Sep 16 15:04:46 devstack cinder-volume[83259]: DEBUG cinder.volume.drivers.quobyte [None req-e878a11a-1507-4ee6-a40c-dda16653c4da tempest-GroupsV320Test-1686829832 None] Available shares ['10.10.41.181/cinder-vol-61f585ac-f8e2-4d19-a890-7ebc2726cc72'] {{(pid=83259) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:669}} Sep 16 15:04:46 devstack cinder-volume[83259]: DEBUG oslo_concurrency.lockutils [None req-e878a11a-1507-4ee6-a40c-dda16653c4da tempest-GroupsV320Test-1686829832 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=83259) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 16 15:04:46 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [None req-e878a11a-1507-4ee6-a40c-dda16653c4da tempest-GroupsV320Test-1686829832 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 15:04:46 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [None req-e878a11a-1507-4ee6-a40c-dda16653c4da tempest-GroupsV320Test-1686829832 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c" returned: 0 in 0.177s {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 15:04:46 devstack cinder-volume[83259]: DEBUG cinder.manager [None req-e878a11a-1507-4ee6-a40c-dda16653c4da tempest-GroupsV320Test-1686829832 None] Notifying Schedulers of capabilities ... {{(pid=83259) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 16 15:04:46 devstack cinder-volume[83259]: INFO cinder.volume.manager [None req-e878a11a-1507-4ee6-a40c-dda16653c4da tempest-GroupsV320Test-1686829832 None] Delete group completed successfully. Sep 16 15:04:46 devstack cinder-volume[83259]: INFO cinder.volume.manager [None req-e0f84c60-e84f-44a9-9980-df2a7d25b040 tempest-GroupSnapshotsTest-952387378 None] Created volume successfully. Sep 16 15:04:47 devstack cinder-volume[83259]: INFO cinder.volume.manager [None req-1cbe9801-d8bb-4213-9efd-e66c74c41270 tempest-GroupSnapshotsTest-952387378 None] GroupSnapshot 52e1464a-126c-4660-bb65-e4b2f1a9ef15: creating. Sep 16 15:04:47 devstack cinder-volume[83259]: WARNING cinder.volume.volume_utils [None req-1cbe9801-d8bb-4213-9efd-e66c74c41270 tempest-GroupSnapshotsTest-952387378 None] Volume driver (QuobyteDriver 1.2) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 16 15:04:47 devstack cinder-volume[83259]: DEBUG cinder.volume.manager [None req-1cbe9801-d8bb-4213-9efd-e66c74c41270 tempest-GroupSnapshotsTest-952387378 None] Group snapshot 52e1464a-126c-4660-bb65-e4b2f1a9ef15: creating. {{(pid=83259) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4142}} Sep 16 15:04:47 devstack cinder-volume[83259]: DEBUG dbcounter [-] [83259] Writing DB stats cinder:SELECT=155,cinder:INSERT=39,cinder:UPDATE=171,cinder:DELETE=4 {{(pid=83259) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Sep 16 15:04:47 devstack cinder-volume[83259]: DEBUG oslo_concurrency.lockutils [None req-1cbe9801-d8bb-4213-9efd-e66c74c41270 tempest-GroupSnapshotsTest-952387378 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=83259) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 16 15:04:47 devstack cinder-volume[83259]: DEBUG oslo_concurrency.lockutils [None req-1cbe9801-d8bb-4213-9efd-e66c74c41270 tempest-GroupSnapshotsTest-952387378 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.005s {{(pid=83259) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 16 15:04:47 devstack cinder-volume[83259]: DEBUG cinder.volume.drivers.remotefs [None req-1cbe9801-d8bb-4213-9efd-e66c74c41270 tempest-GroupSnapshotsTest-952387378 None] Creating offline snapshot a00987fa-5fe0-4418-b7c0-6380bf9c584c of volume 3fce65ed-d5f7-4edc-91e3-25e3958112e0 {{(pid=83259) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1694}} Sep 16 15:04:47 devstack cinder-volume[83259]: DEBUG oslo.privsep.daemon [-] privsep: reply[9aec7cb0-16f5-4f8b-890a-e02afd843ce9]: (4, 'qcow2') {{(pid=84312) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 16 15:04:47 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [None req-1cbe9801-d8bb-4213-9efd-e66c74c41270 tempest-GroupSnapshotsTest-952387378 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c/volume-3fce65ed-d5f7-4edc-91e3-25e3958112e0 {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 15:04:48 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [None req-1cbe9801-d8bb-4213-9efd-e66c74c41270 tempest-GroupSnapshotsTest-952387378 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c/volume-3fce65ed-d5f7-4edc-91e3-25e3958112e0" returned: 0 in 0.595s {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 15:04:48 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [None req-1cbe9801-d8bb-4213-9efd-e66c74c41270 tempest-GroupSnapshotsTest-952387378 None] Running cmd (subprocess): qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c/volume-3fce65ed-d5f7-4edc-91e3-25e3958112e0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c/volume-3fce65ed-d5f7-4edc-91e3-25e3958112e0.a00987fa-5fe0-4418-b7c0-6380bf9c584c 1G {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 15:04:48 devstack quobyte-client[83286]: The server volume:87712ffe-8a69-446d-9ed6-4430c7ee9792@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=87712ffe-8a69-446d-9ed6-4430c7ee9792, inode=54, name=volume-3fce65ed-d5f7-4edc-91e3-25e3958112e0.a00987fa-5fe0-4418-b7c0-6380bf9c584c, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.206), requestorAccessMask=0 Sep 16 15:04:48 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [None req-1cbe9801-d8bb-4213-9efd-e66c74c41270 tempest-GroupSnapshotsTest-952387378 None] CMD "qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c/volume-3fce65ed-d5f7-4edc-91e3-25e3958112e0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c/volume-3fce65ed-d5f7-4edc-91e3-25e3958112e0.a00987fa-5fe0-4418-b7c0-6380bf9c584c 1G" returned: 0 in 0.373s {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 15:04:48 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [None req-1cbe9801-d8bb-4213-9efd-e66c74c41270 tempest-GroupSnapshotsTest-952387378 None] Running cmd (subprocess): qemu-img rebase -u -b volume-3fce65ed-d5f7-4edc-91e3-25e3958112e0 -F qcow2 /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c/volume-3fce65ed-d5f7-4edc-91e3-25e3958112e0.a00987fa-5fe0-4418-b7c0-6380bf9c584c {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 15:04:48 devstack quobyte-client[83286]: System call of process 93340 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 16 15:04:48 devstack quobyte-client[83286]: System call of process 93340 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 16 15:04:48 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [None req-1cbe9801-d8bb-4213-9efd-e66c74c41270 tempest-GroupSnapshotsTest-952387378 None] CMD "qemu-img rebase -u -b volume-3fce65ed-d5f7-4edc-91e3-25e3958112e0 -F qcow2 /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c/volume-3fce65ed-d5f7-4edc-91e3-25e3958112e0.a00987fa-5fe0-4418-b7c0-6380bf9c584c" returned: 0 in 0.221s {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 15:04:48 devstack cinder-volume[83259]: DEBUG cinder.volume.drivers.remotefs [None req-1cbe9801-d8bb-4213-9efd-e66c74c41270 tempest-GroupSnapshotsTest-952387378 None] File path /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c/volume-3fce65ed-d5f7-4edc-91e3-25e3958112e0.a00987fa-5fe0-4418-b7c0-6380bf9c584c is being set with permissions: 660 {{(pid=83259) _set_rw_permissions /opt/stack/cinder/cinder/volume/drivers/remotefs.py:492}} Sep 16 15:04:48 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [None req-1cbe9801-d8bb-4213-9efd-e66c74c41270 tempest-GroupSnapshotsTest-952387378 None] Running cmd (subprocess): chmod 660 /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c/volume-3fce65ed-d5f7-4edc-91e3-25e3958112e0.a00987fa-5fe0-4418-b7c0-6380bf9c584c {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 15:04:49 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [None req-1cbe9801-d8bb-4213-9efd-e66c74c41270 tempest-GroupSnapshotsTest-952387378 None] CMD "chmod 660 /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c/volume-3fce65ed-d5f7-4edc-91e3-25e3958112e0.a00987fa-5fe0-4418-b7c0-6380bf9c584c" returned: 0 in 0.182s {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 15:04:49 devstack cinder-volume[83259]: DEBUG cinder.volume.drivers.remotefs [None req-1cbe9801-d8bb-4213-9efd-e66c74c41270 tempest-GroupSnapshotsTest-952387378 None] Setting permissions: /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c/volume-3fce65ed-d5f7-4edc-91e3-25e3958112e0 -> 1000:1000 {{(pid=83259) _do_create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1584}} Sep 16 15:04:49 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [None req-1cbe9801-d8bb-4213-9efd-e66c74c41270 tempest-GroupSnapshotsTest-952387378 None] Running cmd (subprocess): chown --reference=/opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c/volume-3fce65ed-d5f7-4edc-91e3-25e3958112e0 /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c/volume-3fce65ed-d5f7-4edc-91e3-25e3958112e0.a00987fa-5fe0-4418-b7c0-6380bf9c584c {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 15:04:49 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [None req-1cbe9801-d8bb-4213-9efd-e66c74c41270 tempest-GroupSnapshotsTest-952387378 None] CMD "chown --reference=/opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c/volume-3fce65ed-d5f7-4edc-91e3-25e3958112e0 /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c/volume-3fce65ed-d5f7-4edc-91e3-25e3958112e0.a00987fa-5fe0-4418-b7c0-6380bf9c584c" returned: 0 in 0.125s {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 15:04:49 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [None req-1cbe9801-d8bb-4213-9efd-e66c74c41270 tempest-GroupSnapshotsTest-952387378 None] Running cmd (subprocess): truncate -s0 /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c/volume-3fce65ed-d5f7-4edc-91e3-25e3958112e0.info {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 15:04:49 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [None req-1cbe9801-d8bb-4213-9efd-e66c74c41270 tempest-GroupSnapshotsTest-952387378 None] CMD "truncate -s0 /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c/volume-3fce65ed-d5f7-4edc-91e3-25e3958112e0.info" returned: 0 in 0.132s {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 15:04:49 devstack cinder-volume[83259]: DEBUG cinder.volume.drivers.remotefs [None req-1cbe9801-d8bb-4213-9efd-e66c74c41270 tempest-GroupSnapshotsTest-952387378 None] File path /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c/volume-3fce65ed-d5f7-4edc-91e3-25e3958112e0.info is being set with permissions: 660 {{(pid=83259) _set_rw_permissions /opt/stack/cinder/cinder/volume/drivers/remotefs.py:492}} Sep 16 15:04:49 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [None req-1cbe9801-d8bb-4213-9efd-e66c74c41270 tempest-GroupSnapshotsTest-952387378 None] Running cmd (subprocess): chmod 660 /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c/volume-3fce65ed-d5f7-4edc-91e3-25e3958112e0.info {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 15:04:49 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [None req-1cbe9801-d8bb-4213-9efd-e66c74c41270 tempest-GroupSnapshotsTest-952387378 None] CMD "chmod 660 /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c/volume-3fce65ed-d5f7-4edc-91e3-25e3958112e0.info" returned: 0 in 0.152s {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 15:04:49 devstack cinder-volume[83259]: DEBUG oslo_concurrency.lockutils [None req-1cbe9801-d8bb-4213-9efd-e66c74c41270 tempest-GroupSnapshotsTest-952387378 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.229s {{(pid=83259) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 16 15:04:49 devstack cinder-volume[83259]: DEBUG dbcounter [-] [83259] Writing DB stats cinder:UPDATE=136,cinder:SELECT=127,cinder:INSERT=30,cinder:DELETE=7 {{(pid=83259) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Sep 16 15:04:50 devstack cinder-volume[83259]: INFO cinder.volume.manager [None req-1cbe9801-d8bb-4213-9efd-e66c74c41270 tempest-GroupSnapshotsTest-952387378 None] group_snapshot 52e1464a-126c-4660-bb65-e4b2f1a9ef15: created successfully Sep 16 15:04:51 devstack cinder-volume[83259]: INFO cinder.volume.manager [None req-a528bbdc-68ca-4572-8f76-535576d4f78a tempest-GroupSnapshotsTest-952387378 None] group_snapshot 52e1464a-126c-4660-bb65-e4b2f1a9ef15: deleting Sep 16 15:04:51 devstack cinder-volume[83259]: WARNING cinder.volume.volume_utils [None req-a528bbdc-68ca-4572-8f76-535576d4f78a tempest-GroupSnapshotsTest-952387378 None] Volume driver (QuobyteDriver 1.2) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 16 15:04:51 devstack cinder-volume[83259]: DEBUG cinder.volume.manager [None req-a528bbdc-68ca-4572-8f76-535576d4f78a tempest-GroupSnapshotsTest-952387378 None] group_snapshot 52e1464a-126c-4660-bb65-e4b2f1a9ef15: deleting {{(pid=83259) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4317}} Sep 16 15:04:51 devstack cinder-volume[83259]: DEBUG cinder.coordination [None req-a528bbdc-68ca-4572-8f76-535576d4f78a tempest-GroupSnapshotsTest-952387378 None] Acquiring lock "cinder-quobyte-3fce65ed-d5f7-4edc-91e3-25e3958112e0" by "delete_snapshot" {{(pid=83259) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 16 15:04:51 devstack cinder-volume[83259]: DEBUG cinder.coordination [None req-a528bbdc-68ca-4572-8f76-535576d4f78a tempest-GroupSnapshotsTest-952387378 None] Lock "cinder-quobyte-3fce65ed-d5f7-4edc-91e3-25e3958112e0" acquired by "delete_snapshot" :: waited 0.120s {{(pid=83259) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 16 15:04:51 devstack cinder-volume[83259]: DEBUG cinder.coordination [None req-a528bbdc-68ca-4572-8f76-535576d4f78a tempest-GroupSnapshotsTest-952387378 None] Acquiring lock "cinder-quobyte-a00987fa-5fe0-4418-b7c0-6380bf9c584c" by "_delete_snapshot" {{(pid=83259) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 16 15:04:51 devstack cinder-volume[83259]: DEBUG cinder.coordination [None req-a528bbdc-68ca-4572-8f76-535576d4f78a tempest-GroupSnapshotsTest-952387378 None] Lock "cinder-quobyte-a00987fa-5fe0-4418-b7c0-6380bf9c584c" acquired by "_delete_snapshot" :: waited 0.018s {{(pid=83259) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 16 15:04:51 devstack cinder-volume[83259]: DEBUG cinder.volume.drivers.remotefs [None req-a528bbdc-68ca-4572-8f76-535576d4f78a tempest-GroupSnapshotsTest-952387378 None] Deleting offline snapshot a00987fa-5fe0-4418-b7c0-6380bf9c584c of volume 3fce65ed-d5f7-4edc-91e3-25e3958112e0 {{(pid=83259) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1278}} Sep 16 15:04:51 devstack cinder-volume[83259]: DEBUG cinder.volume.drivers.remotefs [None req-a528bbdc-68ca-4572-8f76-535576d4f78a tempest-GroupSnapshotsTest-952387378 None] snapshot_file for this snap is: volume-3fce65ed-d5f7-4edc-91e3-25e3958112e0.a00987fa-5fe0-4418-b7c0-6380bf9c584c {{(pid=83259) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1307}} Sep 16 15:04:51 devstack cinder-volume[83259]: DEBUG oslo.privsep.daemon [-] privsep: reply[83b3b14a-aade-45c8-b174-343e6b2cb5f1]: (4, 'qcow2') {{(pid=84312) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 16 15:04:51 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [None req-a528bbdc-68ca-4572-8f76-535576d4f78a tempest-GroupSnapshotsTest-952387378 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c/volume-3fce65ed-d5f7-4edc-91e3-25e3958112e0.a00987fa-5fe0-4418-b7c0-6380bf9c584c {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 15:04:51 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [None req-a528bbdc-68ca-4572-8f76-535576d4f78a tempest-GroupSnapshotsTest-952387378 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c/volume-3fce65ed-d5f7-4edc-91e3-25e3958112e0.a00987fa-5fe0-4418-b7c0-6380bf9c584c" returned: 0 in 0.508s {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 15:04:51 devstack cinder-volume[83259]: DEBUG cinder.volume.drivers.remotefs [None req-a528bbdc-68ca-4572-8f76-535576d4f78a tempest-GroupSnapshotsTest-952387378 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-3fce65ed-d5f7-4edc-91e3-25e3958112e0(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83259) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:886}} Sep 16 15:04:51 devstack cinder-volume[83259]: DEBUG oslo.privsep.daemon [-] privsep: reply[b13720cd-0d68-4d1d-86d7-08a932e31c9d]: (4, 'qcow2') {{(pid=84312) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 16 15:04:51 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [None req-a528bbdc-68ca-4572-8f76-535576d4f78a tempest-GroupSnapshotsTest-952387378 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c/volume-3fce65ed-d5f7-4edc-91e3-25e3958112e0 {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 15:04:52 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [None req-a528bbdc-68ca-4572-8f76-535576d4f78a tempest-GroupSnapshotsTest-952387378 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c/volume-3fce65ed-d5f7-4edc-91e3-25e3958112e0" returned: 0 in 0.531s {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 15:04:52 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [None req-a528bbdc-68ca-4572-8f76-535576d4f78a tempest-GroupSnapshotsTest-952387378 None] Running cmd (subprocess): qemu-img commit -d /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c/volume-3fce65ed-d5f7-4edc-91e3-25e3958112e0.a00987fa-5fe0-4418-b7c0-6380bf9c584c {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 15:04:52 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [None req-a528bbdc-68ca-4572-8f76-535576d4f78a tempest-GroupSnapshotsTest-952387378 None] CMD "qemu-img commit -d /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c/volume-3fce65ed-d5f7-4edc-91e3-25e3958112e0.a00987fa-5fe0-4418-b7c0-6380bf9c584c" returned: 0 in 0.293s {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 15:04:52 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [None req-a528bbdc-68ca-4572-8f76-535576d4f78a tempest-GroupSnapshotsTest-952387378 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c/volume-3fce65ed-d5f7-4edc-91e3-25e3958112e0.a00987fa-5fe0-4418-b7c0-6380bf9c584c {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 15:04:53 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [None req-a528bbdc-68ca-4572-8f76-535576d4f78a tempest-GroupSnapshotsTest-952387378 None] CMD "rm -f /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c/volume-3fce65ed-d5f7-4edc-91e3-25e3958112e0.a00987fa-5fe0-4418-b7c0-6380bf9c584c" returned: 0 in 0.129s {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 15:04:53 devstack cinder-volume[83259]: DEBUG cinder.coordination [None req-a528bbdc-68ca-4572-8f76-535576d4f78a tempest-GroupSnapshotsTest-952387378 None] Lock "cinder-quobyte-a00987fa-5fe0-4418-b7c0-6380bf9c584c" released by "_delete_snapshot" :: held 1.874s {{(pid=83259) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 16 15:04:53 devstack cinder-volume[83259]: DEBUG cinder.coordination [None req-a528bbdc-68ca-4572-8f76-535576d4f78a tempest-GroupSnapshotsTest-952387378 None] Lock "cinder-quobyte-3fce65ed-d5f7-4edc-91e3-25e3958112e0" released by "delete_snapshot" :: held 1.908s {{(pid=83259) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 16 15:04:53 devstack cinder-volume[83259]: WARNING cinder.quota [None req-a528bbdc-68ca-4572-8f76-535576d4f78a tempest-GroupSnapshotsTest-952387378 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-1937740416 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-1937740416, it is now deprecated. Please use the default quota class for default quota. Sep 16 15:04:53 devstack cinder-volume[83259]: WARNING cinder.quota [None req-a528bbdc-68ca-4572-8f76-535576d4f78a tempest-GroupSnapshotsTest-952387378 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-1937740416 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-1937740416, it is now deprecated. Please use the default quota class for default quota. Sep 16 15:04:53 devstack cinder-volume[83259]: DEBUG cinder.quota [None req-a528bbdc-68ca-4572-8f76-535576d4f78a tempest-GroupSnapshotsTest-952387378 None] Created reservations ['d2724a67-e052-407f-b574-a572536a711d', '5dfc550e-abf4-4be4-be03-22852adf9acf', 'db922975-7f2a-4699-bd1c-a7c31cc65acf', 'd7bbed2d-7994-4d48-a174-8a99b9d5f76a'] {{(pid=83259) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 16 15:04:54 devstack cinder-volume[83259]: INFO cinder.volume.manager [None req-a528bbdc-68ca-4572-8f76-535576d4f78a tempest-GroupSnapshotsTest-952387378 None] group_snapshot 52e1464a-126c-4660-bb65-e4b2f1a9ef15: deleted successfully Sep 16 15:04:55 devstack cinder-volume[83259]: WARNING cinder.volume.volume_utils [None req-eefd3997-d5b5-4da6-baea-b0b3f604f756 tempest-GroupSnapshotsTest-952387378 None] Volume driver (QuobyteDriver 1.2) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 16 15:04:55 devstack cinder-volume[83259]: DEBUG cinder.coordination [None req-eefd3997-d5b5-4da6-baea-b0b3f604f756 tempest-GroupSnapshotsTest-952387378 None] Acquiring lock "cinder-quobyte-3fce65ed-d5f7-4edc-91e3-25e3958112e0" by "delete_volume" {{(pid=83259) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 16 15:04:55 devstack cinder-volume[83259]: DEBUG cinder.coordination [None req-eefd3997-d5b5-4da6-baea-b0b3f604f756 tempest-GroupSnapshotsTest-952387378 None] Lock "cinder-quobyte-3fce65ed-d5f7-4edc-91e3-25e3958112e0" acquired by "delete_volume" :: waited 0.048s {{(pid=83259) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 16 15:04:55 devstack cinder-volume[83259]: DEBUG oslo.privsep.daemon [-] privsep: reply[9f469200-d0c4-4daa-8f22-d0eda749f34d]: (4, 'qcow2') {{(pid=84312) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 16 15:04:55 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [None req-eefd3997-d5b5-4da6-baea-b0b3f604f756 tempest-GroupSnapshotsTest-952387378 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c/volume-3fce65ed-d5f7-4edc-91e3-25e3958112e0 {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 15:04:56 devstack quobyte-client[83286]: System call of process 93358 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 16 15:04:56 devstack quobyte-client[83286]: System call of process 93358 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 16 15:04:56 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [None req-eefd3997-d5b5-4da6-baea-b0b3f604f756 tempest-GroupSnapshotsTest-952387378 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c/volume-3fce65ed-d5f7-4edc-91e3-25e3958112e0" returned: 0 in 1.083s {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 15:04:56 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [None req-eefd3997-d5b5-4da6-baea-b0b3f604f756 tempest-GroupSnapshotsTest-952387378 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c/volume-3fce65ed-d5f7-4edc-91e3-25e3958112e0 {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 15:04:56 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [None req-eefd3997-d5b5-4da6-baea-b0b3f604f756 tempest-GroupSnapshotsTest-952387378 None] CMD "rm -f /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c/volume-3fce65ed-d5f7-4edc-91e3-25e3958112e0" returned: 0 in 0.182s {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 15:04:57 devstack cinder-volume[83259]: DEBUG cinder.coordination [None req-eefd3997-d5b5-4da6-baea-b0b3f604f756 tempest-GroupSnapshotsTest-952387378 None] Lock "cinder-quobyte-3fce65ed-d5f7-4edc-91e3-25e3958112e0" released by "delete_volume" :: held 1.611s {{(pid=83259) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 16 15:04:57 devstack cinder-volume[83259]: WARNING cinder.volume.volume_utils [None req-5887512c-a250-487e-85fe-e83771d0fc6b tempest-SnapshotsActionsTest-1728937745 None] Volume driver (QuobyteDriver 1.2) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 16 15:04:57 devstack cinder-volume[83259]: DEBUG cinder.volume.flows.manager.create_volume [None req-5887512c-a250-487e-85fe-e83771d0fc6b tempest-SnapshotsActionsTest-1728937745 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#Quobyte'], 'hosts': ['devstack@QuobyteHD#Quobyte']} {{(pid=83259) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1387}} Sep 16 15:04:57 devstack cinder-volume[83259]: DEBUG cinder.volume.manager [None req-5887512c-a250-487e-85fe-e83771d0fc6b tempest-SnapshotsActionsTest-1728937745 None] Flow 'volume_create_manager' (956ede52-baba-46e1-89b6-babbb1af0e3d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83259) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 16 15:04:57 devstack cinder-volume[83259]: DEBUG cinder.volume.manager [None req-5887512c-a250-487e-85fe-e83771d0fc6b tempest-SnapshotsActionsTest-1728937745 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (446a6f81-dba9-4ea2-8791-315d80fab9b7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83259) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 15:04:57 devstack cinder-volume[83259]: DEBUG cinder.volume.manager [None req-5887512c-a250-487e-85fe-e83771d0fc6b tempest-SnapshotsActionsTest-1728937745 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (446a6f81-dba9-4ea2-8791-315d80fab9b7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-16T13:04:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotsActionsTest-Volume-1028128975',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#Quobyte',id=bdbf4fce-d8cb-41ac-80b8-e3362f499765,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9566100ce2f540dca96aedf96fd4f420',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-16T13:04:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-16T13:04:57Z,use_quota=True,user_id='2abd1f7ad7684cc4a35d3cb20956cc36',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(485ead50-3df8-4d76-8d34-a4db136c980a),volume_type_id=485ead50-3df8-4d76-8d34-a4db136c980a)' {{(pid=83259) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 15:04:57 devstack cinder-volume[83259]: DEBUG cinder.volume.manager [None req-5887512c-a250-487e-85fe-e83771d0fc6b tempest-SnapshotsActionsTest-1728937745 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dcdb41a8-d6e6-45b0-ad30-b2822e27f0a8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83259) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 15:04:57 devstack cinder-volume[83259]: DEBUG cinder.volume.manager [None req-5887512c-a250-487e-85fe-e83771d0fc6b tempest-SnapshotsActionsTest-1728937745 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dcdb41a8-d6e6-45b0-ad30-b2822e27f0a8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83259) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 15:04:57 devstack cinder-volume[83259]: DEBUG cinder.volume.manager [None req-5887512c-a250-487e-85fe-e83771d0fc6b tempest-SnapshotsActionsTest-1728937745 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cda1e369-d0a1-40fb-81a2-1004a13521d7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83259) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 15:04:57 devstack cinder-volume[83259]: DEBUG cinder.volume.manager [None req-5887512c-a250-487e-85fe-e83771d0fc6b tempest-SnapshotsActionsTest-1728937745 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cda1e369-d0a1-40fb-81a2-1004a13521d7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'bdbf4fce-d8cb-41ac-80b8-e3362f499765', 'volume_name': 'volume-bdbf4fce-d8cb-41ac-80b8-e3362f499765', 'volume_size': 1}' {{(pid=83259) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 15:04:58 devstack cinder-volume[83259]: DEBUG cinder.volume.manager [None req-5887512c-a250-487e-85fe-e83771d0fc6b tempest-SnapshotsActionsTest-1728937745 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9926616a-b720-48ac-bc59-da296efe9b17) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83259) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 15:04:58 devstack cinder-volume[83259]: DEBUG cinder.volume.manager [None req-5887512c-a250-487e-85fe-e83771d0fc6b tempest-SnapshotsActionsTest-1728937745 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9926616a-b720-48ac-bc59-da296efe9b17) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83259) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 15:04:58 devstack cinder-volume[83259]: DEBUG cinder.volume.manager [None req-5887512c-a250-487e-85fe-e83771d0fc6b tempest-SnapshotsActionsTest-1728937745 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b5e8cb84-7a05-4e00-a4ee-d6e741e46ced) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83259) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 15:04:58 devstack cinder-volume[83259]: INFO cinder.volume.flows.manager.create_volume [None req-5887512c-a250-487e-85fe-e83771d0fc6b tempest-SnapshotsActionsTest-1728937745 None] Volume bdbf4fce-d8cb-41ac-80b8-e3362f499765: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-bdbf4fce-d8cb-41ac-80b8-e3362f499765', 'volume_size': 1} Sep 16 15:04:58 devstack cinder-volume[83259]: DEBUG oslo_concurrency.lockutils [None req-5887512c-a250-487e-85fe-e83771d0fc6b tempest-SnapshotsActionsTest-1728937745 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83259) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 16 15:04:58 devstack cinder-volume[83259]: DEBUG oslo_concurrency.lockutils [None req-5887512c-a250-487e-85fe-e83771d0fc6b tempest-SnapshotsActionsTest-1728937745 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=83259) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 16 15:04:58 devstack cinder-volume[83259]: DEBUG cinder.volume.drivers.quobyte [None req-5887512c-a250-487e-85fe-e83771d0fc6b tempest-SnapshotsActionsTest-1728937745 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-16T13:04:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotsActionsTest-Volume-1028128975',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#Quobyte',id=bdbf4fce-d8cb-41ac-80b8-e3362f499765,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9566100ce2f540dca96aedf96fd4f420',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-16T13:04:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-16T13:04:57Z,use_quota=True,user_id='2abd1f7ad7684cc4a35d3cb20956cc36',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(485ead50-3df8-4d76-8d34-a4db136c980a),volume_type_id=485ead50-3df8-4d76-8d34-a4db136c980a)}" {{(pid=83259) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Sep 16 15:04:58 devstack cinder-volume[83259]: DEBUG cinder.volume.drivers.remotefs [None req-5887512c-a250-487e-85fe-e83771d0fc6b tempest-SnapshotsActionsTest-1728937745 None] Creating volume bdbf4fce-d8cb-41ac-80b8-e3362f499765 {{(pid=83259) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}} Sep 16 15:04:58 devstack cinder-volume[83259]: DEBUG oslo_concurrency.lockutils [None req-5887512c-a250-487e-85fe-e83771d0fc6b tempest-SnapshotsActionsTest-1728937745 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83259) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 16 15:04:58 devstack cinder-volume[83259]: DEBUG oslo_concurrency.lockutils [None req-5887512c-a250-487e-85fe-e83771d0fc6b tempest-SnapshotsActionsTest-1728937745 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83259) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 16 15:04:58 devstack cinder-volume[83259]: DEBUG cinder.volume.drivers.quobyte [None req-5887512c-a250-487e-85fe-e83771d0fc6b tempest-SnapshotsActionsTest-1728937745 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-61f585ac-f8e2-4d19-a890-7ebc2726cc72': None} {{(pid=83259) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:639}} Sep 16 15:04:58 devstack cinder-volume[83259]: DEBUG cinder.volume.drivers.quobyte [None req-5887512c-a250-487e-85fe-e83771d0fc6b tempest-SnapshotsActionsTest-1728937745 None] Available shares ['10.10.41.181/cinder-vol-61f585ac-f8e2-4d19-a890-7ebc2726cc72'] {{(pid=83259) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:669}} Sep 16 15:04:58 devstack cinder-volume[83259]: DEBUG oslo_concurrency.lockutils [None req-5887512c-a250-487e-85fe-e83771d0fc6b tempest-SnapshotsActionsTest-1728937745 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=83259) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 16 15:04:58 devstack cinder-volume[83259]: DEBUG cinder.volume.drivers.quobyte [None req-5887512c-a250-487e-85fe-e83771d0fc6b tempest-SnapshotsActionsTest-1728937745 None] Selected 10.10.41.181/cinder-vol-61f585ac-f8e2-4d19-a890-7ebc2726cc72 as target Quobyte volume. {{(pid=83259) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:690}} Sep 16 15:04:58 devstack cinder-volume[83259]: INFO cinder.volume.drivers.remotefs [None req-5887512c-a250-487e-85fe-e83771d0fc6b tempest-SnapshotsActionsTest-1728937745 None] casted to 10.10.41.181/cinder-vol-61f585ac-f8e2-4d19-a890-7ebc2726cc72 Sep 16 15:04:58 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [None req-5887512c-a250-487e-85fe-e83771d0fc6b tempest-SnapshotsActionsTest-1728937745 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c/volume-bdbf4fce-d8cb-41ac-80b8-e3362f499765 1073741824 {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 15:04:58 devstack quobyte-client[83286]: The server volume:87712ffe-8a69-446d-9ed6-4430c7ee9792@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=87712ffe-8a69-446d-9ed6-4430c7ee9792, inode=56, name=volume-bdbf4fce-d8cb-41ac-80b8-e3362f499765, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.206), requestorAccessMask=0 Sep 16 15:04:58 devstack cinder-volume[83259]: DEBUG cinder.quota [None req-eefd3997-d5b5-4da6-baea-b0b3f604f756 tempest-GroupSnapshotsTest-952387378 None] Created reservations ['8e85abc7-b862-4b7f-b586-932acec9212e'] {{(pid=83259) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 16 15:04:58 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [None req-5887512c-a250-487e-85fe-e83771d0fc6b tempest-SnapshotsActionsTest-1728937745 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c/volume-bdbf4fce-d8cb-41ac-80b8-e3362f499765 1073741824" returned: 0 in 0.616s {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 15:04:58 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [None req-5887512c-a250-487e-85fe-e83771d0fc6b tempest-SnapshotsActionsTest-1728937745 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c/volume-bdbf4fce-d8cb-41ac-80b8-e3362f499765 {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 15:04:59 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [None req-5887512c-a250-487e-85fe-e83771d0fc6b tempest-SnapshotsActionsTest-1728937745 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c/volume-bdbf4fce-d8cb-41ac-80b8-e3362f499765" returned: 0 in 0.429s {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 15:04:59 devstack cinder-volume[83259]: DEBUG cinder.volume.drivers.quobyte [None req-5887512c-a250-487e-85fe-e83771d0fc6b tempest-SnapshotsActionsTest-1728937745 None] <== create_volume: return (1084ms) {'provider_location': '10.10.41.181/cinder-vol-61f585ac-f8e2-4d19-a890-7ebc2726cc72'} {{(pid=83259) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Sep 16 15:04:59 devstack cinder-volume[83259]: DEBUG oslo_concurrency.lockutils [None req-5887512c-a250-487e-85fe-e83771d0fc6b tempest-SnapshotsActionsTest-1728937745 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.094s {{(pid=83259) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 16 15:04:59 devstack cinder-volume[83259]: WARNING cinder.quota [None req-eefd3997-d5b5-4da6-baea-b0b3f604f756 tempest-GroupSnapshotsTest-952387378 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-1937740416 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-1937740416, it is now deprecated. Please use the default quota class for default quota. Sep 16 15:04:59 devstack cinder-volume[83259]: DEBUG cinder.volume.manager [None req-5887512c-a250-487e-85fe-e83771d0fc6b tempest-SnapshotsActionsTest-1728937745 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b5e8cb84-7a05-4e00-a4ee-d6e741e46ced) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-bdbf4fce-d8cb-41ac-80b8-e3362f499765', 'volume_size': 1}' {{(pid=83259) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 15:04:59 devstack cinder-volume[83259]: DEBUG cinder.volume.manager [None req-5887512c-a250-487e-85fe-e83771d0fc6b tempest-SnapshotsActionsTest-1728937745 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (684c0d68-d5d9-4d26-90f4-d872bebd2fa7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83259) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 15:04:59 devstack cinder-volume[83259]: INFO cinder.volume.flows.manager.create_volume [None req-5887512c-a250-487e-85fe-e83771d0fc6b tempest-SnapshotsActionsTest-1728937745 None] Volume volume-bdbf4fce-d8cb-41ac-80b8-e3362f499765 (bdbf4fce-d8cb-41ac-80b8-e3362f499765): created successfully Sep 16 15:04:59 devstack cinder-volume[83259]: DEBUG cinder.volume.manager [None req-5887512c-a250-487e-85fe-e83771d0fc6b tempest-SnapshotsActionsTest-1728937745 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (684c0d68-d5d9-4d26-90f4-d872bebd2fa7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83259) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 15:04:59 devstack cinder-volume[83259]: DEBUG cinder.volume.manager [None req-5887512c-a250-487e-85fe-e83771d0fc6b tempest-SnapshotsActionsTest-1728937745 None] Flow 'volume_create_manager' (956ede52-baba-46e1-89b6-babbb1af0e3d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83259) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 16 15:04:59 devstack cinder-volume[83259]: INFO cinder.volume.manager [None req-5887512c-a250-487e-85fe-e83771d0fc6b tempest-SnapshotsActionsTest-1728937745 None] Created volume successfully. Sep 16 15:04:59 devstack cinder-volume[83259]: DEBUG cinder.quota [None req-eefd3997-d5b5-4da6-baea-b0b3f604f756 tempest-GroupSnapshotsTest-952387378 None] Created reservations ['0de2de73-68ef-4856-afd1-87907d8d258f', 'f9f25a97-5942-4c2b-a6c3-ea8c415044f1', 'e6a3a28d-f878-4133-a90e-3ef93651e6ff', '34190dbd-826e-48d0-827f-21362b4a3df1'] {{(pid=83259) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 16 15:04:59 devstack cinder-volume[83259]: DEBUG oslo_concurrency.lockutils [None req-eefd3997-d5b5-4da6-baea-b0b3f604f756 tempest-GroupSnapshotsTest-952387378 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83259) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 16 15:04:59 devstack cinder-volume[83259]: DEBUG oslo_concurrency.lockutils [None req-eefd3997-d5b5-4da6-baea-b0b3f604f756 tempest-GroupSnapshotsTest-952387378 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=83259) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 16 15:04:59 devstack cinder-volume[83259]: DEBUG cinder.volume.drivers.quobyte [None req-eefd3997-d5b5-4da6-baea-b0b3f604f756 tempest-GroupSnapshotsTest-952387378 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-61f585ac-f8e2-4d19-a890-7ebc2726cc72': None} {{(pid=83259) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:639}} Sep 16 15:04:59 devstack cinder-volume[83259]: DEBUG cinder.volume.drivers.quobyte [None req-eefd3997-d5b5-4da6-baea-b0b3f604f756 tempest-GroupSnapshotsTest-952387378 None] Available shares ['10.10.41.181/cinder-vol-61f585ac-f8e2-4d19-a890-7ebc2726cc72'] {{(pid=83259) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:669}} Sep 16 15:04:59 devstack cinder-volume[83259]: DEBUG oslo_concurrency.lockutils [None req-eefd3997-d5b5-4da6-baea-b0b3f604f756 tempest-GroupSnapshotsTest-952387378 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=83259) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 16 15:04:59 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [None req-eefd3997-d5b5-4da6-baea-b0b3f604f756 tempest-GroupSnapshotsTest-952387378 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 15:04:59 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [None req-eefd3997-d5b5-4da6-baea-b0b3f604f756 tempest-GroupSnapshotsTest-952387378 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c" returned: 0 in 0.120s {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 15:04:59 devstack cinder-volume[83259]: DEBUG cinder.manager [None req-eefd3997-d5b5-4da6-baea-b0b3f604f756 tempest-GroupSnapshotsTest-952387378 None] Notifying Schedulers of capabilities ... {{(pid=83259) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 16 15:05:00 devstack cinder-volume[83259]: INFO cinder.volume.manager [None req-eefd3997-d5b5-4da6-baea-b0b3f604f756 tempest-GroupSnapshotsTest-952387378 None] Delete group completed successfully. Sep 16 15:05:00 devstack cinder-volume[83259]: WARNING cinder.volume.volume_utils [None req-7104a33f-a59c-4b4e-abf9-f276a775fd65 tempest-SnapshotsActionsTest-1728937745 None] Volume driver (QuobyteDriver 1.2) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 16 15:05:00 devstack cinder-volume[83259]: DEBUG oslo_concurrency.lockutils [None req-7104a33f-a59c-4b4e-abf9-f276a775fd65 tempest-SnapshotsActionsTest-1728937745 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=83259) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 16 15:05:00 devstack cinder-volume[83259]: DEBUG oslo_concurrency.lockutils [None req-7104a33f-a59c-4b4e-abf9-f276a775fd65 tempest-SnapshotsActionsTest-1728937745 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.004s {{(pid=83259) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 16 15:05:00 devstack cinder-volume[83259]: DEBUG cinder.volume.drivers.remotefs [None req-7104a33f-a59c-4b4e-abf9-f276a775fd65 tempest-SnapshotsActionsTest-1728937745 None] Creating offline snapshot 042f993b-d8e8-49f9-b87b-038713b2c9cc of volume bdbf4fce-d8cb-41ac-80b8-e3362f499765 {{(pid=83259) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1694}} Sep 16 15:05:00 devstack cinder-volume[83259]: DEBUG oslo.privsep.daemon [-] privsep: reply[b4bcc82c-d2fc-473a-a345-5a54fa0129ac]: (4, 'qcow2') {{(pid=84312) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 16 15:05:00 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [None req-7104a33f-a59c-4b4e-abf9-f276a775fd65 tempest-SnapshotsActionsTest-1728937745 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c/volume-bdbf4fce-d8cb-41ac-80b8-e3362f499765 {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 15:05:01 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [None req-7104a33f-a59c-4b4e-abf9-f276a775fd65 tempest-SnapshotsActionsTest-1728937745 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c/volume-bdbf4fce-d8cb-41ac-80b8-e3362f499765" returned: 0 in 0.571s {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 15:05:01 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [None req-7104a33f-a59c-4b4e-abf9-f276a775fd65 tempest-SnapshotsActionsTest-1728937745 None] Running cmd (subprocess): qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c/volume-bdbf4fce-d8cb-41ac-80b8-e3362f499765,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c/volume-bdbf4fce-d8cb-41ac-80b8-e3362f499765.042f993b-d8e8-49f9-b87b-038713b2c9cc 1G {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 15:05:01 devstack quobyte-client[83286]: The server volume:87712ffe-8a69-446d-9ed6-4430c7ee9792@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=87712ffe-8a69-446d-9ed6-4430c7ee9792, inode=57, name=volume-bdbf4fce-d8cb-41ac-80b8-e3362f499765.042f993b-d8e8-49f9-b87b-038713b2c9cc, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.206), requestorAccessMask=0 Sep 16 15:05:01 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [None req-7104a33f-a59c-4b4e-abf9-f276a775fd65 tempest-SnapshotsActionsTest-1728937745 None] CMD "qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c/volume-bdbf4fce-d8cb-41ac-80b8-e3362f499765,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c/volume-bdbf4fce-d8cb-41ac-80b8-e3362f499765.042f993b-d8e8-49f9-b87b-038713b2c9cc 1G" returned: 0 in 0.290s {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 15:05:01 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [None req-7104a33f-a59c-4b4e-abf9-f276a775fd65 tempest-SnapshotsActionsTest-1728937745 None] Running cmd (subprocess): qemu-img rebase -u -b volume-bdbf4fce-d8cb-41ac-80b8-e3362f499765 -F qcow2 /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c/volume-bdbf4fce-d8cb-41ac-80b8-e3362f499765.042f993b-d8e8-49f9-b87b-038713b2c9cc {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 15:05:01 devstack quobyte-client[83286]: System call of process 93373 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 16 15:05:01 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [None req-7104a33f-a59c-4b4e-abf9-f276a775fd65 tempest-SnapshotsActionsTest-1728937745 None] CMD "qemu-img rebase -u -b volume-bdbf4fce-d8cb-41ac-80b8-e3362f499765 -F qcow2 /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c/volume-bdbf4fce-d8cb-41ac-80b8-e3362f499765.042f993b-d8e8-49f9-b87b-038713b2c9cc" returned: 0 in 0.230s {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 15:05:01 devstack cinder-volume[83259]: DEBUG cinder.volume.drivers.remotefs [None req-7104a33f-a59c-4b4e-abf9-f276a775fd65 tempest-SnapshotsActionsTest-1728937745 None] File path /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c/volume-bdbf4fce-d8cb-41ac-80b8-e3362f499765.042f993b-d8e8-49f9-b87b-038713b2c9cc is being set with permissions: 660 {{(pid=83259) _set_rw_permissions /opt/stack/cinder/cinder/volume/drivers/remotefs.py:492}} Sep 16 15:05:01 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [None req-7104a33f-a59c-4b4e-abf9-f276a775fd65 tempest-SnapshotsActionsTest-1728937745 None] Running cmd (subprocess): chmod 660 /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c/volume-bdbf4fce-d8cb-41ac-80b8-e3362f499765.042f993b-d8e8-49f9-b87b-038713b2c9cc {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 15:05:01 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [None req-7104a33f-a59c-4b4e-abf9-f276a775fd65 tempest-SnapshotsActionsTest-1728937745 None] CMD "chmod 660 /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c/volume-bdbf4fce-d8cb-41ac-80b8-e3362f499765.042f993b-d8e8-49f9-b87b-038713b2c9cc" returned: 0 in 0.150s {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 15:05:01 devstack cinder-volume[83259]: DEBUG cinder.volume.drivers.remotefs [None req-7104a33f-a59c-4b4e-abf9-f276a775fd65 tempest-SnapshotsActionsTest-1728937745 None] Setting permissions: /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c/volume-bdbf4fce-d8cb-41ac-80b8-e3362f499765 -> 1000:1000 {{(pid=83259) _do_create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1584}} Sep 16 15:05:01 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [None req-7104a33f-a59c-4b4e-abf9-f276a775fd65 tempest-SnapshotsActionsTest-1728937745 None] Running cmd (subprocess): chown --reference=/opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c/volume-bdbf4fce-d8cb-41ac-80b8-e3362f499765 /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c/volume-bdbf4fce-d8cb-41ac-80b8-e3362f499765.042f993b-d8e8-49f9-b87b-038713b2c9cc {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 15:05:02 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [None req-7104a33f-a59c-4b4e-abf9-f276a775fd65 tempest-SnapshotsActionsTest-1728937745 None] CMD "chown --reference=/opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c/volume-bdbf4fce-d8cb-41ac-80b8-e3362f499765 /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c/volume-bdbf4fce-d8cb-41ac-80b8-e3362f499765.042f993b-d8e8-49f9-b87b-038713b2c9cc" returned: 0 in 0.109s {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 15:05:02 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [None req-7104a33f-a59c-4b4e-abf9-f276a775fd65 tempest-SnapshotsActionsTest-1728937745 None] Running cmd (subprocess): truncate -s0 /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c/volume-bdbf4fce-d8cb-41ac-80b8-e3362f499765.info {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 15:05:02 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [None req-7104a33f-a59c-4b4e-abf9-f276a775fd65 tempest-SnapshotsActionsTest-1728937745 None] CMD "truncate -s0 /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c/volume-bdbf4fce-d8cb-41ac-80b8-e3362f499765.info" returned: 0 in 0.130s {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 15:05:02 devstack cinder-volume[83259]: DEBUG cinder.volume.drivers.remotefs [None req-7104a33f-a59c-4b4e-abf9-f276a775fd65 tempest-SnapshotsActionsTest-1728937745 None] File path /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c/volume-bdbf4fce-d8cb-41ac-80b8-e3362f499765.info is being set with permissions: 660 {{(pid=83259) _set_rw_permissions /opt/stack/cinder/cinder/volume/drivers/remotefs.py:492}} Sep 16 15:05:02 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [None req-7104a33f-a59c-4b4e-abf9-f276a775fd65 tempest-SnapshotsActionsTest-1728937745 None] Running cmd (subprocess): chmod 660 /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c/volume-bdbf4fce-d8cb-41ac-80b8-e3362f499765.info {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 15:05:02 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [None req-7104a33f-a59c-4b4e-abf9-f276a775fd65 tempest-SnapshotsActionsTest-1728937745 None] CMD "chmod 660 /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c/volume-bdbf4fce-d8cb-41ac-80b8-e3362f499765.info" returned: 0 in 0.218s {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 15:05:02 devstack cinder-volume[83259]: DEBUG oslo_concurrency.lockutils [None req-7104a33f-a59c-4b4e-abf9-f276a775fd65 tempest-SnapshotsActionsTest-1728937745 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.120s {{(pid=83259) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 16 15:05:02 devstack cinder-volume[83259]: INFO cinder.volume.manager [None req-7104a33f-a59c-4b4e-abf9-f276a775fd65 tempest-SnapshotsActionsTest-1728937745 None] Create snapshot completed successfully Sep 16 15:05:04 devstack cinder-volume[83259]: WARNING cinder.volume.volume_utils [None req-db8be307-93cc-405e-a08e-0ef43e4937ee tempest-SnapshotsActionsTest-1728937745 None] Volume driver (QuobyteDriver 1.2) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 16 15:05:04 devstack cinder-volume[83259]: DEBUG oslo_concurrency.lockutils [None req-db8be307-93cc-405e-a08e-0ef43e4937ee tempest-SnapshotsActionsTest-1728937745 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=83259) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 16 15:05:04 devstack cinder-volume[83259]: DEBUG oslo_concurrency.lockutils [None req-db8be307-93cc-405e-a08e-0ef43e4937ee tempest-SnapshotsActionsTest-1728937745 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.003s {{(pid=83259) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 16 15:05:04 devstack cinder-volume[83259]: DEBUG cinder.volume.drivers.remotefs [None req-db8be307-93cc-405e-a08e-0ef43e4937ee tempest-SnapshotsActionsTest-1728937745 None] Creating offline snapshot 9569d7d4-d9a1-4d96-a338-aebe969c37fe of volume bdbf4fce-d8cb-41ac-80b8-e3362f499765 {{(pid=83259) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1694}} Sep 16 15:05:04 devstack cinder-volume[83259]: DEBUG oslo.privsep.daemon [-] privsep: reply[2a368521-1c13-43ea-844f-0eca6270d2ea]: (4, 'qcow2') {{(pid=84312) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 16 15:05:04 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [None req-db8be307-93cc-405e-a08e-0ef43e4937ee tempest-SnapshotsActionsTest-1728937745 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c/volume-bdbf4fce-d8cb-41ac-80b8-e3362f499765.042f993b-d8e8-49f9-b87b-038713b2c9cc {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 15:05:05 devstack quobyte-client[83286]: System call of process 93381 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 16 15:05:05 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [None req-db8be307-93cc-405e-a08e-0ef43e4937ee tempest-SnapshotsActionsTest-1728937745 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c/volume-bdbf4fce-d8cb-41ac-80b8-e3362f499765.042f993b-d8e8-49f9-b87b-038713b2c9cc" returned: 0 in 0.608s {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 15:05:05 devstack cinder-volume[83259]: DEBUG cinder.volume.drivers.remotefs [None req-db8be307-93cc-405e-a08e-0ef43e4937ee tempest-SnapshotsActionsTest-1728937745 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-bdbf4fce-d8cb-41ac-80b8-e3362f499765(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83259) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:886}} Sep 16 15:05:05 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [None req-db8be307-93cc-405e-a08e-0ef43e4937ee tempest-SnapshotsActionsTest-1728937745 None] Running cmd (subprocess): qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c/volume-bdbf4fce-d8cb-41ac-80b8-e3362f499765.042f993b-d8e8-49f9-b87b-038713b2c9cc,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c/volume-bdbf4fce-d8cb-41ac-80b8-e3362f499765.9569d7d4-d9a1-4d96-a338-aebe969c37fe 1G {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 15:05:05 devstack quobyte-client[83286]: System call of process 93384 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 16 15:05:05 devstack quobyte-client[83286]: The server volume:87712ffe-8a69-446d-9ed6-4430c7ee9792@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=87712ffe-8a69-446d-9ed6-4430c7ee9792, inode=59, name=volume-bdbf4fce-d8cb-41ac-80b8-e3362f499765.9569d7d4-d9a1-4d96-a338-aebe969c37fe, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.206), requestorAccessMask=0 Sep 16 15:05:05 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [None req-db8be307-93cc-405e-a08e-0ef43e4937ee tempest-SnapshotsActionsTest-1728937745 None] CMD "qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c/volume-bdbf4fce-d8cb-41ac-80b8-e3362f499765.042f993b-d8e8-49f9-b87b-038713b2c9cc,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c/volume-bdbf4fce-d8cb-41ac-80b8-e3362f499765.9569d7d4-d9a1-4d96-a338-aebe969c37fe 1G" returned: 0 in 0.349s {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 15:05:05 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [None req-db8be307-93cc-405e-a08e-0ef43e4937ee tempest-SnapshotsActionsTest-1728937745 None] Running cmd (subprocess): qemu-img rebase -u -b volume-bdbf4fce-d8cb-41ac-80b8-e3362f499765.042f993b-d8e8-49f9-b87b-038713b2c9cc -F qcow2 /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c/volume-bdbf4fce-d8cb-41ac-80b8-e3362f499765.9569d7d4-d9a1-4d96-a338-aebe969c37fe {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 15:05:06 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [None req-db8be307-93cc-405e-a08e-0ef43e4937ee tempest-SnapshotsActionsTest-1728937745 None] CMD "qemu-img rebase -u -b volume-bdbf4fce-d8cb-41ac-80b8-e3362f499765.042f993b-d8e8-49f9-b87b-038713b2c9cc -F qcow2 /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c/volume-bdbf4fce-d8cb-41ac-80b8-e3362f499765.9569d7d4-d9a1-4d96-a338-aebe969c37fe" returned: 0 in 0.202s {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 15:05:06 devstack cinder-volume[83259]: DEBUG cinder.volume.drivers.remotefs [None req-db8be307-93cc-405e-a08e-0ef43e4937ee tempest-SnapshotsActionsTest-1728937745 None] File path /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c/volume-bdbf4fce-d8cb-41ac-80b8-e3362f499765.9569d7d4-d9a1-4d96-a338-aebe969c37fe is being set with permissions: 660 {{(pid=83259) _set_rw_permissions /opt/stack/cinder/cinder/volume/drivers/remotefs.py:492}} Sep 16 15:05:06 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [None req-db8be307-93cc-405e-a08e-0ef43e4937ee tempest-SnapshotsActionsTest-1728937745 None] Running cmd (subprocess): chmod 660 /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c/volume-bdbf4fce-d8cb-41ac-80b8-e3362f499765.9569d7d4-d9a1-4d96-a338-aebe969c37fe {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 15:05:06 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [None req-db8be307-93cc-405e-a08e-0ef43e4937ee tempest-SnapshotsActionsTest-1728937745 None] CMD "chmod 660 /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c/volume-bdbf4fce-d8cb-41ac-80b8-e3362f499765.9569d7d4-d9a1-4d96-a338-aebe969c37fe" returned: 0 in 0.106s {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 15:05:06 devstack cinder-volume[83259]: DEBUG cinder.volume.drivers.remotefs [None req-db8be307-93cc-405e-a08e-0ef43e4937ee tempest-SnapshotsActionsTest-1728937745 None] Setting permissions: /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c/volume-bdbf4fce-d8cb-41ac-80b8-e3362f499765.042f993b-d8e8-49f9-b87b-038713b2c9cc -> 1000:1000 {{(pid=83259) _do_create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1584}} Sep 16 15:05:06 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [None req-db8be307-93cc-405e-a08e-0ef43e4937ee tempest-SnapshotsActionsTest-1728937745 None] Running cmd (subprocess): chown --reference=/opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c/volume-bdbf4fce-d8cb-41ac-80b8-e3362f499765.042f993b-d8e8-49f9-b87b-038713b2c9cc /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c/volume-bdbf4fce-d8cb-41ac-80b8-e3362f499765.9569d7d4-d9a1-4d96-a338-aebe969c37fe {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 15:05:06 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [None req-db8be307-93cc-405e-a08e-0ef43e4937ee tempest-SnapshotsActionsTest-1728937745 None] CMD "chown --reference=/opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c/volume-bdbf4fce-d8cb-41ac-80b8-e3362f499765.042f993b-d8e8-49f9-b87b-038713b2c9cc /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c/volume-bdbf4fce-d8cb-41ac-80b8-e3362f499765.9569d7d4-d9a1-4d96-a338-aebe969c37fe" returned: 0 in 0.104s {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 15:05:06 devstack cinder-volume[83259]: DEBUG oslo_concurrency.lockutils [None req-db8be307-93cc-405e-a08e-0ef43e4937ee tempest-SnapshotsActionsTest-1728937745 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.737s {{(pid=83259) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 16 15:05:07 devstack cinder-volume[83259]: INFO cinder.volume.manager [None req-db8be307-93cc-405e-a08e-0ef43e4937ee tempest-SnapshotsActionsTest-1728937745 None] Create snapshot completed successfully Sep 16 15:05:08 devstack cinder-volume[83259]: DEBUG cinder.coordination [None req-fbf20793-41f3-4f21-bc28-7e7c7a7adcd7 tempest-SnapshotsActionsTest-937325462 None] Acquiring lock "cinder-9569d7d4-d9a1-4d96-a338-aebe969c37fe-delete_snapshot" by "delete_snapshot" {{(pid=83259) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 16 15:05:08 devstack cinder-volume[83259]: DEBUG cinder.coordination [None req-fbf20793-41f3-4f21-bc28-7e7c7a7adcd7 tempest-SnapshotsActionsTest-937325462 None] Lock "cinder-9569d7d4-d9a1-4d96-a338-aebe969c37fe-delete_snapshot" acquired by "delete_snapshot" :: waited 0.059s {{(pid=83259) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 16 15:05:08 devstack cinder-volume[83259]: WARNING cinder.volume.volume_utils [None req-fbf20793-41f3-4f21-bc28-7e7c7a7adcd7 tempest-SnapshotsActionsTest-937325462 None] Volume driver (QuobyteDriver 1.2) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 16 15:05:08 devstack cinder-volume[83259]: DEBUG cinder.coordination [None req-fbf20793-41f3-4f21-bc28-7e7c7a7adcd7 tempest-SnapshotsActionsTest-937325462 None] Acquiring lock "cinder-quobyte-bdbf4fce-d8cb-41ac-80b8-e3362f499765" by "delete_snapshot" {{(pid=83259) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 16 15:05:08 devstack cinder-volume[83259]: DEBUG cinder.coordination [None req-fbf20793-41f3-4f21-bc28-7e7c7a7adcd7 tempest-SnapshotsActionsTest-937325462 None] Lock "cinder-quobyte-bdbf4fce-d8cb-41ac-80b8-e3362f499765" acquired by "delete_snapshot" :: waited 0.013s {{(pid=83259) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 16 15:05:08 devstack cinder-volume[83259]: DEBUG cinder.coordination [None req-fbf20793-41f3-4f21-bc28-7e7c7a7adcd7 tempest-SnapshotsActionsTest-937325462 None] Acquiring lock "cinder-quobyte-9569d7d4-d9a1-4d96-a338-aebe969c37fe" by "_delete_snapshot" {{(pid=83259) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 16 15:05:08 devstack cinder-volume[83259]: DEBUG cinder.coordination [None req-fbf20793-41f3-4f21-bc28-7e7c7a7adcd7 tempest-SnapshotsActionsTest-937325462 None] Lock "cinder-quobyte-9569d7d4-d9a1-4d96-a338-aebe969c37fe" acquired by "_delete_snapshot" :: waited 0.014s {{(pid=83259) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 16 15:05:08 devstack cinder-volume[83259]: DEBUG cinder.volume.drivers.remotefs [None req-fbf20793-41f3-4f21-bc28-7e7c7a7adcd7 tempest-SnapshotsActionsTest-937325462 None] Deleting offline snapshot 9569d7d4-d9a1-4d96-a338-aebe969c37fe of volume bdbf4fce-d8cb-41ac-80b8-e3362f499765 {{(pid=83259) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1278}} Sep 16 15:05:08 devstack cinder-volume[83259]: DEBUG cinder.volume.drivers.remotefs [None req-fbf20793-41f3-4f21-bc28-7e7c7a7adcd7 tempest-SnapshotsActionsTest-937325462 None] snapshot_file for this snap is: volume-bdbf4fce-d8cb-41ac-80b8-e3362f499765.9569d7d4-d9a1-4d96-a338-aebe969c37fe {{(pid=83259) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1307}} Sep 16 15:05:08 devstack cinder-volume[83259]: DEBUG oslo.privsep.daemon [-] privsep: reply[47517418-3b13-4368-ab47-944209cd8146]: (4, 'qcow2') {{(pid=84312) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 16 15:05:08 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [None req-fbf20793-41f3-4f21-bc28-7e7c7a7adcd7 tempest-SnapshotsActionsTest-937325462 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c/volume-bdbf4fce-d8cb-41ac-80b8-e3362f499765.9569d7d4-d9a1-4d96-a338-aebe969c37fe {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 15:05:08 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [None req-fbf20793-41f3-4f21-bc28-7e7c7a7adcd7 tempest-SnapshotsActionsTest-937325462 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c/volume-bdbf4fce-d8cb-41ac-80b8-e3362f499765.9569d7d4-d9a1-4d96-a338-aebe969c37fe" returned: 0 in 0.494s {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 15:05:08 devstack cinder-volume[83259]: DEBUG cinder.volume.drivers.remotefs [None req-fbf20793-41f3-4f21-bc28-7e7c7a7adcd7 tempest-SnapshotsActionsTest-937325462 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-bdbf4fce-d8cb-41ac-80b8-e3362f499765(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83259) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:886}} Sep 16 15:05:08 devstack cinder-volume[83259]: DEBUG oslo.privsep.daemon [-] privsep: reply[8bdb87f8-5689-4df2-b22a-9828a645da16]: (4, 'qcow2') {{(pid=84312) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 16 15:05:08 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [None req-fbf20793-41f3-4f21-bc28-7e7c7a7adcd7 tempest-SnapshotsActionsTest-937325462 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c/volume-bdbf4fce-d8cb-41ac-80b8-e3362f499765.042f993b-d8e8-49f9-b87b-038713b2c9cc {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 15:05:09 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [None req-fbf20793-41f3-4f21-bc28-7e7c7a7adcd7 tempest-SnapshotsActionsTest-937325462 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c/volume-bdbf4fce-d8cb-41ac-80b8-e3362f499765.042f993b-d8e8-49f9-b87b-038713b2c9cc" returned: 0 in 0.478s {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 15:05:09 devstack cinder-volume[83259]: DEBUG cinder.volume.drivers.remotefs [None req-fbf20793-41f3-4f21-bc28-7e7c7a7adcd7 tempest-SnapshotsActionsTest-937325462 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-bdbf4fce-d8cb-41ac-80b8-e3362f499765(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83259) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:886}} Sep 16 15:05:09 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [None req-fbf20793-41f3-4f21-bc28-7e7c7a7adcd7 tempest-SnapshotsActionsTest-937325462 None] Running cmd (subprocess): qemu-img commit -d /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c/volume-bdbf4fce-d8cb-41ac-80b8-e3362f499765.9569d7d4-d9a1-4d96-a338-aebe969c37fe {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 15:05:09 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [None req-fbf20793-41f3-4f21-bc28-7e7c7a7adcd7 tempest-SnapshotsActionsTest-937325462 None] CMD "qemu-img commit -d /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c/volume-bdbf4fce-d8cb-41ac-80b8-e3362f499765.9569d7d4-d9a1-4d96-a338-aebe969c37fe" returned: 0 in 0.299s {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 15:05:09 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [None req-fbf20793-41f3-4f21-bc28-7e7c7a7adcd7 tempest-SnapshotsActionsTest-937325462 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c/volume-bdbf4fce-d8cb-41ac-80b8-e3362f499765.9569d7d4-d9a1-4d96-a338-aebe969c37fe {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 15:05:09 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [None req-fbf20793-41f3-4f21-bc28-7e7c7a7adcd7 tempest-SnapshotsActionsTest-937325462 None] CMD "rm -f /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c/volume-bdbf4fce-d8cb-41ac-80b8-e3362f499765.9569d7d4-d9a1-4d96-a338-aebe969c37fe" returned: 0 in 0.143s {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 15:05:10 devstack cinder-volume[83259]: DEBUG cinder.coordination [None req-fbf20793-41f3-4f21-bc28-7e7c7a7adcd7 tempest-SnapshotsActionsTest-937325462 None] Lock "cinder-quobyte-9569d7d4-d9a1-4d96-a338-aebe969c37fe" released by "_delete_snapshot" :: held 1.821s {{(pid=83259) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 16 15:05:10 devstack cinder-volume[83259]: DEBUG cinder.coordination [None req-fbf20793-41f3-4f21-bc28-7e7c7a7adcd7 tempest-SnapshotsActionsTest-937325462 None] Lock "cinder-quobyte-bdbf4fce-d8cb-41ac-80b8-e3362f499765" released by "delete_snapshot" :: held 1.848s {{(pid=83259) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 16 15:05:10 devstack cinder-volume[83259]: DEBUG cinder.quota [None req-fbf20793-41f3-4f21-bc28-7e7c7a7adcd7 tempest-SnapshotsActionsTest-937325462 None] Created reservations ['e7c646d8-8ff6-496e-b32f-538a5ede0df6', 'c5f33926-fc6a-4b15-9c6f-54f178843bc0', 'a3c06f5d-ddd1-467e-ae31-6fcf4e46c2e6', '7f4942cc-d1f6-4c08-8733-7f287f87fcca'] {{(pid=83259) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 16 15:05:10 devstack cinder-volume[83259]: INFO cinder.volume.manager [None req-fbf20793-41f3-4f21-bc28-7e7c7a7adcd7 tempest-SnapshotsActionsTest-937325462 None] Delete snapshot completed successfully. Sep 16 15:05:10 devstack cinder-volume[83259]: DEBUG cinder.coordination [None req-fbf20793-41f3-4f21-bc28-7e7c7a7adcd7 tempest-SnapshotsActionsTest-937325462 None] Lock "cinder-9569d7d4-d9a1-4d96-a338-aebe969c37fe-delete_snapshot" released by "delete_snapshot" :: held 2.470s {{(pid=83259) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 16 15:05:12 devstack cinder-volume[83259]: WARNING cinder.volume.volume_utils [None req-624aabe5-2559-4bb3-8272-6bef1daa77c5 tempest-SnapshotsActionsTest-1728937745 None] Volume driver (QuobyteDriver 1.2) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 16 15:05:12 devstack cinder-volume[83259]: DEBUG oslo_concurrency.lockutils [None req-624aabe5-2559-4bb3-8272-6bef1daa77c5 tempest-SnapshotsActionsTest-1728937745 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=83259) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 16 15:05:12 devstack cinder-volume[83259]: DEBUG oslo_concurrency.lockutils [None req-624aabe5-2559-4bb3-8272-6bef1daa77c5 tempest-SnapshotsActionsTest-1728937745 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.002s {{(pid=83259) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 16 15:05:12 devstack cinder-volume[83259]: DEBUG cinder.volume.drivers.remotefs [None req-624aabe5-2559-4bb3-8272-6bef1daa77c5 tempest-SnapshotsActionsTest-1728937745 None] Creating offline snapshot 3277a254-00fe-4351-b553-6a84e2934125 of volume bdbf4fce-d8cb-41ac-80b8-e3362f499765 {{(pid=83259) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1694}} Sep 16 15:05:12 devstack cinder-volume[83259]: DEBUG oslo.privsep.daemon [-] privsep: reply[aea36074-cc00-4ac5-8860-e58c35c5972a]: (4, 'qcow2') {{(pid=84312) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 16 15:05:12 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [None req-624aabe5-2559-4bb3-8272-6bef1daa77c5 tempest-SnapshotsActionsTest-1728937745 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c/volume-bdbf4fce-d8cb-41ac-80b8-e3362f499765.042f993b-d8e8-49f9-b87b-038713b2c9cc {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 15:05:12 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [None req-624aabe5-2559-4bb3-8272-6bef1daa77c5 tempest-SnapshotsActionsTest-1728937745 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c/volume-bdbf4fce-d8cb-41ac-80b8-e3362f499765.042f993b-d8e8-49f9-b87b-038713b2c9cc" returned: 0 in 0.498s {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 15:05:12 devstack cinder-volume[83259]: DEBUG cinder.volume.drivers.remotefs [None req-624aabe5-2559-4bb3-8272-6bef1daa77c5 tempest-SnapshotsActionsTest-1728937745 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-bdbf4fce-d8cb-41ac-80b8-e3362f499765(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83259) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:886}} Sep 16 15:05:12 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [None req-624aabe5-2559-4bb3-8272-6bef1daa77c5 tempest-SnapshotsActionsTest-1728937745 None] Running cmd (subprocess): qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c/volume-bdbf4fce-d8cb-41ac-80b8-e3362f499765.042f993b-d8e8-49f9-b87b-038713b2c9cc,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c/volume-bdbf4fce-d8cb-41ac-80b8-e3362f499765.3277a254-00fe-4351-b553-6a84e2934125 1G {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 15:05:13 devstack quobyte-client[83286]: The server volume:87712ffe-8a69-446d-9ed6-4430c7ee9792@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=87712ffe-8a69-446d-9ed6-4430c7ee9792, inode=60, name=volume-bdbf4fce-d8cb-41ac-80b8-e3362f499765.3277a254-00fe-4351-b553-6a84e2934125, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.206), requestorAccessMask=0 Sep 16 15:05:13 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [None req-624aabe5-2559-4bb3-8272-6bef1daa77c5 tempest-SnapshotsActionsTest-1728937745 None] CMD "qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c/volume-bdbf4fce-d8cb-41ac-80b8-e3362f499765.042f993b-d8e8-49f9-b87b-038713b2c9cc,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c/volume-bdbf4fce-d8cb-41ac-80b8-e3362f499765.3277a254-00fe-4351-b553-6a84e2934125 1G" returned: 0 in 0.380s {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 15:05:13 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [None req-624aabe5-2559-4bb3-8272-6bef1daa77c5 tempest-SnapshotsActionsTest-1728937745 None] Running cmd (subprocess): qemu-img rebase -u -b volume-bdbf4fce-d8cb-41ac-80b8-e3362f499765.042f993b-d8e8-49f9-b87b-038713b2c9cc -F qcow2 /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c/volume-bdbf4fce-d8cb-41ac-80b8-e3362f499765.3277a254-00fe-4351-b553-6a84e2934125 {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 15:05:13 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [None req-624aabe5-2559-4bb3-8272-6bef1daa77c5 tempest-SnapshotsActionsTest-1728937745 None] CMD "qemu-img rebase -u -b volume-bdbf4fce-d8cb-41ac-80b8-e3362f499765.042f993b-d8e8-49f9-b87b-038713b2c9cc -F qcow2 /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c/volume-bdbf4fce-d8cb-41ac-80b8-e3362f499765.3277a254-00fe-4351-b553-6a84e2934125" returned: 0 in 0.212s {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 15:05:13 devstack cinder-volume[83259]: DEBUG cinder.volume.drivers.remotefs [None req-624aabe5-2559-4bb3-8272-6bef1daa77c5 tempest-SnapshotsActionsTest-1728937745 None] File path /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c/volume-bdbf4fce-d8cb-41ac-80b8-e3362f499765.3277a254-00fe-4351-b553-6a84e2934125 is being set with permissions: 660 {{(pid=83259) _set_rw_permissions /opt/stack/cinder/cinder/volume/drivers/remotefs.py:492}} Sep 16 15:05:13 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [None req-624aabe5-2559-4bb3-8272-6bef1daa77c5 tempest-SnapshotsActionsTest-1728937745 None] Running cmd (subprocess): chmod 660 /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c/volume-bdbf4fce-d8cb-41ac-80b8-e3362f499765.3277a254-00fe-4351-b553-6a84e2934125 {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 15:05:13 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [None req-624aabe5-2559-4bb3-8272-6bef1daa77c5 tempest-SnapshotsActionsTest-1728937745 None] CMD "chmod 660 /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c/volume-bdbf4fce-d8cb-41ac-80b8-e3362f499765.3277a254-00fe-4351-b553-6a84e2934125" returned: 0 in 0.146s {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 15:05:13 devstack cinder-volume[83259]: DEBUG cinder.volume.drivers.remotefs [None req-624aabe5-2559-4bb3-8272-6bef1daa77c5 tempest-SnapshotsActionsTest-1728937745 None] Setting permissions: /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c/volume-bdbf4fce-d8cb-41ac-80b8-e3362f499765.042f993b-d8e8-49f9-b87b-038713b2c9cc -> 1000:1000 {{(pid=83259) _do_create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1584}} Sep 16 15:05:13 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [None req-624aabe5-2559-4bb3-8272-6bef1daa77c5 tempest-SnapshotsActionsTest-1728937745 None] Running cmd (subprocess): chown --reference=/opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c/volume-bdbf4fce-d8cb-41ac-80b8-e3362f499765.042f993b-d8e8-49f9-b87b-038713b2c9cc /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c/volume-bdbf4fce-d8cb-41ac-80b8-e3362f499765.3277a254-00fe-4351-b553-6a84e2934125 {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 15:05:13 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [None req-624aabe5-2559-4bb3-8272-6bef1daa77c5 tempest-SnapshotsActionsTest-1728937745 None] CMD "chown --reference=/opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c/volume-bdbf4fce-d8cb-41ac-80b8-e3362f499765.042f993b-d8e8-49f9-b87b-038713b2c9cc /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c/volume-bdbf4fce-d8cb-41ac-80b8-e3362f499765.3277a254-00fe-4351-b553-6a84e2934125" returned: 0 in 0.177s {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 15:05:14 devstack cinder-volume[83259]: DEBUG oslo_concurrency.lockutils [None req-624aabe5-2559-4bb3-8272-6bef1daa77c5 tempest-SnapshotsActionsTest-1728937745 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.734s {{(pid=83259) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 16 15:05:14 devstack cinder-volume[83259]: INFO cinder.volume.manager [None req-624aabe5-2559-4bb3-8272-6bef1daa77c5 tempest-SnapshotsActionsTest-1728937745 None] Create snapshot completed successfully Sep 16 15:05:15 devstack cinder-volume[83259]: DEBUG cinder.coordination [None req-b0ff94d3-da27-4135-9744-33468159d684 tempest-SnapshotsActionsTest-937325462 None] Acquiring lock "cinder-3277a254-00fe-4351-b553-6a84e2934125-delete_snapshot" by "delete_snapshot" {{(pid=83259) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 16 15:05:15 devstack cinder-volume[83259]: DEBUG cinder.coordination [None req-b0ff94d3-da27-4135-9744-33468159d684 tempest-SnapshotsActionsTest-937325462 None] Lock "cinder-3277a254-00fe-4351-b553-6a84e2934125-delete_snapshot" acquired by "delete_snapshot" :: waited 0.083s {{(pid=83259) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 16 15:05:15 devstack cinder-volume[83259]: WARNING cinder.volume.volume_utils [None req-b0ff94d3-da27-4135-9744-33468159d684 tempest-SnapshotsActionsTest-937325462 None] Volume driver (QuobyteDriver 1.2) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 16 15:05:15 devstack cinder-volume[83259]: DEBUG cinder.coordination [None req-b0ff94d3-da27-4135-9744-33468159d684 tempest-SnapshotsActionsTest-937325462 None] Acquiring lock "cinder-quobyte-bdbf4fce-d8cb-41ac-80b8-e3362f499765" by "delete_snapshot" {{(pid=83259) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 16 15:05:15 devstack cinder-volume[83259]: DEBUG cinder.coordination [None req-b0ff94d3-da27-4135-9744-33468159d684 tempest-SnapshotsActionsTest-937325462 None] Lock "cinder-quobyte-bdbf4fce-d8cb-41ac-80b8-e3362f499765" acquired by "delete_snapshot" :: waited 0.019s {{(pid=83259) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 16 15:05:15 devstack cinder-volume[83259]: DEBUG cinder.coordination [None req-b0ff94d3-da27-4135-9744-33468159d684 tempest-SnapshotsActionsTest-937325462 None] Acquiring lock "cinder-quobyte-3277a254-00fe-4351-b553-6a84e2934125" by "_delete_snapshot" {{(pid=83259) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 16 15:05:16 devstack cinder-volume[83259]: DEBUG cinder.coordination [None req-b0ff94d3-da27-4135-9744-33468159d684 tempest-SnapshotsActionsTest-937325462 None] Lock "cinder-quobyte-3277a254-00fe-4351-b553-6a84e2934125" acquired by "_delete_snapshot" :: waited 0.017s {{(pid=83259) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 16 15:05:16 devstack cinder-volume[83259]: DEBUG cinder.volume.drivers.remotefs [None req-b0ff94d3-da27-4135-9744-33468159d684 tempest-SnapshotsActionsTest-937325462 None] Deleting offline snapshot 3277a254-00fe-4351-b553-6a84e2934125 of volume bdbf4fce-d8cb-41ac-80b8-e3362f499765 {{(pid=83259) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1278}} Sep 16 15:05:16 devstack cinder-volume[83259]: DEBUG cinder.volume.drivers.remotefs [None req-b0ff94d3-da27-4135-9744-33468159d684 tempest-SnapshotsActionsTest-937325462 None] snapshot_file for this snap is: volume-bdbf4fce-d8cb-41ac-80b8-e3362f499765.3277a254-00fe-4351-b553-6a84e2934125 {{(pid=83259) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1307}} Sep 16 15:05:16 devstack cinder-volume[83259]: DEBUG oslo.privsep.daemon [-] privsep: reply[e1b85ec3-dcb3-419c-9ca2-f70e604bf975]: (4, 'qcow2') {{(pid=84312) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 16 15:05:16 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [None req-b0ff94d3-da27-4135-9744-33468159d684 tempest-SnapshotsActionsTest-937325462 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c/volume-bdbf4fce-d8cb-41ac-80b8-e3362f499765.3277a254-00fe-4351-b553-6a84e2934125 {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 15:05:17 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [None req-b0ff94d3-da27-4135-9744-33468159d684 tempest-SnapshotsActionsTest-937325462 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c/volume-bdbf4fce-d8cb-41ac-80b8-e3362f499765.3277a254-00fe-4351-b553-6a84e2934125" returned: 0 in 0.868s {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 15:05:17 devstack cinder-volume[83259]: DEBUG cinder.volume.drivers.remotefs [None req-b0ff94d3-da27-4135-9744-33468159d684 tempest-SnapshotsActionsTest-937325462 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-bdbf4fce-d8cb-41ac-80b8-e3362f499765(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83259) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:886}} Sep 16 15:05:17 devstack cinder-volume[83259]: DEBUG oslo.privsep.daemon [-] privsep: reply[fdacc24b-e153-4a80-957b-a81ed0f54403]: (4, 'qcow2') {{(pid=84312) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 16 15:05:17 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [None req-b0ff94d3-da27-4135-9744-33468159d684 tempest-SnapshotsActionsTest-937325462 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c/volume-bdbf4fce-d8cb-41ac-80b8-e3362f499765.042f993b-d8e8-49f9-b87b-038713b2c9cc {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 15:05:17 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [None req-b0ff94d3-da27-4135-9744-33468159d684 tempest-SnapshotsActionsTest-937325462 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c/volume-bdbf4fce-d8cb-41ac-80b8-e3362f499765.042f993b-d8e8-49f9-b87b-038713b2c9cc" returned: 0 in 0.659s {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 15:05:17 devstack cinder-volume[83259]: DEBUG cinder.volume.drivers.remotefs [None req-b0ff94d3-da27-4135-9744-33468159d684 tempest-SnapshotsActionsTest-937325462 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-bdbf4fce-d8cb-41ac-80b8-e3362f499765(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83259) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:886}} Sep 16 15:05:17 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [None req-b0ff94d3-da27-4135-9744-33468159d684 tempest-SnapshotsActionsTest-937325462 None] Running cmd (subprocess): qemu-img commit -d /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c/volume-bdbf4fce-d8cb-41ac-80b8-e3362f499765.3277a254-00fe-4351-b553-6a84e2934125 {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 15:05:18 devstack quobyte-client[83286]: System call of process 93468 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 16 15:05:18 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [None req-b0ff94d3-da27-4135-9744-33468159d684 tempest-SnapshotsActionsTest-937325462 None] CMD "qemu-img commit -d /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c/volume-bdbf4fce-d8cb-41ac-80b8-e3362f499765.3277a254-00fe-4351-b553-6a84e2934125" returned: 0 in 0.347s {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 15:05:18 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [None req-b0ff94d3-da27-4135-9744-33468159d684 tempest-SnapshotsActionsTest-937325462 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c/volume-bdbf4fce-d8cb-41ac-80b8-e3362f499765.3277a254-00fe-4351-b553-6a84e2934125 {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 15:05:18 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [None req-b0ff94d3-da27-4135-9744-33468159d684 tempest-SnapshotsActionsTest-937325462 None] CMD "rm -f /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c/volume-bdbf4fce-d8cb-41ac-80b8-e3362f499765.3277a254-00fe-4351-b553-6a84e2934125" returned: 0 in 0.129s {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 15:05:18 devstack cinder-volume[83259]: DEBUG cinder.coordination [None req-b0ff94d3-da27-4135-9744-33468159d684 tempest-SnapshotsActionsTest-937325462 None] Lock "cinder-quobyte-3277a254-00fe-4351-b553-6a84e2934125" released by "_delete_snapshot" :: held 2.536s {{(pid=83259) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 16 15:05:18 devstack cinder-volume[83259]: DEBUG cinder.coordination [None req-b0ff94d3-da27-4135-9744-33468159d684 tempest-SnapshotsActionsTest-937325462 None] Lock "cinder-quobyte-bdbf4fce-d8cb-41ac-80b8-e3362f499765" released by "delete_snapshot" :: held 2.568s {{(pid=83259) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 16 15:05:19 devstack cinder-volume[83259]: DEBUG cinder.quota [None req-b0ff94d3-da27-4135-9744-33468159d684 tempest-SnapshotsActionsTest-937325462 None] Created reservations ['733348b9-14cb-4ffd-a078-e1c85693b105', '056d2644-da49-46e5-ae53-0b5cd4fe5cc5', '89fc7efd-0c7f-4a39-8dbd-4b2e73fe29f4', '0226a742-9c9f-417a-9f83-0b96db82837f'] {{(pid=83259) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 16 15:05:19 devstack cinder-volume[83259]: INFO cinder.volume.manager [None req-b0ff94d3-da27-4135-9744-33468159d684 tempest-SnapshotsActionsTest-937325462 None] Delete snapshot completed successfully. Sep 16 15:05:19 devstack cinder-volume[83259]: DEBUG cinder.coordination [None req-b0ff94d3-da27-4135-9744-33468159d684 tempest-SnapshotsActionsTest-937325462 None] Lock "cinder-3277a254-00fe-4351-b553-6a84e2934125-delete_snapshot" released by "delete_snapshot" :: held 3.399s {{(pid=83259) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 16 15:05:21 devstack cinder-volume[83259]: WARNING cinder.volume.volume_utils [None req-f1fb6ecf-674f-4ec0-a857-54f0214be21b tempest-SnapshotsActionsTest-1728937745 None] Volume driver (QuobyteDriver 1.2) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 16 15:05:21 devstack cinder-volume[83259]: DEBUG oslo_concurrency.lockutils [None req-f1fb6ecf-674f-4ec0-a857-54f0214be21b tempest-SnapshotsActionsTest-1728937745 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=83259) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 16 15:05:21 devstack cinder-volume[83259]: DEBUG oslo_concurrency.lockutils [None req-f1fb6ecf-674f-4ec0-a857-54f0214be21b tempest-SnapshotsActionsTest-1728937745 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.002s {{(pid=83259) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 16 15:05:21 devstack cinder-volume[83259]: DEBUG cinder.volume.drivers.remotefs [None req-f1fb6ecf-674f-4ec0-a857-54f0214be21b tempest-SnapshotsActionsTest-1728937745 None] Creating offline snapshot efa111b9-64ab-4e2a-837d-0e13481aa227 of volume bdbf4fce-d8cb-41ac-80b8-e3362f499765 {{(pid=83259) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1694}} Sep 16 15:05:21 devstack cinder-volume[83259]: DEBUG oslo.privsep.daemon [-] privsep: reply[94854c6c-0923-4f6f-b51e-e55b9698a6fe]: (4, 'qcow2') {{(pid=84312) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 16 15:05:21 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [None req-f1fb6ecf-674f-4ec0-a857-54f0214be21b tempest-SnapshotsActionsTest-1728937745 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c/volume-bdbf4fce-d8cb-41ac-80b8-e3362f499765.042f993b-d8e8-49f9-b87b-038713b2c9cc {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 15:05:22 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [None req-f1fb6ecf-674f-4ec0-a857-54f0214be21b tempest-SnapshotsActionsTest-1728937745 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c/volume-bdbf4fce-d8cb-41ac-80b8-e3362f499765.042f993b-d8e8-49f9-b87b-038713b2c9cc" returned: 0 in 0.420s {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 15:05:22 devstack cinder-volume[83259]: DEBUG cinder.volume.drivers.remotefs [None req-f1fb6ecf-674f-4ec0-a857-54f0214be21b tempest-SnapshotsActionsTest-1728937745 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-bdbf4fce-d8cb-41ac-80b8-e3362f499765(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83259) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:886}} Sep 16 15:05:22 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [None req-f1fb6ecf-674f-4ec0-a857-54f0214be21b tempest-SnapshotsActionsTest-1728937745 None] Running cmd (subprocess): qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c/volume-bdbf4fce-d8cb-41ac-80b8-e3362f499765.042f993b-d8e8-49f9-b87b-038713b2c9cc,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c/volume-bdbf4fce-d8cb-41ac-80b8-e3362f499765.efa111b9-64ab-4e2a-837d-0e13481aa227 1G {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 15:05:22 devstack quobyte-client[83286]: System call of process 93481 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 16 15:05:22 devstack quobyte-client[83286]: The server volume:87712ffe-8a69-446d-9ed6-4430c7ee9792@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=87712ffe-8a69-446d-9ed6-4430c7ee9792, inode=61, name=volume-bdbf4fce-d8cb-41ac-80b8-e3362f499765.efa111b9-64ab-4e2a-837d-0e13481aa227, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.206), requestorAccessMask=0 Sep 16 15:05:22 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [None req-f1fb6ecf-674f-4ec0-a857-54f0214be21b tempest-SnapshotsActionsTest-1728937745 None] CMD "qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c/volume-bdbf4fce-d8cb-41ac-80b8-e3362f499765.042f993b-d8e8-49f9-b87b-038713b2c9cc,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c/volume-bdbf4fce-d8cb-41ac-80b8-e3362f499765.efa111b9-64ab-4e2a-837d-0e13481aa227 1G" returned: 0 in 0.304s {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 15:05:22 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [None req-f1fb6ecf-674f-4ec0-a857-54f0214be21b tempest-SnapshotsActionsTest-1728937745 None] Running cmd (subprocess): qemu-img rebase -u -b volume-bdbf4fce-d8cb-41ac-80b8-e3362f499765.042f993b-d8e8-49f9-b87b-038713b2c9cc -F qcow2 /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c/volume-bdbf4fce-d8cb-41ac-80b8-e3362f499765.efa111b9-64ab-4e2a-837d-0e13481aa227 {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 15:05:22 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [None req-f1fb6ecf-674f-4ec0-a857-54f0214be21b tempest-SnapshotsActionsTest-1728937745 None] CMD "qemu-img rebase -u -b volume-bdbf4fce-d8cb-41ac-80b8-e3362f499765.042f993b-d8e8-49f9-b87b-038713b2c9cc -F qcow2 /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c/volume-bdbf4fce-d8cb-41ac-80b8-e3362f499765.efa111b9-64ab-4e2a-837d-0e13481aa227" returned: 0 in 0.170s {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 15:05:22 devstack cinder-volume[83259]: DEBUG cinder.volume.drivers.remotefs [None req-f1fb6ecf-674f-4ec0-a857-54f0214be21b tempest-SnapshotsActionsTest-1728937745 None] File path /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c/volume-bdbf4fce-d8cb-41ac-80b8-e3362f499765.efa111b9-64ab-4e2a-837d-0e13481aa227 is being set with permissions: 660 {{(pid=83259) _set_rw_permissions /opt/stack/cinder/cinder/volume/drivers/remotefs.py:492}} Sep 16 15:05:22 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [None req-f1fb6ecf-674f-4ec0-a857-54f0214be21b tempest-SnapshotsActionsTest-1728937745 None] Running cmd (subprocess): chmod 660 /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c/volume-bdbf4fce-d8cb-41ac-80b8-e3362f499765.efa111b9-64ab-4e2a-837d-0e13481aa227 {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 15:05:23 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [None req-f1fb6ecf-674f-4ec0-a857-54f0214be21b tempest-SnapshotsActionsTest-1728937745 None] CMD "chmod 660 /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c/volume-bdbf4fce-d8cb-41ac-80b8-e3362f499765.efa111b9-64ab-4e2a-837d-0e13481aa227" returned: 0 in 0.171s {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 15:05:23 devstack cinder-volume[83259]: DEBUG cinder.volume.drivers.remotefs [None req-f1fb6ecf-674f-4ec0-a857-54f0214be21b tempest-SnapshotsActionsTest-1728937745 None] Setting permissions: /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c/volume-bdbf4fce-d8cb-41ac-80b8-e3362f499765.042f993b-d8e8-49f9-b87b-038713b2c9cc -> 1000:1000 {{(pid=83259) _do_create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1584}} Sep 16 15:05:23 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [None req-f1fb6ecf-674f-4ec0-a857-54f0214be21b tempest-SnapshotsActionsTest-1728937745 None] Running cmd (subprocess): chown --reference=/opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c/volume-bdbf4fce-d8cb-41ac-80b8-e3362f499765.042f993b-d8e8-49f9-b87b-038713b2c9cc /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c/volume-bdbf4fce-d8cb-41ac-80b8-e3362f499765.efa111b9-64ab-4e2a-837d-0e13481aa227 {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 15:05:23 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [None req-f1fb6ecf-674f-4ec0-a857-54f0214be21b tempest-SnapshotsActionsTest-1728937745 None] CMD "chown --reference=/opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c/volume-bdbf4fce-d8cb-41ac-80b8-e3362f499765.042f993b-d8e8-49f9-b87b-038713b2c9cc /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c/volume-bdbf4fce-d8cb-41ac-80b8-e3362f499765.efa111b9-64ab-4e2a-837d-0e13481aa227" returned: 0 in 0.148s {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 15:05:23 devstack cinder-volume[83259]: DEBUG oslo_concurrency.lockutils [None req-f1fb6ecf-674f-4ec0-a857-54f0214be21b tempest-SnapshotsActionsTest-1728937745 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.606s {{(pid=83259) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 16 15:05:23 devstack cinder-volume[83259]: INFO cinder.volume.manager [None req-f1fb6ecf-674f-4ec0-a857-54f0214be21b tempest-SnapshotsActionsTest-1728937745 None] Create snapshot completed successfully Sep 16 15:05:24 devstack cinder-volume[83259]: DEBUG cinder.coordination [None req-5e6a4976-1f70-47fe-8197-b1bb4c588531 tempest-SnapshotsActionsTest-937325462 None] Acquiring lock "cinder-efa111b9-64ab-4e2a-837d-0e13481aa227-delete_snapshot" by "delete_snapshot" {{(pid=83259) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 16 15:05:25 devstack cinder-volume[83259]: DEBUG cinder.coordination [None req-5e6a4976-1f70-47fe-8197-b1bb4c588531 tempest-SnapshotsActionsTest-937325462 None] Lock "cinder-efa111b9-64ab-4e2a-837d-0e13481aa227-delete_snapshot" acquired by "delete_snapshot" :: waited 0.063s {{(pid=83259) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 16 15:05:25 devstack cinder-volume[83259]: WARNING cinder.volume.volume_utils [None req-5e6a4976-1f70-47fe-8197-b1bb4c588531 tempest-SnapshotsActionsTest-937325462 None] Volume driver (QuobyteDriver 1.2) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 16 15:05:25 devstack cinder-volume[83259]: DEBUG cinder.coordination [None req-5e6a4976-1f70-47fe-8197-b1bb4c588531 tempest-SnapshotsActionsTest-937325462 None] Acquiring lock "cinder-quobyte-bdbf4fce-d8cb-41ac-80b8-e3362f499765" by "delete_snapshot" {{(pid=83259) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 16 15:05:25 devstack cinder-volume[83259]: DEBUG cinder.coordination [None req-5e6a4976-1f70-47fe-8197-b1bb4c588531 tempest-SnapshotsActionsTest-937325462 None] Lock "cinder-quobyte-bdbf4fce-d8cb-41ac-80b8-e3362f499765" acquired by "delete_snapshot" :: waited 0.010s {{(pid=83259) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 16 15:05:25 devstack cinder-volume[83259]: DEBUG cinder.coordination [None req-5e6a4976-1f70-47fe-8197-b1bb4c588531 tempest-SnapshotsActionsTest-937325462 None] Acquiring lock "cinder-quobyte-efa111b9-64ab-4e2a-837d-0e13481aa227" by "_delete_snapshot" {{(pid=83259) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 16 15:05:25 devstack cinder-volume[83259]: DEBUG cinder.coordination [None req-5e6a4976-1f70-47fe-8197-b1bb4c588531 tempest-SnapshotsActionsTest-937325462 None] Lock "cinder-quobyte-efa111b9-64ab-4e2a-837d-0e13481aa227" acquired by "_delete_snapshot" :: waited 0.019s {{(pid=83259) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 16 15:05:25 devstack cinder-volume[83259]: DEBUG cinder.volume.drivers.remotefs [None req-5e6a4976-1f70-47fe-8197-b1bb4c588531 tempest-SnapshotsActionsTest-937325462 None] Deleting offline snapshot efa111b9-64ab-4e2a-837d-0e13481aa227 of volume bdbf4fce-d8cb-41ac-80b8-e3362f499765 {{(pid=83259) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1278}} Sep 16 15:05:25 devstack cinder-volume[83259]: DEBUG cinder.volume.drivers.remotefs [None req-5e6a4976-1f70-47fe-8197-b1bb4c588531 tempest-SnapshotsActionsTest-937325462 None] snapshot_file for this snap is: volume-bdbf4fce-d8cb-41ac-80b8-e3362f499765.efa111b9-64ab-4e2a-837d-0e13481aa227 {{(pid=83259) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1307}} Sep 16 15:05:25 devstack cinder-volume[83259]: DEBUG oslo.privsep.daemon [-] privsep: reply[5f7462d7-875d-4766-9a70-7c84b52a6fd4]: (4, 'qcow2') {{(pid=84312) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 16 15:05:25 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [None req-5e6a4976-1f70-47fe-8197-b1bb4c588531 tempest-SnapshotsActionsTest-937325462 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c/volume-bdbf4fce-d8cb-41ac-80b8-e3362f499765.efa111b9-64ab-4e2a-837d-0e13481aa227 {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 15:05:25 devstack quobyte-client[83286]: System call of process 93502 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 16 15:05:25 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [None req-5e6a4976-1f70-47fe-8197-b1bb4c588531 tempest-SnapshotsActionsTest-937325462 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c/volume-bdbf4fce-d8cb-41ac-80b8-e3362f499765.efa111b9-64ab-4e2a-837d-0e13481aa227" returned: 0 in 0.538s {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 15:05:25 devstack cinder-volume[83259]: DEBUG cinder.volume.drivers.remotefs [None req-5e6a4976-1f70-47fe-8197-b1bb4c588531 tempest-SnapshotsActionsTest-937325462 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-bdbf4fce-d8cb-41ac-80b8-e3362f499765(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83259) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:886}} Sep 16 15:05:25 devstack cinder-volume[83259]: DEBUG oslo.privsep.daemon [-] privsep: reply[e95151af-9cb2-4a3f-b7d9-955fd8bab7ac]: (4, 'qcow2') {{(pid=84312) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 16 15:05:25 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [None req-5e6a4976-1f70-47fe-8197-b1bb4c588531 tempest-SnapshotsActionsTest-937325462 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c/volume-bdbf4fce-d8cb-41ac-80b8-e3362f499765.042f993b-d8e8-49f9-b87b-038713b2c9cc {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 15:05:26 devstack quobyte-client[83286]: System call of process 93516 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 16 15:05:26 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [None req-5e6a4976-1f70-47fe-8197-b1bb4c588531 tempest-SnapshotsActionsTest-937325462 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c/volume-bdbf4fce-d8cb-41ac-80b8-e3362f499765.042f993b-d8e8-49f9-b87b-038713b2c9cc" returned: 0 in 1.109s {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 15:05:27 devstack cinder-volume[83259]: DEBUG cinder.volume.drivers.remotefs [None req-5e6a4976-1f70-47fe-8197-b1bb4c588531 tempest-SnapshotsActionsTest-937325462 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-bdbf4fce-d8cb-41ac-80b8-e3362f499765(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83259) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:886}} Sep 16 15:05:27 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [None req-5e6a4976-1f70-47fe-8197-b1bb4c588531 tempest-SnapshotsActionsTest-937325462 None] Running cmd (subprocess): qemu-img commit -d /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c/volume-bdbf4fce-d8cb-41ac-80b8-e3362f499765.efa111b9-64ab-4e2a-837d-0e13481aa227 {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 15:05:27 devstack quobyte-client[83286]: System call of process 93542 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 16 15:05:28 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [None req-5e6a4976-1f70-47fe-8197-b1bb4c588531 tempest-SnapshotsActionsTest-937325462 None] CMD "qemu-img commit -d /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c/volume-bdbf4fce-d8cb-41ac-80b8-e3362f499765.efa111b9-64ab-4e2a-837d-0e13481aa227" returned: 0 in 1.108s {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 15:05:28 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [None req-5e6a4976-1f70-47fe-8197-b1bb4c588531 tempest-SnapshotsActionsTest-937325462 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c/volume-bdbf4fce-d8cb-41ac-80b8-e3362f499765.efa111b9-64ab-4e2a-837d-0e13481aa227 {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 15:05:28 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [None req-5e6a4976-1f70-47fe-8197-b1bb4c588531 tempest-SnapshotsActionsTest-937325462 None] CMD "rm -f /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c/volume-bdbf4fce-d8cb-41ac-80b8-e3362f499765.efa111b9-64ab-4e2a-837d-0e13481aa227" returned: 0 in 0.244s {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 15:05:28 devstack cinder-volume[83259]: DEBUG cinder.coordination [None req-5e6a4976-1f70-47fe-8197-b1bb4c588531 tempest-SnapshotsActionsTest-937325462 None] Lock "cinder-quobyte-efa111b9-64ab-4e2a-837d-0e13481aa227" released by "_delete_snapshot" :: held 3.644s {{(pid=83259) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 16 15:05:28 devstack cinder-volume[83259]: DEBUG cinder.coordination [None req-5e6a4976-1f70-47fe-8197-b1bb4c588531 tempest-SnapshotsActionsTest-937325462 None] Lock "cinder-quobyte-bdbf4fce-d8cb-41ac-80b8-e3362f499765" released by "delete_snapshot" :: held 3.679s {{(pid=83259) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 16 15:05:29 devstack cinder-volume[83259]: DEBUG cinder.quota [None req-5e6a4976-1f70-47fe-8197-b1bb4c588531 tempest-SnapshotsActionsTest-937325462 None] Created reservations ['8b516511-7cb1-4ea1-af75-c681080a4cf1', '49b192fb-20f3-4735-9311-c262735be114', 'eef12ee6-d09f-405f-909d-4d1076b96613', 'c1e5681f-765a-4767-897c-0ece731b013c'] {{(pid=83259) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 16 15:05:29 devstack cinder-volume[83259]: INFO cinder.volume.manager [None req-5e6a4976-1f70-47fe-8197-b1bb4c588531 tempest-SnapshotsActionsTest-937325462 None] Delete snapshot completed successfully. Sep 16 15:05:29 devstack cinder-volume[83259]: DEBUG cinder.coordination [None req-5e6a4976-1f70-47fe-8197-b1bb4c588531 tempest-SnapshotsActionsTest-937325462 None] Lock "cinder-efa111b9-64ab-4e2a-837d-0e13481aa227-delete_snapshot" released by "delete_snapshot" :: held 4.868s {{(pid=83259) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 16 15:05:31 devstack cinder-volume[83259]: WARNING cinder.volume.volume_utils [None req-30b477e8-bc6d-4c00-9d64-21cfccbe246e tempest-SnapshotsActionsTest-1728937745 None] Volume driver (QuobyteDriver 1.2) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 16 15:05:31 devstack cinder-volume[83259]: DEBUG oslo_concurrency.lockutils [None req-30b477e8-bc6d-4c00-9d64-21cfccbe246e tempest-SnapshotsActionsTest-1728937745 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=83259) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 16 15:05:31 devstack cinder-volume[83259]: DEBUG oslo_concurrency.lockutils [None req-30b477e8-bc6d-4c00-9d64-21cfccbe246e tempest-SnapshotsActionsTest-1728937745 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.002s {{(pid=83259) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 16 15:05:31 devstack cinder-volume[83259]: DEBUG cinder.volume.drivers.remotefs [None req-30b477e8-bc6d-4c00-9d64-21cfccbe246e tempest-SnapshotsActionsTest-1728937745 None] Creating offline snapshot 0f9eeacc-32aa-4a98-a1a5-a792991db1ab of volume bdbf4fce-d8cb-41ac-80b8-e3362f499765 {{(pid=83259) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1694}} Sep 16 15:05:31 devstack cinder-volume[83259]: DEBUG oslo.privsep.daemon [-] privsep: reply[f7e2d547-940d-4fe1-b4c3-f4a43cfd3403]: (4, 'qcow2') {{(pid=84312) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 16 15:05:31 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [None req-30b477e8-bc6d-4c00-9d64-21cfccbe246e tempest-SnapshotsActionsTest-1728937745 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c/volume-bdbf4fce-d8cb-41ac-80b8-e3362f499765.042f993b-d8e8-49f9-b87b-038713b2c9cc {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 15:05:32 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [None req-30b477e8-bc6d-4c00-9d64-21cfccbe246e tempest-SnapshotsActionsTest-1728937745 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c/volume-bdbf4fce-d8cb-41ac-80b8-e3362f499765.042f993b-d8e8-49f9-b87b-038713b2c9cc" returned: 0 in 0.624s {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 15:05:32 devstack cinder-volume[83259]: DEBUG cinder.volume.drivers.remotefs [None req-30b477e8-bc6d-4c00-9d64-21cfccbe246e tempest-SnapshotsActionsTest-1728937745 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-bdbf4fce-d8cb-41ac-80b8-e3362f499765(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83259) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:886}} Sep 16 15:05:32 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [None req-30b477e8-bc6d-4c00-9d64-21cfccbe246e tempest-SnapshotsActionsTest-1728937745 None] Running cmd (subprocess): qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c/volume-bdbf4fce-d8cb-41ac-80b8-e3362f499765.042f993b-d8e8-49f9-b87b-038713b2c9cc,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c/volume-bdbf4fce-d8cb-41ac-80b8-e3362f499765.0f9eeacc-32aa-4a98-a1a5-a792991db1ab 1G {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 15:05:32 devstack quobyte-client[83286]: System call of process 93579 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 16 15:05:32 devstack quobyte-client[83286]: The server volume:87712ffe-8a69-446d-9ed6-4430c7ee9792@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=87712ffe-8a69-446d-9ed6-4430c7ee9792, inode=62, name=volume-bdbf4fce-d8cb-41ac-80b8-e3362f499765.0f9eeacc-32aa-4a98-a1a5-a792991db1ab, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.206), requestorAccessMask=0 Sep 16 15:05:32 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [None req-30b477e8-bc6d-4c00-9d64-21cfccbe246e tempest-SnapshotsActionsTest-1728937745 None] CMD "qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c/volume-bdbf4fce-d8cb-41ac-80b8-e3362f499765.042f993b-d8e8-49f9-b87b-038713b2c9cc,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c/volume-bdbf4fce-d8cb-41ac-80b8-e3362f499765.0f9eeacc-32aa-4a98-a1a5-a792991db1ab 1G" returned: 0 in 0.497s {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 15:05:32 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [None req-30b477e8-bc6d-4c00-9d64-21cfccbe246e tempest-SnapshotsActionsTest-1728937745 None] Running cmd (subprocess): qemu-img rebase -u -b volume-bdbf4fce-d8cb-41ac-80b8-e3362f499765.042f993b-d8e8-49f9-b87b-038713b2c9cc -F qcow2 /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c/volume-bdbf4fce-d8cb-41ac-80b8-e3362f499765.0f9eeacc-32aa-4a98-a1a5-a792991db1ab {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 15:05:33 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [None req-30b477e8-bc6d-4c00-9d64-21cfccbe246e tempest-SnapshotsActionsTest-1728937745 None] CMD "qemu-img rebase -u -b volume-bdbf4fce-d8cb-41ac-80b8-e3362f499765.042f993b-d8e8-49f9-b87b-038713b2c9cc -F qcow2 /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c/volume-bdbf4fce-d8cb-41ac-80b8-e3362f499765.0f9eeacc-32aa-4a98-a1a5-a792991db1ab" returned: 0 in 0.342s {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 15:05:33 devstack cinder-volume[83259]: DEBUG cinder.volume.drivers.remotefs [None req-30b477e8-bc6d-4c00-9d64-21cfccbe246e tempest-SnapshotsActionsTest-1728937745 None] File path /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c/volume-bdbf4fce-d8cb-41ac-80b8-e3362f499765.0f9eeacc-32aa-4a98-a1a5-a792991db1ab is being set with permissions: 660 {{(pid=83259) _set_rw_permissions /opt/stack/cinder/cinder/volume/drivers/remotefs.py:492}} Sep 16 15:05:33 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [None req-30b477e8-bc6d-4c00-9d64-21cfccbe246e tempest-SnapshotsActionsTest-1728937745 None] Running cmd (subprocess): chmod 660 /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c/volume-bdbf4fce-d8cb-41ac-80b8-e3362f499765.0f9eeacc-32aa-4a98-a1a5-a792991db1ab {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 15:05:33 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [None req-30b477e8-bc6d-4c00-9d64-21cfccbe246e tempest-SnapshotsActionsTest-1728937745 None] CMD "chmod 660 /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c/volume-bdbf4fce-d8cb-41ac-80b8-e3362f499765.0f9eeacc-32aa-4a98-a1a5-a792991db1ab" returned: 0 in 0.096s {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 15:05:33 devstack cinder-volume[83259]: DEBUG cinder.volume.drivers.remotefs [None req-30b477e8-bc6d-4c00-9d64-21cfccbe246e tempest-SnapshotsActionsTest-1728937745 None] Setting permissions: /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c/volume-bdbf4fce-d8cb-41ac-80b8-e3362f499765.042f993b-d8e8-49f9-b87b-038713b2c9cc -> 1000:1000 {{(pid=83259) _do_create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1584}} Sep 16 15:05:33 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [None req-30b477e8-bc6d-4c00-9d64-21cfccbe246e tempest-SnapshotsActionsTest-1728937745 None] Running cmd (subprocess): chown --reference=/opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c/volume-bdbf4fce-d8cb-41ac-80b8-e3362f499765.042f993b-d8e8-49f9-b87b-038713b2c9cc /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c/volume-bdbf4fce-d8cb-41ac-80b8-e3362f499765.0f9eeacc-32aa-4a98-a1a5-a792991db1ab {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 15:05:33 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [None req-30b477e8-bc6d-4c00-9d64-21cfccbe246e tempest-SnapshotsActionsTest-1728937745 None] CMD "chown --reference=/opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c/volume-bdbf4fce-d8cb-41ac-80b8-e3362f499765.042f993b-d8e8-49f9-b87b-038713b2c9cc /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c/volume-bdbf4fce-d8cb-41ac-80b8-e3362f499765.0f9eeacc-32aa-4a98-a1a5-a792991db1ab" returned: 0 in 0.088s {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 15:05:33 devstack cinder-volume[83259]: DEBUG oslo_concurrency.lockutils [None req-30b477e8-bc6d-4c00-9d64-21cfccbe246e tempest-SnapshotsActionsTest-1728937745 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.073s {{(pid=83259) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 16 15:05:33 devstack cinder-volume[83259]: INFO cinder.volume.manager [None req-30b477e8-bc6d-4c00-9d64-21cfccbe246e tempest-SnapshotsActionsTest-1728937745 None] Create snapshot completed successfully Sep 16 15:05:35 devstack cinder-volume[83259]: DEBUG cinder.coordination [None req-1b7548d4-e4ce-4a08-9d5e-ec89cf0e1d5e tempest-SnapshotsActionsTest-937325462 None] Acquiring lock "cinder-0f9eeacc-32aa-4a98-a1a5-a792991db1ab-delete_snapshot" by "delete_snapshot" {{(pid=83259) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 16 15:05:35 devstack cinder-volume[83259]: DEBUG cinder.coordination [None req-1b7548d4-e4ce-4a08-9d5e-ec89cf0e1d5e tempest-SnapshotsActionsTest-937325462 None] Lock "cinder-0f9eeacc-32aa-4a98-a1a5-a792991db1ab-delete_snapshot" acquired by "delete_snapshot" :: waited 0.201s {{(pid=83259) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 16 15:05:35 devstack cinder-volume[83259]: WARNING cinder.volume.volume_utils [None req-1b7548d4-e4ce-4a08-9d5e-ec89cf0e1d5e tempest-SnapshotsActionsTest-937325462 None] Volume driver (QuobyteDriver 1.2) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 16 15:05:35 devstack cinder-volume[83259]: DEBUG cinder.coordination [None req-1b7548d4-e4ce-4a08-9d5e-ec89cf0e1d5e tempest-SnapshotsActionsTest-937325462 None] Acquiring lock "cinder-quobyte-bdbf4fce-d8cb-41ac-80b8-e3362f499765" by "delete_snapshot" {{(pid=83259) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 16 15:05:35 devstack cinder-volume[83259]: DEBUG cinder.coordination [None req-1b7548d4-e4ce-4a08-9d5e-ec89cf0e1d5e tempest-SnapshotsActionsTest-937325462 None] Lock "cinder-quobyte-bdbf4fce-d8cb-41ac-80b8-e3362f499765" acquired by "delete_snapshot" :: waited 0.034s {{(pid=83259) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 16 15:05:35 devstack cinder-volume[83259]: DEBUG cinder.coordination [None req-1b7548d4-e4ce-4a08-9d5e-ec89cf0e1d5e tempest-SnapshotsActionsTest-937325462 None] Acquiring lock "cinder-quobyte-0f9eeacc-32aa-4a98-a1a5-a792991db1ab" by "_delete_snapshot" {{(pid=83259) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 16 15:05:35 devstack cinder-volume[83259]: DEBUG cinder.coordination [None req-1b7548d4-e4ce-4a08-9d5e-ec89cf0e1d5e tempest-SnapshotsActionsTest-937325462 None] Lock "cinder-quobyte-0f9eeacc-32aa-4a98-a1a5-a792991db1ab" acquired by "_delete_snapshot" :: waited 0.500s {{(pid=83259) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 16 15:05:35 devstack cinder-volume[83259]: DEBUG cinder.volume.drivers.remotefs [None req-1b7548d4-e4ce-4a08-9d5e-ec89cf0e1d5e tempest-SnapshotsActionsTest-937325462 None] Deleting offline snapshot 0f9eeacc-32aa-4a98-a1a5-a792991db1ab of volume bdbf4fce-d8cb-41ac-80b8-e3362f499765 {{(pid=83259) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1278}} Sep 16 15:05:35 devstack cinder-volume[83259]: DEBUG cinder.volume.drivers.remotefs [None req-1b7548d4-e4ce-4a08-9d5e-ec89cf0e1d5e tempest-SnapshotsActionsTest-937325462 None] snapshot_file for this snap is: volume-bdbf4fce-d8cb-41ac-80b8-e3362f499765.0f9eeacc-32aa-4a98-a1a5-a792991db1ab {{(pid=83259) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1307}} Sep 16 15:05:35 devstack cinder-volume[83259]: DEBUG oslo.privsep.daemon [-] privsep: reply[167701a4-dd3b-4140-bf56-9dcc88f164ba]: (4, 'qcow2') {{(pid=84312) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 16 15:05:35 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [None req-1b7548d4-e4ce-4a08-9d5e-ec89cf0e1d5e tempest-SnapshotsActionsTest-937325462 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c/volume-bdbf4fce-d8cb-41ac-80b8-e3362f499765.0f9eeacc-32aa-4a98-a1a5-a792991db1ab {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 15:05:36 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [None req-1b7548d4-e4ce-4a08-9d5e-ec89cf0e1d5e tempest-SnapshotsActionsTest-937325462 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c/volume-bdbf4fce-d8cb-41ac-80b8-e3362f499765.0f9eeacc-32aa-4a98-a1a5-a792991db1ab" returned: 0 in 0.721s {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 15:05:36 devstack cinder-volume[83259]: DEBUG cinder.volume.drivers.remotefs [None req-1b7548d4-e4ce-4a08-9d5e-ec89cf0e1d5e tempest-SnapshotsActionsTest-937325462 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-bdbf4fce-d8cb-41ac-80b8-e3362f499765(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83259) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:886}} Sep 16 15:05:36 devstack cinder-volume[83259]: DEBUG oslo.privsep.daemon [-] privsep: reply[005e7054-1b63-4eac-b010-9cc5c8246aa6]: (4, 'qcow2') {{(pid=84312) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 16 15:05:36 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [None req-1b7548d4-e4ce-4a08-9d5e-ec89cf0e1d5e tempest-SnapshotsActionsTest-937325462 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c/volume-bdbf4fce-d8cb-41ac-80b8-e3362f499765.042f993b-d8e8-49f9-b87b-038713b2c9cc {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 15:05:37 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [None req-1b7548d4-e4ce-4a08-9d5e-ec89cf0e1d5e tempest-SnapshotsActionsTest-937325462 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c/volume-bdbf4fce-d8cb-41ac-80b8-e3362f499765.042f993b-d8e8-49f9-b87b-038713b2c9cc" returned: 0 in 0.648s {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 15:05:37 devstack cinder-volume[83259]: DEBUG cinder.volume.drivers.remotefs [None req-1b7548d4-e4ce-4a08-9d5e-ec89cf0e1d5e tempest-SnapshotsActionsTest-937325462 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-bdbf4fce-d8cb-41ac-80b8-e3362f499765(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83259) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:886}} Sep 16 15:05:37 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [None req-1b7548d4-e4ce-4a08-9d5e-ec89cf0e1d5e tempest-SnapshotsActionsTest-937325462 None] Running cmd (subprocess): qemu-img commit -d /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c/volume-bdbf4fce-d8cb-41ac-80b8-e3362f499765.0f9eeacc-32aa-4a98-a1a5-a792991db1ab {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 15:05:37 devstack quobyte-client[83286]: System call of process 93598 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 16 15:05:38 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [None req-1b7548d4-e4ce-4a08-9d5e-ec89cf0e1d5e tempest-SnapshotsActionsTest-937325462 None] CMD "qemu-img commit -d /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c/volume-bdbf4fce-d8cb-41ac-80b8-e3362f499765.0f9eeacc-32aa-4a98-a1a5-a792991db1ab" returned: 0 in 0.529s {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 15:05:38 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [None req-1b7548d4-e4ce-4a08-9d5e-ec89cf0e1d5e tempest-SnapshotsActionsTest-937325462 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c/volume-bdbf4fce-d8cb-41ac-80b8-e3362f499765.0f9eeacc-32aa-4a98-a1a5-a792991db1ab {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 15:05:38 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [None req-1b7548d4-e4ce-4a08-9d5e-ec89cf0e1d5e tempest-SnapshotsActionsTest-937325462 None] CMD "rm -f /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c/volume-bdbf4fce-d8cb-41ac-80b8-e3362f499765.0f9eeacc-32aa-4a98-a1a5-a792991db1ab" returned: 0 in 0.382s {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 15:05:38 devstack cinder-volume[83259]: DEBUG cinder.coordination [None req-1b7548d4-e4ce-4a08-9d5e-ec89cf0e1d5e tempest-SnapshotsActionsTest-937325462 None] Lock "cinder-quobyte-0f9eeacc-32aa-4a98-a1a5-a792991db1ab" released by "_delete_snapshot" :: held 2.861s {{(pid=83259) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 16 15:05:38 devstack cinder-volume[83259]: DEBUG cinder.coordination [None req-1b7548d4-e4ce-4a08-9d5e-ec89cf0e1d5e tempest-SnapshotsActionsTest-937325462 None] Lock "cinder-quobyte-bdbf4fce-d8cb-41ac-80b8-e3362f499765" released by "delete_snapshot" :: held 3.379s {{(pid=83259) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 16 15:05:39 devstack cinder-volume[83259]: DEBUG cinder.quota [None req-1b7548d4-e4ce-4a08-9d5e-ec89cf0e1d5e tempest-SnapshotsActionsTest-937325462 None] Created reservations ['07778817-97e4-4f26-82b4-35923de6b62f', 'd4e08f83-8860-428f-a9a2-296244ce9e2d', '7ad45b73-df6e-4ea9-85fd-13888aee4029', '7e1e90f1-8b62-450d-b11d-9f3680f778d2'] {{(pid=83259) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 16 15:05:39 devstack cinder-volume[83259]: INFO cinder.volume.manager [None req-1b7548d4-e4ce-4a08-9d5e-ec89cf0e1d5e tempest-SnapshotsActionsTest-937325462 None] Delete snapshot completed successfully. Sep 16 15:05:39 devstack cinder-volume[83259]: DEBUG cinder.coordination [None req-1b7548d4-e4ce-4a08-9d5e-ec89cf0e1d5e tempest-SnapshotsActionsTest-937325462 None] Lock "cinder-0f9eeacc-32aa-4a98-a1a5-a792991db1ab-delete_snapshot" released by "delete_snapshot" :: held 4.189s {{(pid=83259) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 16 15:05:41 devstack cinder-volume[83259]: DEBUG cinder.coordination [None req-114a8088-256d-49d1-8581-67a32ea84d4b tempest-SnapshotsActionsTest-1728937745 None] Acquiring lock "cinder-042f993b-d8e8-49f9-b87b-038713b2c9cc-delete_snapshot" by "delete_snapshot" {{(pid=83259) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 16 15:05:41 devstack cinder-volume[83259]: DEBUG cinder.coordination [None req-114a8088-256d-49d1-8581-67a32ea84d4b tempest-SnapshotsActionsTest-1728937745 None] Lock "cinder-042f993b-d8e8-49f9-b87b-038713b2c9cc-delete_snapshot" acquired by "delete_snapshot" :: waited 0.035s {{(pid=83259) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 16 15:05:41 devstack cinder-volume[83259]: WARNING cinder.volume.volume_utils [None req-114a8088-256d-49d1-8581-67a32ea84d4b tempest-SnapshotsActionsTest-1728937745 None] Volume driver (QuobyteDriver 1.2) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 16 15:05:41 devstack cinder-volume[83259]: DEBUG cinder.coordination [None req-114a8088-256d-49d1-8581-67a32ea84d4b tempest-SnapshotsActionsTest-1728937745 None] Acquiring lock "cinder-quobyte-bdbf4fce-d8cb-41ac-80b8-e3362f499765" by "delete_snapshot" {{(pid=83259) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 16 15:05:41 devstack cinder-volume[83259]: DEBUG cinder.coordination [None req-114a8088-256d-49d1-8581-67a32ea84d4b tempest-SnapshotsActionsTest-1728937745 None] Lock "cinder-quobyte-bdbf4fce-d8cb-41ac-80b8-e3362f499765" acquired by "delete_snapshot" :: waited 0.014s {{(pid=83259) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 16 15:05:41 devstack cinder-volume[83259]: DEBUG cinder.coordination [None req-114a8088-256d-49d1-8581-67a32ea84d4b tempest-SnapshotsActionsTest-1728937745 None] Acquiring lock "cinder-quobyte-042f993b-d8e8-49f9-b87b-038713b2c9cc" by "_delete_snapshot" {{(pid=83259) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 16 15:05:41 devstack cinder-volume[83259]: DEBUG cinder.coordination [None req-114a8088-256d-49d1-8581-67a32ea84d4b tempest-SnapshotsActionsTest-1728937745 None] Lock "cinder-quobyte-042f993b-d8e8-49f9-b87b-038713b2c9cc" acquired by "_delete_snapshot" :: waited 0.013s {{(pid=83259) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 16 15:05:41 devstack cinder-volume[83259]: DEBUG cinder.volume.drivers.remotefs [None req-114a8088-256d-49d1-8581-67a32ea84d4b tempest-SnapshotsActionsTest-1728937745 None] Deleting offline snapshot 042f993b-d8e8-49f9-b87b-038713b2c9cc of volume bdbf4fce-d8cb-41ac-80b8-e3362f499765 {{(pid=83259) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1278}} Sep 16 15:05:41 devstack cinder-volume[83259]: DEBUG cinder.volume.drivers.remotefs [None req-114a8088-256d-49d1-8581-67a32ea84d4b tempest-SnapshotsActionsTest-1728937745 None] snapshot_file for this snap is: volume-bdbf4fce-d8cb-41ac-80b8-e3362f499765.042f993b-d8e8-49f9-b87b-038713b2c9cc {{(pid=83259) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1307}} Sep 16 15:05:41 devstack cinder-volume[83259]: DEBUG oslo.privsep.daemon [-] privsep: reply[2d841d47-7fbc-460a-89a8-4c7d78895bee]: (4, 'qcow2') {{(pid=84312) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 16 15:05:41 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [None req-114a8088-256d-49d1-8581-67a32ea84d4b tempest-SnapshotsActionsTest-1728937745 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c/volume-bdbf4fce-d8cb-41ac-80b8-e3362f499765.042f993b-d8e8-49f9-b87b-038713b2c9cc {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 15:05:42 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [None req-114a8088-256d-49d1-8581-67a32ea84d4b tempest-SnapshotsActionsTest-1728937745 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c/volume-bdbf4fce-d8cb-41ac-80b8-e3362f499765.042f993b-d8e8-49f9-b87b-038713b2c9cc" returned: 0 in 0.455s {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 15:05:42 devstack cinder-volume[83259]: DEBUG cinder.volume.drivers.remotefs [None req-114a8088-256d-49d1-8581-67a32ea84d4b tempest-SnapshotsActionsTest-1728937745 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-bdbf4fce-d8cb-41ac-80b8-e3362f499765(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83259) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:886}} Sep 16 15:05:42 devstack cinder-volume[83259]: DEBUG oslo.privsep.daemon [-] privsep: reply[d5a2ab3a-7f79-491c-be74-b01c4f4878a1]: (4, 'qcow2') {{(pid=84312) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 16 15:05:42 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [None req-114a8088-256d-49d1-8581-67a32ea84d4b tempest-SnapshotsActionsTest-1728937745 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c/volume-bdbf4fce-d8cb-41ac-80b8-e3362f499765 {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 15:05:42 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [None req-114a8088-256d-49d1-8581-67a32ea84d4b tempest-SnapshotsActionsTest-1728937745 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c/volume-bdbf4fce-d8cb-41ac-80b8-e3362f499765" returned: 0 in 0.556s {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 15:05:42 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [None req-114a8088-256d-49d1-8581-67a32ea84d4b tempest-SnapshotsActionsTest-1728937745 None] Running cmd (subprocess): qemu-img commit -d /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c/volume-bdbf4fce-d8cb-41ac-80b8-e3362f499765.042f993b-d8e8-49f9-b87b-038713b2c9cc {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 15:05:42 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [None req-114a8088-256d-49d1-8581-67a32ea84d4b tempest-SnapshotsActionsTest-1728937745 None] CMD "qemu-img commit -d /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c/volume-bdbf4fce-d8cb-41ac-80b8-e3362f499765.042f993b-d8e8-49f9-b87b-038713b2c9cc" returned: 0 in 0.245s {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 15:05:42 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [None req-114a8088-256d-49d1-8581-67a32ea84d4b tempest-SnapshotsActionsTest-1728937745 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c/volume-bdbf4fce-d8cb-41ac-80b8-e3362f499765.042f993b-d8e8-49f9-b87b-038713b2c9cc {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 15:05:43 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [None req-114a8088-256d-49d1-8581-67a32ea84d4b tempest-SnapshotsActionsTest-1728937745 None] CMD "rm -f /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c/volume-bdbf4fce-d8cb-41ac-80b8-e3362f499765.042f993b-d8e8-49f9-b87b-038713b2c9cc" returned: 0 in 0.120s {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 15:05:43 devstack cinder-volume[83259]: DEBUG cinder.coordination [None req-114a8088-256d-49d1-8581-67a32ea84d4b tempest-SnapshotsActionsTest-1728937745 None] Lock "cinder-quobyte-042f993b-d8e8-49f9-b87b-038713b2c9cc" released by "_delete_snapshot" :: held 1.807s {{(pid=83259) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 16 15:05:43 devstack cinder-volume[83259]: DEBUG cinder.coordination [None req-114a8088-256d-49d1-8581-67a32ea84d4b tempest-SnapshotsActionsTest-1728937745 None] Lock "cinder-quobyte-bdbf4fce-d8cb-41ac-80b8-e3362f499765" released by "delete_snapshot" :: held 1.855s {{(pid=83259) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 16 15:05:43 devstack cinder-volume[83259]: DEBUG cinder.quota [None req-114a8088-256d-49d1-8581-67a32ea84d4b tempest-SnapshotsActionsTest-1728937745 None] Created reservations ['18680153-8154-4cd9-84a3-89c77a8f1e75', 'f4b034e3-eb41-4734-bd0f-3cc4416ac0eb', '3614e192-7924-418e-8b2d-71da55f64877', '2a19aa77-5bb0-4b82-b224-6750129da67d'] {{(pid=83259) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 16 15:05:44 devstack cinder-volume[83259]: INFO cinder.volume.manager [None req-114a8088-256d-49d1-8581-67a32ea84d4b tempest-SnapshotsActionsTest-1728937745 None] Delete snapshot completed successfully. Sep 16 15:05:44 devstack cinder-volume[83259]: DEBUG cinder.coordination [None req-114a8088-256d-49d1-8581-67a32ea84d4b tempest-SnapshotsActionsTest-1728937745 None] Lock "cinder-042f993b-d8e8-49f9-b87b-038713b2c9cc-delete_snapshot" released by "delete_snapshot" :: held 2.645s {{(pid=83259) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 16 15:05:44 devstack cinder-volume[83259]: DEBUG cinder.coordination [None req-ffdbef28-3a99-4c8a-b2d3-44fbaf2a233d tempest-SnapshotsActionsTest-1728937745 None] Acquiring lock "cinder-bdbf4fce-d8cb-41ac-80b8-e3362f499765-delete_volume" by "delete_volume" {{(pid=83259) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 16 15:05:45 devstack cinder-volume[83259]: DEBUG cinder.coordination [None req-ffdbef28-3a99-4c8a-b2d3-44fbaf2a233d tempest-SnapshotsActionsTest-1728937745 None] Lock "cinder-bdbf4fce-d8cb-41ac-80b8-e3362f499765-delete_volume" acquired by "delete_volume" :: waited 0.076s {{(pid=83259) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 16 15:05:45 devstack cinder-volume[83259]: WARNING cinder.volume.volume_utils [None req-ffdbef28-3a99-4c8a-b2d3-44fbaf2a233d tempest-SnapshotsActionsTest-1728937745 None] Volume driver (QuobyteDriver 1.2) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 16 15:05:45 devstack cinder-volume[83259]: DEBUG cinder.coordination [None req-ffdbef28-3a99-4c8a-b2d3-44fbaf2a233d tempest-SnapshotsActionsTest-1728937745 None] Acquiring lock "cinder-quobyte-bdbf4fce-d8cb-41ac-80b8-e3362f499765" by "delete_volume" {{(pid=83259) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 16 15:05:45 devstack cinder-volume[83259]: DEBUG cinder.coordination [None req-ffdbef28-3a99-4c8a-b2d3-44fbaf2a233d tempest-SnapshotsActionsTest-1728937745 None] Lock "cinder-quobyte-bdbf4fce-d8cb-41ac-80b8-e3362f499765" acquired by "delete_volume" :: waited 0.015s {{(pid=83259) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 16 15:05:45 devstack cinder-volume[83259]: DEBUG oslo.privsep.daemon [-] privsep: reply[3fdca0c4-4b79-45e2-8131-d094fbd6223c]: (4, 'qcow2') {{(pid=84312) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 16 15:05:45 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [None req-ffdbef28-3a99-4c8a-b2d3-44fbaf2a233d tempest-SnapshotsActionsTest-1728937745 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c/volume-bdbf4fce-d8cb-41ac-80b8-e3362f499765 {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 15:05:45 devstack cinder-volume[83259]: DEBUG oslo_service.periodic_task [None req-050ec8a1-6ffd-499d-95ad-d548a84437e2 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=83259) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} Sep 16 15:05:45 devstack cinder-volume[83259]: DEBUG oslo_concurrency.lockutils [None req-050ec8a1-6ffd-499d-95ad-d548a84437e2 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83259) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 16 15:05:45 devstack cinder-volume[83259]: DEBUG oslo_concurrency.lockutils [None req-050ec8a1-6ffd-499d-95ad-d548a84437e2 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.006s {{(pid=83259) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 16 15:05:45 devstack cinder-volume[83259]: DEBUG cinder.volume.drivers.quobyte [None req-050ec8a1-6ffd-499d-95ad-d548a84437e2 None None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-61f585ac-f8e2-4d19-a890-7ebc2726cc72': None} {{(pid=83259) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:639}} Sep 16 15:05:45 devstack cinder-volume[83259]: DEBUG cinder.volume.drivers.quobyte [None req-050ec8a1-6ffd-499d-95ad-d548a84437e2 None None] Available shares ['10.10.41.181/cinder-vol-61f585ac-f8e2-4d19-a890-7ebc2726cc72'] {{(pid=83259) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:669}} Sep 16 15:05:45 devstack cinder-volume[83259]: DEBUG oslo_concurrency.lockutils [None req-050ec8a1-6ffd-499d-95ad-d548a84437e2 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.029s {{(pid=83259) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 16 15:05:45 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [None req-050ec8a1-6ffd-499d-95ad-d548a84437e2 None None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 15:05:45 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [None req-ffdbef28-3a99-4c8a-b2d3-44fbaf2a233d tempest-SnapshotsActionsTest-1728937745 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c/volume-bdbf4fce-d8cb-41ac-80b8-e3362f499765" returned: 0 in 0.698s {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 15:05:45 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [None req-ffdbef28-3a99-4c8a-b2d3-44fbaf2a233d tempest-SnapshotsActionsTest-1728937745 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c/volume-bdbf4fce-d8cb-41ac-80b8-e3362f499765 {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 15:05:46 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [None req-050ec8a1-6ffd-499d-95ad-d548a84437e2 None None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c" returned: 0 in 0.315s {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 15:05:46 devstack cinder-volume[83259]: DEBUG cinder.manager [None req-050ec8a1-6ffd-499d-95ad-d548a84437e2 None None] Notifying Schedulers of capabilities ... {{(pid=83259) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 16 15:05:46 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [None req-ffdbef28-3a99-4c8a-b2d3-44fbaf2a233d tempest-SnapshotsActionsTest-1728937745 None] CMD "rm -f /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c/volume-bdbf4fce-d8cb-41ac-80b8-e3362f499765" returned: 0 in 0.270s {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 15:05:46 devstack cinder-volume[83259]: DEBUG cinder.coordination [None req-ffdbef28-3a99-4c8a-b2d3-44fbaf2a233d tempest-SnapshotsActionsTest-1728937745 None] Lock "cinder-quobyte-bdbf4fce-d8cb-41ac-80b8-e3362f499765" released by "delete_volume" :: held 1.191s {{(pid=83259) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 16 15:05:46 devstack cinder-volume[83259]: DEBUG cinder.quota [None req-ffdbef28-3a99-4c8a-b2d3-44fbaf2a233d tempest-SnapshotsActionsTest-1728937745 None] Created reservations ['b23cf92a-11ed-4e8c-baae-0f45a649f394', '1c884060-3e7f-4564-99c3-89202a8a35f1', '575be543-7f8d-467a-8305-a76744b5d22e', '0580a7e8-3efa-4e6f-b039-869406273bee'] {{(pid=83259) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 16 15:05:46 devstack cinder-volume[83259]: DEBUG oslo_concurrency.lockutils [None req-ffdbef28-3a99-4c8a-b2d3-44fbaf2a233d tempest-SnapshotsActionsTest-1728937745 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83259) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 16 15:05:46 devstack cinder-volume[83259]: DEBUG oslo_concurrency.lockutils [None req-ffdbef28-3a99-4c8a-b2d3-44fbaf2a233d tempest-SnapshotsActionsTest-1728937745 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.005s {{(pid=83259) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 16 15:05:46 devstack cinder-volume[83259]: DEBUG cinder.volume.drivers.quobyte [None req-ffdbef28-3a99-4c8a-b2d3-44fbaf2a233d tempest-SnapshotsActionsTest-1728937745 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-61f585ac-f8e2-4d19-a890-7ebc2726cc72': None} {{(pid=83259) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:639}} Sep 16 15:05:46 devstack cinder-volume[83259]: DEBUG cinder.volume.drivers.quobyte [None req-ffdbef28-3a99-4c8a-b2d3-44fbaf2a233d tempest-SnapshotsActionsTest-1728937745 None] Available shares ['10.10.41.181/cinder-vol-61f585ac-f8e2-4d19-a890-7ebc2726cc72'] {{(pid=83259) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:669}} Sep 16 15:05:46 devstack cinder-volume[83259]: DEBUG oslo_concurrency.lockutils [None req-ffdbef28-3a99-4c8a-b2d3-44fbaf2a233d tempest-SnapshotsActionsTest-1728937745 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=83259) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 16 15:05:46 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [None req-ffdbef28-3a99-4c8a-b2d3-44fbaf2a233d tempest-SnapshotsActionsTest-1728937745 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 15:05:47 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [None req-ffdbef28-3a99-4c8a-b2d3-44fbaf2a233d tempest-SnapshotsActionsTest-1728937745 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c" returned: 0 in 0.122s {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 15:05:47 devstack cinder-volume[83259]: DEBUG cinder.manager [None req-ffdbef28-3a99-4c8a-b2d3-44fbaf2a233d tempest-SnapshotsActionsTest-1728937745 None] Notifying Schedulers of capabilities ... {{(pid=83259) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 16 15:05:47 devstack cinder-volume[83259]: INFO cinder.volume.manager [None req-ffdbef28-3a99-4c8a-b2d3-44fbaf2a233d tempest-SnapshotsActionsTest-1728937745 None] Deleted volume successfully. Sep 16 15:05:47 devstack cinder-volume[83259]: DEBUG cinder.coordination [None req-ffdbef28-3a99-4c8a-b2d3-44fbaf2a233d tempest-SnapshotsActionsTest-1728937745 None] Lock "cinder-bdbf4fce-d8cb-41ac-80b8-e3362f499765-delete_volume" released by "delete_volume" :: held 2.396s {{(pid=83259) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 16 15:05:56 devstack cinder-volume[83259]: DEBUG dbcounter [-] [83259] Writing DB stats cinder:UPDATE=35,cinder:SELECT=54,cinder:INSERT=22,cinder:DELETE=3 {{(pid=83259) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Sep 16 15:05:57 devstack cinder-volume[83259]: DEBUG dbcounter [-] [83259] Writing DB stats cinder:SELECT=56,cinder:UPDATE=86,cinder:INSERT=11,cinder:DELETE=4 {{(pid=83259) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Sep 16 15:06:05 devstack cinder-volume[83259]: WARNING cinder.volume.volume_utils [None req-77d19172-0d89-4ec4-8733-c68bc3a748da tempest-VolumeQuotasNegativeTestJSON-1572228644 None] Volume driver (QuobyteDriver 1.2) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 16 15:06:05 devstack cinder-volume[83259]: DEBUG cinder.volume.flows.manager.create_volume [None req-77d19172-0d89-4ec4-8733-c68bc3a748da tempest-VolumeQuotasNegativeTestJSON-1572228644 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#Quobyte'], 'hosts': ['devstack@QuobyteHD#Quobyte']} {{(pid=83259) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1387}} Sep 16 15:06:05 devstack cinder-volume[83259]: DEBUG cinder.volume.manager [None req-77d19172-0d89-4ec4-8733-c68bc3a748da tempest-VolumeQuotasNegativeTestJSON-1572228644 None] Flow 'volume_create_manager' (b3b8b3da-6dcf-4663-a28b-c60b3b2ca0b4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83259) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 16 15:06:05 devstack cinder-volume[83259]: DEBUG cinder.volume.manager [None req-77d19172-0d89-4ec4-8733-c68bc3a748da tempest-VolumeQuotasNegativeTestJSON-1572228644 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f22402e6-7042-4cfc-a628-d43d3ed8892b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83259) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 15:06:05 devstack cinder-volume[83259]: DEBUG cinder.volume.manager [None req-77d19172-0d89-4ec4-8733-c68bc3a748da tempest-VolumeQuotasNegativeTestJSON-1572228644 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f22402e6-7042-4cfc-a628-d43d3ed8892b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-16T13:06:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasNegativeTestJSON-Volume-711277973',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#Quobyte',id=06cd79f6-251d-4875-a4a0-abc7f21cefcb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e3bf2547696d4862a979187d135fbca6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-16T13:06:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-16T13:06:05Z,use_quota=True,user_id='de23561b0e154bcea134a7f41cf88b04',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(485ead50-3df8-4d76-8d34-a4db136c980a),volume_type_id=485ead50-3df8-4d76-8d34-a4db136c980a)' {{(pid=83259) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 15:06:05 devstack cinder-volume[83259]: DEBUG cinder.volume.manager [None req-77d19172-0d89-4ec4-8733-c68bc3a748da tempest-VolumeQuotasNegativeTestJSON-1572228644 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5fd386d4-3975-43fa-8f76-40d3d7f6f4b0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83259) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 15:06:05 devstack cinder-volume[83259]: DEBUG cinder.volume.manager [None req-77d19172-0d89-4ec4-8733-c68bc3a748da tempest-VolumeQuotasNegativeTestJSON-1572228644 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5fd386d4-3975-43fa-8f76-40d3d7f6f4b0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83259) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 15:06:05 devstack cinder-volume[83259]: DEBUG cinder.volume.manager [None req-77d19172-0d89-4ec4-8733-c68bc3a748da tempest-VolumeQuotasNegativeTestJSON-1572228644 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1cd34f5d-f140-42ca-9dad-a5949404f904) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83259) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 15:06:05 devstack cinder-volume[83259]: DEBUG cinder.volume.manager [None req-77d19172-0d89-4ec4-8733-c68bc3a748da tempest-VolumeQuotasNegativeTestJSON-1572228644 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1cd34f5d-f140-42ca-9dad-a5949404f904) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '06cd79f6-251d-4875-a4a0-abc7f21cefcb', 'volume_name': 'volume-06cd79f6-251d-4875-a4a0-abc7f21cefcb', 'volume_size': 1}' {{(pid=83259) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 15:06:05 devstack cinder-volume[83259]: DEBUG cinder.volume.manager [None req-77d19172-0d89-4ec4-8733-c68bc3a748da tempest-VolumeQuotasNegativeTestJSON-1572228644 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5ac81525-6ca3-4eca-9723-1f9990103e01) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83259) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 15:06:05 devstack cinder-volume[83259]: DEBUG cinder.volume.manager [None req-77d19172-0d89-4ec4-8733-c68bc3a748da tempest-VolumeQuotasNegativeTestJSON-1572228644 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5ac81525-6ca3-4eca-9723-1f9990103e01) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83259) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 15:06:05 devstack cinder-volume[83259]: DEBUG cinder.volume.manager [None req-77d19172-0d89-4ec4-8733-c68bc3a748da tempest-VolumeQuotasNegativeTestJSON-1572228644 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4bdcd22a-411c-4334-b145-bd2d074354c7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83259) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 15:06:05 devstack cinder-volume[83259]: INFO cinder.volume.flows.manager.create_volume [None req-77d19172-0d89-4ec4-8733-c68bc3a748da tempest-VolumeQuotasNegativeTestJSON-1572228644 None] Volume 06cd79f6-251d-4875-a4a0-abc7f21cefcb: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-06cd79f6-251d-4875-a4a0-abc7f21cefcb', 'volume_size': 1} Sep 16 15:06:05 devstack cinder-volume[83259]: DEBUG oslo_concurrency.lockutils [None req-77d19172-0d89-4ec4-8733-c68bc3a748da tempest-VolumeQuotasNegativeTestJSON-1572228644 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83259) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 16 15:06:05 devstack cinder-volume[83259]: DEBUG oslo_concurrency.lockutils [None req-77d19172-0d89-4ec4-8733-c68bc3a748da tempest-VolumeQuotasNegativeTestJSON-1572228644 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=83259) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 16 15:06:05 devstack cinder-volume[83259]: DEBUG cinder.volume.drivers.quobyte [None req-77d19172-0d89-4ec4-8733-c68bc3a748da tempest-VolumeQuotasNegativeTestJSON-1572228644 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-16T13:06:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasNegativeTestJSON-Volume-711277973',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#Quobyte',id=06cd79f6-251d-4875-a4a0-abc7f21cefcb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e3bf2547696d4862a979187d135fbca6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-16T13:06:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-16T13:06:05Z,use_quota=True,user_id='de23561b0e154bcea134a7f41cf88b04',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(485ead50-3df8-4d76-8d34-a4db136c980a),volume_type_id=485ead50-3df8-4d76-8d34-a4db136c980a)}" {{(pid=83259) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Sep 16 15:06:05 devstack cinder-volume[83259]: DEBUG cinder.volume.drivers.remotefs [None req-77d19172-0d89-4ec4-8733-c68bc3a748da tempest-VolumeQuotasNegativeTestJSON-1572228644 None] Creating volume 06cd79f6-251d-4875-a4a0-abc7f21cefcb {{(pid=83259) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}} Sep 16 15:06:05 devstack cinder-volume[83259]: DEBUG oslo_concurrency.lockutils [None req-77d19172-0d89-4ec4-8733-c68bc3a748da tempest-VolumeQuotasNegativeTestJSON-1572228644 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83259) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 16 15:06:05 devstack cinder-volume[83259]: DEBUG oslo_concurrency.lockutils [None req-77d19172-0d89-4ec4-8733-c68bc3a748da tempest-VolumeQuotasNegativeTestJSON-1572228644 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83259) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 16 15:06:05 devstack cinder-volume[83259]: DEBUG cinder.volume.drivers.quobyte [None req-77d19172-0d89-4ec4-8733-c68bc3a748da tempest-VolumeQuotasNegativeTestJSON-1572228644 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-61f585ac-f8e2-4d19-a890-7ebc2726cc72': None} {{(pid=83259) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:639}} Sep 16 15:06:05 devstack cinder-volume[83259]: DEBUG cinder.volume.drivers.quobyte [None req-77d19172-0d89-4ec4-8733-c68bc3a748da tempest-VolumeQuotasNegativeTestJSON-1572228644 None] Available shares ['10.10.41.181/cinder-vol-61f585ac-f8e2-4d19-a890-7ebc2726cc72'] {{(pid=83259) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:669}} Sep 16 15:06:05 devstack cinder-volume[83259]: DEBUG oslo_concurrency.lockutils [None req-77d19172-0d89-4ec4-8733-c68bc3a748da tempest-VolumeQuotasNegativeTestJSON-1572228644 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=83259) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 16 15:06:05 devstack cinder-volume[83259]: DEBUG cinder.volume.drivers.quobyte [None req-77d19172-0d89-4ec4-8733-c68bc3a748da tempest-VolumeQuotasNegativeTestJSON-1572228644 None] Selected 10.10.41.181/cinder-vol-61f585ac-f8e2-4d19-a890-7ebc2726cc72 as target Quobyte volume. {{(pid=83259) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:690}} Sep 16 15:06:05 devstack cinder-volume[83259]: INFO cinder.volume.drivers.remotefs [None req-77d19172-0d89-4ec4-8733-c68bc3a748da tempest-VolumeQuotasNegativeTestJSON-1572228644 None] casted to 10.10.41.181/cinder-vol-61f585ac-f8e2-4d19-a890-7ebc2726cc72 Sep 16 15:06:05 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [None req-77d19172-0d89-4ec4-8733-c68bc3a748da tempest-VolumeQuotasNegativeTestJSON-1572228644 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c/volume-06cd79f6-251d-4875-a4a0-abc7f21cefcb 1073741824 {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 15:06:05 devstack quobyte-client[83286]: The server volume:87712ffe-8a69-446d-9ed6-4430c7ee9792@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=87712ffe-8a69-446d-9ed6-4430c7ee9792, inode=63, name=volume-06cd79f6-251d-4875-a4a0-abc7f21cefcb, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.206), requestorAccessMask=0 Sep 16 15:06:05 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [None req-77d19172-0d89-4ec4-8733-c68bc3a748da tempest-VolumeQuotasNegativeTestJSON-1572228644 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c/volume-06cd79f6-251d-4875-a4a0-abc7f21cefcb 1073741824" returned: 0 in 0.501s {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 15:06:05 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [None req-77d19172-0d89-4ec4-8733-c68bc3a748da tempest-VolumeQuotasNegativeTestJSON-1572228644 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c/volume-06cd79f6-251d-4875-a4a0-abc7f21cefcb {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 15:06:06 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [None req-77d19172-0d89-4ec4-8733-c68bc3a748da tempest-VolumeQuotasNegativeTestJSON-1572228644 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c/volume-06cd79f6-251d-4875-a4a0-abc7f21cefcb" returned: 0 in 0.430s {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 15:06:06 devstack cinder-volume[83259]: DEBUG cinder.volume.drivers.quobyte [None req-77d19172-0d89-4ec4-8733-c68bc3a748da tempest-VolumeQuotasNegativeTestJSON-1572228644 None] <== create_volume: return (1002ms) {'provider_location': '10.10.41.181/cinder-vol-61f585ac-f8e2-4d19-a890-7ebc2726cc72'} {{(pid=83259) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Sep 16 15:06:06 devstack cinder-volume[83259]: DEBUG oslo_concurrency.lockutils [None req-77d19172-0d89-4ec4-8733-c68bc3a748da tempest-VolumeQuotasNegativeTestJSON-1572228644 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.010s {{(pid=83259) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 16 15:06:06 devstack cinder-volume[83259]: WARNING cinder.volume.volume_utils [None req-ea86a059-934e-4ae9-9d4d-6a0566292f25 tempest-VolumeQuotasAdminTestJSON-1056022608 None] Volume driver (QuobyteDriver 1.2) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 16 15:06:06 devstack cinder-volume[83259]: DEBUG cinder.volume.flows.manager.create_volume [None req-ea86a059-934e-4ae9-9d4d-6a0566292f25 tempest-VolumeQuotasAdminTestJSON-1056022608 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#Quobyte'], 'hosts': ['devstack@QuobyteHD#Quobyte']} {{(pid=83259) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1387}} Sep 16 15:06:06 devstack cinder-volume[83259]: DEBUG cinder.volume.manager [None req-ea86a059-934e-4ae9-9d4d-6a0566292f25 tempest-VolumeQuotasAdminTestJSON-1056022608 None] Flow 'volume_create_manager' (5c098620-b275-41ac-b343-aa616cf1d9ee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83259) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 16 15:06:06 devstack cinder-volume[83259]: DEBUG cinder.volume.manager [None req-ea86a059-934e-4ae9-9d4d-6a0566292f25 tempest-VolumeQuotasAdminTestJSON-1056022608 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (25c4e741-381a-4810-a35b-a7dec01f0bf6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83259) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 15:06:06 devstack cinder-volume[83259]: DEBUG cinder.volume.manager [None req-77d19172-0d89-4ec4-8733-c68bc3a748da tempest-VolumeQuotasNegativeTestJSON-1572228644 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4bdcd22a-411c-4334-b145-bd2d074354c7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-06cd79f6-251d-4875-a4a0-abc7f21cefcb', 'volume_size': 1}' {{(pid=83259) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 15:06:06 devstack cinder-volume[83259]: DEBUG cinder.volume.manager [None req-77d19172-0d89-4ec4-8733-c68bc3a748da tempest-VolumeQuotasNegativeTestJSON-1572228644 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bed704ab-fe0f-4b08-872b-a7e90586c212) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83259) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 15:06:06 devstack cinder-volume[83259]: DEBUG cinder.volume.manager [None req-ea86a059-934e-4ae9-9d4d-6a0566292f25 tempest-VolumeQuotasAdminTestJSON-1056022608 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (25c4e741-381a-4810-a35b-a7dec01f0bf6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-16T13:06:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-1581883636',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#Quobyte',id=5434c27b-8b3b-495f-94b3-1cd0b213d480,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9f8a5076a9ce410c97f7b960ab8dd50f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-16T13:06:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-16T13:06:06Z,use_quota=True,user_id='e0b96f4576554c2d87e4832c1e7686cc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(485ead50-3df8-4d76-8d34-a4db136c980a),volume_type_id=485ead50-3df8-4d76-8d34-a4db136c980a)' {{(pid=83259) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 15:06:06 devstack cinder-volume[83259]: DEBUG cinder.volume.manager [None req-ea86a059-934e-4ae9-9d4d-6a0566292f25 tempest-VolumeQuotasAdminTestJSON-1056022608 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (de48e241-43e8-4b5d-8b21-c9e4ac802ba1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83259) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 15:06:06 devstack cinder-volume[83259]: DEBUG cinder.volume.manager [None req-ea86a059-934e-4ae9-9d4d-6a0566292f25 tempest-VolumeQuotasAdminTestJSON-1056022608 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (de48e241-43e8-4b5d-8b21-c9e4ac802ba1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83259) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 15:06:06 devstack cinder-volume[83259]: DEBUG cinder.volume.manager [None req-ea86a059-934e-4ae9-9d4d-6a0566292f25 tempest-VolumeQuotasAdminTestJSON-1056022608 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f6bee9dc-c24c-47be-8637-64b72ee3933a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83259) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 15:06:06 devstack cinder-volume[83259]: DEBUG cinder.volume.manager [None req-ea86a059-934e-4ae9-9d4d-6a0566292f25 tempest-VolumeQuotasAdminTestJSON-1056022608 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f6bee9dc-c24c-47be-8637-64b72ee3933a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5434c27b-8b3b-495f-94b3-1cd0b213d480', 'volume_name': 'volume-5434c27b-8b3b-495f-94b3-1cd0b213d480', 'volume_size': 1}' {{(pid=83259) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 15:06:06 devstack cinder-volume[83259]: DEBUG cinder.volume.manager [None req-ea86a059-934e-4ae9-9d4d-6a0566292f25 tempest-VolumeQuotasAdminTestJSON-1056022608 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d5ca007e-1b5d-4576-b7f4-38bf1888a45b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83259) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 15:06:06 devstack cinder-volume[83259]: DEBUG cinder.volume.manager [None req-ea86a059-934e-4ae9-9d4d-6a0566292f25 tempest-VolumeQuotasAdminTestJSON-1056022608 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d5ca007e-1b5d-4576-b7f4-38bf1888a45b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83259) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 15:06:06 devstack cinder-volume[83259]: DEBUG cinder.volume.manager [None req-ea86a059-934e-4ae9-9d4d-6a0566292f25 tempest-VolumeQuotasAdminTestJSON-1056022608 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b1056afd-08cd-404e-a3c1-26bf296a38f1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83259) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 15:06:06 devstack cinder-volume[83259]: INFO cinder.volume.flows.manager.create_volume [None req-ea86a059-934e-4ae9-9d4d-6a0566292f25 tempest-VolumeQuotasAdminTestJSON-1056022608 None] Volume 5434c27b-8b3b-495f-94b3-1cd0b213d480: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5434c27b-8b3b-495f-94b3-1cd0b213d480', 'volume_size': 1} Sep 16 15:06:06 devstack cinder-volume[83259]: DEBUG oslo_concurrency.lockutils [None req-ea86a059-934e-4ae9-9d4d-6a0566292f25 tempest-VolumeQuotasAdminTestJSON-1056022608 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83259) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 16 15:06:06 devstack cinder-volume[83259]: DEBUG oslo_concurrency.lockutils [None req-ea86a059-934e-4ae9-9d4d-6a0566292f25 tempest-VolumeQuotasAdminTestJSON-1056022608 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=83259) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 16 15:06:06 devstack cinder-volume[83259]: DEBUG cinder.volume.drivers.quobyte [None req-ea86a059-934e-4ae9-9d4d-6a0566292f25 tempest-VolumeQuotasAdminTestJSON-1056022608 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-16T13:06:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-1581883636',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#Quobyte',id=5434c27b-8b3b-495f-94b3-1cd0b213d480,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9f8a5076a9ce410c97f7b960ab8dd50f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-16T13:06:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-16T13:06:06Z,use_quota=True,user_id='e0b96f4576554c2d87e4832c1e7686cc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(485ead50-3df8-4d76-8d34-a4db136c980a),volume_type_id=485ead50-3df8-4d76-8d34-a4db136c980a)}" {{(pid=83259) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Sep 16 15:06:06 devstack cinder-volume[83259]: DEBUG cinder.volume.drivers.remotefs [None req-ea86a059-934e-4ae9-9d4d-6a0566292f25 tempest-VolumeQuotasAdminTestJSON-1056022608 None] Creating volume 5434c27b-8b3b-495f-94b3-1cd0b213d480 {{(pid=83259) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}} Sep 16 15:06:06 devstack cinder-volume[83259]: DEBUG oslo_concurrency.lockutils [None req-ea86a059-934e-4ae9-9d4d-6a0566292f25 tempest-VolumeQuotasAdminTestJSON-1056022608 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83259) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 16 15:06:06 devstack cinder-volume[83259]: DEBUG oslo_concurrency.lockutils [None req-ea86a059-934e-4ae9-9d4d-6a0566292f25 tempest-VolumeQuotasAdminTestJSON-1056022608 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83259) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 16 15:06:06 devstack cinder-volume[83259]: DEBUG cinder.volume.drivers.quobyte [None req-ea86a059-934e-4ae9-9d4d-6a0566292f25 tempest-VolumeQuotasAdminTestJSON-1056022608 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-61f585ac-f8e2-4d19-a890-7ebc2726cc72': None} {{(pid=83259) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:639}} Sep 16 15:06:06 devstack cinder-volume[83259]: DEBUG cinder.volume.drivers.quobyte [None req-ea86a059-934e-4ae9-9d4d-6a0566292f25 tempest-VolumeQuotasAdminTestJSON-1056022608 None] Available shares ['10.10.41.181/cinder-vol-61f585ac-f8e2-4d19-a890-7ebc2726cc72'] {{(pid=83259) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:669}} Sep 16 15:06:06 devstack cinder-volume[83259]: DEBUG oslo_concurrency.lockutils [None req-ea86a059-934e-4ae9-9d4d-6a0566292f25 tempest-VolumeQuotasAdminTestJSON-1056022608 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=83259) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 16 15:06:06 devstack cinder-volume[83259]: DEBUG cinder.volume.drivers.quobyte [None req-ea86a059-934e-4ae9-9d4d-6a0566292f25 tempest-VolumeQuotasAdminTestJSON-1056022608 None] Selected 10.10.41.181/cinder-vol-61f585ac-f8e2-4d19-a890-7ebc2726cc72 as target Quobyte volume. {{(pid=83259) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:690}} Sep 16 15:06:06 devstack cinder-volume[83259]: INFO cinder.volume.drivers.remotefs [None req-ea86a059-934e-4ae9-9d4d-6a0566292f25 tempest-VolumeQuotasAdminTestJSON-1056022608 None] casted to 10.10.41.181/cinder-vol-61f585ac-f8e2-4d19-a890-7ebc2726cc72 Sep 16 15:06:06 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [None req-ea86a059-934e-4ae9-9d4d-6a0566292f25 tempest-VolumeQuotasAdminTestJSON-1056022608 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c/volume-5434c27b-8b3b-495f-94b3-1cd0b213d480 1073741824 {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 15:06:06 devstack quobyte-client[83286]: System call of process 93676 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 16 15:06:06 devstack cinder-volume[83259]: INFO cinder.volume.flows.manager.create_volume [None req-77d19172-0d89-4ec4-8733-c68bc3a748da tempest-VolumeQuotasNegativeTestJSON-1572228644 None] Volume volume-06cd79f6-251d-4875-a4a0-abc7f21cefcb (06cd79f6-251d-4875-a4a0-abc7f21cefcb): created successfully Sep 16 15:06:06 devstack quobyte-client[83286]: The server volume:87712ffe-8a69-446d-9ed6-4430c7ee9792@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=87712ffe-8a69-446d-9ed6-4430c7ee9792, inode=64, name=volume-5434c27b-8b3b-495f-94b3-1cd0b213d480, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.206), requestorAccessMask=0 Sep 16 15:06:06 devstack cinder-volume[83259]: DEBUG cinder.volume.manager [None req-77d19172-0d89-4ec4-8733-c68bc3a748da tempest-VolumeQuotasNegativeTestJSON-1572228644 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bed704ab-fe0f-4b08-872b-a7e90586c212) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83259) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 15:06:06 devstack cinder-volume[83259]: DEBUG cinder.volume.manager [None req-77d19172-0d89-4ec4-8733-c68bc3a748da tempest-VolumeQuotasNegativeTestJSON-1572228644 None] Flow 'volume_create_manager' (b3b8b3da-6dcf-4663-a28b-c60b3b2ca0b4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83259) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 16 15:06:06 devstack cinder-volume[83259]: INFO cinder.volume.manager [None req-77d19172-0d89-4ec4-8733-c68bc3a748da tempest-VolumeQuotasNegativeTestJSON-1572228644 None] Created volume successfully. Sep 16 15:06:06 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [None req-ea86a059-934e-4ae9-9d4d-6a0566292f25 tempest-VolumeQuotasAdminTestJSON-1056022608 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c/volume-5434c27b-8b3b-495f-94b3-1cd0b213d480 1073741824" returned: 0 in 0.459s {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 15:06:07 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [None req-ea86a059-934e-4ae9-9d4d-6a0566292f25 tempest-VolumeQuotasAdminTestJSON-1056022608 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c/volume-5434c27b-8b3b-495f-94b3-1cd0b213d480 {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 15:06:07 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [None req-ea86a059-934e-4ae9-9d4d-6a0566292f25 tempest-VolumeQuotasAdminTestJSON-1056022608 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c/volume-5434c27b-8b3b-495f-94b3-1cd0b213d480" returned: 0 in 0.259s {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 15:06:07 devstack cinder-volume[83259]: DEBUG cinder.volume.drivers.quobyte [None req-ea86a059-934e-4ae9-9d4d-6a0566292f25 tempest-VolumeQuotasAdminTestJSON-1056022608 None] <== create_volume: return (785ms) {'provider_location': '10.10.41.181/cinder-vol-61f585ac-f8e2-4d19-a890-7ebc2726cc72'} {{(pid=83259) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Sep 16 15:06:07 devstack cinder-volume[83259]: DEBUG oslo_concurrency.lockutils [None req-ea86a059-934e-4ae9-9d4d-6a0566292f25 tempest-VolumeQuotasAdminTestJSON-1056022608 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.795s {{(pid=83259) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 16 15:06:07 devstack cinder-volume[83259]: DEBUG cinder.volume.manager [None req-ea86a059-934e-4ae9-9d4d-6a0566292f25 tempest-VolumeQuotasAdminTestJSON-1056022608 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b1056afd-08cd-404e-a3c1-26bf296a38f1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5434c27b-8b3b-495f-94b3-1cd0b213d480', 'volume_size': 1}' {{(pid=83259) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 15:06:07 devstack cinder-volume[83259]: DEBUG cinder.volume.manager [None req-ea86a059-934e-4ae9-9d4d-6a0566292f25 tempest-VolumeQuotasAdminTestJSON-1056022608 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9fda81ac-ef94-4e27-8bf0-4f0c1847b352) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83259) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 15:06:07 devstack cinder-volume[83259]: INFO cinder.volume.flows.manager.create_volume [None req-ea86a059-934e-4ae9-9d4d-6a0566292f25 tempest-VolumeQuotasAdminTestJSON-1056022608 None] Volume volume-5434c27b-8b3b-495f-94b3-1cd0b213d480 (5434c27b-8b3b-495f-94b3-1cd0b213d480): created successfully Sep 16 15:06:07 devstack cinder-volume[83259]: DEBUG cinder.volume.manager [None req-ea86a059-934e-4ae9-9d4d-6a0566292f25 tempest-VolumeQuotasAdminTestJSON-1056022608 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9fda81ac-ef94-4e27-8bf0-4f0c1847b352) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83259) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 15:06:07 devstack cinder-volume[83259]: DEBUG cinder.volume.manager [None req-ea86a059-934e-4ae9-9d4d-6a0566292f25 tempest-VolumeQuotasAdminTestJSON-1056022608 None] Flow 'volume_create_manager' (5c098620-b275-41ac-b343-aa616cf1d9ee) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83259) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 16 15:06:07 devstack cinder-volume[83259]: INFO cinder.volume.manager [None req-ea86a059-934e-4ae9-9d4d-6a0566292f25 tempest-VolumeQuotasAdminTestJSON-1056022608 None] Created volume successfully. Sep 16 15:06:08 devstack cinder-volume[83259]: DEBUG cinder.coordination [None req-45afbe52-d396-4558-9b43-e0222df87273 tempest-VolumeQuotasAdminTestJSON-1056022608 None] Acquiring lock "cinder-5434c27b-8b3b-495f-94b3-1cd0b213d480-delete_volume" by "delete_volume" {{(pid=83259) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 16 15:06:08 devstack cinder-volume[83259]: DEBUG cinder.coordination [None req-45afbe52-d396-4558-9b43-e0222df87273 tempest-VolumeQuotasAdminTestJSON-1056022608 None] Lock "cinder-5434c27b-8b3b-495f-94b3-1cd0b213d480-delete_volume" acquired by "delete_volume" :: waited 0.092s {{(pid=83259) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 16 15:06:08 devstack cinder-volume[83259]: WARNING cinder.volume.volume_utils [None req-45afbe52-d396-4558-9b43-e0222df87273 tempest-VolumeQuotasAdminTestJSON-1056022608 None] Volume driver (QuobyteDriver 1.2) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 16 15:06:08 devstack cinder-volume[83259]: DEBUG cinder.coordination [None req-45afbe52-d396-4558-9b43-e0222df87273 tempest-VolumeQuotasAdminTestJSON-1056022608 None] Acquiring lock "cinder-quobyte-5434c27b-8b3b-495f-94b3-1cd0b213d480" by "delete_volume" {{(pid=83259) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 16 15:06:08 devstack cinder-volume[83259]: DEBUG cinder.coordination [None req-45afbe52-d396-4558-9b43-e0222df87273 tempest-VolumeQuotasAdminTestJSON-1056022608 None] Lock "cinder-quobyte-5434c27b-8b3b-495f-94b3-1cd0b213d480" acquired by "delete_volume" :: waited 0.029s {{(pid=83259) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 16 15:06:08 devstack cinder-volume[83259]: DEBUG oslo.privsep.daemon [-] privsep: reply[1601fc30-7b06-4b75-bb4b-85648e085fb5]: (4, 'qcow2') {{(pid=84312) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 16 15:06:08 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [None req-45afbe52-d396-4558-9b43-e0222df87273 tempest-VolumeQuotasAdminTestJSON-1056022608 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c/volume-5434c27b-8b3b-495f-94b3-1cd0b213d480 {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 15:06:09 devstack cinder-volume[83259]: DEBUG cinder.coordination [None req-1023b6e3-aef6-4f6f-9fb4-e8511eeb8708 tempest-VolumeQuotasNegativeTestJSON-1572228644 None] Acquiring lock "cinder-06cd79f6-251d-4875-a4a0-abc7f21cefcb-delete_volume" by "delete_volume" {{(pid=83259) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 16 15:06:09 devstack cinder-volume[83259]: DEBUG cinder.coordination [None req-1023b6e3-aef6-4f6f-9fb4-e8511eeb8708 tempest-VolumeQuotasNegativeTestJSON-1572228644 None] Lock "cinder-06cd79f6-251d-4875-a4a0-abc7f21cefcb-delete_volume" acquired by "delete_volume" :: waited 0.123s {{(pid=83259) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 16 15:06:09 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [None req-45afbe52-d396-4558-9b43-e0222df87273 tempest-VolumeQuotasAdminTestJSON-1056022608 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c/volume-5434c27b-8b3b-495f-94b3-1cd0b213d480" returned: 0 in 0.850s {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 15:06:09 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [None req-45afbe52-d396-4558-9b43-e0222df87273 tempest-VolumeQuotasAdminTestJSON-1056022608 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c/volume-5434c27b-8b3b-495f-94b3-1cd0b213d480 {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 15:06:09 devstack cinder-volume[83259]: WARNING cinder.volume.volume_utils [None req-1023b6e3-aef6-4f6f-9fb4-e8511eeb8708 tempest-VolumeQuotasNegativeTestJSON-1572228644 None] Volume driver (QuobyteDriver 1.2) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 16 15:06:09 devstack cinder-volume[83259]: DEBUG cinder.coordination [None req-1023b6e3-aef6-4f6f-9fb4-e8511eeb8708 tempest-VolumeQuotasNegativeTestJSON-1572228644 None] Acquiring lock "cinder-quobyte-06cd79f6-251d-4875-a4a0-abc7f21cefcb" by "delete_volume" {{(pid=83259) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 16 15:06:09 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [None req-45afbe52-d396-4558-9b43-e0222df87273 tempest-VolumeQuotasAdminTestJSON-1056022608 None] CMD "rm -f /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c/volume-5434c27b-8b3b-495f-94b3-1cd0b213d480" returned: 0 in 0.430s {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 15:06:09 devstack cinder-volume[83259]: DEBUG cinder.coordination [None req-45afbe52-d396-4558-9b43-e0222df87273 tempest-VolumeQuotasAdminTestJSON-1056022608 None] Lock "cinder-quobyte-5434c27b-8b3b-495f-94b3-1cd0b213d480" released by "delete_volume" :: held 1.351s {{(pid=83259) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 16 15:06:09 devstack cinder-volume[83259]: DEBUG cinder.coordination [None req-1023b6e3-aef6-4f6f-9fb4-e8511eeb8708 tempest-VolumeQuotasNegativeTestJSON-1572228644 None] Lock "cinder-quobyte-06cd79f6-251d-4875-a4a0-abc7f21cefcb" acquired by "delete_volume" :: waited 0.085s {{(pid=83259) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 16 15:06:09 devstack cinder-volume[83259]: DEBUG oslo.privsep.daemon [-] privsep: reply[4e05f430-7ca4-4f45-9f63-6b4a7049e6d4]: (4, 'qcow2') {{(pid=84312) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 16 15:06:09 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [None req-1023b6e3-aef6-4f6f-9fb4-e8511eeb8708 tempest-VolumeQuotasNegativeTestJSON-1572228644 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c/volume-06cd79f6-251d-4875-a4a0-abc7f21cefcb {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 15:06:10 devstack cinder-volume[83259]: DEBUG cinder.quota [None req-45afbe52-d396-4558-9b43-e0222df87273 tempest-VolumeQuotasAdminTestJSON-1056022608 None] Created reservations ['8157dc85-2037-44eb-ba63-90cfaa58ef91', '684da78a-7a0a-4792-b037-cd8d1167e686', '45153274-b875-47a3-891b-17d401529977', '1317da9d-b53c-4d44-bc81-ed743e174074'] {{(pid=83259) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 16 15:06:10 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [None req-1023b6e3-aef6-4f6f-9fb4-e8511eeb8708 tempest-VolumeQuotasNegativeTestJSON-1572228644 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c/volume-06cd79f6-251d-4875-a4a0-abc7f21cefcb" returned: 0 in 0.643s {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 15:06:10 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [None req-1023b6e3-aef6-4f6f-9fb4-e8511eeb8708 tempest-VolumeQuotasNegativeTestJSON-1572228644 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c/volume-06cd79f6-251d-4875-a4a0-abc7f21cefcb {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 15:06:11 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [None req-1023b6e3-aef6-4f6f-9fb4-e8511eeb8708 tempest-VolumeQuotasNegativeTestJSON-1572228644 None] CMD "rm -f /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c/volume-06cd79f6-251d-4875-a4a0-abc7f21cefcb" returned: 0 in 0.340s {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 15:06:11 devstack cinder-volume[83259]: DEBUG cinder.coordination [None req-1023b6e3-aef6-4f6f-9fb4-e8511eeb8708 tempest-VolumeQuotasNegativeTestJSON-1572228644 None] Lock "cinder-quobyte-06cd79f6-251d-4875-a4a0-abc7f21cefcb" released by "delete_volume" :: held 1.107s {{(pid=83259) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 16 15:06:11 devstack cinder-volume[83259]: DEBUG oslo_concurrency.lockutils [None req-45afbe52-d396-4558-9b43-e0222df87273 tempest-VolumeQuotasAdminTestJSON-1056022608 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83259) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 16 15:06:11 devstack cinder-volume[83259]: DEBUG oslo_concurrency.lockutils [None req-45afbe52-d396-4558-9b43-e0222df87273 tempest-VolumeQuotasAdminTestJSON-1056022608 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=83259) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 16 15:06:11 devstack cinder-volume[83259]: DEBUG cinder.volume.drivers.quobyte [None req-45afbe52-d396-4558-9b43-e0222df87273 tempest-VolumeQuotasAdminTestJSON-1056022608 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-61f585ac-f8e2-4d19-a890-7ebc2726cc72': None} {{(pid=83259) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:639}} Sep 16 15:06:11 devstack cinder-volume[83259]: DEBUG cinder.volume.drivers.quobyte [None req-45afbe52-d396-4558-9b43-e0222df87273 tempest-VolumeQuotasAdminTestJSON-1056022608 None] Available shares ['10.10.41.181/cinder-vol-61f585ac-f8e2-4d19-a890-7ebc2726cc72'] {{(pid=83259) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:669}} Sep 16 15:06:11 devstack cinder-volume[83259]: DEBUG oslo_concurrency.lockutils [None req-45afbe52-d396-4558-9b43-e0222df87273 tempest-VolumeQuotasAdminTestJSON-1056022608 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=83259) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 16 15:06:11 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [None req-45afbe52-d396-4558-9b43-e0222df87273 tempest-VolumeQuotasAdminTestJSON-1056022608 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 15:06:11 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [None req-45afbe52-d396-4558-9b43-e0222df87273 tempest-VolumeQuotasAdminTestJSON-1056022608 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c" returned: 0 in 0.294s {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 15:06:11 devstack cinder-volume[83259]: DEBUG cinder.manager [None req-45afbe52-d396-4558-9b43-e0222df87273 tempest-VolumeQuotasAdminTestJSON-1056022608 None] Notifying Schedulers of capabilities ... {{(pid=83259) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 16 15:06:11 devstack cinder-volume[83259]: INFO cinder.volume.manager [None req-45afbe52-d396-4558-9b43-e0222df87273 tempest-VolumeQuotasAdminTestJSON-1056022608 None] Deleted volume successfully. Sep 16 15:06:11 devstack cinder-volume[83259]: DEBUG cinder.quota [None req-1023b6e3-aef6-4f6f-9fb4-e8511eeb8708 tempest-VolumeQuotasNegativeTestJSON-1572228644 None] Created reservations ['8567db62-bc69-4bd3-91bc-a754b1897f09', 'add1674d-499a-44ef-bb93-b9f01b474564', '51c23535-207b-4540-b63e-6498863bfbd7', 'a9c8d81d-b560-473c-811f-e6b886d6a836'] {{(pid=83259) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 16 15:06:11 devstack cinder-volume[83259]: DEBUG cinder.coordination [None req-45afbe52-d396-4558-9b43-e0222df87273 tempest-VolumeQuotasAdminTestJSON-1056022608 None] Lock "cinder-5434c27b-8b3b-495f-94b3-1cd0b213d480-delete_volume" released by "delete_volume" :: held 3.232s {{(pid=83259) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 16 15:06:11 devstack cinder-volume[83259]: DEBUG oslo_concurrency.lockutils [None req-1023b6e3-aef6-4f6f-9fb4-e8511eeb8708 tempest-VolumeQuotasNegativeTestJSON-1572228644 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83259) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 16 15:06:11 devstack cinder-volume[83259]: DEBUG oslo_concurrency.lockutils [None req-1023b6e3-aef6-4f6f-9fb4-e8511eeb8708 tempest-VolumeQuotasNegativeTestJSON-1572228644 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=83259) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 16 15:06:11 devstack cinder-volume[83259]: DEBUG cinder.volume.drivers.quobyte [None req-1023b6e3-aef6-4f6f-9fb4-e8511eeb8708 tempest-VolumeQuotasNegativeTestJSON-1572228644 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-61f585ac-f8e2-4d19-a890-7ebc2726cc72': None} {{(pid=83259) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:639}} Sep 16 15:06:11 devstack cinder-volume[83259]: DEBUG cinder.volume.drivers.quobyte [None req-1023b6e3-aef6-4f6f-9fb4-e8511eeb8708 tempest-VolumeQuotasNegativeTestJSON-1572228644 None] Available shares ['10.10.41.181/cinder-vol-61f585ac-f8e2-4d19-a890-7ebc2726cc72'] {{(pid=83259) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:669}} Sep 16 15:06:11 devstack cinder-volume[83259]: DEBUG oslo_concurrency.lockutils [None req-1023b6e3-aef6-4f6f-9fb4-e8511eeb8708 tempest-VolumeQuotasNegativeTestJSON-1572228644 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=83259) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 16 15:06:11 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [None req-1023b6e3-aef6-4f6f-9fb4-e8511eeb8708 tempest-VolumeQuotasNegativeTestJSON-1572228644 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 15:06:12 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [None req-1023b6e3-aef6-4f6f-9fb4-e8511eeb8708 tempest-VolumeQuotasNegativeTestJSON-1572228644 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c" returned: 0 in 0.153s {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 15:06:12 devstack cinder-volume[83259]: DEBUG cinder.manager [None req-1023b6e3-aef6-4f6f-9fb4-e8511eeb8708 tempest-VolumeQuotasNegativeTestJSON-1572228644 None] Notifying Schedulers of capabilities ... {{(pid=83259) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 16 15:06:12 devstack cinder-volume[83259]: INFO cinder.volume.manager [None req-1023b6e3-aef6-4f6f-9fb4-e8511eeb8708 tempest-VolumeQuotasNegativeTestJSON-1572228644 None] Deleted volume successfully. Sep 16 15:06:12 devstack cinder-volume[83259]: DEBUG cinder.coordination [None req-1023b6e3-aef6-4f6f-9fb4-e8511eeb8708 tempest-VolumeQuotasNegativeTestJSON-1572228644 None] Lock "cinder-06cd79f6-251d-4875-a4a0-abc7f21cefcb-delete_volume" released by "delete_volume" :: held 3.093s {{(pid=83259) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 16 15:06:12 devstack cinder-volume[83259]: WARNING cinder.volume.volume_utils [None req-fc91bd59-e67b-446f-b216-95122b1fbf21 tempest-VolumeQuotasAdminTestJSON-1056022608 None] Volume driver (QuobyteDriver 1.2) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 16 15:06:12 devstack cinder-volume[83259]: DEBUG cinder.volume.flows.manager.create_volume [None req-fc91bd59-e67b-446f-b216-95122b1fbf21 tempest-VolumeQuotasAdminTestJSON-1056022608 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#Quobyte'], 'hosts': ['devstack@QuobyteHD#Quobyte']} {{(pid=83259) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1387}} Sep 16 15:06:12 devstack cinder-volume[83259]: DEBUG cinder.volume.manager [None req-fc91bd59-e67b-446f-b216-95122b1fbf21 tempest-VolumeQuotasAdminTestJSON-1056022608 None] Flow 'volume_create_manager' (70eb3092-8d61-480c-a5f1-949076b265d9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83259) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 16 15:06:12 devstack cinder-volume[83259]: DEBUG cinder.volume.manager [None req-fc91bd59-e67b-446f-b216-95122b1fbf21 tempest-VolumeQuotasAdminTestJSON-1056022608 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (82a3cfea-fc28-477a-9f75-c89b6ab5020a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83259) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 15:06:13 devstack cinder-volume[83259]: DEBUG cinder.volume.manager [None req-fc91bd59-e67b-446f-b216-95122b1fbf21 tempest-VolumeQuotasAdminTestJSON-1056022608 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (82a3cfea-fc28-477a-9f75-c89b6ab5020a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-16T13:06:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-1800228221',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#Quobyte',id=748d6c49-c36f-48df-b5fc-8566cce9aa65,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9f8a5076a9ce410c97f7b960ab8dd50f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-16T13:06:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-16T13:06:13Z,use_quota=True,user_id='e0b96f4576554c2d87e4832c1e7686cc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(485ead50-3df8-4d76-8d34-a4db136c980a),volume_type_id=485ead50-3df8-4d76-8d34-a4db136c980a)' {{(pid=83259) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 15:06:13 devstack cinder-volume[83259]: DEBUG cinder.volume.manager [None req-fc91bd59-e67b-446f-b216-95122b1fbf21 tempest-VolumeQuotasAdminTestJSON-1056022608 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (82b1610f-f7c1-4251-b4b2-ecbe04b89be8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83259) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 15:06:13 devstack cinder-volume[83259]: DEBUG cinder.volume.manager [None req-fc91bd59-e67b-446f-b216-95122b1fbf21 tempest-VolumeQuotasAdminTestJSON-1056022608 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (82b1610f-f7c1-4251-b4b2-ecbe04b89be8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83259) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 15:06:13 devstack cinder-volume[83259]: DEBUG cinder.volume.manager [None req-fc91bd59-e67b-446f-b216-95122b1fbf21 tempest-VolumeQuotasAdminTestJSON-1056022608 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7683efa7-d75d-4424-9d5e-bcd4d8b4df67) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83259) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 15:06:13 devstack cinder-volume[83259]: DEBUG cinder.volume.manager [None req-fc91bd59-e67b-446f-b216-95122b1fbf21 tempest-VolumeQuotasAdminTestJSON-1056022608 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7683efa7-d75d-4424-9d5e-bcd4d8b4df67) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '748d6c49-c36f-48df-b5fc-8566cce9aa65', 'volume_name': 'volume-748d6c49-c36f-48df-b5fc-8566cce9aa65', 'volume_size': 1}' {{(pid=83259) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 15:06:13 devstack cinder-volume[83259]: DEBUG cinder.volume.manager [None req-fc91bd59-e67b-446f-b216-95122b1fbf21 tempest-VolumeQuotasAdminTestJSON-1056022608 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e94132e0-b92f-4622-9d8e-6beb658f6fc4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83259) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 15:06:13 devstack cinder-volume[83259]: DEBUG cinder.volume.manager [None req-fc91bd59-e67b-446f-b216-95122b1fbf21 tempest-VolumeQuotasAdminTestJSON-1056022608 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e94132e0-b92f-4622-9d8e-6beb658f6fc4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83259) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 15:06:13 devstack cinder-volume[83259]: DEBUG cinder.volume.manager [None req-fc91bd59-e67b-446f-b216-95122b1fbf21 tempest-VolumeQuotasAdminTestJSON-1056022608 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6aaa3465-faf6-4cde-884f-0d0ea7b54fc3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83259) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 15:06:13 devstack cinder-volume[83259]: INFO cinder.volume.flows.manager.create_volume [None req-fc91bd59-e67b-446f-b216-95122b1fbf21 tempest-VolumeQuotasAdminTestJSON-1056022608 None] Volume 748d6c49-c36f-48df-b5fc-8566cce9aa65: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-748d6c49-c36f-48df-b5fc-8566cce9aa65', 'volume_size': 1} Sep 16 15:06:13 devstack cinder-volume[83259]: DEBUG oslo_concurrency.lockutils [None req-fc91bd59-e67b-446f-b216-95122b1fbf21 tempest-VolumeQuotasAdminTestJSON-1056022608 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83259) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 16 15:06:13 devstack cinder-volume[83259]: DEBUG oslo_concurrency.lockutils [None req-fc91bd59-e67b-446f-b216-95122b1fbf21 tempest-VolumeQuotasAdminTestJSON-1056022608 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=83259) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 16 15:06:13 devstack cinder-volume[83259]: DEBUG cinder.volume.drivers.quobyte [None req-fc91bd59-e67b-446f-b216-95122b1fbf21 tempest-VolumeQuotasAdminTestJSON-1056022608 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-16T13:06:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-1800228221',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#Quobyte',id=748d6c49-c36f-48df-b5fc-8566cce9aa65,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9f8a5076a9ce410c97f7b960ab8dd50f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-16T13:06:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-16T13:06:13Z,use_quota=True,user_id='e0b96f4576554c2d87e4832c1e7686cc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(485ead50-3df8-4d76-8d34-a4db136c980a),volume_type_id=485ead50-3df8-4d76-8d34-a4db136c980a)}" {{(pid=83259) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Sep 16 15:06:13 devstack cinder-volume[83259]: DEBUG cinder.volume.drivers.remotefs [None req-fc91bd59-e67b-446f-b216-95122b1fbf21 tempest-VolumeQuotasAdminTestJSON-1056022608 None] Creating volume 748d6c49-c36f-48df-b5fc-8566cce9aa65 {{(pid=83259) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}} Sep 16 15:06:13 devstack cinder-volume[83259]: DEBUG oslo_concurrency.lockutils [None req-fc91bd59-e67b-446f-b216-95122b1fbf21 tempest-VolumeQuotasAdminTestJSON-1056022608 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83259) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 16 15:06:13 devstack cinder-volume[83259]: DEBUG oslo_concurrency.lockutils [None req-fc91bd59-e67b-446f-b216-95122b1fbf21 tempest-VolumeQuotasAdminTestJSON-1056022608 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83259) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 16 15:06:13 devstack cinder-volume[83259]: DEBUG cinder.volume.drivers.quobyte [None req-fc91bd59-e67b-446f-b216-95122b1fbf21 tempest-VolumeQuotasAdminTestJSON-1056022608 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-61f585ac-f8e2-4d19-a890-7ebc2726cc72': None} {{(pid=83259) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:639}} Sep 16 15:06:13 devstack cinder-volume[83259]: DEBUG cinder.volume.drivers.quobyte [None req-fc91bd59-e67b-446f-b216-95122b1fbf21 tempest-VolumeQuotasAdminTestJSON-1056022608 None] Available shares ['10.10.41.181/cinder-vol-61f585ac-f8e2-4d19-a890-7ebc2726cc72'] {{(pid=83259) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:669}} Sep 16 15:06:13 devstack cinder-volume[83259]: DEBUG oslo_concurrency.lockutils [None req-fc91bd59-e67b-446f-b216-95122b1fbf21 tempest-VolumeQuotasAdminTestJSON-1056022608 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=83259) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 16 15:06:13 devstack cinder-volume[83259]: DEBUG cinder.volume.drivers.quobyte [None req-fc91bd59-e67b-446f-b216-95122b1fbf21 tempest-VolumeQuotasAdminTestJSON-1056022608 None] Selected 10.10.41.181/cinder-vol-61f585ac-f8e2-4d19-a890-7ebc2726cc72 as target Quobyte volume. {{(pid=83259) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:690}} Sep 16 15:06:13 devstack cinder-volume[83259]: INFO cinder.volume.drivers.remotefs [None req-fc91bd59-e67b-446f-b216-95122b1fbf21 tempest-VolumeQuotasAdminTestJSON-1056022608 None] casted to 10.10.41.181/cinder-vol-61f585ac-f8e2-4d19-a890-7ebc2726cc72 Sep 16 15:06:13 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [None req-fc91bd59-e67b-446f-b216-95122b1fbf21 tempest-VolumeQuotasAdminTestJSON-1056022608 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c/volume-748d6c49-c36f-48df-b5fc-8566cce9aa65 1073741824 {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 15:06:13 devstack quobyte-client[83286]: The server volume:87712ffe-8a69-446d-9ed6-4430c7ee9792@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=87712ffe-8a69-446d-9ed6-4430c7ee9792, inode=65, name=volume-748d6c49-c36f-48df-b5fc-8566cce9aa65, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.206), requestorAccessMask=0 Sep 16 15:06:13 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [None req-fc91bd59-e67b-446f-b216-95122b1fbf21 tempest-VolumeQuotasAdminTestJSON-1056022608 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c/volume-748d6c49-c36f-48df-b5fc-8566cce9aa65 1073741824" returned: 0 in 0.498s {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 15:06:13 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [None req-fc91bd59-e67b-446f-b216-95122b1fbf21 tempest-VolumeQuotasAdminTestJSON-1056022608 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c/volume-748d6c49-c36f-48df-b5fc-8566cce9aa65 {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 15:06:13 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [None req-fc91bd59-e67b-446f-b216-95122b1fbf21 tempest-VolumeQuotasAdminTestJSON-1056022608 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c/volume-748d6c49-c36f-48df-b5fc-8566cce9aa65" returned: 0 in 0.103s {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 15:06:13 devstack cinder-volume[83259]: DEBUG cinder.volume.drivers.quobyte [None req-fc91bd59-e67b-446f-b216-95122b1fbf21 tempest-VolumeQuotasAdminTestJSON-1056022608 None] <== create_volume: return (693ms) {'provider_location': '10.10.41.181/cinder-vol-61f585ac-f8e2-4d19-a890-7ebc2726cc72'} {{(pid=83259) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Sep 16 15:06:13 devstack cinder-volume[83259]: DEBUG oslo_concurrency.lockutils [None req-fc91bd59-e67b-446f-b216-95122b1fbf21 tempest-VolumeQuotasAdminTestJSON-1056022608 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.710s {{(pid=83259) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 16 15:06:14 devstack cinder-volume[83259]: DEBUG cinder.volume.manager [None req-fc91bd59-e67b-446f-b216-95122b1fbf21 tempest-VolumeQuotasAdminTestJSON-1056022608 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6aaa3465-faf6-4cde-884f-0d0ea7b54fc3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-748d6c49-c36f-48df-b5fc-8566cce9aa65', 'volume_size': 1}' {{(pid=83259) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 15:06:14 devstack cinder-volume[83259]: DEBUG cinder.volume.manager [None req-fc91bd59-e67b-446f-b216-95122b1fbf21 tempest-VolumeQuotasAdminTestJSON-1056022608 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b6f51dd1-5837-41d6-bb80-5a243562ddac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83259) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 15:06:14 devstack cinder-volume[83259]: INFO cinder.volume.flows.manager.create_volume [None req-fc91bd59-e67b-446f-b216-95122b1fbf21 tempest-VolumeQuotasAdminTestJSON-1056022608 None] Volume volume-748d6c49-c36f-48df-b5fc-8566cce9aa65 (748d6c49-c36f-48df-b5fc-8566cce9aa65): created successfully Sep 16 15:06:14 devstack cinder-volume[83259]: DEBUG cinder.volume.manager [None req-fc91bd59-e67b-446f-b216-95122b1fbf21 tempest-VolumeQuotasAdminTestJSON-1056022608 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b6f51dd1-5837-41d6-bb80-5a243562ddac) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83259) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 15:06:14 devstack cinder-volume[83259]: DEBUG cinder.volume.manager [None req-fc91bd59-e67b-446f-b216-95122b1fbf21 tempest-VolumeQuotasAdminTestJSON-1056022608 None] Flow 'volume_create_manager' (70eb3092-8d61-480c-a5f1-949076b265d9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83259) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 16 15:06:14 devstack cinder-volume[83259]: INFO cinder.volume.manager [None req-fc91bd59-e67b-446f-b216-95122b1fbf21 tempest-VolumeQuotasAdminTestJSON-1056022608 None] Created volume successfully. Sep 16 15:06:15 devstack cinder-volume[83259]: WARNING cinder.volume.volume_utils [None req-12ec6d5a-5ccb-4536-96c9-5b84527f8e05 tempest-VolumeQuotasAdminTestJSON-869676469 None] Volume driver (QuobyteDriver 1.2) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 16 15:06:15 devstack cinder-volume[83259]: INFO cinder.volume.manager [None req-12ec6d5a-5ccb-4536-96c9-5b84527f8e05 tempest-VolumeQuotasAdminTestJSON-869676469 None] Transfer volume completed successfully. Sep 16 15:06:16 devstack cinder-volume[83259]: DEBUG cinder.coordination [None req-d66072df-35de-4b62-9d01-8365af0aa555 tempest-VolumeQuotasAdminTestJSON-973452424 None] Acquiring lock "cinder-748d6c49-c36f-48df-b5fc-8566cce9aa65-delete_volume" by "delete_volume" {{(pid=83259) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 16 15:06:16 devstack cinder-volume[83259]: DEBUG cinder.coordination [None req-d66072df-35de-4b62-9d01-8365af0aa555 tempest-VolumeQuotasAdminTestJSON-973452424 None] Lock "cinder-748d6c49-c36f-48df-b5fc-8566cce9aa65-delete_volume" acquired by "delete_volume" :: waited 0.051s {{(pid=83259) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 16 15:06:16 devstack cinder-volume[83259]: WARNING cinder.volume.volume_utils [None req-d66072df-35de-4b62-9d01-8365af0aa555 tempest-VolumeQuotasAdminTestJSON-973452424 None] Volume driver (QuobyteDriver 1.2) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 16 15:06:16 devstack cinder-volume[83259]: DEBUG cinder.coordination [None req-d66072df-35de-4b62-9d01-8365af0aa555 tempest-VolumeQuotasAdminTestJSON-973452424 None] Acquiring lock "cinder-quobyte-748d6c49-c36f-48df-b5fc-8566cce9aa65" by "delete_volume" {{(pid=83259) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 16 15:06:17 devstack cinder-volume[83259]: DEBUG cinder.coordination [None req-d66072df-35de-4b62-9d01-8365af0aa555 tempest-VolumeQuotasAdminTestJSON-973452424 None] Lock "cinder-quobyte-748d6c49-c36f-48df-b5fc-8566cce9aa65" acquired by "delete_volume" :: waited 0.012s {{(pid=83259) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 16 15:06:17 devstack cinder-volume[83259]: DEBUG oslo.privsep.daemon [-] privsep: reply[9c873c25-b0cd-4fc3-a3a3-3876134e59a6]: (4, 'qcow2') {{(pid=84312) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 16 15:06:17 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [None req-d66072df-35de-4b62-9d01-8365af0aa555 tempest-VolumeQuotasAdminTestJSON-973452424 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c/volume-748d6c49-c36f-48df-b5fc-8566cce9aa65 {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 15:06:17 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [None req-d66072df-35de-4b62-9d01-8365af0aa555 tempest-VolumeQuotasAdminTestJSON-973452424 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c/volume-748d6c49-c36f-48df-b5fc-8566cce9aa65" returned: 0 in 0.441s {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 15:06:17 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [None req-d66072df-35de-4b62-9d01-8365af0aa555 tempest-VolumeQuotasAdminTestJSON-973452424 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c/volume-748d6c49-c36f-48df-b5fc-8566cce9aa65 {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 15:06:17 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [None req-d66072df-35de-4b62-9d01-8365af0aa555 tempest-VolumeQuotasAdminTestJSON-973452424 None] CMD "rm -f /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c/volume-748d6c49-c36f-48df-b5fc-8566cce9aa65" returned: 0 in 0.123s {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 15:06:17 devstack cinder-volume[83259]: DEBUG cinder.coordination [None req-d66072df-35de-4b62-9d01-8365af0aa555 tempest-VolumeQuotasAdminTestJSON-973452424 None] Lock "cinder-quobyte-748d6c49-c36f-48df-b5fc-8566cce9aa65" released by "delete_volume" :: held 0.738s {{(pid=83259) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 16 15:06:18 devstack cinder-volume[83259]: DEBUG cinder.quota [None req-d66072df-35de-4b62-9d01-8365af0aa555 tempest-VolumeQuotasAdminTestJSON-973452424 None] Created reservations ['c91891ca-f03a-4191-aad8-e002bf2ad662', '33557036-bd7b-4ecc-8e59-db471d151c3d', 'c4585139-d22b-4a6d-a022-e8df1dc905e1', '6d9c1daf-4a1b-48d9-a5c5-4e213aff2189'] {{(pid=83259) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 16 15:06:18 devstack cinder-volume[83259]: DEBUG oslo_concurrency.lockutils [None req-d66072df-35de-4b62-9d01-8365af0aa555 tempest-VolumeQuotasAdminTestJSON-973452424 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83259) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 16 15:06:18 devstack cinder-volume[83259]: DEBUG oslo_concurrency.lockutils [None req-d66072df-35de-4b62-9d01-8365af0aa555 tempest-VolumeQuotasAdminTestJSON-973452424 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=83259) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 16 15:06:18 devstack cinder-volume[83259]: DEBUG cinder.volume.drivers.quobyte [None req-d66072df-35de-4b62-9d01-8365af0aa555 tempest-VolumeQuotasAdminTestJSON-973452424 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-61f585ac-f8e2-4d19-a890-7ebc2726cc72': None} {{(pid=83259) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:639}} Sep 16 15:06:18 devstack cinder-volume[83259]: DEBUG cinder.volume.drivers.quobyte [None req-d66072df-35de-4b62-9d01-8365af0aa555 tempest-VolumeQuotasAdminTestJSON-973452424 None] Available shares ['10.10.41.181/cinder-vol-61f585ac-f8e2-4d19-a890-7ebc2726cc72'] {{(pid=83259) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:669}} Sep 16 15:06:18 devstack cinder-volume[83259]: DEBUG oslo_concurrency.lockutils [None req-d66072df-35de-4b62-9d01-8365af0aa555 tempest-VolumeQuotasAdminTestJSON-973452424 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=83259) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 16 15:06:18 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [None req-d66072df-35de-4b62-9d01-8365af0aa555 tempest-VolumeQuotasAdminTestJSON-973452424 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 15:06:18 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [None req-d66072df-35de-4b62-9d01-8365af0aa555 tempest-VolumeQuotasAdminTestJSON-973452424 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c" returned: 0 in 0.108s {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 15:06:18 devstack cinder-volume[83259]: DEBUG cinder.manager [None req-d66072df-35de-4b62-9d01-8365af0aa555 tempest-VolumeQuotasAdminTestJSON-973452424 None] Notifying Schedulers of capabilities ... {{(pid=83259) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 16 15:06:18 devstack cinder-volume[83259]: INFO cinder.volume.manager [None req-d66072df-35de-4b62-9d01-8365af0aa555 tempest-VolumeQuotasAdminTestJSON-973452424 None] Deleted volume successfully. Sep 16 15:06:18 devstack cinder-volume[83259]: DEBUG cinder.coordination [None req-d66072df-35de-4b62-9d01-8365af0aa555 tempest-VolumeQuotasAdminTestJSON-973452424 None] Lock "cinder-748d6c49-c36f-48df-b5fc-8566cce9aa65-delete_volume" released by "delete_volume" :: held 1.786s {{(pid=83259) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 16 15:06:20 devstack cinder-volume[83259]: WARNING cinder.volume.volume_utils [None req-fa66de18-db44-48ab-b51a-79ff7a6e2743 tempest-VolumeRetypeWithoutMigrationTest-1832793192 None] Volume driver (QuobyteDriver 1.2) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 16 15:06:20 devstack cinder-volume[83259]: DEBUG cinder.volume.flows.manager.create_volume [None req-fa66de18-db44-48ab-b51a-79ff7a6e2743 tempest-VolumeRetypeWithoutMigrationTest-1832793192 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#Quobyte'], 'hosts': ['devstack@QuobyteHD#Quobyte']} {{(pid=83259) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1387}} Sep 16 15:06:20 devstack cinder-volume[83259]: DEBUG cinder.volume.manager [None req-fa66de18-db44-48ab-b51a-79ff7a6e2743 tempest-VolumeRetypeWithoutMigrationTest-1832793192 None] Flow 'volume_create_manager' (270c45c2-4b10-4cdb-b981-b2ce003ae068) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83259) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 16 15:06:20 devstack cinder-volume[83259]: DEBUG cinder.volume.manager [None req-fa66de18-db44-48ab-b51a-79ff7a6e2743 tempest-VolumeRetypeWithoutMigrationTest-1832793192 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5c70b8f4-ad3d-4f69-b3b5-78fc7cfda777) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83259) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 15:06:20 devstack cinder-volume[83259]: DEBUG cinder.volume.manager [None req-fa66de18-db44-48ab-b51a-79ff7a6e2743 tempest-VolumeRetypeWithoutMigrationTest-1832793192 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5c70b8f4-ad3d-4f69-b3b5-78fc7cfda777) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-16T13:06:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeRetypeWithoutMigrationTest-Volume-533395848',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#Quobyte',id=0e081fd7-e87b-4bd0-9caa-c559aca71fd6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3f006d01cc2f488e85d07b31c18c91d4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-16T13:06:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-16T13:06:20Z,use_quota=True,user_id='8d0db21ea1864b3e8904503b940d03ca',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(01de9215-ed43-42fc-b9f5-7cfb766127b0),volume_type_id=01de9215-ed43-42fc-b9f5-7cfb766127b0)' {{(pid=83259) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 15:06:20 devstack cinder-volume[83259]: DEBUG cinder.volume.manager [None req-fa66de18-db44-48ab-b51a-79ff7a6e2743 tempest-VolumeRetypeWithoutMigrationTest-1832793192 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a104b723-be0b-47c0-8c81-10ea502f4737) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83259) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 15:06:20 devstack cinder-volume[83259]: DEBUG cinder.volume.manager [None req-fa66de18-db44-48ab-b51a-79ff7a6e2743 tempest-VolumeRetypeWithoutMigrationTest-1832793192 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a104b723-be0b-47c0-8c81-10ea502f4737) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83259) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 15:06:20 devstack cinder-volume[83259]: DEBUG cinder.volume.manager [None req-fa66de18-db44-48ab-b51a-79ff7a6e2743 tempest-VolumeRetypeWithoutMigrationTest-1832793192 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2f8d2f46-8172-45ec-a6aa-e4592c1670e8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83259) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 15:06:20 devstack cinder-volume[83259]: DEBUG cinder.volume.manager [None req-fa66de18-db44-48ab-b51a-79ff7a6e2743 tempest-VolumeRetypeWithoutMigrationTest-1832793192 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2f8d2f46-8172-45ec-a6aa-e4592c1670e8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0e081fd7-e87b-4bd0-9caa-c559aca71fd6', 'volume_name': 'volume-0e081fd7-e87b-4bd0-9caa-c559aca71fd6', 'volume_size': 1}' {{(pid=83259) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 15:06:20 devstack cinder-volume[83259]: DEBUG cinder.volume.manager [None req-fa66de18-db44-48ab-b51a-79ff7a6e2743 tempest-VolumeRetypeWithoutMigrationTest-1832793192 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c05c8ff2-d341-43a0-9933-e0a3183a4bd2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83259) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 15:06:20 devstack cinder-volume[83259]: DEBUG cinder.volume.manager [None req-fa66de18-db44-48ab-b51a-79ff7a6e2743 tempest-VolumeRetypeWithoutMigrationTest-1832793192 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c05c8ff2-d341-43a0-9933-e0a3183a4bd2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83259) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 15:06:20 devstack cinder-volume[83259]: DEBUG cinder.volume.manager [None req-fa66de18-db44-48ab-b51a-79ff7a6e2743 tempest-VolumeRetypeWithoutMigrationTest-1832793192 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d6855769-07a4-41b7-8617-f3940e65b043) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83259) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 15:06:20 devstack cinder-volume[83259]: INFO cinder.volume.flows.manager.create_volume [None req-fa66de18-db44-48ab-b51a-79ff7a6e2743 tempest-VolumeRetypeWithoutMigrationTest-1832793192 None] Volume 0e081fd7-e87b-4bd0-9caa-c559aca71fd6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0e081fd7-e87b-4bd0-9caa-c559aca71fd6', 'volume_size': 1} Sep 16 15:06:20 devstack cinder-volume[83259]: DEBUG oslo_concurrency.lockutils [None req-fa66de18-db44-48ab-b51a-79ff7a6e2743 tempest-VolumeRetypeWithoutMigrationTest-1832793192 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83259) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 16 15:06:20 devstack cinder-volume[83259]: DEBUG oslo_concurrency.lockutils [None req-fa66de18-db44-48ab-b51a-79ff7a6e2743 tempest-VolumeRetypeWithoutMigrationTest-1832793192 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=83259) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 16 15:06:20 devstack cinder-volume[83259]: DEBUG cinder.volume.drivers.quobyte [None req-fa66de18-db44-48ab-b51a-79ff7a6e2743 tempest-VolumeRetypeWithoutMigrationTest-1832793192 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-16T13:06:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeRetypeWithoutMigrationTest-Volume-533395848',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#Quobyte',id=0e081fd7-e87b-4bd0-9caa-c559aca71fd6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3f006d01cc2f488e85d07b31c18c91d4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-16T13:06:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-16T13:06:20Z,use_quota=True,user_id='8d0db21ea1864b3e8904503b940d03ca',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(01de9215-ed43-42fc-b9f5-7cfb766127b0),volume_type_id=01de9215-ed43-42fc-b9f5-7cfb766127b0)}" {{(pid=83259) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Sep 16 15:06:20 devstack cinder-volume[83259]: DEBUG cinder.volume.drivers.remotefs [None req-fa66de18-db44-48ab-b51a-79ff7a6e2743 tempest-VolumeRetypeWithoutMigrationTest-1832793192 None] Creating volume 0e081fd7-e87b-4bd0-9caa-c559aca71fd6 {{(pid=83259) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}} Sep 16 15:06:20 devstack cinder-volume[83259]: DEBUG oslo_concurrency.lockutils [None req-fa66de18-db44-48ab-b51a-79ff7a6e2743 tempest-VolumeRetypeWithoutMigrationTest-1832793192 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83259) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 16 15:06:20 devstack cinder-volume[83259]: DEBUG oslo_concurrency.lockutils [None req-fa66de18-db44-48ab-b51a-79ff7a6e2743 tempest-VolumeRetypeWithoutMigrationTest-1832793192 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83259) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 16 15:06:20 devstack cinder-volume[83259]: DEBUG cinder.volume.drivers.quobyte [None req-fa66de18-db44-48ab-b51a-79ff7a6e2743 tempest-VolumeRetypeWithoutMigrationTest-1832793192 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-61f585ac-f8e2-4d19-a890-7ebc2726cc72': None} {{(pid=83259) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:639}} Sep 16 15:06:20 devstack cinder-volume[83259]: DEBUG cinder.volume.drivers.quobyte [None req-fa66de18-db44-48ab-b51a-79ff7a6e2743 tempest-VolumeRetypeWithoutMigrationTest-1832793192 None] Available shares ['10.10.41.181/cinder-vol-61f585ac-f8e2-4d19-a890-7ebc2726cc72'] {{(pid=83259) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:669}} Sep 16 15:06:20 devstack cinder-volume[83259]: DEBUG oslo_concurrency.lockutils [None req-fa66de18-db44-48ab-b51a-79ff7a6e2743 tempest-VolumeRetypeWithoutMigrationTest-1832793192 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=83259) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 16 15:06:20 devstack cinder-volume[83259]: DEBUG cinder.volume.drivers.quobyte [None req-fa66de18-db44-48ab-b51a-79ff7a6e2743 tempest-VolumeRetypeWithoutMigrationTest-1832793192 None] Selected 10.10.41.181/cinder-vol-61f585ac-f8e2-4d19-a890-7ebc2726cc72 as target Quobyte volume. {{(pid=83259) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:690}} Sep 16 15:06:20 devstack cinder-volume[83259]: INFO cinder.volume.drivers.remotefs [None req-fa66de18-db44-48ab-b51a-79ff7a6e2743 tempest-VolumeRetypeWithoutMigrationTest-1832793192 None] casted to 10.10.41.181/cinder-vol-61f585ac-f8e2-4d19-a890-7ebc2726cc72 Sep 16 15:06:20 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [None req-fa66de18-db44-48ab-b51a-79ff7a6e2743 tempest-VolumeRetypeWithoutMigrationTest-1832793192 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c/volume-0e081fd7-e87b-4bd0-9caa-c559aca71fd6 1073741824 {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 15:06:20 devstack quobyte-client[83286]: System call of process 93732 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 16 15:06:20 devstack quobyte-client[83286]: The server volume:87712ffe-8a69-446d-9ed6-4430c7ee9792@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=87712ffe-8a69-446d-9ed6-4430c7ee9792, inode=66, name=volume-0e081fd7-e87b-4bd0-9caa-c559aca71fd6, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.206), requestorAccessMask=0 Sep 16 15:06:21 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [None req-fa66de18-db44-48ab-b51a-79ff7a6e2743 tempest-VolumeRetypeWithoutMigrationTest-1832793192 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c/volume-0e081fd7-e87b-4bd0-9caa-c559aca71fd6 1073741824" returned: 0 in 0.531s {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 15:06:21 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [None req-fa66de18-db44-48ab-b51a-79ff7a6e2743 tempest-VolumeRetypeWithoutMigrationTest-1832793192 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c/volume-0e081fd7-e87b-4bd0-9caa-c559aca71fd6 {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 15:06:21 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [None req-fa66de18-db44-48ab-b51a-79ff7a6e2743 tempest-VolumeRetypeWithoutMigrationTest-1832793192 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c/volume-0e081fd7-e87b-4bd0-9caa-c559aca71fd6" returned: 0 in 0.185s {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 15:06:21 devstack cinder-volume[83259]: DEBUG cinder.volume.drivers.quobyte [None req-fa66de18-db44-48ab-b51a-79ff7a6e2743 tempest-VolumeRetypeWithoutMigrationTest-1832793192 None] <== create_volume: return (801ms) {'provider_location': '10.10.41.181/cinder-vol-61f585ac-f8e2-4d19-a890-7ebc2726cc72'} {{(pid=83259) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Sep 16 15:06:21 devstack cinder-volume[83259]: DEBUG oslo_concurrency.lockutils [None req-fa66de18-db44-48ab-b51a-79ff7a6e2743 tempest-VolumeRetypeWithoutMigrationTest-1832793192 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.816s {{(pid=83259) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 16 15:06:21 devstack cinder-volume[83259]: DEBUG cinder.volume.manager [None req-fa66de18-db44-48ab-b51a-79ff7a6e2743 tempest-VolumeRetypeWithoutMigrationTest-1832793192 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d6855769-07a4-41b7-8617-f3940e65b043) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0e081fd7-e87b-4bd0-9caa-c559aca71fd6', 'volume_size': 1}' {{(pid=83259) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 15:06:21 devstack cinder-volume[83259]: DEBUG cinder.volume.manager [None req-fa66de18-db44-48ab-b51a-79ff7a6e2743 tempest-VolumeRetypeWithoutMigrationTest-1832793192 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ee840464-e03c-482f-80be-f0356b97022b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83259) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 15:06:22 devstack cinder-volume[83259]: INFO cinder.volume.flows.manager.create_volume [None req-fa66de18-db44-48ab-b51a-79ff7a6e2743 tempest-VolumeRetypeWithoutMigrationTest-1832793192 None] Volume volume-0e081fd7-e87b-4bd0-9caa-c559aca71fd6 (0e081fd7-e87b-4bd0-9caa-c559aca71fd6): created successfully Sep 16 15:06:22 devstack cinder-volume[83259]: DEBUG cinder.volume.manager [None req-fa66de18-db44-48ab-b51a-79ff7a6e2743 tempest-VolumeRetypeWithoutMigrationTest-1832793192 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ee840464-e03c-482f-80be-f0356b97022b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83259) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 15:06:22 devstack cinder-volume[83259]: DEBUG cinder.volume.manager [None req-fa66de18-db44-48ab-b51a-79ff7a6e2743 tempest-VolumeRetypeWithoutMigrationTest-1832793192 None] Flow 'volume_create_manager' (270c45c2-4b10-4cdb-b981-b2ce003ae068) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83259) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 16 15:06:22 devstack cinder-volume[83259]: INFO cinder.volume.manager [None req-fa66de18-db44-48ab-b51a-79ff7a6e2743 tempest-VolumeRetypeWithoutMigrationTest-1832793192 None] Created volume successfully. Sep 16 15:06:24 devstack cinder-volume[83259]: WARNING cinder.volume.volume_utils [None req-dbad2c63-bd84-4f16-b2fb-fdcd8c1293fa tempest-VolumeRetypeWithoutMigrationTest-1832793192 None] Volume driver (QuobyteDriver 1.2) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 16 15:06:25 devstack cinder-volume[83259]: DEBUG oslo_concurrency.lockutils [None req-dbad2c63-bd84-4f16-b2fb-fdcd8c1293fa tempest-VolumeRetypeWithoutMigrationTest-1832793192 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83259) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 16 15:06:25 devstack cinder-volume[83259]: DEBUG oslo_concurrency.lockutils [None req-dbad2c63-bd84-4f16-b2fb-fdcd8c1293fa tempest-VolumeRetypeWithoutMigrationTest-1832793192 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=83259) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 16 15:06:25 devstack cinder-volume[83259]: DEBUG cinder.volume.drivers.quobyte [None req-dbad2c63-bd84-4f16-b2fb-fdcd8c1293fa tempest-VolumeRetypeWithoutMigrationTest-1832793192 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-61f585ac-f8e2-4d19-a890-7ebc2726cc72': None} {{(pid=83259) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:639}} Sep 16 15:06:25 devstack cinder-volume[83259]: DEBUG cinder.volume.drivers.quobyte [None req-dbad2c63-bd84-4f16-b2fb-fdcd8c1293fa tempest-VolumeRetypeWithoutMigrationTest-1832793192 None] Available shares ['10.10.41.181/cinder-vol-61f585ac-f8e2-4d19-a890-7ebc2726cc72'] {{(pid=83259) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:669}} Sep 16 15:06:25 devstack cinder-volume[83259]: DEBUG oslo_concurrency.lockutils [None req-dbad2c63-bd84-4f16-b2fb-fdcd8c1293fa tempest-VolumeRetypeWithoutMigrationTest-1832793192 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.026s {{(pid=83259) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 16 15:06:25 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [None req-dbad2c63-bd84-4f16-b2fb-fdcd8c1293fa tempest-VolumeRetypeWithoutMigrationTest-1832793192 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 15:06:25 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [None req-dbad2c63-bd84-4f16-b2fb-fdcd8c1293fa tempest-VolumeRetypeWithoutMigrationTest-1832793192 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c" returned: 0 in 0.202s {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 15:06:25 devstack cinder-volume[83259]: DEBUG cinder.manager [None req-dbad2c63-bd84-4f16-b2fb-fdcd8c1293fa tempest-VolumeRetypeWithoutMigrationTest-1832793192 None] Notifying Schedulers of capabilities ... {{(pid=83259) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 16 15:06:25 devstack cinder-volume[83259]: INFO cinder.volume.manager [None req-dbad2c63-bd84-4f16-b2fb-fdcd8c1293fa tempest-VolumeRetypeWithoutMigrationTest-1832793192 None] Retype volume completed successfully. Sep 16 15:06:26 devstack cinder-volume[83259]: DEBUG cinder.coordination [None req-74361177-05a0-49e0-8b26-2ad1d4763536 tempest-VolumeRetypeWithoutMigrationTest-1832793192 None] Acquiring lock "cinder-0e081fd7-e87b-4bd0-9caa-c559aca71fd6-delete_volume" by "delete_volume" {{(pid=83259) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 16 15:06:26 devstack cinder-volume[83259]: DEBUG cinder.coordination [None req-74361177-05a0-49e0-8b26-2ad1d4763536 tempest-VolumeRetypeWithoutMigrationTest-1832793192 None] Lock "cinder-0e081fd7-e87b-4bd0-9caa-c559aca71fd6-delete_volume" acquired by "delete_volume" :: waited 0.194s {{(pid=83259) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 16 15:06:27 devstack cinder-volume[83259]: WARNING cinder.volume.volume_utils [None req-74361177-05a0-49e0-8b26-2ad1d4763536 tempest-VolumeRetypeWithoutMigrationTest-1832793192 None] Volume driver (QuobyteDriver 1.2) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 16 15:06:27 devstack cinder-volume[83259]: DEBUG cinder.coordination [None req-74361177-05a0-49e0-8b26-2ad1d4763536 tempest-VolumeRetypeWithoutMigrationTest-1832793192 None] Acquiring lock "cinder-quobyte-0e081fd7-e87b-4bd0-9caa-c559aca71fd6" by "delete_volume" {{(pid=83259) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 16 15:06:27 devstack cinder-volume[83259]: DEBUG cinder.coordination [None req-74361177-05a0-49e0-8b26-2ad1d4763536 tempest-VolumeRetypeWithoutMigrationTest-1832793192 None] Lock "cinder-quobyte-0e081fd7-e87b-4bd0-9caa-c559aca71fd6" acquired by "delete_volume" :: waited 0.015s {{(pid=83259) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 16 15:06:27 devstack cinder-volume[83259]: DEBUG oslo.privsep.daemon [-] privsep: reply[19beb5c7-071c-4ed7-9cc4-323db98a67ab]: (4, 'qcow2') {{(pid=84312) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 16 15:06:27 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [None req-74361177-05a0-49e0-8b26-2ad1d4763536 tempest-VolumeRetypeWithoutMigrationTest-1832793192 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c/volume-0e081fd7-e87b-4bd0-9caa-c559aca71fd6 {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 15:06:27 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [None req-74361177-05a0-49e0-8b26-2ad1d4763536 tempest-VolumeRetypeWithoutMigrationTest-1832793192 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c/volume-0e081fd7-e87b-4bd0-9caa-c559aca71fd6" returned: 0 in 0.655s {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 15:06:27 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [None req-74361177-05a0-49e0-8b26-2ad1d4763536 tempest-VolumeRetypeWithoutMigrationTest-1832793192 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c/volume-0e081fd7-e87b-4bd0-9caa-c559aca71fd6 {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 15:06:28 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [None req-74361177-05a0-49e0-8b26-2ad1d4763536 tempest-VolumeRetypeWithoutMigrationTest-1832793192 None] CMD "rm -f /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c/volume-0e081fd7-e87b-4bd0-9caa-c559aca71fd6" returned: 0 in 0.224s {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 15:06:28 devstack cinder-volume[83259]: DEBUG cinder.coordination [None req-74361177-05a0-49e0-8b26-2ad1d4763536 tempest-VolumeRetypeWithoutMigrationTest-1832793192 None] Lock "cinder-quobyte-0e081fd7-e87b-4bd0-9caa-c559aca71fd6" released by "delete_volume" :: held 1.070s {{(pid=83259) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 16 15:06:28 devstack cinder-volume[83259]: WARNING cinder.quota [None req-74361177-05a0-49e0-8b26-2ad1d4763536 tempest-VolumeRetypeWithoutMigrationTest-1832793192 None] Deprecated: Default quota for resource: volumes_volume-type-2 is set by the default quota flag: quota_volumes_volume-type-2, it is now deprecated. Please use the default quota class for default quota. Sep 16 15:06:28 devstack cinder-volume[83259]: WARNING cinder.quota [None req-74361177-05a0-49e0-8b26-2ad1d4763536 tempest-VolumeRetypeWithoutMigrationTest-1832793192 None] Deprecated: Default quota for resource: gigabytes_volume-type-2 is set by the default quota flag: quota_gigabytes_volume-type-2, it is now deprecated. Please use the default quota class for default quota. Sep 16 15:06:28 devstack cinder-volume[83259]: DEBUG cinder.quota [None req-74361177-05a0-49e0-8b26-2ad1d4763536 tempest-VolumeRetypeWithoutMigrationTest-1832793192 None] Created reservations ['20041188-4452-4c76-905f-ee7c592e0ffe', '64e5f7da-da7d-45a0-88f2-16e5f53744f8', 'af39505b-4b02-4c41-bbd6-ab3de30ca985', 'd78b3d23-75f8-4ccb-8cc3-b78bb2980084'] {{(pid=83259) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 16 15:06:28 devstack cinder-volume[83259]: DEBUG oslo_concurrency.lockutils [None req-74361177-05a0-49e0-8b26-2ad1d4763536 tempest-VolumeRetypeWithoutMigrationTest-1832793192 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83259) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 16 15:06:28 devstack cinder-volume[83259]: DEBUG oslo_concurrency.lockutils [None req-74361177-05a0-49e0-8b26-2ad1d4763536 tempest-VolumeRetypeWithoutMigrationTest-1832793192 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=83259) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 16 15:06:28 devstack cinder-volume[83259]: DEBUG cinder.volume.drivers.quobyte [None req-74361177-05a0-49e0-8b26-2ad1d4763536 tempest-VolumeRetypeWithoutMigrationTest-1832793192 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-61f585ac-f8e2-4d19-a890-7ebc2726cc72': None} {{(pid=83259) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:639}} Sep 16 15:06:28 devstack cinder-volume[83259]: DEBUG cinder.volume.drivers.quobyte [None req-74361177-05a0-49e0-8b26-2ad1d4763536 tempest-VolumeRetypeWithoutMigrationTest-1832793192 None] Available shares ['10.10.41.181/cinder-vol-61f585ac-f8e2-4d19-a890-7ebc2726cc72'] {{(pid=83259) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:669}} Sep 16 15:06:28 devstack cinder-volume[83259]: DEBUG oslo_concurrency.lockutils [None req-74361177-05a0-49e0-8b26-2ad1d4763536 tempest-VolumeRetypeWithoutMigrationTest-1832793192 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=83259) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 16 15:06:28 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [None req-74361177-05a0-49e0-8b26-2ad1d4763536 tempest-VolumeRetypeWithoutMigrationTest-1832793192 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 15:06:29 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [None req-74361177-05a0-49e0-8b26-2ad1d4763536 tempest-VolumeRetypeWithoutMigrationTest-1832793192 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c" returned: 0 in 0.158s {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 15:06:29 devstack cinder-volume[83259]: DEBUG cinder.manager [None req-74361177-05a0-49e0-8b26-2ad1d4763536 tempest-VolumeRetypeWithoutMigrationTest-1832793192 None] Notifying Schedulers of capabilities ... {{(pid=83259) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 16 15:06:29 devstack cinder-volume[83259]: INFO cinder.volume.manager [None req-74361177-05a0-49e0-8b26-2ad1d4763536 tempest-VolumeRetypeWithoutMigrationTest-1832793192 None] Deleted volume successfully. Sep 16 15:06:29 devstack cinder-volume[83259]: DEBUG cinder.coordination [None req-74361177-05a0-49e0-8b26-2ad1d4763536 tempest-VolumeRetypeWithoutMigrationTest-1832793192 None] Lock "cinder-0e081fd7-e87b-4bd0-9caa-c559aca71fd6-delete_volume" released by "delete_volume" :: held 2.747s {{(pid=83259) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 16 15:06:33 devstack cinder-volume[83259]: WARNING cinder.volume.volume_utils [None req-df39de51-4c25-4e06-b007-c44a04ddc19e tempest-VolumeTypesAccessTest-479362670 None] Volume driver (QuobyteDriver 1.2) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 16 15:06:33 devstack cinder-volume[83259]: DEBUG cinder.volume.flows.manager.create_volume [None req-df39de51-4c25-4e06-b007-c44a04ddc19e tempest-VolumeTypesAccessTest-479362670 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#Quobyte'], 'hosts': ['devstack@QuobyteHD#Quobyte']} {{(pid=83259) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1387}} Sep 16 15:06:33 devstack cinder-volume[83259]: DEBUG cinder.volume.manager [None req-df39de51-4c25-4e06-b007-c44a04ddc19e tempest-VolumeTypesAccessTest-479362670 None] Flow 'volume_create_manager' (b1453c3a-a26f-4e7a-83e3-50a953dc1e55) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83259) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 16 15:06:33 devstack cinder-volume[83259]: DEBUG cinder.volume.manager [None req-df39de51-4c25-4e06-b007-c44a04ddc19e tempest-VolumeTypesAccessTest-479362670 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (474e923f-95b6-4266-a849-55520862e569) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83259) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 15:06:33 devstack cinder-volume[83259]: DEBUG cinder.volume.manager [None req-df39de51-4c25-4e06-b007-c44a04ddc19e tempest-VolumeTypesAccessTest-479362670 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (474e923f-95b6-4266-a849-55520862e569) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-16T13:06:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeTypesAccessTest-Volume-1498815180',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#Quobyte',id=1b6d3353-917a-4562-a28d-b2bca1b3d12f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6cded12f8ce74670bbab912f1f919d61',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-16T13:06:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-16T13:06:33Z,use_quota=True,user_id='da4db6a2a2954dc0bde69d57e12a914c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(daf3d6a3-62c7-4477-9aee-f9c40d89e2bb),volume_type_id=daf3d6a3-62c7-4477-9aee-f9c40d89e2bb)' {{(pid=83259) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 15:06:33 devstack cinder-volume[83259]: DEBUG cinder.volume.manager [None req-df39de51-4c25-4e06-b007-c44a04ddc19e tempest-VolumeTypesAccessTest-479362670 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (32565535-38da-41ff-b495-669b8707da2c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83259) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 15:06:33 devstack cinder-volume[83259]: DEBUG cinder.volume.manager [None req-df39de51-4c25-4e06-b007-c44a04ddc19e tempest-VolumeTypesAccessTest-479362670 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (32565535-38da-41ff-b495-669b8707da2c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83259) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 15:06:33 devstack cinder-volume[83259]: DEBUG cinder.volume.manager [None req-df39de51-4c25-4e06-b007-c44a04ddc19e tempest-VolumeTypesAccessTest-479362670 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (69b7e3ff-b1fa-4d1b-951b-011f2eb8ffee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83259) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 15:06:33 devstack cinder-volume[83259]: DEBUG cinder.volume.manager [None req-df39de51-4c25-4e06-b007-c44a04ddc19e tempest-VolumeTypesAccessTest-479362670 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (69b7e3ff-b1fa-4d1b-951b-011f2eb8ffee) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1b6d3353-917a-4562-a28d-b2bca1b3d12f', 'volume_name': 'volume-1b6d3353-917a-4562-a28d-b2bca1b3d12f', 'volume_size': 1}' {{(pid=83259) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 15:06:33 devstack cinder-volume[83259]: DEBUG cinder.volume.manager [None req-df39de51-4c25-4e06-b007-c44a04ddc19e tempest-VolumeTypesAccessTest-479362670 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8d46a0af-36b9-4c28-814e-634aeb2b4698) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83259) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 15:06:33 devstack cinder-volume[83259]: DEBUG cinder.volume.manager [None req-df39de51-4c25-4e06-b007-c44a04ddc19e tempest-VolumeTypesAccessTest-479362670 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8d46a0af-36b9-4c28-814e-634aeb2b4698) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83259) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 15:06:33 devstack cinder-volume[83259]: DEBUG cinder.volume.manager [None req-df39de51-4c25-4e06-b007-c44a04ddc19e tempest-VolumeTypesAccessTest-479362670 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (45b7e9ba-05cf-4177-af77-23b7cb835077) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83259) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 15:06:33 devstack cinder-volume[83259]: INFO cinder.volume.flows.manager.create_volume [None req-df39de51-4c25-4e06-b007-c44a04ddc19e tempest-VolumeTypesAccessTest-479362670 None] Volume 1b6d3353-917a-4562-a28d-b2bca1b3d12f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1b6d3353-917a-4562-a28d-b2bca1b3d12f', 'volume_size': 1} Sep 16 15:06:33 devstack cinder-volume[83259]: DEBUG oslo_concurrency.lockutils [None req-df39de51-4c25-4e06-b007-c44a04ddc19e tempest-VolumeTypesAccessTest-479362670 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83259) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 16 15:06:33 devstack cinder-volume[83259]: DEBUG oslo_concurrency.lockutils [None req-df39de51-4c25-4e06-b007-c44a04ddc19e tempest-VolumeTypesAccessTest-479362670 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.003s {{(pid=83259) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 16 15:06:33 devstack cinder-volume[83259]: DEBUG cinder.volume.drivers.quobyte [None req-df39de51-4c25-4e06-b007-c44a04ddc19e tempest-VolumeTypesAccessTest-479362670 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-16T13:06:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeTypesAccessTest-Volume-1498815180',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#Quobyte',id=1b6d3353-917a-4562-a28d-b2bca1b3d12f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6cded12f8ce74670bbab912f1f919d61',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-16T13:06:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-16T13:06:33Z,use_quota=True,user_id='da4db6a2a2954dc0bde69d57e12a914c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(daf3d6a3-62c7-4477-9aee-f9c40d89e2bb),volume_type_id=daf3d6a3-62c7-4477-9aee-f9c40d89e2bb)}" {{(pid=83259) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Sep 16 15:06:33 devstack cinder-volume[83259]: DEBUG cinder.volume.drivers.remotefs [None req-df39de51-4c25-4e06-b007-c44a04ddc19e tempest-VolumeTypesAccessTest-479362670 None] Creating volume 1b6d3353-917a-4562-a28d-b2bca1b3d12f {{(pid=83259) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}} Sep 16 15:06:33 devstack cinder-volume[83259]: DEBUG oslo_concurrency.lockutils [None req-df39de51-4c25-4e06-b007-c44a04ddc19e tempest-VolumeTypesAccessTest-479362670 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83259) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 16 15:06:33 devstack cinder-volume[83259]: DEBUG oslo_concurrency.lockutils [None req-df39de51-4c25-4e06-b007-c44a04ddc19e tempest-VolumeTypesAccessTest-479362670 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83259) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 16 15:06:33 devstack cinder-volume[83259]: DEBUG cinder.volume.drivers.quobyte [None req-df39de51-4c25-4e06-b007-c44a04ddc19e tempest-VolumeTypesAccessTest-479362670 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-61f585ac-f8e2-4d19-a890-7ebc2726cc72': None} {{(pid=83259) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:639}} Sep 16 15:06:33 devstack cinder-volume[83259]: DEBUG cinder.volume.drivers.quobyte [None req-df39de51-4c25-4e06-b007-c44a04ddc19e tempest-VolumeTypesAccessTest-479362670 None] Available shares ['10.10.41.181/cinder-vol-61f585ac-f8e2-4d19-a890-7ebc2726cc72'] {{(pid=83259) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:669}} Sep 16 15:06:33 devstack cinder-volume[83259]: DEBUG oslo_concurrency.lockutils [None req-df39de51-4c25-4e06-b007-c44a04ddc19e tempest-VolumeTypesAccessTest-479362670 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=83259) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 16 15:06:33 devstack cinder-volume[83259]: DEBUG cinder.volume.drivers.quobyte [None req-df39de51-4c25-4e06-b007-c44a04ddc19e tempest-VolumeTypesAccessTest-479362670 None] Selected 10.10.41.181/cinder-vol-61f585ac-f8e2-4d19-a890-7ebc2726cc72 as target Quobyte volume. {{(pid=83259) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:690}} Sep 16 15:06:33 devstack cinder-volume[83259]: INFO cinder.volume.drivers.remotefs [None req-df39de51-4c25-4e06-b007-c44a04ddc19e tempest-VolumeTypesAccessTest-479362670 None] casted to 10.10.41.181/cinder-vol-61f585ac-f8e2-4d19-a890-7ebc2726cc72 Sep 16 15:06:33 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [None req-df39de51-4c25-4e06-b007-c44a04ddc19e tempest-VolumeTypesAccessTest-479362670 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c/volume-1b6d3353-917a-4562-a28d-b2bca1b3d12f 1073741824 {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 15:06:34 devstack quobyte-client[83286]: The server volume:87712ffe-8a69-446d-9ed6-4430c7ee9792@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=87712ffe-8a69-446d-9ed6-4430c7ee9792, inode=67, name=volume-1b6d3353-917a-4562-a28d-b2bca1b3d12f, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.206), requestorAccessMask=0 Sep 16 15:06:34 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [None req-df39de51-4c25-4e06-b007-c44a04ddc19e tempest-VolumeTypesAccessTest-479362670 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c/volume-1b6d3353-917a-4562-a28d-b2bca1b3d12f 1073741824" returned: 0 in 0.425s {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 15:06:34 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [None req-df39de51-4c25-4e06-b007-c44a04ddc19e tempest-VolumeTypesAccessTest-479362670 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c/volume-1b6d3353-917a-4562-a28d-b2bca1b3d12f {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 15:06:34 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [None req-df39de51-4c25-4e06-b007-c44a04ddc19e tempest-VolumeTypesAccessTest-479362670 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c/volume-1b6d3353-917a-4562-a28d-b2bca1b3d12f" returned: 0 in 0.209s {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 15:06:34 devstack cinder-volume[83259]: DEBUG cinder.volume.drivers.quobyte [None req-df39de51-4c25-4e06-b007-c44a04ddc19e tempest-VolumeTypesAccessTest-479362670 None] <== create_volume: return (726ms) {'provider_location': '10.10.41.181/cinder-vol-61f585ac-f8e2-4d19-a890-7ebc2726cc72'} {{(pid=83259) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Sep 16 15:06:34 devstack cinder-volume[83259]: DEBUG oslo_concurrency.lockutils [None req-df39de51-4c25-4e06-b007-c44a04ddc19e tempest-VolumeTypesAccessTest-479362670 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.739s {{(pid=83259) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 16 15:06:34 devstack cinder-volume[83259]: DEBUG cinder.volume.manager [None req-df39de51-4c25-4e06-b007-c44a04ddc19e tempest-VolumeTypesAccessTest-479362670 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (45b7e9ba-05cf-4177-af77-23b7cb835077) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1b6d3353-917a-4562-a28d-b2bca1b3d12f', 'volume_size': 1}' {{(pid=83259) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 15:06:34 devstack cinder-volume[83259]: DEBUG cinder.volume.manager [None req-df39de51-4c25-4e06-b007-c44a04ddc19e tempest-VolumeTypesAccessTest-479362670 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (620e829f-7aa5-47cd-875c-109a8aa30899) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83259) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 15:06:34 devstack cinder-volume[83259]: INFO cinder.volume.flows.manager.create_volume [None req-df39de51-4c25-4e06-b007-c44a04ddc19e tempest-VolumeTypesAccessTest-479362670 None] Volume volume-1b6d3353-917a-4562-a28d-b2bca1b3d12f (1b6d3353-917a-4562-a28d-b2bca1b3d12f): created successfully Sep 16 15:06:34 devstack cinder-volume[83259]: DEBUG cinder.volume.manager [None req-df39de51-4c25-4e06-b007-c44a04ddc19e tempest-VolumeTypesAccessTest-479362670 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (620e829f-7aa5-47cd-875c-109a8aa30899) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83259) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 15:06:34 devstack cinder-volume[83259]: DEBUG cinder.volume.manager [None req-df39de51-4c25-4e06-b007-c44a04ddc19e tempest-VolumeTypesAccessTest-479362670 None] Flow 'volume_create_manager' (b1453c3a-a26f-4e7a-83e3-50a953dc1e55) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83259) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 16 15:06:34 devstack cinder-volume[83259]: INFO cinder.volume.manager [None req-df39de51-4c25-4e06-b007-c44a04ddc19e tempest-VolumeTypesAccessTest-479362670 None] Created volume successfully. Sep 16 15:06:35 devstack cinder-volume[83259]: DEBUG cinder.coordination [None req-215820a7-63f0-4b5d-a21d-a533ba674c9e tempest-VolumeTypesAccessTest-479362670 None] Acquiring lock "cinder-1b6d3353-917a-4562-a28d-b2bca1b3d12f-delete_volume" by "delete_volume" {{(pid=83259) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 16 15:06:36 devstack cinder-volume[83259]: DEBUG cinder.coordination [None req-215820a7-63f0-4b5d-a21d-a533ba674c9e tempest-VolumeTypesAccessTest-479362670 None] Lock "cinder-1b6d3353-917a-4562-a28d-b2bca1b3d12f-delete_volume" acquired by "delete_volume" :: waited 0.063s {{(pid=83259) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 16 15:06:36 devstack cinder-volume[83259]: WARNING cinder.volume.volume_utils [None req-215820a7-63f0-4b5d-a21d-a533ba674c9e tempest-VolumeTypesAccessTest-479362670 None] Volume driver (QuobyteDriver 1.2) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 16 15:06:36 devstack cinder-volume[83259]: DEBUG cinder.coordination [None req-215820a7-63f0-4b5d-a21d-a533ba674c9e tempest-VolumeTypesAccessTest-479362670 None] Acquiring lock "cinder-quobyte-1b6d3353-917a-4562-a28d-b2bca1b3d12f" by "delete_volume" {{(pid=83259) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 16 15:06:36 devstack cinder-volume[83259]: DEBUG cinder.coordination [None req-215820a7-63f0-4b5d-a21d-a533ba674c9e tempest-VolumeTypesAccessTest-479362670 None] Lock "cinder-quobyte-1b6d3353-917a-4562-a28d-b2bca1b3d12f" acquired by "delete_volume" :: waited 0.015s {{(pid=83259) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 16 15:06:36 devstack cinder-volume[83259]: DEBUG oslo.privsep.daemon [-] privsep: reply[4dd7056b-99cd-4638-bffe-d59664f60833]: (4, 'qcow2') {{(pid=84312) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 16 15:06:36 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [None req-215820a7-63f0-4b5d-a21d-a533ba674c9e tempest-VolumeTypesAccessTest-479362670 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c/volume-1b6d3353-917a-4562-a28d-b2bca1b3d12f {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 15:06:36 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [None req-215820a7-63f0-4b5d-a21d-a533ba674c9e tempest-VolumeTypesAccessTest-479362670 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c/volume-1b6d3353-917a-4562-a28d-b2bca1b3d12f" returned: 0 in 0.619s {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 15:06:36 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [None req-215820a7-63f0-4b5d-a21d-a533ba674c9e tempest-VolumeTypesAccessTest-479362670 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c/volume-1b6d3353-917a-4562-a28d-b2bca1b3d12f {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 15:06:37 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [None req-215820a7-63f0-4b5d-a21d-a533ba674c9e tempest-VolumeTypesAccessTest-479362670 None] CMD "rm -f /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c/volume-1b6d3353-917a-4562-a28d-b2bca1b3d12f" returned: 0 in 0.126s {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 15:06:37 devstack cinder-volume[83259]: DEBUG cinder.coordination [None req-215820a7-63f0-4b5d-a21d-a533ba674c9e tempest-VolumeTypesAccessTest-479362670 None] Lock "cinder-quobyte-1b6d3353-917a-4562-a28d-b2bca1b3d12f" released by "delete_volume" :: held 0.954s {{(pid=83259) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 16 15:06:37 devstack cinder-volume[83259]: WARNING cinder.quota [None req-215820a7-63f0-4b5d-a21d-a533ba674c9e tempest-VolumeTypesAccessTest-479362670 None] Deprecated: Default quota for resource: volumes_tempest-VolumeTypesAccessTest-volume-type-271037521 is set by the default quota flag: quota_volumes_tempest-VolumeTypesAccessTest-volume-type-271037521, it is now deprecated. Please use the default quota class for default quota. Sep 16 15:06:37 devstack cinder-volume[83259]: WARNING cinder.quota [None req-215820a7-63f0-4b5d-a21d-a533ba674c9e tempest-VolumeTypesAccessTest-479362670 None] Deprecated: Default quota for resource: gigabytes_tempest-VolumeTypesAccessTest-volume-type-271037521 is set by the default quota flag: quota_gigabytes_tempest-VolumeTypesAccessTest-volume-type-271037521, it is now deprecated. Please use the default quota class for default quota. Sep 16 15:06:37 devstack cinder-volume[83259]: DEBUG cinder.quota [None req-215820a7-63f0-4b5d-a21d-a533ba674c9e tempest-VolumeTypesAccessTest-479362670 None] Created reservations ['b9e0d4aa-71c9-45ed-a78f-23070a05e078', 'a6223ff2-2c67-4c6c-8aeb-89c3607aed47', 'ef92b25f-6570-43fa-bf61-5c8de57c7ff0', '977246dc-b37e-49e2-88ca-ae8693744552'] {{(pid=83259) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 16 15:06:37 devstack cinder-volume[83259]: DEBUG oslo_concurrency.lockutils [None req-215820a7-63f0-4b5d-a21d-a533ba674c9e tempest-VolumeTypesAccessTest-479362670 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83259) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 16 15:06:37 devstack cinder-volume[83259]: DEBUG oslo_concurrency.lockutils [None req-215820a7-63f0-4b5d-a21d-a533ba674c9e tempest-VolumeTypesAccessTest-479362670 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.007s {{(pid=83259) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 16 15:06:37 devstack cinder-volume[83259]: DEBUG cinder.volume.drivers.quobyte [None req-215820a7-63f0-4b5d-a21d-a533ba674c9e tempest-VolumeTypesAccessTest-479362670 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-61f585ac-f8e2-4d19-a890-7ebc2726cc72': None} {{(pid=83259) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:639}} Sep 16 15:06:37 devstack cinder-volume[83259]: DEBUG cinder.volume.drivers.quobyte [None req-215820a7-63f0-4b5d-a21d-a533ba674c9e tempest-VolumeTypesAccessTest-479362670 None] Available shares ['10.10.41.181/cinder-vol-61f585ac-f8e2-4d19-a890-7ebc2726cc72'] {{(pid=83259) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:669}} Sep 16 15:06:37 devstack cinder-volume[83259]: DEBUG oslo_concurrency.lockutils [None req-215820a7-63f0-4b5d-a21d-a533ba674c9e tempest-VolumeTypesAccessTest-479362670 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=83259) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 16 15:06:37 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [None req-215820a7-63f0-4b5d-a21d-a533ba674c9e tempest-VolumeTypesAccessTest-479362670 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 15:06:37 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [None req-215820a7-63f0-4b5d-a21d-a533ba674c9e tempest-VolumeTypesAccessTest-479362670 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c" returned: 0 in 0.140s {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 15:06:37 devstack cinder-volume[83259]: DEBUG cinder.manager [None req-215820a7-63f0-4b5d-a21d-a533ba674c9e tempest-VolumeTypesAccessTest-479362670 None] Notifying Schedulers of capabilities ... {{(pid=83259) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 16 15:06:38 devstack cinder-volume[83259]: INFO cinder.volume.manager [None req-215820a7-63f0-4b5d-a21d-a533ba674c9e tempest-VolumeTypesAccessTest-479362670 None] Deleted volume successfully. Sep 16 15:06:38 devstack cinder-volume[83259]: DEBUG cinder.coordination [None req-215820a7-63f0-4b5d-a21d-a533ba674c9e tempest-VolumeTypesAccessTest-479362670 None] Lock "cinder-1b6d3353-917a-4562-a28d-b2bca1b3d12f-delete_volume" released by "delete_volume" :: held 2.631s {{(pid=83259) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 16 15:06:38 devstack cinder-volume[83259]: WARNING cinder.volume.volume_utils [None req-9956b169-419f-4013-8568-972813b9e8dc tempest-VolumesServicesTestJSON-889738229 None] Volume driver (QuobyteDriver 1.2) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 16 15:06:38 devstack cinder-volume[83259]: DEBUG cinder.volume.flows.manager.create_volume [None req-9956b169-419f-4013-8568-972813b9e8dc tempest-VolumesServicesTestJSON-889738229 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#Quobyte'], 'hosts': ['devstack@QuobyteHD#Quobyte']} {{(pid=83259) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1387}} Sep 16 15:06:38 devstack cinder-volume[83259]: DEBUG cinder.volume.manager [None req-9956b169-419f-4013-8568-972813b9e8dc tempest-VolumesServicesTestJSON-889738229 None] Flow 'volume_create_manager' (a8de7feb-f8df-4655-9844-300133cf8583) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83259) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 16 15:06:38 devstack cinder-volume[83259]: DEBUG cinder.volume.manager [None req-9956b169-419f-4013-8568-972813b9e8dc tempest-VolumesServicesTestJSON-889738229 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (37cfc539-de7b-463a-81eb-7988e099edbe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83259) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 15:06:38 devstack cinder-volume[83259]: DEBUG cinder.volume.manager [None req-9956b169-419f-4013-8568-972813b9e8dc tempest-VolumesServicesTestJSON-889738229 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (37cfc539-de7b-463a-81eb-7988e099edbe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-16T13:06:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesServicesTestJSON-Volume-1996732864',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#Quobyte',id=eecbe087-37e5-452c-ab29-c8049de2153c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c2b03b8808f74191b6ec2adb77c3d20d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-16T13:06:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-16T13:06:38Z,use_quota=True,user_id='1d38a185ea684457a113a9d5234dfe9f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(485ead50-3df8-4d76-8d34-a4db136c980a),volume_type_id=485ead50-3df8-4d76-8d34-a4db136c980a)' {{(pid=83259) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 15:06:38 devstack cinder-volume[83259]: DEBUG cinder.volume.manager [None req-9956b169-419f-4013-8568-972813b9e8dc tempest-VolumesServicesTestJSON-889738229 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9b969607-51ab-4db0-a52b-71fa9d4d83bb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83259) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 15:06:38 devstack cinder-volume[83259]: DEBUG cinder.volume.manager [None req-9956b169-419f-4013-8568-972813b9e8dc tempest-VolumesServicesTestJSON-889738229 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9b969607-51ab-4db0-a52b-71fa9d4d83bb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83259) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 15:06:39 devstack cinder-volume[83259]: DEBUG cinder.volume.manager [None req-9956b169-419f-4013-8568-972813b9e8dc tempest-VolumesServicesTestJSON-889738229 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (04ba7281-ba03-46cd-8ba0-38d41debde56) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83259) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 15:06:39 devstack cinder-volume[83259]: DEBUG cinder.volume.manager [None req-9956b169-419f-4013-8568-972813b9e8dc tempest-VolumesServicesTestJSON-889738229 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (04ba7281-ba03-46cd-8ba0-38d41debde56) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'eecbe087-37e5-452c-ab29-c8049de2153c', 'volume_name': 'volume-eecbe087-37e5-452c-ab29-c8049de2153c', 'volume_size': 1}' {{(pid=83259) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 15:06:39 devstack cinder-volume[83259]: DEBUG cinder.volume.manager [None req-9956b169-419f-4013-8568-972813b9e8dc tempest-VolumesServicesTestJSON-889738229 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bb026942-2829-42c3-8d7f-ae9ea1c8c324) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83259) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 15:06:39 devstack cinder-volume[83259]: DEBUG cinder.volume.manager [None req-9956b169-419f-4013-8568-972813b9e8dc tempest-VolumesServicesTestJSON-889738229 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bb026942-2829-42c3-8d7f-ae9ea1c8c324) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83259) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 15:06:39 devstack cinder-volume[83259]: DEBUG cinder.volume.manager [None req-9956b169-419f-4013-8568-972813b9e8dc tempest-VolumesServicesTestJSON-889738229 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (74b611e2-f0b6-4cf0-a012-38f26c72cde0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83259) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 15:06:39 devstack cinder-volume[83259]: INFO cinder.volume.flows.manager.create_volume [None req-9956b169-419f-4013-8568-972813b9e8dc tempest-VolumesServicesTestJSON-889738229 None] Volume eecbe087-37e5-452c-ab29-c8049de2153c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-eecbe087-37e5-452c-ab29-c8049de2153c', 'volume_size': 1} Sep 16 15:06:39 devstack cinder-volume[83259]: DEBUG oslo_concurrency.lockutils [None req-9956b169-419f-4013-8568-972813b9e8dc tempest-VolumesServicesTestJSON-889738229 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83259) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 16 15:06:39 devstack cinder-volume[83259]: DEBUG oslo_concurrency.lockutils [None req-9956b169-419f-4013-8568-972813b9e8dc tempest-VolumesServicesTestJSON-889738229 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=83259) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 16 15:06:39 devstack cinder-volume[83259]: DEBUG cinder.volume.drivers.quobyte [None req-9956b169-419f-4013-8568-972813b9e8dc tempest-VolumesServicesTestJSON-889738229 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-16T13:06:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesServicesTestJSON-Volume-1996732864',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#Quobyte',id=eecbe087-37e5-452c-ab29-c8049de2153c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c2b03b8808f74191b6ec2adb77c3d20d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-16T13:06:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-16T13:06:38Z,use_quota=True,user_id='1d38a185ea684457a113a9d5234dfe9f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(485ead50-3df8-4d76-8d34-a4db136c980a),volume_type_id=485ead50-3df8-4d76-8d34-a4db136c980a)}" {{(pid=83259) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Sep 16 15:06:39 devstack cinder-volume[83259]: DEBUG cinder.volume.drivers.remotefs [None req-9956b169-419f-4013-8568-972813b9e8dc tempest-VolumesServicesTestJSON-889738229 None] Creating volume eecbe087-37e5-452c-ab29-c8049de2153c {{(pid=83259) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}} Sep 16 15:06:39 devstack cinder-volume[83259]: DEBUG oslo_concurrency.lockutils [None req-9956b169-419f-4013-8568-972813b9e8dc tempest-VolumesServicesTestJSON-889738229 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83259) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 16 15:06:39 devstack cinder-volume[83259]: DEBUG oslo_concurrency.lockutils [None req-9956b169-419f-4013-8568-972813b9e8dc tempest-VolumesServicesTestJSON-889738229 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83259) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 16 15:06:39 devstack cinder-volume[83259]: DEBUG cinder.volume.drivers.quobyte [None req-9956b169-419f-4013-8568-972813b9e8dc tempest-VolumesServicesTestJSON-889738229 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-61f585ac-f8e2-4d19-a890-7ebc2726cc72': None} {{(pid=83259) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:639}} Sep 16 15:06:39 devstack cinder-volume[83259]: DEBUG cinder.volume.drivers.quobyte [None req-9956b169-419f-4013-8568-972813b9e8dc tempest-VolumesServicesTestJSON-889738229 None] Available shares ['10.10.41.181/cinder-vol-61f585ac-f8e2-4d19-a890-7ebc2726cc72'] {{(pid=83259) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:669}} Sep 16 15:06:39 devstack cinder-volume[83259]: DEBUG oslo_concurrency.lockutils [None req-9956b169-419f-4013-8568-972813b9e8dc tempest-VolumesServicesTestJSON-889738229 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=83259) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 16 15:06:39 devstack cinder-volume[83259]: DEBUG cinder.volume.drivers.quobyte [None req-9956b169-419f-4013-8568-972813b9e8dc tempest-VolumesServicesTestJSON-889738229 None] Selected 10.10.41.181/cinder-vol-61f585ac-f8e2-4d19-a890-7ebc2726cc72 as target Quobyte volume. {{(pid=83259) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:690}} Sep 16 15:06:39 devstack cinder-volume[83259]: INFO cinder.volume.drivers.remotefs [None req-9956b169-419f-4013-8568-972813b9e8dc tempest-VolumesServicesTestJSON-889738229 None] casted to 10.10.41.181/cinder-vol-61f585ac-f8e2-4d19-a890-7ebc2726cc72 Sep 16 15:06:39 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [None req-9956b169-419f-4013-8568-972813b9e8dc tempest-VolumesServicesTestJSON-889738229 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c/volume-eecbe087-37e5-452c-ab29-c8049de2153c 1073741824 {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 15:06:39 devstack quobyte-client[83286]: System call of process 93801 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 16 15:06:39 devstack quobyte-client[83286]: The server volume:87712ffe-8a69-446d-9ed6-4430c7ee9792@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=87712ffe-8a69-446d-9ed6-4430c7ee9792, inode=68, name=volume-eecbe087-37e5-452c-ab29-c8049de2153c, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.206), requestorAccessMask=0 Sep 16 15:06:39 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [None req-9956b169-419f-4013-8568-972813b9e8dc tempest-VolumesServicesTestJSON-889738229 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c/volume-eecbe087-37e5-452c-ab29-c8049de2153c 1073741824" returned: 0 in 0.444s {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 15:06:39 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [None req-9956b169-419f-4013-8568-972813b9e8dc tempest-VolumesServicesTestJSON-889738229 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c/volume-eecbe087-37e5-452c-ab29-c8049de2153c {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 15:06:39 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [None req-9956b169-419f-4013-8568-972813b9e8dc tempest-VolumesServicesTestJSON-889738229 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c/volume-eecbe087-37e5-452c-ab29-c8049de2153c" returned: 0 in 0.239s {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 15:06:39 devstack cinder-volume[83259]: DEBUG cinder.volume.drivers.quobyte [None req-9956b169-419f-4013-8568-972813b9e8dc tempest-VolumesServicesTestJSON-889738229 None] <== create_volume: return (775ms) {'provider_location': '10.10.41.181/cinder-vol-61f585ac-f8e2-4d19-a890-7ebc2726cc72'} {{(pid=83259) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Sep 16 15:06:39 devstack cinder-volume[83259]: DEBUG oslo_concurrency.lockutils [None req-9956b169-419f-4013-8568-972813b9e8dc tempest-VolumesServicesTestJSON-889738229 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.790s {{(pid=83259) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 16 15:06:40 devstack cinder-volume[83259]: DEBUG cinder.volume.manager [None req-9956b169-419f-4013-8568-972813b9e8dc tempest-VolumesServicesTestJSON-889738229 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (74b611e2-f0b6-4cf0-a012-38f26c72cde0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-eecbe087-37e5-452c-ab29-c8049de2153c', 'volume_size': 1}' {{(pid=83259) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 15:06:40 devstack cinder-volume[83259]: DEBUG cinder.volume.manager [None req-9956b169-419f-4013-8568-972813b9e8dc tempest-VolumesServicesTestJSON-889738229 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fa91c9a0-5cff-48e4-9eee-05454848c380) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83259) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 15:06:40 devstack cinder-volume[83259]: INFO cinder.volume.flows.manager.create_volume [None req-9956b169-419f-4013-8568-972813b9e8dc tempest-VolumesServicesTestJSON-889738229 None] Volume volume-eecbe087-37e5-452c-ab29-c8049de2153c (eecbe087-37e5-452c-ab29-c8049de2153c): created successfully Sep 16 15:06:40 devstack cinder-volume[83259]: DEBUG cinder.volume.manager [None req-9956b169-419f-4013-8568-972813b9e8dc tempest-VolumesServicesTestJSON-889738229 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fa91c9a0-5cff-48e4-9eee-05454848c380) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83259) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 15:06:40 devstack cinder-volume[83259]: DEBUG cinder.volume.manager [None req-9956b169-419f-4013-8568-972813b9e8dc tempest-VolumesServicesTestJSON-889738229 None] Flow 'volume_create_manager' (a8de7feb-f8df-4655-9844-300133cf8583) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83259) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 16 15:06:40 devstack cinder-volume[83259]: INFO cinder.volume.manager [None req-9956b169-419f-4013-8568-972813b9e8dc tempest-VolumesServicesTestJSON-889738229 None] Created volume successfully. Sep 16 15:06:41 devstack cinder-volume[83259]: DEBUG cinder.coordination [None req-723471d4-530b-4f80-95de-fc73cd233db9 tempest-VolumesServicesTestJSON-889738229 None] Acquiring lock "cinder-eecbe087-37e5-452c-ab29-c8049de2153c-delete_volume" by "delete_volume" {{(pid=83259) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 16 15:06:41 devstack cinder-volume[83259]: DEBUG cinder.coordination [None req-723471d4-530b-4f80-95de-fc73cd233db9 tempest-VolumesServicesTestJSON-889738229 None] Lock "cinder-eecbe087-37e5-452c-ab29-c8049de2153c-delete_volume" acquired by "delete_volume" :: waited 0.088s {{(pid=83259) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 16 15:06:41 devstack cinder-volume[83259]: WARNING cinder.volume.volume_utils [None req-723471d4-530b-4f80-95de-fc73cd233db9 tempest-VolumesServicesTestJSON-889738229 None] Volume driver (QuobyteDriver 1.2) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 16 15:06:41 devstack cinder-volume[83259]: DEBUG cinder.coordination [None req-723471d4-530b-4f80-95de-fc73cd233db9 tempest-VolumesServicesTestJSON-889738229 None] Acquiring lock "cinder-quobyte-eecbe087-37e5-452c-ab29-c8049de2153c" by "delete_volume" {{(pid=83259) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 16 15:06:41 devstack cinder-volume[83259]: DEBUG cinder.coordination [None req-723471d4-530b-4f80-95de-fc73cd233db9 tempest-VolumesServicesTestJSON-889738229 None] Lock "cinder-quobyte-eecbe087-37e5-452c-ab29-c8049de2153c" acquired by "delete_volume" :: waited 0.014s {{(pid=83259) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 16 15:06:41 devstack cinder-volume[83259]: DEBUG oslo.privsep.daemon [-] privsep: reply[2340dcc6-1b18-49c7-845f-b8c16b58093d]: (4, 'qcow2') {{(pid=84312) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 16 15:06:41 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [None req-723471d4-530b-4f80-95de-fc73cd233db9 tempest-VolumesServicesTestJSON-889738229 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c/volume-eecbe087-37e5-452c-ab29-c8049de2153c {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 15:06:42 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [None req-723471d4-530b-4f80-95de-fc73cd233db9 tempest-VolumesServicesTestJSON-889738229 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c/volume-eecbe087-37e5-452c-ab29-c8049de2153c" returned: 0 in 0.723s {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 15:06:42 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [None req-723471d4-530b-4f80-95de-fc73cd233db9 tempest-VolumesServicesTestJSON-889738229 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c/volume-eecbe087-37e5-452c-ab29-c8049de2153c {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 15:06:42 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [None req-723471d4-530b-4f80-95de-fc73cd233db9 tempest-VolumesServicesTestJSON-889738229 None] CMD "rm -f /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c/volume-eecbe087-37e5-452c-ab29-c8049de2153c" returned: 0 in 0.244s {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 15:06:42 devstack cinder-volume[83259]: DEBUG cinder.coordination [None req-723471d4-530b-4f80-95de-fc73cd233db9 tempest-VolumesServicesTestJSON-889738229 None] Lock "cinder-quobyte-eecbe087-37e5-452c-ab29-c8049de2153c" released by "delete_volume" :: held 1.300s {{(pid=83259) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 16 15:06:43 devstack cinder-volume[83259]: DEBUG cinder.quota [None req-723471d4-530b-4f80-95de-fc73cd233db9 tempest-VolumesServicesTestJSON-889738229 None] Created reservations ['4a86b842-9f24-4537-b8a0-056701f4bcf3', '6647bf84-c571-4525-a04e-ec19586282b9', '2fef7e5b-233e-4b41-a37a-908cf6cc3991', '496675a0-42d5-46d5-b992-e3c7969f37f9'] {{(pid=83259) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 16 15:06:43 devstack cinder-volume[83259]: DEBUG oslo_concurrency.lockutils [None req-723471d4-530b-4f80-95de-fc73cd233db9 tempest-VolumesServicesTestJSON-889738229 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83259) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 16 15:06:43 devstack cinder-volume[83259]: DEBUG oslo_concurrency.lockutils [None req-723471d4-530b-4f80-95de-fc73cd233db9 tempest-VolumesServicesTestJSON-889738229 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=83259) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 16 15:06:43 devstack cinder-volume[83259]: DEBUG cinder.volume.drivers.quobyte [None req-723471d4-530b-4f80-95de-fc73cd233db9 tempest-VolumesServicesTestJSON-889738229 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-61f585ac-f8e2-4d19-a890-7ebc2726cc72': None} {{(pid=83259) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:639}} Sep 16 15:06:43 devstack cinder-volume[83259]: DEBUG cinder.volume.drivers.quobyte [None req-723471d4-530b-4f80-95de-fc73cd233db9 tempest-VolumesServicesTestJSON-889738229 None] Available shares ['10.10.41.181/cinder-vol-61f585ac-f8e2-4d19-a890-7ebc2726cc72'] {{(pid=83259) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:669}} Sep 16 15:06:43 devstack cinder-volume[83259]: DEBUG oslo_concurrency.lockutils [None req-723471d4-530b-4f80-95de-fc73cd233db9 tempest-VolumesServicesTestJSON-889738229 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=83259) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 16 15:06:43 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [None req-723471d4-530b-4f80-95de-fc73cd233db9 tempest-VolumesServicesTestJSON-889738229 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 15:06:43 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [None req-723471d4-530b-4f80-95de-fc73cd233db9 tempest-VolumesServicesTestJSON-889738229 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c" returned: 0 in 0.201s {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 15:06:43 devstack cinder-volume[83259]: DEBUG cinder.manager [None req-723471d4-530b-4f80-95de-fc73cd233db9 tempest-VolumesServicesTestJSON-889738229 None] Notifying Schedulers of capabilities ... {{(pid=83259) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 16 15:06:43 devstack cinder-volume[83259]: INFO cinder.volume.manager [None req-723471d4-530b-4f80-95de-fc73cd233db9 tempest-VolumesServicesTestJSON-889738229 None] Deleted volume successfully. Sep 16 15:06:43 devstack cinder-volume[83259]: DEBUG cinder.coordination [None req-723471d4-530b-4f80-95de-fc73cd233db9 tempest-VolumesServicesTestJSON-889738229 None] Lock "cinder-eecbe087-37e5-452c-ab29-c8049de2153c-delete_volume" released by "delete_volume" :: held 2.675s {{(pid=83259) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 16 15:06:44 devstack cinder-volume[83259]: WARNING cinder.volume.volume_utils [None req-cf0bcee1-dbf8-4304-b258-6923a2924f61 tempest-TestServerVolumeAttachScenarioOldVersion-929263564 None] Volume driver (QuobyteDriver 1.2) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 16 15:06:44 devstack cinder-volume[83259]: DEBUG cinder.volume.flows.manager.create_volume [None req-cf0bcee1-dbf8-4304-b258-6923a2924f61 tempest-TestServerVolumeAttachScenarioOldVersion-929263564 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#Quobyte'], 'hosts': ['devstack@QuobyteHD#Quobyte']} {{(pid=83259) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1387}} Sep 16 15:06:44 devstack cinder-volume[83259]: DEBUG cinder.volume.manager [None req-cf0bcee1-dbf8-4304-b258-6923a2924f61 tempest-TestServerVolumeAttachScenarioOldVersion-929263564 None] Flow 'volume_create_manager' (039839a9-bbbd-4082-8dba-15c046d479d1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83259) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 16 15:06:44 devstack cinder-volume[83259]: DEBUG cinder.volume.manager [None req-cf0bcee1-dbf8-4304-b258-6923a2924f61 tempest-TestServerVolumeAttachScenarioOldVersion-929263564 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9c6c7150-3c17-4299-9e54-778c2d08c119) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83259) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 15:06:44 devstack cinder-volume[83259]: DEBUG cinder.volume.manager [None req-cf0bcee1-dbf8-4304-b258-6923a2924f61 tempest-TestServerVolumeAttachScenarioOldVersion-929263564 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9c6c7150-3c17-4299-9e54-778c2d08c119) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-16T13:06:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachScenarioOldVersion-volume-72123780',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#Quobyte',id=179246e2-5916-4b62-9684-9e9d55587aa2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fd1c6bbba0af43d6a121fc951bca062a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-16T13:06:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-16T13:06:44Z,use_quota=True,user_id='22564b56e0324390ab56ae48fdee92c5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(485ead50-3df8-4d76-8d34-a4db136c980a),volume_type_id=485ead50-3df8-4d76-8d34-a4db136c980a)' {{(pid=83259) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 15:06:44 devstack cinder-volume[83259]: DEBUG cinder.volume.manager [None req-cf0bcee1-dbf8-4304-b258-6923a2924f61 tempest-TestServerVolumeAttachScenarioOldVersion-929263564 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ef5a51b1-f907-4532-955b-0d1ac3350799) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83259) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 15:06:44 devstack cinder-volume[83259]: DEBUG cinder.volume.manager [None req-cf0bcee1-dbf8-4304-b258-6923a2924f61 tempest-TestServerVolumeAttachScenarioOldVersion-929263564 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ef5a51b1-f907-4532-955b-0d1ac3350799) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83259) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 15:06:44 devstack cinder-volume[83259]: DEBUG cinder.volume.manager [None req-cf0bcee1-dbf8-4304-b258-6923a2924f61 tempest-TestServerVolumeAttachScenarioOldVersion-929263564 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6c1fff10-baa0-4b19-a5ef-52ab54cd84d4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83259) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 15:06:44 devstack cinder-volume[83259]: DEBUG cinder.volume.manager [None req-cf0bcee1-dbf8-4304-b258-6923a2924f61 tempest-TestServerVolumeAttachScenarioOldVersion-929263564 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6c1fff10-baa0-4b19-a5ef-52ab54cd84d4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '179246e2-5916-4b62-9684-9e9d55587aa2', 'volume_name': 'volume-179246e2-5916-4b62-9684-9e9d55587aa2', 'volume_size': 1}' {{(pid=83259) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 15:06:44 devstack cinder-volume[83259]: DEBUG cinder.volume.manager [None req-cf0bcee1-dbf8-4304-b258-6923a2924f61 tempest-TestServerVolumeAttachScenarioOldVersion-929263564 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1fa87f12-15c5-4ea3-9b2f-41b5ab279019) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83259) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 15:06:44 devstack cinder-volume[83259]: DEBUG cinder.volume.manager [None req-cf0bcee1-dbf8-4304-b258-6923a2924f61 tempest-TestServerVolumeAttachScenarioOldVersion-929263564 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1fa87f12-15c5-4ea3-9b2f-41b5ab279019) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83259) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 15:06:44 devstack cinder-volume[83259]: DEBUG cinder.volume.manager [None req-cf0bcee1-dbf8-4304-b258-6923a2924f61 tempest-TestServerVolumeAttachScenarioOldVersion-929263564 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0904290c-3adc-476a-a204-e589ef787124) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83259) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 15:06:44 devstack cinder-volume[83259]: INFO cinder.volume.flows.manager.create_volume [None req-cf0bcee1-dbf8-4304-b258-6923a2924f61 tempest-TestServerVolumeAttachScenarioOldVersion-929263564 None] Volume 179246e2-5916-4b62-9684-9e9d55587aa2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-179246e2-5916-4b62-9684-9e9d55587aa2', 'volume_size': 1} Sep 16 15:06:44 devstack cinder-volume[83259]: DEBUG oslo_concurrency.lockutils [None req-cf0bcee1-dbf8-4304-b258-6923a2924f61 tempest-TestServerVolumeAttachScenarioOldVersion-929263564 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83259) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 16 15:06:44 devstack cinder-volume[83259]: DEBUG oslo_concurrency.lockutils [None req-cf0bcee1-dbf8-4304-b258-6923a2924f61 tempest-TestServerVolumeAttachScenarioOldVersion-929263564 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=83259) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 16 15:06:44 devstack cinder-volume[83259]: DEBUG cinder.volume.drivers.quobyte [None req-cf0bcee1-dbf8-4304-b258-6923a2924f61 tempest-TestServerVolumeAttachScenarioOldVersion-929263564 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-16T13:06:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachScenarioOldVersion-volume-72123780',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#Quobyte',id=179246e2-5916-4b62-9684-9e9d55587aa2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fd1c6bbba0af43d6a121fc951bca062a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-16T13:06:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-16T13:06:44Z,use_quota=True,user_id='22564b56e0324390ab56ae48fdee92c5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(485ead50-3df8-4d76-8d34-a4db136c980a),volume_type_id=485ead50-3df8-4d76-8d34-a4db136c980a)}" {{(pid=83259) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Sep 16 15:06:44 devstack cinder-volume[83259]: DEBUG cinder.volume.drivers.remotefs [None req-cf0bcee1-dbf8-4304-b258-6923a2924f61 tempest-TestServerVolumeAttachScenarioOldVersion-929263564 None] Creating volume 179246e2-5916-4b62-9684-9e9d55587aa2 {{(pid=83259) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}} Sep 16 15:06:44 devstack cinder-volume[83259]: DEBUG oslo_concurrency.lockutils [None req-cf0bcee1-dbf8-4304-b258-6923a2924f61 tempest-TestServerVolumeAttachScenarioOldVersion-929263564 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83259) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 16 15:06:44 devstack cinder-volume[83259]: DEBUG oslo_concurrency.lockutils [None req-cf0bcee1-dbf8-4304-b258-6923a2924f61 tempest-TestServerVolumeAttachScenarioOldVersion-929263564 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83259) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 16 15:06:44 devstack cinder-volume[83259]: DEBUG cinder.volume.drivers.quobyte [None req-cf0bcee1-dbf8-4304-b258-6923a2924f61 tempest-TestServerVolumeAttachScenarioOldVersion-929263564 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-61f585ac-f8e2-4d19-a890-7ebc2726cc72': None} {{(pid=83259) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:639}} Sep 16 15:06:44 devstack cinder-volume[83259]: DEBUG cinder.volume.drivers.quobyte [None req-cf0bcee1-dbf8-4304-b258-6923a2924f61 tempest-TestServerVolumeAttachScenarioOldVersion-929263564 None] Available shares ['10.10.41.181/cinder-vol-61f585ac-f8e2-4d19-a890-7ebc2726cc72'] {{(pid=83259) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:669}} Sep 16 15:06:44 devstack cinder-volume[83259]: DEBUG oslo_concurrency.lockutils [None req-cf0bcee1-dbf8-4304-b258-6923a2924f61 tempest-TestServerVolumeAttachScenarioOldVersion-929263564 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=83259) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 16 15:06:44 devstack cinder-volume[83259]: DEBUG cinder.volume.drivers.quobyte [None req-cf0bcee1-dbf8-4304-b258-6923a2924f61 tempest-TestServerVolumeAttachScenarioOldVersion-929263564 None] Selected 10.10.41.181/cinder-vol-61f585ac-f8e2-4d19-a890-7ebc2726cc72 as target Quobyte volume. {{(pid=83259) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:690}} Sep 16 15:06:44 devstack cinder-volume[83259]: INFO cinder.volume.drivers.remotefs [None req-cf0bcee1-dbf8-4304-b258-6923a2924f61 tempest-TestServerVolumeAttachScenarioOldVersion-929263564 None] casted to 10.10.41.181/cinder-vol-61f585ac-f8e2-4d19-a890-7ebc2726cc72 Sep 16 15:06:44 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [None req-cf0bcee1-dbf8-4304-b258-6923a2924f61 tempest-TestServerVolumeAttachScenarioOldVersion-929263564 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c/volume-179246e2-5916-4b62-9684-9e9d55587aa2 1073741824 {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 15:06:44 devstack quobyte-client[83286]: The server volume:87712ffe-8a69-446d-9ed6-4430c7ee9792@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=87712ffe-8a69-446d-9ed6-4430c7ee9792, inode=69, name=volume-179246e2-5916-4b62-9684-9e9d55587aa2, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.206), requestorAccessMask=0 Sep 16 15:06:44 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [None req-cf0bcee1-dbf8-4304-b258-6923a2924f61 tempest-TestServerVolumeAttachScenarioOldVersion-929263564 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c/volume-179246e2-5916-4b62-9684-9e9d55587aa2 1073741824" returned: 0 in 0.386s {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 15:06:44 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [None req-cf0bcee1-dbf8-4304-b258-6923a2924f61 tempest-TestServerVolumeAttachScenarioOldVersion-929263564 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c/volume-179246e2-5916-4b62-9684-9e9d55587aa2 {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 15:06:45 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [None req-cf0bcee1-dbf8-4304-b258-6923a2924f61 tempest-TestServerVolumeAttachScenarioOldVersion-929263564 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c/volume-179246e2-5916-4b62-9684-9e9d55587aa2" returned: 0 in 0.161s {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 15:06:45 devstack cinder-volume[83259]: DEBUG cinder.volume.drivers.quobyte [None req-cf0bcee1-dbf8-4304-b258-6923a2924f61 tempest-TestServerVolumeAttachScenarioOldVersion-929263564 None] <== create_volume: return (633ms) {'provider_location': '10.10.41.181/cinder-vol-61f585ac-f8e2-4d19-a890-7ebc2726cc72'} {{(pid=83259) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Sep 16 15:06:45 devstack cinder-volume[83259]: DEBUG oslo_concurrency.lockutils [None req-cf0bcee1-dbf8-4304-b258-6923a2924f61 tempest-TestServerVolumeAttachScenarioOldVersion-929263564 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.647s {{(pid=83259) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 16 15:06:45 devstack cinder-volume[83259]: DEBUG cinder.volume.manager [None req-cf0bcee1-dbf8-4304-b258-6923a2924f61 tempest-TestServerVolumeAttachScenarioOldVersion-929263564 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0904290c-3adc-476a-a204-e589ef787124) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-179246e2-5916-4b62-9684-9e9d55587aa2', 'volume_size': 1}' {{(pid=83259) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 15:06:45 devstack cinder-volume[83259]: DEBUG cinder.volume.manager [None req-cf0bcee1-dbf8-4304-b258-6923a2924f61 tempest-TestServerVolumeAttachScenarioOldVersion-929263564 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (40f63bf3-87f0-42c1-872b-afa7731f9c18) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83259) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 15:06:45 devstack cinder-volume[83259]: INFO cinder.volume.flows.manager.create_volume [None req-cf0bcee1-dbf8-4304-b258-6923a2924f61 tempest-TestServerVolumeAttachScenarioOldVersion-929263564 None] Volume volume-179246e2-5916-4b62-9684-9e9d55587aa2 (179246e2-5916-4b62-9684-9e9d55587aa2): created successfully Sep 16 15:06:45 devstack cinder-volume[83259]: DEBUG cinder.volume.manager [None req-cf0bcee1-dbf8-4304-b258-6923a2924f61 tempest-TestServerVolumeAttachScenarioOldVersion-929263564 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (40f63bf3-87f0-42c1-872b-afa7731f9c18) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83259) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 15:06:45 devstack cinder-volume[83259]: DEBUG cinder.volume.manager [None req-cf0bcee1-dbf8-4304-b258-6923a2924f61 tempest-TestServerVolumeAttachScenarioOldVersion-929263564 None] Flow 'volume_create_manager' (039839a9-bbbd-4082-8dba-15c046d479d1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83259) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 16 15:06:45 devstack cinder-volume[83259]: INFO cinder.volume.manager [None req-cf0bcee1-dbf8-4304-b258-6923a2924f61 tempest-TestServerVolumeAttachScenarioOldVersion-929263564 None] Created volume successfully. Sep 16 15:06:45 devstack cinder-volume[83259]: DEBUG oslo_service.periodic_task [None req-050ec8a1-6ffd-499d-95ad-d548a84437e2 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=83259) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} Sep 16 15:06:45 devstack cinder-volume[83259]: DEBUG oslo_concurrency.lockutils [None req-050ec8a1-6ffd-499d-95ad-d548a84437e2 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83259) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 16 15:06:45 devstack cinder-volume[83259]: DEBUG oslo_concurrency.lockutils [None req-050ec8a1-6ffd-499d-95ad-d548a84437e2 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=83259) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 16 15:06:45 devstack cinder-volume[83259]: DEBUG cinder.volume.drivers.quobyte [None req-050ec8a1-6ffd-499d-95ad-d548a84437e2 None None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-61f585ac-f8e2-4d19-a890-7ebc2726cc72': None} {{(pid=83259) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:639}} Sep 16 15:06:45 devstack cinder-volume[83259]: DEBUG cinder.volume.drivers.quobyte [None req-050ec8a1-6ffd-499d-95ad-d548a84437e2 None None] Available shares ['10.10.41.181/cinder-vol-61f585ac-f8e2-4d19-a890-7ebc2726cc72'] {{(pid=83259) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:669}} Sep 16 15:06:45 devstack cinder-volume[83259]: DEBUG oslo_concurrency.lockutils [None req-050ec8a1-6ffd-499d-95ad-d548a84437e2 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=83259) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 16 15:06:45 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [None req-050ec8a1-6ffd-499d-95ad-d548a84437e2 None None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 15:06:45 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [None req-050ec8a1-6ffd-499d-95ad-d548a84437e2 None None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c" returned: 0 in 0.228s {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 15:06:45 devstack cinder-volume[83259]: DEBUG cinder.manager [None req-050ec8a1-6ffd-499d-95ad-d548a84437e2 None None] Notifying Schedulers of capabilities ... {{(pid=83259) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 16 15:06:50 devstack cinder-volume[83259]: WARNING cinder.volume.volume_utils [None req-9184e3f1-268f-441b-8b90-7a578c26d0eb tempest-VolumesListAdminTestJSON-78946226 None] Volume driver (QuobyteDriver 1.2) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 16 15:06:50 devstack cinder-volume[83259]: DEBUG cinder.volume.flows.manager.create_volume [None req-9184e3f1-268f-441b-8b90-7a578c26d0eb tempest-VolumesListAdminTestJSON-78946226 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#Quobyte'], 'hosts': ['devstack@QuobyteHD#Quobyte']} {{(pid=83259) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1387}} Sep 16 15:06:50 devstack cinder-volume[83259]: DEBUG cinder.volume.manager [None req-9184e3f1-268f-441b-8b90-7a578c26d0eb tempest-VolumesListAdminTestJSON-78946226 None] Flow 'volume_create_manager' (fa8512ba-d83c-4384-acb9-51950fbf227c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83259) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 16 15:06:50 devstack cinder-volume[83259]: DEBUG cinder.volume.manager [None req-9184e3f1-268f-441b-8b90-7a578c26d0eb tempest-VolumesListAdminTestJSON-78946226 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2ababb58-3f7a-4e67-9de3-7d68698099e4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83259) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 15:06:50 devstack cinder-volume[83259]: DEBUG cinder.volume.manager [None req-9184e3f1-268f-441b-8b90-7a578c26d0eb tempest-VolumesListAdminTestJSON-78946226 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2ababb58-3f7a-4e67-9de3-7d68698099e4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-16T13:06:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-1940636755',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#Quobyte',id=da48ebf1-0b1e-4104-85f3-19dee9a63e36,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6b10ec5d1cf24ecd80d8ef9173044270',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-16T13:06:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-16T13:06:50Z,use_quota=True,user_id='537902b0d2fa4885b2c2a9a5b20749b5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(485ead50-3df8-4d76-8d34-a4db136c980a),volume_type_id=485ead50-3df8-4d76-8d34-a4db136c980a)' {{(pid=83259) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 15:06:50 devstack cinder-volume[83259]: DEBUG cinder.volume.manager [None req-9184e3f1-268f-441b-8b90-7a578c26d0eb tempest-VolumesListAdminTestJSON-78946226 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (07e6da69-c381-41c8-841c-f0448c106a53) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83259) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 15:06:50 devstack cinder-volume[83259]: DEBUG cinder.volume.manager [None req-9184e3f1-268f-441b-8b90-7a578c26d0eb tempest-VolumesListAdminTestJSON-78946226 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (07e6da69-c381-41c8-841c-f0448c106a53) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83259) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 15:06:50 devstack cinder-volume[83259]: DEBUG cinder.volume.manager [None req-9184e3f1-268f-441b-8b90-7a578c26d0eb tempest-VolumesListAdminTestJSON-78946226 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (62a9ab7a-438b-4797-b8e4-5b81189360f2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83259) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 15:06:50 devstack cinder-volume[83259]: DEBUG cinder.volume.manager [None req-9184e3f1-268f-441b-8b90-7a578c26d0eb tempest-VolumesListAdminTestJSON-78946226 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (62a9ab7a-438b-4797-b8e4-5b81189360f2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'da48ebf1-0b1e-4104-85f3-19dee9a63e36', 'volume_name': 'volume-da48ebf1-0b1e-4104-85f3-19dee9a63e36', 'volume_size': 1}' {{(pid=83259) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 15:06:50 devstack cinder-volume[83259]: DEBUG cinder.volume.manager [None req-9184e3f1-268f-441b-8b90-7a578c26d0eb tempest-VolumesListAdminTestJSON-78946226 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a51cc90b-99b3-4f44-961b-28d9dc81feb5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83259) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 15:06:50 devstack cinder-volume[83259]: DEBUG cinder.volume.manager [None req-9184e3f1-268f-441b-8b90-7a578c26d0eb tempest-VolumesListAdminTestJSON-78946226 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a51cc90b-99b3-4f44-961b-28d9dc81feb5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83259) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 15:06:50 devstack cinder-volume[83259]: DEBUG cinder.volume.manager [None req-9184e3f1-268f-441b-8b90-7a578c26d0eb tempest-VolumesListAdminTestJSON-78946226 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (642a0705-9431-4116-8eaf-a042e1758613) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83259) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 15:06:50 devstack cinder-volume[83259]: INFO cinder.volume.flows.manager.create_volume [None req-9184e3f1-268f-441b-8b90-7a578c26d0eb tempest-VolumesListAdminTestJSON-78946226 None] Volume da48ebf1-0b1e-4104-85f3-19dee9a63e36: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-da48ebf1-0b1e-4104-85f3-19dee9a63e36', 'volume_size': 1} Sep 16 15:06:50 devstack cinder-volume[83259]: DEBUG oslo_concurrency.lockutils [None req-9184e3f1-268f-441b-8b90-7a578c26d0eb tempest-VolumesListAdminTestJSON-78946226 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83259) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 16 15:06:50 devstack cinder-volume[83259]: DEBUG oslo_concurrency.lockutils [None req-9184e3f1-268f-441b-8b90-7a578c26d0eb tempest-VolumesListAdminTestJSON-78946226 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.004s {{(pid=83259) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 16 15:06:50 devstack cinder-volume[83259]: DEBUG cinder.volume.drivers.quobyte [None req-9184e3f1-268f-441b-8b90-7a578c26d0eb tempest-VolumesListAdminTestJSON-78946226 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-16T13:06:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-1940636755',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#Quobyte',id=da48ebf1-0b1e-4104-85f3-19dee9a63e36,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6b10ec5d1cf24ecd80d8ef9173044270',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-16T13:06:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-16T13:06:50Z,use_quota=True,user_id='537902b0d2fa4885b2c2a9a5b20749b5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(485ead50-3df8-4d76-8d34-a4db136c980a),volume_type_id=485ead50-3df8-4d76-8d34-a4db136c980a)}" {{(pid=83259) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Sep 16 15:06:50 devstack cinder-volume[83259]: DEBUG cinder.volume.drivers.remotefs [None req-9184e3f1-268f-441b-8b90-7a578c26d0eb tempest-VolumesListAdminTestJSON-78946226 None] Creating volume da48ebf1-0b1e-4104-85f3-19dee9a63e36 {{(pid=83259) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}} Sep 16 15:06:50 devstack cinder-volume[83259]: DEBUG oslo_concurrency.lockutils [None req-9184e3f1-268f-441b-8b90-7a578c26d0eb tempest-VolumesListAdminTestJSON-78946226 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83259) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 16 15:06:50 devstack cinder-volume[83259]: DEBUG oslo_concurrency.lockutils [None req-9184e3f1-268f-441b-8b90-7a578c26d0eb tempest-VolumesListAdminTestJSON-78946226 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83259) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 16 15:06:50 devstack cinder-volume[83259]: DEBUG cinder.volume.drivers.quobyte [None req-9184e3f1-268f-441b-8b90-7a578c26d0eb tempest-VolumesListAdminTestJSON-78946226 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-61f585ac-f8e2-4d19-a890-7ebc2726cc72': None} {{(pid=83259) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:639}} Sep 16 15:06:50 devstack cinder-volume[83259]: DEBUG cinder.volume.drivers.quobyte [None req-9184e3f1-268f-441b-8b90-7a578c26d0eb tempest-VolumesListAdminTestJSON-78946226 None] Available shares ['10.10.41.181/cinder-vol-61f585ac-f8e2-4d19-a890-7ebc2726cc72'] {{(pid=83259) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:669}} Sep 16 15:06:50 devstack cinder-volume[83259]: DEBUG oslo_concurrency.lockutils [None req-9184e3f1-268f-441b-8b90-7a578c26d0eb tempest-VolumesListAdminTestJSON-78946226 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=83259) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 16 15:06:50 devstack cinder-volume[83259]: DEBUG cinder.volume.drivers.quobyte [None req-9184e3f1-268f-441b-8b90-7a578c26d0eb tempest-VolumesListAdminTestJSON-78946226 None] Selected 10.10.41.181/cinder-vol-61f585ac-f8e2-4d19-a890-7ebc2726cc72 as target Quobyte volume. {{(pid=83259) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:690}} Sep 16 15:06:50 devstack cinder-volume[83259]: INFO cinder.volume.drivers.remotefs [None req-9184e3f1-268f-441b-8b90-7a578c26d0eb tempest-VolumesListAdminTestJSON-78946226 None] casted to 10.10.41.181/cinder-vol-61f585ac-f8e2-4d19-a890-7ebc2726cc72 Sep 16 15:06:50 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [None req-9184e3f1-268f-441b-8b90-7a578c26d0eb tempest-VolumesListAdminTestJSON-78946226 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c/volume-da48ebf1-0b1e-4104-85f3-19dee9a63e36 1073741824 {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 15:06:50 devstack quobyte-client[83286]: The server volume:87712ffe-8a69-446d-9ed6-4430c7ee9792@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=87712ffe-8a69-446d-9ed6-4430c7ee9792, inode=70, name=volume-da48ebf1-0b1e-4104-85f3-19dee9a63e36, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.206), requestorAccessMask=0 Sep 16 15:06:51 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [None req-9184e3f1-268f-441b-8b90-7a578c26d0eb tempest-VolumesListAdminTestJSON-78946226 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c/volume-da48ebf1-0b1e-4104-85f3-19dee9a63e36 1073741824" returned: 0 in 0.656s {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 15:06:51 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [None req-9184e3f1-268f-441b-8b90-7a578c26d0eb tempest-VolumesListAdminTestJSON-78946226 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c/volume-da48ebf1-0b1e-4104-85f3-19dee9a63e36 {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 15:06:51 devstack cinder-volume[83259]: DEBUG oslo_concurrency.lockutils [req-e743a5dc-640c-47bb-88dc-8f89b6b3bfb5 req-c8829db6-a9d3-4ba7-80c2-5a363d92d1d6 tempest-TestServerVolumeAttachScenarioOldVersion-929263564 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=83259) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 16 15:06:51 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [None req-9184e3f1-268f-441b-8b90-7a578c26d0eb tempest-VolumesListAdminTestJSON-78946226 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c/volume-da48ebf1-0b1e-4104-85f3-19dee9a63e36" returned: 0 in 0.196s {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 15:06:51 devstack cinder-volume[83259]: DEBUG cinder.volume.drivers.quobyte [None req-9184e3f1-268f-441b-8b90-7a578c26d0eb tempest-VolumesListAdminTestJSON-78946226 None] <== create_volume: return (890ms) {'provider_location': '10.10.41.181/cinder-vol-61f585ac-f8e2-4d19-a890-7ebc2726cc72'} {{(pid=83259) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Sep 16 15:06:51 devstack cinder-volume[83259]: DEBUG oslo_concurrency.lockutils [None req-9184e3f1-268f-441b-8b90-7a578c26d0eb tempest-VolumesListAdminTestJSON-78946226 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.901s {{(pid=83259) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 16 15:06:51 devstack cinder-volume[83259]: DEBUG oslo_concurrency.lockutils [req-e743a5dc-640c-47bb-88dc-8f89b6b3bfb5 req-c8829db6-a9d3-4ba7-80c2-5a363d92d1d6 tempest-TestServerVolumeAttachScenarioOldVersion-929263564 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.176s {{(pid=83259) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 16 15:06:51 devstack cinder-volume[83259]: DEBUG oslo.privsep.daemon [-] privsep: reply[4e3e46e6-d429-46f0-9c53-7f21298ce39b]: (4, 'qcow2') {{(pid=84312) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 16 15:06:51 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [req-e743a5dc-640c-47bb-88dc-8f89b6b3bfb5 req-c8829db6-a9d3-4ba7-80c2-5a363d92d1d6 tempest-TestServerVolumeAttachScenarioOldVersion-929263564 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c/volume-179246e2-5916-4b62-9684-9e9d55587aa2 {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 15:06:51 devstack cinder-volume[83259]: DEBUG cinder.volume.manager [None req-9184e3f1-268f-441b-8b90-7a578c26d0eb tempest-VolumesListAdminTestJSON-78946226 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (642a0705-9431-4116-8eaf-a042e1758613) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-da48ebf1-0b1e-4104-85f3-19dee9a63e36', 'volume_size': 1}' {{(pid=83259) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 15:06:51 devstack cinder-volume[83259]: DEBUG cinder.volume.manager [None req-9184e3f1-268f-441b-8b90-7a578c26d0eb tempest-VolumesListAdminTestJSON-78946226 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f36ac0c4-026a-4045-b988-d161d35941cd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83259) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 15:06:52 devstack cinder-volume[83259]: INFO cinder.volume.flows.manager.create_volume [None req-9184e3f1-268f-441b-8b90-7a578c26d0eb tempest-VolumesListAdminTestJSON-78946226 None] Volume volume-da48ebf1-0b1e-4104-85f3-19dee9a63e36 (da48ebf1-0b1e-4104-85f3-19dee9a63e36): created successfully Sep 16 15:06:52 devstack cinder-volume[83259]: DEBUG cinder.volume.manager [None req-9184e3f1-268f-441b-8b90-7a578c26d0eb tempest-VolumesListAdminTestJSON-78946226 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f36ac0c4-026a-4045-b988-d161d35941cd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83259) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 15:06:52 devstack cinder-volume[83259]: DEBUG cinder.volume.manager [None req-9184e3f1-268f-441b-8b90-7a578c26d0eb tempest-VolumesListAdminTestJSON-78946226 None] Flow 'volume_create_manager' (fa8512ba-d83c-4384-acb9-51950fbf227c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83259) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 16 15:06:52 devstack cinder-volume[83259]: INFO cinder.volume.manager [None req-9184e3f1-268f-441b-8b90-7a578c26d0eb tempest-VolumesListAdminTestJSON-78946226 None] Created volume successfully. Sep 16 15:06:52 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [req-e743a5dc-640c-47bb-88dc-8f89b6b3bfb5 req-c8829db6-a9d3-4ba7-80c2-5a363d92d1d6 tempest-TestServerVolumeAttachScenarioOldVersion-929263564 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c/volume-179246e2-5916-4b62-9684-9e9d55587aa2" returned: 0 in 0.588s {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 15:06:52 devstack cinder-volume[83259]: DEBUG oslo_concurrency.lockutils [req-e743a5dc-640c-47bb-88dc-8f89b6b3bfb5 req-c8829db6-a9d3-4ba7-80c2-5a363d92d1d6 tempest-TestServerVolumeAttachScenarioOldVersion-929263564 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.635s {{(pid=83259) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 16 15:06:52 devstack cinder-volume[83259]: DEBUG cinder.volume.manager [req-e743a5dc-640c-47bb-88dc-8f89b6b3bfb5 req-c8829db6-a9d3-4ba7-80c2-5a363d92d1d6 tempest-TestServerVolumeAttachScenarioOldVersion-929263564 None] Connection info returned from driver {'export': '10.10.41.181/cinder-vol-61f585ac-f8e2-4d19-a890-7ebc2726cc72', 'name': 'volume-179246e2-5916-4b62-9684-9e9d55587aa2', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'fd261355-2264-46b6-a42f-b7d8e456fa85', 'enforce_multipath': True} {{(pid=83259) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4891}} Sep 16 15:06:52 devstack cinder-volume[83259]: WARNING cinder.volume.volume_utils [req-e743a5dc-640c-47bb-88dc-8f89b6b3bfb5 req-c8829db6-a9d3-4ba7-80c2-5a363d92d1d6 tempest-TestServerVolumeAttachScenarioOldVersion-929263564 None] Volume driver (QuobyteDriver 1.2) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 16 15:06:52 devstack cinder-volume[83259]: INFO cinder.volume.manager [req-e743a5dc-640c-47bb-88dc-8f89b6b3bfb5 req-c8829db6-a9d3-4ba7-80c2-5a363d92d1d6 tempest-TestServerVolumeAttachScenarioOldVersion-929263564 None] attachment_update completed successfully. Sep 16 15:06:53 devstack cinder-volume[83259]: WARNING cinder.volume.volume_utils [None req-33af7ba2-d32f-4596-8ad7-618f7d53150b tempest-VolumesListAdminTestJSON-78946226 None] Volume driver (QuobyteDriver 1.2) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 16 15:06:53 devstack cinder-volume[83259]: DEBUG cinder.volume.flows.manager.create_volume [None req-33af7ba2-d32f-4596-8ad7-618f7d53150b tempest-VolumesListAdminTestJSON-78946226 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#Quobyte'], 'hosts': ['devstack@QuobyteHD#Quobyte']} {{(pid=83259) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1387}} Sep 16 15:06:53 devstack cinder-volume[83259]: DEBUG cinder.volume.manager [None req-33af7ba2-d32f-4596-8ad7-618f7d53150b tempest-VolumesListAdminTestJSON-78946226 None] Flow 'volume_create_manager' (d3356e53-d75a-41ae-a6a4-5f95fa07dbbe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83259) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 16 15:06:53 devstack cinder-volume[83259]: DEBUG cinder.volume.manager [None req-33af7ba2-d32f-4596-8ad7-618f7d53150b tempest-VolumesListAdminTestJSON-78946226 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d4334f97-2d9b-40a4-833c-bc65235c8ec5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83259) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 15:06:53 devstack cinder-volume[83259]: DEBUG cinder.volume.manager [None req-33af7ba2-d32f-4596-8ad7-618f7d53150b tempest-VolumesListAdminTestJSON-78946226 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d4334f97-2d9b-40a4-833c-bc65235c8ec5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-16T13:06:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-368370536',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#Quobyte',id=ece6179e-7d60-4952-8c10-bd6522e2bc1a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6b10ec5d1cf24ecd80d8ef9173044270',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-16T13:06:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-16T13:06:54Z,use_quota=True,user_id='537902b0d2fa4885b2c2a9a5b20749b5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(485ead50-3df8-4d76-8d34-a4db136c980a),volume_type_id=485ead50-3df8-4d76-8d34-a4db136c980a)' {{(pid=83259) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 15:06:53 devstack cinder-volume[83259]: DEBUG cinder.volume.manager [None req-33af7ba2-d32f-4596-8ad7-618f7d53150b tempest-VolumesListAdminTestJSON-78946226 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (02660cf5-8a5e-4dd9-a3b7-1535676466a2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83259) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 15:06:53 devstack cinder-volume[83259]: DEBUG cinder.volume.manager [None req-33af7ba2-d32f-4596-8ad7-618f7d53150b tempest-VolumesListAdminTestJSON-78946226 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (02660cf5-8a5e-4dd9-a3b7-1535676466a2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83259) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 15:06:53 devstack cinder-volume[83259]: DEBUG cinder.volume.manager [None req-33af7ba2-d32f-4596-8ad7-618f7d53150b tempest-VolumesListAdminTestJSON-78946226 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dac14a97-481e-45a3-9848-2b327c6f8f73) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83259) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 15:06:53 devstack cinder-volume[83259]: DEBUG cinder.volume.manager [None req-33af7ba2-d32f-4596-8ad7-618f7d53150b tempest-VolumesListAdminTestJSON-78946226 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dac14a97-481e-45a3-9848-2b327c6f8f73) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ece6179e-7d60-4952-8c10-bd6522e2bc1a', 'volume_name': 'volume-ece6179e-7d60-4952-8c10-bd6522e2bc1a', 'volume_size': 1}' {{(pid=83259) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 15:06:53 devstack cinder-volume[83259]: DEBUG cinder.volume.manager [None req-33af7ba2-d32f-4596-8ad7-618f7d53150b tempest-VolumesListAdminTestJSON-78946226 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (54fa8e34-a8ec-4f9b-8990-7a4e8a158f66) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83259) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 15:06:53 devstack cinder-volume[83259]: DEBUG cinder.volume.manager [None req-33af7ba2-d32f-4596-8ad7-618f7d53150b tempest-VolumesListAdminTestJSON-78946226 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (54fa8e34-a8ec-4f9b-8990-7a4e8a158f66) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83259) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 15:06:53 devstack cinder-volume[83259]: DEBUG cinder.volume.manager [None req-33af7ba2-d32f-4596-8ad7-618f7d53150b tempest-VolumesListAdminTestJSON-78946226 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (70c656e1-c2e6-44da-8055-041a1f07ffc9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83259) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 15:06:53 devstack cinder-volume[83259]: INFO cinder.volume.flows.manager.create_volume [None req-33af7ba2-d32f-4596-8ad7-618f7d53150b tempest-VolumesListAdminTestJSON-78946226 None] Volume ece6179e-7d60-4952-8c10-bd6522e2bc1a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ece6179e-7d60-4952-8c10-bd6522e2bc1a', 'volume_size': 1} Sep 16 15:06:53 devstack cinder-volume[83259]: DEBUG oslo_concurrency.lockutils [None req-33af7ba2-d32f-4596-8ad7-618f7d53150b tempest-VolumesListAdminTestJSON-78946226 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83259) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 16 15:06:53 devstack cinder-volume[83259]: DEBUG oslo_concurrency.lockutils [None req-33af7ba2-d32f-4596-8ad7-618f7d53150b tempest-VolumesListAdminTestJSON-78946226 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=83259) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 16 15:06:53 devstack cinder-volume[83259]: DEBUG cinder.volume.drivers.quobyte [None req-33af7ba2-d32f-4596-8ad7-618f7d53150b tempest-VolumesListAdminTestJSON-78946226 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-16T13:06:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-368370536',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#Quobyte',id=ece6179e-7d60-4952-8c10-bd6522e2bc1a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6b10ec5d1cf24ecd80d8ef9173044270',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-16T13:06:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-16T13:06:54Z,use_quota=True,user_id='537902b0d2fa4885b2c2a9a5b20749b5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(485ead50-3df8-4d76-8d34-a4db136c980a),volume_type_id=485ead50-3df8-4d76-8d34-a4db136c980a)}" {{(pid=83259) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Sep 16 15:06:53 devstack cinder-volume[83259]: DEBUG cinder.volume.drivers.remotefs [None req-33af7ba2-d32f-4596-8ad7-618f7d53150b tempest-VolumesListAdminTestJSON-78946226 None] Creating volume ece6179e-7d60-4952-8c10-bd6522e2bc1a {{(pid=83259) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}} Sep 16 15:06:53 devstack cinder-volume[83259]: DEBUG oslo_concurrency.lockutils [None req-33af7ba2-d32f-4596-8ad7-618f7d53150b tempest-VolumesListAdminTestJSON-78946226 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83259) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 16 15:06:53 devstack cinder-volume[83259]: DEBUG oslo_concurrency.lockutils [None req-33af7ba2-d32f-4596-8ad7-618f7d53150b tempest-VolumesListAdminTestJSON-78946226 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83259) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 16 15:06:53 devstack cinder-volume[83259]: DEBUG cinder.volume.drivers.quobyte [None req-33af7ba2-d32f-4596-8ad7-618f7d53150b tempest-VolumesListAdminTestJSON-78946226 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-61f585ac-f8e2-4d19-a890-7ebc2726cc72': None} {{(pid=83259) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:639}} Sep 16 15:06:53 devstack cinder-volume[83259]: DEBUG cinder.volume.drivers.quobyte [None req-33af7ba2-d32f-4596-8ad7-618f7d53150b tempest-VolumesListAdminTestJSON-78946226 None] Available shares ['10.10.41.181/cinder-vol-61f585ac-f8e2-4d19-a890-7ebc2726cc72'] {{(pid=83259) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:669}} Sep 16 15:06:53 devstack cinder-volume[83259]: DEBUG oslo_concurrency.lockutils [None req-33af7ba2-d32f-4596-8ad7-618f7d53150b tempest-VolumesListAdminTestJSON-78946226 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=83259) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 16 15:06:53 devstack cinder-volume[83259]: DEBUG cinder.volume.drivers.quobyte [None req-33af7ba2-d32f-4596-8ad7-618f7d53150b tempest-VolumesListAdminTestJSON-78946226 None] Selected 10.10.41.181/cinder-vol-61f585ac-f8e2-4d19-a890-7ebc2726cc72 as target Quobyte volume. {{(pid=83259) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:690}} Sep 16 15:06:53 devstack cinder-volume[83259]: INFO cinder.volume.drivers.remotefs [None req-33af7ba2-d32f-4596-8ad7-618f7d53150b tempest-VolumesListAdminTestJSON-78946226 None] casted to 10.10.41.181/cinder-vol-61f585ac-f8e2-4d19-a890-7ebc2726cc72 Sep 16 15:06:53 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [None req-33af7ba2-d32f-4596-8ad7-618f7d53150b tempest-VolumesListAdminTestJSON-78946226 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c/volume-ece6179e-7d60-4952-8c10-bd6522e2bc1a 1073741824 {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 15:06:54 devstack quobyte-client[83286]: The server volume:87712ffe-8a69-446d-9ed6-4430c7ee9792@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=87712ffe-8a69-446d-9ed6-4430c7ee9792, inode=71, name=volume-ece6179e-7d60-4952-8c10-bd6522e2bc1a, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.206), requestorAccessMask=0 Sep 16 15:06:54 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [None req-33af7ba2-d32f-4596-8ad7-618f7d53150b tempest-VolumesListAdminTestJSON-78946226 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c/volume-ece6179e-7d60-4952-8c10-bd6522e2bc1a 1073741824" returned: 0 in 0.378s {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 15:06:54 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [None req-33af7ba2-d32f-4596-8ad7-618f7d53150b tempest-VolumesListAdminTestJSON-78946226 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c/volume-ece6179e-7d60-4952-8c10-bd6522e2bc1a {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 15:06:54 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [None req-33af7ba2-d32f-4596-8ad7-618f7d53150b tempest-VolumesListAdminTestJSON-78946226 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c/volume-ece6179e-7d60-4952-8c10-bd6522e2bc1a" returned: 0 in 0.210s {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 15:06:54 devstack cinder-volume[83259]: DEBUG cinder.volume.drivers.quobyte [None req-33af7ba2-d32f-4596-8ad7-618f7d53150b tempest-VolumesListAdminTestJSON-78946226 None] <== create_volume: return (705ms) {'provider_location': '10.10.41.181/cinder-vol-61f585ac-f8e2-4d19-a890-7ebc2726cc72'} {{(pid=83259) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Sep 16 15:06:54 devstack cinder-volume[83259]: DEBUG oslo_concurrency.lockutils [None req-33af7ba2-d32f-4596-8ad7-618f7d53150b tempest-VolumesListAdminTestJSON-78946226 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.725s {{(pid=83259) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 16 15:06:54 devstack cinder-volume[83259]: DEBUG cinder.volume.manager [None req-33af7ba2-d32f-4596-8ad7-618f7d53150b tempest-VolumesListAdminTestJSON-78946226 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (70c656e1-c2e6-44da-8055-041a1f07ffc9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ece6179e-7d60-4952-8c10-bd6522e2bc1a', 'volume_size': 1}' {{(pid=83259) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 15:06:54 devstack cinder-volume[83259]: DEBUG cinder.volume.manager [None req-33af7ba2-d32f-4596-8ad7-618f7d53150b tempest-VolumesListAdminTestJSON-78946226 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2c471203-6c32-42c2-9161-e6f7225353f6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83259) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 15:06:55 devstack cinder-volume[83259]: INFO cinder.volume.flows.manager.create_volume [None req-33af7ba2-d32f-4596-8ad7-618f7d53150b tempest-VolumesListAdminTestJSON-78946226 None] Volume volume-ece6179e-7d60-4952-8c10-bd6522e2bc1a (ece6179e-7d60-4952-8c10-bd6522e2bc1a): created successfully Sep 16 15:06:55 devstack cinder-volume[83259]: DEBUG cinder.volume.manager [None req-33af7ba2-d32f-4596-8ad7-618f7d53150b tempest-VolumesListAdminTestJSON-78946226 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2c471203-6c32-42c2-9161-e6f7225353f6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83259) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 15:06:55 devstack cinder-volume[83259]: DEBUG cinder.volume.manager [None req-33af7ba2-d32f-4596-8ad7-618f7d53150b tempest-VolumesListAdminTestJSON-78946226 None] Flow 'volume_create_manager' (d3356e53-d75a-41ae-a6a4-5f95fa07dbbe) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83259) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 16 15:06:55 devstack cinder-volume[83259]: INFO cinder.volume.manager [None req-33af7ba2-d32f-4596-8ad7-618f7d53150b tempest-VolumesListAdminTestJSON-78946226 None] Created volume successfully. Sep 16 15:06:56 devstack cinder-volume[83259]: WARNING cinder.volume.volume_utils [None req-58d752cd-cdfc-4e7d-a2d3-a083fa04038b tempest-VolumesListAdminTestJSON-78946226 None] Volume driver (QuobyteDriver 1.2) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 16 15:06:56 devstack cinder-volume[83259]: DEBUG cinder.volume.flows.manager.create_volume [None req-58d752cd-cdfc-4e7d-a2d3-a083fa04038b tempest-VolumesListAdminTestJSON-78946226 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#Quobyte'], 'hosts': ['devstack@QuobyteHD#Quobyte']} {{(pid=83259) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1387}} Sep 16 15:06:56 devstack cinder-volume[83259]: DEBUG cinder.volume.manager [None req-58d752cd-cdfc-4e7d-a2d3-a083fa04038b tempest-VolumesListAdminTestJSON-78946226 None] Flow 'volume_create_manager' (95794fad-c3f5-493f-a621-59162a00553c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83259) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 16 15:06:56 devstack cinder-volume[83259]: DEBUG cinder.volume.manager [None req-58d752cd-cdfc-4e7d-a2d3-a083fa04038b tempest-VolumesListAdminTestJSON-78946226 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (897e7783-61de-455e-8c47-229e4cd78876) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83259) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 15:06:56 devstack cinder-volume[83259]: DEBUG cinder.volume.manager [None req-58d752cd-cdfc-4e7d-a2d3-a083fa04038b tempest-VolumesListAdminTestJSON-78946226 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (897e7783-61de-455e-8c47-229e4cd78876) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-16T13:06:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-708275189',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#Quobyte',id=673d231e-66e0-40ec-9626-8308928bca73,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6b10ec5d1cf24ecd80d8ef9173044270',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-16T13:06:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-16T13:06:57Z,use_quota=True,user_id='537902b0d2fa4885b2c2a9a5b20749b5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(485ead50-3df8-4d76-8d34-a4db136c980a),volume_type_id=485ead50-3df8-4d76-8d34-a4db136c980a)' {{(pid=83259) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 15:06:56 devstack cinder-volume[83259]: DEBUG cinder.volume.manager [None req-58d752cd-cdfc-4e7d-a2d3-a083fa04038b tempest-VolumesListAdminTestJSON-78946226 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (899e5226-3280-40e0-ad98-6361082d2a72) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83259) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 15:06:56 devstack cinder-volume[83259]: DEBUG cinder.volume.manager [None req-58d752cd-cdfc-4e7d-a2d3-a083fa04038b tempest-VolumesListAdminTestJSON-78946226 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (899e5226-3280-40e0-ad98-6361082d2a72) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83259) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 15:06:56 devstack cinder-volume[83259]: DEBUG cinder.volume.manager [None req-58d752cd-cdfc-4e7d-a2d3-a083fa04038b tempest-VolumesListAdminTestJSON-78946226 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b00aa77a-8b44-40de-8ca5-660e2ce3e175) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83259) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 15:06:56 devstack cinder-volume[83259]: DEBUG cinder.volume.manager [None req-58d752cd-cdfc-4e7d-a2d3-a083fa04038b tempest-VolumesListAdminTestJSON-78946226 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b00aa77a-8b44-40de-8ca5-660e2ce3e175) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '673d231e-66e0-40ec-9626-8308928bca73', 'volume_name': 'volume-673d231e-66e0-40ec-9626-8308928bca73', 'volume_size': 1}' {{(pid=83259) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 15:06:56 devstack cinder-volume[83259]: DEBUG cinder.volume.manager [None req-58d752cd-cdfc-4e7d-a2d3-a083fa04038b tempest-VolumesListAdminTestJSON-78946226 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a7c6e663-8817-4ef3-b5f9-5554692c266d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83259) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 15:06:56 devstack cinder-volume[83259]: DEBUG cinder.volume.manager [None req-58d752cd-cdfc-4e7d-a2d3-a083fa04038b tempest-VolumesListAdminTestJSON-78946226 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a7c6e663-8817-4ef3-b5f9-5554692c266d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83259) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 15:06:56 devstack cinder-volume[83259]: DEBUG cinder.volume.manager [None req-58d752cd-cdfc-4e7d-a2d3-a083fa04038b tempest-VolumesListAdminTestJSON-78946226 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4232bc95-5e86-4654-b4ed-d7b26b81b278) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83259) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 15:06:56 devstack cinder-volume[83259]: INFO cinder.volume.flows.manager.create_volume [None req-58d752cd-cdfc-4e7d-a2d3-a083fa04038b tempest-VolumesListAdminTestJSON-78946226 None] Volume 673d231e-66e0-40ec-9626-8308928bca73: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-673d231e-66e0-40ec-9626-8308928bca73', 'volume_size': 1} Sep 16 15:06:57 devstack cinder-volume[83259]: DEBUG oslo_concurrency.lockutils [None req-58d752cd-cdfc-4e7d-a2d3-a083fa04038b tempest-VolumesListAdminTestJSON-78946226 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83259) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 16 15:06:57 devstack cinder-volume[83259]: DEBUG oslo_concurrency.lockutils [None req-58d752cd-cdfc-4e7d-a2d3-a083fa04038b tempest-VolumesListAdminTestJSON-78946226 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.003s {{(pid=83259) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 16 15:06:57 devstack cinder-volume[83259]: DEBUG cinder.volume.drivers.quobyte [None req-58d752cd-cdfc-4e7d-a2d3-a083fa04038b tempest-VolumesListAdminTestJSON-78946226 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-16T13:06:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-708275189',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#Quobyte',id=673d231e-66e0-40ec-9626-8308928bca73,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6b10ec5d1cf24ecd80d8ef9173044270',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-16T13:06:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-16T13:06:57Z,use_quota=True,user_id='537902b0d2fa4885b2c2a9a5b20749b5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(485ead50-3df8-4d76-8d34-a4db136c980a),volume_type_id=485ead50-3df8-4d76-8d34-a4db136c980a)}" {{(pid=83259) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Sep 16 15:06:57 devstack cinder-volume[83259]: DEBUG cinder.volume.drivers.remotefs [None req-58d752cd-cdfc-4e7d-a2d3-a083fa04038b tempest-VolumesListAdminTestJSON-78946226 None] Creating volume 673d231e-66e0-40ec-9626-8308928bca73 {{(pid=83259) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}} Sep 16 15:06:57 devstack cinder-volume[83259]: DEBUG oslo_concurrency.lockutils [None req-58d752cd-cdfc-4e7d-a2d3-a083fa04038b tempest-VolumesListAdminTestJSON-78946226 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83259) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 16 15:06:57 devstack cinder-volume[83259]: DEBUG oslo_concurrency.lockutils [None req-58d752cd-cdfc-4e7d-a2d3-a083fa04038b tempest-VolumesListAdminTestJSON-78946226 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83259) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 16 15:06:57 devstack cinder-volume[83259]: DEBUG cinder.volume.drivers.quobyte [None req-58d752cd-cdfc-4e7d-a2d3-a083fa04038b tempest-VolumesListAdminTestJSON-78946226 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-61f585ac-f8e2-4d19-a890-7ebc2726cc72': None} {{(pid=83259) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:639}} Sep 16 15:06:57 devstack cinder-volume[83259]: DEBUG cinder.volume.drivers.quobyte [None req-58d752cd-cdfc-4e7d-a2d3-a083fa04038b tempest-VolumesListAdminTestJSON-78946226 None] Available shares ['10.10.41.181/cinder-vol-61f585ac-f8e2-4d19-a890-7ebc2726cc72'] {{(pid=83259) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:669}} Sep 16 15:06:57 devstack cinder-volume[83259]: DEBUG oslo_concurrency.lockutils [None req-58d752cd-cdfc-4e7d-a2d3-a083fa04038b tempest-VolumesListAdminTestJSON-78946226 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=83259) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 16 15:06:57 devstack cinder-volume[83259]: DEBUG cinder.volume.drivers.quobyte [None req-58d752cd-cdfc-4e7d-a2d3-a083fa04038b tempest-VolumesListAdminTestJSON-78946226 None] Selected 10.10.41.181/cinder-vol-61f585ac-f8e2-4d19-a890-7ebc2726cc72 as target Quobyte volume. {{(pid=83259) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:690}} Sep 16 15:06:57 devstack cinder-volume[83259]: INFO cinder.volume.drivers.remotefs [None req-58d752cd-cdfc-4e7d-a2d3-a083fa04038b tempest-VolumesListAdminTestJSON-78946226 None] casted to 10.10.41.181/cinder-vol-61f585ac-f8e2-4d19-a890-7ebc2726cc72 Sep 16 15:06:57 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [None req-58d752cd-cdfc-4e7d-a2d3-a083fa04038b tempest-VolumesListAdminTestJSON-78946226 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c/volume-673d231e-66e0-40ec-9626-8308928bca73 1073741824 {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 15:06:57 devstack quobyte-client[83286]: The server volume:87712ffe-8a69-446d-9ed6-4430c7ee9792@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=87712ffe-8a69-446d-9ed6-4430c7ee9792, inode=72, name=volume-673d231e-66e0-40ec-9626-8308928bca73, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.206), requestorAccessMask=0 Sep 16 15:06:57 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [None req-58d752cd-cdfc-4e7d-a2d3-a083fa04038b tempest-VolumesListAdminTestJSON-78946226 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c/volume-673d231e-66e0-40ec-9626-8308928bca73 1073741824" returned: 0 in 0.434s {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 15:06:57 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [None req-58d752cd-cdfc-4e7d-a2d3-a083fa04038b tempest-VolumesListAdminTestJSON-78946226 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c/volume-673d231e-66e0-40ec-9626-8308928bca73 {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 15:06:57 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [None req-58d752cd-cdfc-4e7d-a2d3-a083fa04038b tempest-VolumesListAdminTestJSON-78946226 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c/volume-673d231e-66e0-40ec-9626-8308928bca73" returned: 0 in 0.162s {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 15:06:57 devstack cinder-volume[83259]: DEBUG cinder.volume.drivers.quobyte [None req-58d752cd-cdfc-4e7d-a2d3-a083fa04038b tempest-VolumesListAdminTestJSON-78946226 None] <== create_volume: return (678ms) {'provider_location': '10.10.41.181/cinder-vol-61f585ac-f8e2-4d19-a890-7ebc2726cc72'} {{(pid=83259) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Sep 16 15:06:57 devstack cinder-volume[83259]: DEBUG oslo_concurrency.lockutils [None req-58d752cd-cdfc-4e7d-a2d3-a083fa04038b tempest-VolumesListAdminTestJSON-78946226 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.696s {{(pid=83259) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 16 15:06:57 devstack cinder-volume[83259]: DEBUG dbcounter [-] [83259] Writing DB stats cinder:SELECT=60,cinder:UPDATE=74,cinder:INSERT=9,cinder:DELETE=4 {{(pid=83259) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Sep 16 15:06:57 devstack cinder-volume[83259]: DEBUG cinder.volume.manager [None req-58d752cd-cdfc-4e7d-a2d3-a083fa04038b tempest-VolumesListAdminTestJSON-78946226 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4232bc95-5e86-4654-b4ed-d7b26b81b278) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-673d231e-66e0-40ec-9626-8308928bca73', 'volume_size': 1}' {{(pid=83259) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 15:06:57 devstack cinder-volume[83259]: DEBUG cinder.volume.manager [None req-58d752cd-cdfc-4e7d-a2d3-a083fa04038b tempest-VolumesListAdminTestJSON-78946226 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1f9afa4e-9253-4de9-8135-c02175194efd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83259) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 15:06:57 devstack cinder-volume[83259]: DEBUG dbcounter [-] [83259] Writing DB stats cinder:UPDATE=74,cinder:SELECT=47,cinder:DELETE=11,cinder:INSERT=15 {{(pid=83259) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Sep 16 15:06:58 devstack cinder-volume[83259]: INFO cinder.volume.flows.manager.create_volume [None req-58d752cd-cdfc-4e7d-a2d3-a083fa04038b tempest-VolumesListAdminTestJSON-78946226 None] Volume volume-673d231e-66e0-40ec-9626-8308928bca73 (673d231e-66e0-40ec-9626-8308928bca73): created successfully Sep 16 15:06:58 devstack cinder-volume[83259]: DEBUG cinder.volume.manager [None req-58d752cd-cdfc-4e7d-a2d3-a083fa04038b tempest-VolumesListAdminTestJSON-78946226 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1f9afa4e-9253-4de9-8135-c02175194efd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83259) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 15:06:58 devstack cinder-volume[83259]: DEBUG cinder.volume.manager [None req-58d752cd-cdfc-4e7d-a2d3-a083fa04038b tempest-VolumesListAdminTestJSON-78946226 None] Flow 'volume_create_manager' (95794fad-c3f5-493f-a621-59162a00553c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83259) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 16 15:06:58 devstack cinder-volume[83259]: INFO cinder.volume.manager [None req-58d752cd-cdfc-4e7d-a2d3-a083fa04038b tempest-VolumesListAdminTestJSON-78946226 None] Created volume successfully. Sep 16 15:07:00 devstack cinder-volume[83259]: WARNING cinder.volume.volume_utils [None req-59091deb-44dc-4c83-8ea0-03c7e7b30042 tempest-VolumesListAdminTestJSON-1524776145 None] Volume driver (QuobyteDriver 1.2) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 16 15:07:00 devstack cinder-volume[83259]: DEBUG cinder.volume.flows.manager.create_volume [None req-59091deb-44dc-4c83-8ea0-03c7e7b30042 tempest-VolumesListAdminTestJSON-1524776145 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#Quobyte'], 'hosts': ['devstack@QuobyteHD#Quobyte']} {{(pid=83259) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1387}} Sep 16 15:07:00 devstack cinder-volume[83259]: DEBUG cinder.volume.manager [None req-59091deb-44dc-4c83-8ea0-03c7e7b30042 tempest-VolumesListAdminTestJSON-1524776145 None] Flow 'volume_create_manager' (1f93492d-1168-4982-bdc6-1eb6171d70b2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83259) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 16 15:07:00 devstack cinder-volume[83259]: DEBUG cinder.volume.manager [None req-59091deb-44dc-4c83-8ea0-03c7e7b30042 tempest-VolumesListAdminTestJSON-1524776145 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (50c9a1aa-fadc-41fc-83f2-f9736e6a61da) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83259) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 15:07:00 devstack cinder-volume[83259]: DEBUG cinder.volume.manager [None req-59091deb-44dc-4c83-8ea0-03c7e7b30042 tempest-VolumesListAdminTestJSON-1524776145 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (50c9a1aa-fadc-41fc-83f2-f9736e6a61da) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-16T13:06:59Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#Quobyte',id=0c3ec8ab-f263-495a-86cc-8e16a1244b70,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='795df43155d848f2a9154adb88a2baa1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-16T13:07:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-16T13:07:00Z,use_quota=True,user_id='e6c48c07a90d4159913a2f759026e544',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(485ead50-3df8-4d76-8d34-a4db136c980a),volume_type_id=485ead50-3df8-4d76-8d34-a4db136c980a)' {{(pid=83259) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 15:07:00 devstack cinder-volume[83259]: DEBUG cinder.volume.manager [None req-59091deb-44dc-4c83-8ea0-03c7e7b30042 tempest-VolumesListAdminTestJSON-1524776145 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a311c741-e29c-41e9-9ffb-0638506755dd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83259) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 15:07:00 devstack cinder-volume[83259]: DEBUG cinder.volume.manager [None req-59091deb-44dc-4c83-8ea0-03c7e7b30042 tempest-VolumesListAdminTestJSON-1524776145 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a311c741-e29c-41e9-9ffb-0638506755dd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83259) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 15:07:00 devstack cinder-volume[83259]: DEBUG cinder.volume.manager [None req-59091deb-44dc-4c83-8ea0-03c7e7b30042 tempest-VolumesListAdminTestJSON-1524776145 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (903cd1de-b744-411a-9d8d-89b8b20bcb11) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83259) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 15:07:00 devstack cinder-volume[83259]: DEBUG cinder.volume.manager [None req-59091deb-44dc-4c83-8ea0-03c7e7b30042 tempest-VolumesListAdminTestJSON-1524776145 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (903cd1de-b744-411a-9d8d-89b8b20bcb11) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0c3ec8ab-f263-495a-86cc-8e16a1244b70', 'volume_name': 'volume-0c3ec8ab-f263-495a-86cc-8e16a1244b70', 'volume_size': 1}' {{(pid=83259) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 15:07:00 devstack cinder-volume[83259]: DEBUG cinder.volume.manager [None req-59091deb-44dc-4c83-8ea0-03c7e7b30042 tempest-VolumesListAdminTestJSON-1524776145 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6c909d54-c87f-4a7b-b091-21c13aa04bdf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83259) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 15:07:00 devstack cinder-volume[83259]: DEBUG cinder.volume.manager [None req-59091deb-44dc-4c83-8ea0-03c7e7b30042 tempest-VolumesListAdminTestJSON-1524776145 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6c909d54-c87f-4a7b-b091-21c13aa04bdf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83259) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 15:07:00 devstack cinder-volume[83259]: DEBUG cinder.volume.manager [None req-59091deb-44dc-4c83-8ea0-03c7e7b30042 tempest-VolumesListAdminTestJSON-1524776145 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (766045d0-e42f-4262-b3de-1eb63a011d2a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83259) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 15:07:00 devstack cinder-volume[83259]: INFO cinder.volume.flows.manager.create_volume [None req-59091deb-44dc-4c83-8ea0-03c7e7b30042 tempest-VolumesListAdminTestJSON-1524776145 None] Volume 0c3ec8ab-f263-495a-86cc-8e16a1244b70: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0c3ec8ab-f263-495a-86cc-8e16a1244b70', 'volume_size': 1} Sep 16 15:07:00 devstack cinder-volume[83259]: DEBUG oslo_concurrency.lockutils [None req-59091deb-44dc-4c83-8ea0-03c7e7b30042 tempest-VolumesListAdminTestJSON-1524776145 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83259) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 16 15:07:00 devstack cinder-volume[83259]: DEBUG oslo_concurrency.lockutils [None req-59091deb-44dc-4c83-8ea0-03c7e7b30042 tempest-VolumesListAdminTestJSON-1524776145 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=83259) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 16 15:07:00 devstack cinder-volume[83259]: DEBUG cinder.volume.drivers.quobyte [None req-59091deb-44dc-4c83-8ea0-03c7e7b30042 tempest-VolumesListAdminTestJSON-1524776145 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-16T13:06:59Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#Quobyte',id=0c3ec8ab-f263-495a-86cc-8e16a1244b70,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='795df43155d848f2a9154adb88a2baa1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-16T13:07:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-16T13:07:00Z,use_quota=True,user_id='e6c48c07a90d4159913a2f759026e544',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(485ead50-3df8-4d76-8d34-a4db136c980a),volume_type_id=485ead50-3df8-4d76-8d34-a4db136c980a)}" {{(pid=83259) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Sep 16 15:07:00 devstack cinder-volume[83259]: DEBUG cinder.volume.drivers.remotefs [None req-59091deb-44dc-4c83-8ea0-03c7e7b30042 tempest-VolumesListAdminTestJSON-1524776145 None] Creating volume 0c3ec8ab-f263-495a-86cc-8e16a1244b70 {{(pid=83259) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}} Sep 16 15:07:00 devstack cinder-volume[83259]: DEBUG oslo_concurrency.lockutils [None req-59091deb-44dc-4c83-8ea0-03c7e7b30042 tempest-VolumesListAdminTestJSON-1524776145 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83259) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 16 15:07:00 devstack cinder-volume[83259]: DEBUG oslo_concurrency.lockutils [None req-59091deb-44dc-4c83-8ea0-03c7e7b30042 tempest-VolumesListAdminTestJSON-1524776145 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83259) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 16 15:07:00 devstack cinder-volume[83259]: DEBUG cinder.volume.drivers.quobyte [None req-59091deb-44dc-4c83-8ea0-03c7e7b30042 tempest-VolumesListAdminTestJSON-1524776145 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-61f585ac-f8e2-4d19-a890-7ebc2726cc72': None} {{(pid=83259) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:639}} Sep 16 15:07:00 devstack cinder-volume[83259]: DEBUG cinder.volume.drivers.quobyte [None req-59091deb-44dc-4c83-8ea0-03c7e7b30042 tempest-VolumesListAdminTestJSON-1524776145 None] Available shares ['10.10.41.181/cinder-vol-61f585ac-f8e2-4d19-a890-7ebc2726cc72'] {{(pid=83259) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:669}} Sep 16 15:07:00 devstack cinder-volume[83259]: DEBUG oslo_concurrency.lockutils [None req-59091deb-44dc-4c83-8ea0-03c7e7b30042 tempest-VolumesListAdminTestJSON-1524776145 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=83259) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 16 15:07:00 devstack cinder-volume[83259]: DEBUG cinder.volume.drivers.quobyte [None req-59091deb-44dc-4c83-8ea0-03c7e7b30042 tempest-VolumesListAdminTestJSON-1524776145 None] Selected 10.10.41.181/cinder-vol-61f585ac-f8e2-4d19-a890-7ebc2726cc72 as target Quobyte volume. {{(pid=83259) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:690}} Sep 16 15:07:00 devstack cinder-volume[83259]: INFO cinder.volume.drivers.remotefs [None req-59091deb-44dc-4c83-8ea0-03c7e7b30042 tempest-VolumesListAdminTestJSON-1524776145 None] casted to 10.10.41.181/cinder-vol-61f585ac-f8e2-4d19-a890-7ebc2726cc72 Sep 16 15:07:00 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [None req-59091deb-44dc-4c83-8ea0-03c7e7b30042 tempest-VolumesListAdminTestJSON-1524776145 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c/volume-0c3ec8ab-f263-495a-86cc-8e16a1244b70 1073741824 {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 15:07:00 devstack quobyte-client[83286]: System call of process 94230 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 16 15:07:00 devstack quobyte-client[83286]: The server volume:87712ffe-8a69-446d-9ed6-4430c7ee9792@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=87712ffe-8a69-446d-9ed6-4430c7ee9792, inode=73, name=volume-0c3ec8ab-f263-495a-86cc-8e16a1244b70, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.206), requestorAccessMask=0 Sep 16 15:07:00 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [None req-59091deb-44dc-4c83-8ea0-03c7e7b30042 tempest-VolumesListAdminTestJSON-1524776145 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c/volume-0c3ec8ab-f263-495a-86cc-8e16a1244b70 1073741824" returned: 0 in 0.362s {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 15:07:00 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [None req-59091deb-44dc-4c83-8ea0-03c7e7b30042 tempest-VolumesListAdminTestJSON-1524776145 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c/volume-0c3ec8ab-f263-495a-86cc-8e16a1244b70 {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 15:07:00 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [None req-59091deb-44dc-4c83-8ea0-03c7e7b30042 tempest-VolumesListAdminTestJSON-1524776145 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c/volume-0c3ec8ab-f263-495a-86cc-8e16a1244b70" returned: 0 in 0.124s {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 15:07:00 devstack cinder-volume[83259]: DEBUG cinder.volume.drivers.quobyte [None req-59091deb-44dc-4c83-8ea0-03c7e7b30042 tempest-VolumesListAdminTestJSON-1524776145 None] <== create_volume: return (555ms) {'provider_location': '10.10.41.181/cinder-vol-61f585ac-f8e2-4d19-a890-7ebc2726cc72'} {{(pid=83259) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Sep 16 15:07:00 devstack cinder-volume[83259]: DEBUG oslo_concurrency.lockutils [None req-59091deb-44dc-4c83-8ea0-03c7e7b30042 tempest-VolumesListAdminTestJSON-1524776145 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.583s {{(pid=83259) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 16 15:07:01 devstack cinder-volume[83259]: DEBUG cinder.volume.manager [None req-59091deb-44dc-4c83-8ea0-03c7e7b30042 tempest-VolumesListAdminTestJSON-1524776145 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (766045d0-e42f-4262-b3de-1eb63a011d2a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0c3ec8ab-f263-495a-86cc-8e16a1244b70', 'volume_size': 1}' {{(pid=83259) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 15:07:01 devstack cinder-volume[83259]: DEBUG cinder.volume.manager [None req-59091deb-44dc-4c83-8ea0-03c7e7b30042 tempest-VolumesListAdminTestJSON-1524776145 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c4c42d2f-6abc-4ce9-af61-1901ae6f3aa0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83259) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 15:07:01 devstack cinder-volume[83259]: INFO cinder.volume.flows.manager.create_volume [None req-59091deb-44dc-4c83-8ea0-03c7e7b30042 tempest-VolumesListAdminTestJSON-1524776145 None] Volume volume-0c3ec8ab-f263-495a-86cc-8e16a1244b70 (0c3ec8ab-f263-495a-86cc-8e16a1244b70): created successfully Sep 16 15:07:01 devstack cinder-volume[83259]: DEBUG cinder.volume.manager [None req-59091deb-44dc-4c83-8ea0-03c7e7b30042 tempest-VolumesListAdminTestJSON-1524776145 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c4c42d2f-6abc-4ce9-af61-1901ae6f3aa0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83259) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 15:07:01 devstack cinder-volume[83259]: DEBUG cinder.volume.manager [None req-59091deb-44dc-4c83-8ea0-03c7e7b30042 tempest-VolumesListAdminTestJSON-1524776145 None] Flow 'volume_create_manager' (1f93492d-1168-4982-bdc6-1eb6171d70b2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83259) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 16 15:07:01 devstack cinder-volume[83259]: INFO cinder.volume.manager [None req-59091deb-44dc-4c83-8ea0-03c7e7b30042 tempest-VolumesListAdminTestJSON-1524776145 None] Created volume successfully. Sep 16 15:07:02 devstack cinder-volume[83259]: DEBUG cinder.coordination [None req-8d974b3e-a67b-4f9c-a0c2-42b2645cdcfe tempest-VolumesListAdminTestJSON-1524776145 None] Acquiring lock "cinder-0c3ec8ab-f263-495a-86cc-8e16a1244b70-delete_volume" by "delete_volume" {{(pid=83259) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 16 15:07:02 devstack cinder-volume[83259]: DEBUG cinder.coordination [None req-8d974b3e-a67b-4f9c-a0c2-42b2645cdcfe tempest-VolumesListAdminTestJSON-1524776145 None] Lock "cinder-0c3ec8ab-f263-495a-86cc-8e16a1244b70-delete_volume" acquired by "delete_volume" :: waited 0.073s {{(pid=83259) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 16 15:07:02 devstack cinder-volume[83259]: WARNING cinder.volume.volume_utils [None req-8d974b3e-a67b-4f9c-a0c2-42b2645cdcfe tempest-VolumesListAdminTestJSON-1524776145 None] Volume driver (QuobyteDriver 1.2) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 16 15:07:02 devstack cinder-volume[83259]: DEBUG cinder.coordination [None req-8d974b3e-a67b-4f9c-a0c2-42b2645cdcfe tempest-VolumesListAdminTestJSON-1524776145 None] Acquiring lock "cinder-quobyte-0c3ec8ab-f263-495a-86cc-8e16a1244b70" by "delete_volume" {{(pid=83259) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 16 15:07:02 devstack cinder-volume[83259]: DEBUG cinder.coordination [None req-8d974b3e-a67b-4f9c-a0c2-42b2645cdcfe tempest-VolumesListAdminTestJSON-1524776145 None] Lock "cinder-quobyte-0c3ec8ab-f263-495a-86cc-8e16a1244b70" acquired by "delete_volume" :: waited 0.013s {{(pid=83259) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 16 15:07:02 devstack cinder-volume[83259]: DEBUG cinder.coordination [None req-45ed2546-1dad-42a3-8150-144fb0743b65 tempest-VolumesListAdminTestJSON-78946226 None] Acquiring lock "cinder-673d231e-66e0-40ec-9626-8308928bca73-delete_volume" by "delete_volume" {{(pid=83259) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 16 15:07:02 devstack cinder-volume[83259]: DEBUG oslo.privsep.daemon [-] privsep: reply[74fea5ca-0e17-4389-b749-1eb56e05c697]: (4, 'qcow2') {{(pid=84312) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 16 15:07:02 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [None req-8d974b3e-a67b-4f9c-a0c2-42b2645cdcfe tempest-VolumesListAdminTestJSON-1524776145 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c/volume-0c3ec8ab-f263-495a-86cc-8e16a1244b70 {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 15:07:02 devstack cinder-volume[83259]: DEBUG cinder.coordination [None req-45ed2546-1dad-42a3-8150-144fb0743b65 tempest-VolumesListAdminTestJSON-78946226 None] Lock "cinder-673d231e-66e0-40ec-9626-8308928bca73-delete_volume" acquired by "delete_volume" :: waited 0.159s {{(pid=83259) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 16 15:07:03 devstack cinder-volume[83259]: WARNING cinder.volume.volume_utils [None req-45ed2546-1dad-42a3-8150-144fb0743b65 tempest-VolumesListAdminTestJSON-78946226 None] Volume driver (QuobyteDriver 1.2) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 16 15:07:03 devstack cinder-volume[83259]: DEBUG cinder.coordination [None req-45ed2546-1dad-42a3-8150-144fb0743b65 tempest-VolumesListAdminTestJSON-78946226 None] Acquiring lock "cinder-quobyte-673d231e-66e0-40ec-9626-8308928bca73" by "delete_volume" {{(pid=83259) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 16 15:07:03 devstack cinder-volume[83259]: DEBUG cinder.coordination [None req-45ed2546-1dad-42a3-8150-144fb0743b65 tempest-VolumesListAdminTestJSON-78946226 None] Lock "cinder-quobyte-673d231e-66e0-40ec-9626-8308928bca73" acquired by "delete_volume" :: waited 0.021s {{(pid=83259) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 16 15:07:03 devstack cinder-volume[83259]: DEBUG oslo.privsep.daemon [-] privsep: reply[7f7e7891-fc16-428c-9fa4-703db969de9f]: (4, 'qcow2') {{(pid=84312) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 16 15:07:03 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [None req-45ed2546-1dad-42a3-8150-144fb0743b65 tempest-VolumesListAdminTestJSON-78946226 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c/volume-673d231e-66e0-40ec-9626-8308928bca73 {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 15:07:03 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [None req-8d974b3e-a67b-4f9c-a0c2-42b2645cdcfe tempest-VolumesListAdminTestJSON-1524776145 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c/volume-0c3ec8ab-f263-495a-86cc-8e16a1244b70" returned: 0 in 0.928s {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 15:07:03 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [None req-8d974b3e-a67b-4f9c-a0c2-42b2645cdcfe tempest-VolumesListAdminTestJSON-1524776145 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c/volume-0c3ec8ab-f263-495a-86cc-8e16a1244b70 {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 15:07:03 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [None req-8d974b3e-a67b-4f9c-a0c2-42b2645cdcfe tempest-VolumesListAdminTestJSON-1524776145 None] CMD "rm -f /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c/volume-0c3ec8ab-f263-495a-86cc-8e16a1244b70" returned: 0 in 0.233s {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 15:07:04 devstack cinder-volume[83259]: DEBUG cinder.coordination [None req-8d974b3e-a67b-4f9c-a0c2-42b2645cdcfe tempest-VolumesListAdminTestJSON-1524776145 None] Lock "cinder-quobyte-0c3ec8ab-f263-495a-86cc-8e16a1244b70" released by "delete_volume" :: held 1.417s {{(pid=83259) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 16 15:07:04 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [None req-45ed2546-1dad-42a3-8150-144fb0743b65 tempest-VolumesListAdminTestJSON-78946226 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c/volume-673d231e-66e0-40ec-9626-8308928bca73" returned: 0 in 0.927s {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 15:07:04 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [None req-45ed2546-1dad-42a3-8150-144fb0743b65 tempest-VolumesListAdminTestJSON-78946226 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c/volume-673d231e-66e0-40ec-9626-8308928bca73 {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 15:07:04 devstack cinder-volume[83259]: DEBUG cinder.quota [None req-8d974b3e-a67b-4f9c-a0c2-42b2645cdcfe tempest-VolumesListAdminTestJSON-1524776145 None] Created reservations ['e8adc69c-4703-4895-81e9-a5313acc0099', 'b9d3ba16-5e68-4838-8eb8-bfc419c98f79', 'a9a95ee7-9fda-4fe1-ad3e-ea554fcdcc4d', '6fec3e9f-e7d3-400c-9e02-517301b6479c'] {{(pid=83259) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 16 15:07:04 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [None req-45ed2546-1dad-42a3-8150-144fb0743b65 tempest-VolumesListAdminTestJSON-78946226 None] CMD "rm -f /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c/volume-673d231e-66e0-40ec-9626-8308928bca73" returned: 0 in 0.318s {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 15:07:04 devstack cinder-volume[83259]: DEBUG cinder.coordination [None req-45ed2546-1dad-42a3-8150-144fb0743b65 tempest-VolumesListAdminTestJSON-78946226 None] Lock "cinder-quobyte-673d231e-66e0-40ec-9626-8308928bca73" released by "delete_volume" :: held 1.475s {{(pid=83259) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 16 15:07:04 devstack cinder-volume[83259]: DEBUG oslo_concurrency.lockutils [None req-8d974b3e-a67b-4f9c-a0c2-42b2645cdcfe tempest-VolumesListAdminTestJSON-1524776145 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83259) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 16 15:07:04 devstack cinder-volume[83259]: DEBUG oslo_concurrency.lockutils [None req-8d974b3e-a67b-4f9c-a0c2-42b2645cdcfe tempest-VolumesListAdminTestJSON-1524776145 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=83259) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 16 15:07:04 devstack cinder-volume[83259]: DEBUG cinder.volume.drivers.quobyte [None req-8d974b3e-a67b-4f9c-a0c2-42b2645cdcfe tempest-VolumesListAdminTestJSON-1524776145 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-61f585ac-f8e2-4d19-a890-7ebc2726cc72': None} {{(pid=83259) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:639}} Sep 16 15:07:04 devstack cinder-volume[83259]: DEBUG cinder.volume.drivers.quobyte [None req-8d974b3e-a67b-4f9c-a0c2-42b2645cdcfe tempest-VolumesListAdminTestJSON-1524776145 None] Available shares ['10.10.41.181/cinder-vol-61f585ac-f8e2-4d19-a890-7ebc2726cc72'] {{(pid=83259) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:669}} Sep 16 15:07:04 devstack cinder-volume[83259]: DEBUG oslo_concurrency.lockutils [None req-8d974b3e-a67b-4f9c-a0c2-42b2645cdcfe tempest-VolumesListAdminTestJSON-1524776145 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=83259) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 16 15:07:04 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [None req-8d974b3e-a67b-4f9c-a0c2-42b2645cdcfe tempest-VolumesListAdminTestJSON-1524776145 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 15:07:05 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [None req-8d974b3e-a67b-4f9c-a0c2-42b2645cdcfe tempest-VolumesListAdminTestJSON-1524776145 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c" returned: 0 in 0.389s {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 15:07:05 devstack cinder-volume[83259]: DEBUG cinder.manager [None req-8d974b3e-a67b-4f9c-a0c2-42b2645cdcfe tempest-VolumesListAdminTestJSON-1524776145 None] Notifying Schedulers of capabilities ... {{(pid=83259) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 16 15:07:05 devstack cinder-volume[83259]: INFO cinder.volume.manager [None req-8d974b3e-a67b-4f9c-a0c2-42b2645cdcfe tempest-VolumesListAdminTestJSON-1524776145 None] Deleted volume successfully. Sep 16 15:07:05 devstack cinder-volume[83259]: DEBUG cinder.quota [None req-45ed2546-1dad-42a3-8150-144fb0743b65 tempest-VolumesListAdminTestJSON-78946226 None] Created reservations ['d1137477-7c8b-4b5c-9b10-f276530197ee', '2dbc1ce0-b064-49f5-bc27-765df7da9a09', '3694dbac-8940-4785-a84c-23eda8efe788', '9392ca09-0169-4211-b1f1-8782ee3d2f26'] {{(pid=83259) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 16 15:07:05 devstack cinder-volume[83259]: DEBUG cinder.coordination [None req-8d974b3e-a67b-4f9c-a0c2-42b2645cdcfe tempest-VolumesListAdminTestJSON-1524776145 None] Lock "cinder-0c3ec8ab-f263-495a-86cc-8e16a1244b70-delete_volume" released by "delete_volume" :: held 3.092s {{(pid=83259) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 16 15:07:05 devstack cinder-volume[83259]: DEBUG oslo_concurrency.lockutils [None req-45ed2546-1dad-42a3-8150-144fb0743b65 tempest-VolumesListAdminTestJSON-78946226 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83259) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 16 15:07:05 devstack cinder-volume[83259]: DEBUG oslo_concurrency.lockutils [None req-45ed2546-1dad-42a3-8150-144fb0743b65 tempest-VolumesListAdminTestJSON-78946226 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=83259) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 16 15:07:05 devstack cinder-volume[83259]: DEBUG cinder.volume.drivers.quobyte [None req-45ed2546-1dad-42a3-8150-144fb0743b65 tempest-VolumesListAdminTestJSON-78946226 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-61f585ac-f8e2-4d19-a890-7ebc2726cc72': None} {{(pid=83259) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:639}} Sep 16 15:07:05 devstack cinder-volume[83259]: DEBUG cinder.volume.drivers.quobyte [None req-45ed2546-1dad-42a3-8150-144fb0743b65 tempest-VolumesListAdminTestJSON-78946226 None] Available shares ['10.10.41.181/cinder-vol-61f585ac-f8e2-4d19-a890-7ebc2726cc72'] {{(pid=83259) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:669}} Sep 16 15:07:05 devstack cinder-volume[83259]: DEBUG oslo_concurrency.lockutils [None req-45ed2546-1dad-42a3-8150-144fb0743b65 tempest-VolumesListAdminTestJSON-78946226 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=83259) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 16 15:07:05 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [None req-45ed2546-1dad-42a3-8150-144fb0743b65 tempest-VolumesListAdminTestJSON-78946226 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 15:07:05 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [None req-45ed2546-1dad-42a3-8150-144fb0743b65 tempest-VolumesListAdminTestJSON-78946226 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c" returned: 0 in 0.097s {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 15:07:05 devstack cinder-volume[83259]: DEBUG cinder.manager [None req-45ed2546-1dad-42a3-8150-144fb0743b65 tempest-VolumesListAdminTestJSON-78946226 None] Notifying Schedulers of capabilities ... {{(pid=83259) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 16 15:07:05 devstack cinder-volume[83259]: INFO cinder.volume.manager [None req-45ed2546-1dad-42a3-8150-144fb0743b65 tempest-VolumesListAdminTestJSON-78946226 None] Deleted volume successfully. Sep 16 15:07:06 devstack cinder-volume[83259]: DEBUG cinder.coordination [None req-45ed2546-1dad-42a3-8150-144fb0743b65 tempest-VolumesListAdminTestJSON-78946226 None] Lock "cinder-673d231e-66e0-40ec-9626-8308928bca73-delete_volume" released by "delete_volume" :: held 3.489s {{(pid=83259) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 16 15:07:06 devstack cinder-volume[83259]: DEBUG cinder.coordination [None req-144bf98c-e18a-486b-b70d-2b238a63923c tempest-VolumesListAdminTestJSON-78946226 None] Acquiring lock "cinder-ece6179e-7d60-4952-8c10-bd6522e2bc1a-delete_volume" by "delete_volume" {{(pid=83259) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 16 15:07:06 devstack cinder-volume[83259]: DEBUG cinder.coordination [None req-144bf98c-e18a-486b-b70d-2b238a63923c tempest-VolumesListAdminTestJSON-78946226 None] Lock "cinder-ece6179e-7d60-4952-8c10-bd6522e2bc1a-delete_volume" acquired by "delete_volume" :: waited 0.073s {{(pid=83259) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 16 15:07:06 devstack cinder-volume[83259]: WARNING cinder.volume.volume_utils [None req-144bf98c-e18a-486b-b70d-2b238a63923c tempest-VolumesListAdminTestJSON-78946226 None] Volume driver (QuobyteDriver 1.2) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 16 15:07:06 devstack cinder-volume[83259]: DEBUG cinder.coordination [None req-144bf98c-e18a-486b-b70d-2b238a63923c tempest-VolumesListAdminTestJSON-78946226 None] Acquiring lock "cinder-quobyte-ece6179e-7d60-4952-8c10-bd6522e2bc1a" by "delete_volume" {{(pid=83259) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 16 15:07:06 devstack cinder-volume[83259]: DEBUG cinder.coordination [None req-144bf98c-e18a-486b-b70d-2b238a63923c tempest-VolumesListAdminTestJSON-78946226 None] Lock "cinder-quobyte-ece6179e-7d60-4952-8c10-bd6522e2bc1a" acquired by "delete_volume" :: waited 0.013s {{(pid=83259) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 16 15:07:06 devstack cinder-volume[83259]: DEBUG oslo.privsep.daemon [-] privsep: reply[0d943f73-46aa-4ca7-bea7-343beaa99edf]: (4, 'qcow2') {{(pid=84312) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 16 15:07:06 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [None req-144bf98c-e18a-486b-b70d-2b238a63923c tempest-VolumesListAdminTestJSON-78946226 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c/volume-ece6179e-7d60-4952-8c10-bd6522e2bc1a {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 15:07:07 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [None req-144bf98c-e18a-486b-b70d-2b238a63923c tempest-VolumesListAdminTestJSON-78946226 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c/volume-ece6179e-7d60-4952-8c10-bd6522e2bc1a" returned: 0 in 0.500s {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 15:07:07 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [None req-144bf98c-e18a-486b-b70d-2b238a63923c tempest-VolumesListAdminTestJSON-78946226 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c/volume-ece6179e-7d60-4952-8c10-bd6522e2bc1a {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 15:07:07 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [None req-144bf98c-e18a-486b-b70d-2b238a63923c tempest-VolumesListAdminTestJSON-78946226 None] CMD "rm -f /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c/volume-ece6179e-7d60-4952-8c10-bd6522e2bc1a" returned: 0 in 0.099s {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 15:07:07 devstack cinder-volume[83259]: DEBUG cinder.coordination [None req-144bf98c-e18a-486b-b70d-2b238a63923c tempest-VolumesListAdminTestJSON-78946226 None] Lock "cinder-quobyte-ece6179e-7d60-4952-8c10-bd6522e2bc1a" released by "delete_volume" :: held 0.796s {{(pid=83259) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 16 15:07:07 devstack cinder-volume[83259]: DEBUG cinder.quota [None req-144bf98c-e18a-486b-b70d-2b238a63923c tempest-VolumesListAdminTestJSON-78946226 None] Created reservations ['f76c654e-4540-40c0-8c29-f69d4745a596', '1966eab6-944d-460d-891c-addeb5ea4932', '53379e19-0bb2-4ba9-b598-86ae655ae3ef', '74c23d9b-9278-471b-944d-ddc0c3fe5039'] {{(pid=83259) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 16 15:07:08 devstack cinder-volume[83259]: DEBUG oslo_concurrency.lockutils [None req-144bf98c-e18a-486b-b70d-2b238a63923c tempest-VolumesListAdminTestJSON-78946226 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83259) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 16 15:07:08 devstack cinder-volume[83259]: DEBUG oslo_concurrency.lockutils [None req-144bf98c-e18a-486b-b70d-2b238a63923c tempest-VolumesListAdminTestJSON-78946226 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=83259) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 16 15:07:08 devstack cinder-volume[83259]: DEBUG cinder.volume.drivers.quobyte [None req-144bf98c-e18a-486b-b70d-2b238a63923c tempest-VolumesListAdminTestJSON-78946226 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-61f585ac-f8e2-4d19-a890-7ebc2726cc72': None} {{(pid=83259) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:639}} Sep 16 15:07:08 devstack cinder-volume[83259]: DEBUG cinder.volume.drivers.quobyte [None req-144bf98c-e18a-486b-b70d-2b238a63923c tempest-VolumesListAdminTestJSON-78946226 None] Available shares ['10.10.41.181/cinder-vol-61f585ac-f8e2-4d19-a890-7ebc2726cc72'] {{(pid=83259) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:669}} Sep 16 15:07:08 devstack cinder-volume[83259]: DEBUG oslo_concurrency.lockutils [None req-144bf98c-e18a-486b-b70d-2b238a63923c tempest-VolumesListAdminTestJSON-78946226 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=83259) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 16 15:07:08 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [None req-144bf98c-e18a-486b-b70d-2b238a63923c tempest-VolumesListAdminTestJSON-78946226 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 15:07:08 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [None req-144bf98c-e18a-486b-b70d-2b238a63923c tempest-VolumesListAdminTestJSON-78946226 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c" returned: 0 in 0.144s {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 15:07:08 devstack cinder-volume[83259]: DEBUG cinder.manager [None req-144bf98c-e18a-486b-b70d-2b238a63923c tempest-VolumesListAdminTestJSON-78946226 None] Notifying Schedulers of capabilities ... {{(pid=83259) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 16 15:07:08 devstack cinder-volume[83259]: INFO cinder.volume.manager [None req-144bf98c-e18a-486b-b70d-2b238a63923c tempest-VolumesListAdminTestJSON-78946226 None] Deleted volume successfully. Sep 16 15:07:08 devstack cinder-volume[83259]: DEBUG cinder.coordination [None req-144bf98c-e18a-486b-b70d-2b238a63923c tempest-VolumesListAdminTestJSON-78946226 None] Lock "cinder-ece6179e-7d60-4952-8c10-bd6522e2bc1a-delete_volume" released by "delete_volume" :: held 2.113s {{(pid=83259) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 16 15:07:08 devstack cinder-volume[83259]: DEBUG cinder.coordination [None req-2385ad8a-8027-45c3-bc3b-8b7f71503c6a tempest-VolumesListAdminTestJSON-78946226 None] Acquiring lock "cinder-da48ebf1-0b1e-4104-85f3-19dee9a63e36-delete_volume" by "delete_volume" {{(pid=83259) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 16 15:07:08 devstack cinder-volume[83259]: DEBUG cinder.coordination [None req-2385ad8a-8027-45c3-bc3b-8b7f71503c6a tempest-VolumesListAdminTestJSON-78946226 None] Lock "cinder-da48ebf1-0b1e-4104-85f3-19dee9a63e36-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=83259) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 16 15:07:08 devstack cinder-volume[83259]: WARNING cinder.volume.volume_utils [None req-2385ad8a-8027-45c3-bc3b-8b7f71503c6a tempest-VolumesListAdminTestJSON-78946226 None] Volume driver (QuobyteDriver 1.2) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 16 15:07:08 devstack cinder-volume[83259]: DEBUG cinder.coordination [None req-2385ad8a-8027-45c3-bc3b-8b7f71503c6a tempest-VolumesListAdminTestJSON-78946226 None] Acquiring lock "cinder-quobyte-da48ebf1-0b1e-4104-85f3-19dee9a63e36" by "delete_volume" {{(pid=83259) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 16 15:07:08 devstack cinder-volume[83259]: DEBUG cinder.coordination [None req-2385ad8a-8027-45c3-bc3b-8b7f71503c6a tempest-VolumesListAdminTestJSON-78946226 None] Lock "cinder-quobyte-da48ebf1-0b1e-4104-85f3-19dee9a63e36" acquired by "delete_volume" :: waited 0.015s {{(pid=83259) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 16 15:07:08 devstack cinder-volume[83259]: DEBUG oslo.privsep.daemon [-] privsep: reply[3974bdd4-dcda-4be9-82c4-fce5275c78a0]: (4, 'qcow2') {{(pid=84312) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 16 15:07:08 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [None req-2385ad8a-8027-45c3-bc3b-8b7f71503c6a tempest-VolumesListAdminTestJSON-78946226 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c/volume-da48ebf1-0b1e-4104-85f3-19dee9a63e36 {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 15:07:09 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [None req-2385ad8a-8027-45c3-bc3b-8b7f71503c6a tempest-VolumesListAdminTestJSON-78946226 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c/volume-da48ebf1-0b1e-4104-85f3-19dee9a63e36" returned: 0 in 0.424s {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 15:07:09 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [None req-2385ad8a-8027-45c3-bc3b-8b7f71503c6a tempest-VolumesListAdminTestJSON-78946226 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c/volume-da48ebf1-0b1e-4104-85f3-19dee9a63e36 {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 15:07:09 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [None req-2385ad8a-8027-45c3-bc3b-8b7f71503c6a tempest-VolumesListAdminTestJSON-78946226 None] CMD "rm -f /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c/volume-da48ebf1-0b1e-4104-85f3-19dee9a63e36" returned: 0 in 0.100s {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 15:07:09 devstack cinder-volume[83259]: DEBUG cinder.coordination [None req-2385ad8a-8027-45c3-bc3b-8b7f71503c6a tempest-VolumesListAdminTestJSON-78946226 None] Lock "cinder-quobyte-da48ebf1-0b1e-4104-85f3-19dee9a63e36" released by "delete_volume" :: held 0.694s {{(pid=83259) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 16 15:07:09 devstack cinder-volume[83259]: DEBUG cinder.quota [None req-2385ad8a-8027-45c3-bc3b-8b7f71503c6a tempest-VolumesListAdminTestJSON-78946226 None] Created reservations ['27eb70c8-ba5c-496a-9f01-7941ebfbe34c', '7a651ed2-352a-4ab6-a687-fbb27d63073d', 'cb050f91-af66-400f-8750-8a455af2d57d', '7c499fb4-57f3-46af-b9a9-b665b41c31f1'] {{(pid=83259) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 16 15:07:10 devstack cinder-volume[83259]: DEBUG oslo_concurrency.lockutils [None req-2385ad8a-8027-45c3-bc3b-8b7f71503c6a tempest-VolumesListAdminTestJSON-78946226 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83259) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 16 15:07:10 devstack cinder-volume[83259]: DEBUG oslo_concurrency.lockutils [None req-2385ad8a-8027-45c3-bc3b-8b7f71503c6a tempest-VolumesListAdminTestJSON-78946226 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.009s {{(pid=83259) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 16 15:07:10 devstack cinder-volume[83259]: DEBUG cinder.volume.drivers.quobyte [None req-2385ad8a-8027-45c3-bc3b-8b7f71503c6a tempest-VolumesListAdminTestJSON-78946226 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-61f585ac-f8e2-4d19-a890-7ebc2726cc72': None} {{(pid=83259) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:639}} Sep 16 15:07:10 devstack cinder-volume[83259]: DEBUG cinder.volume.drivers.quobyte [None req-2385ad8a-8027-45c3-bc3b-8b7f71503c6a tempest-VolumesListAdminTestJSON-78946226 None] Available shares ['10.10.41.181/cinder-vol-61f585ac-f8e2-4d19-a890-7ebc2726cc72'] {{(pid=83259) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:669}} Sep 16 15:07:10 devstack cinder-volume[83259]: DEBUG oslo_concurrency.lockutils [None req-2385ad8a-8027-45c3-bc3b-8b7f71503c6a tempest-VolumesListAdminTestJSON-78946226 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=83259) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 16 15:07:10 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [None req-2385ad8a-8027-45c3-bc3b-8b7f71503c6a tempest-VolumesListAdminTestJSON-78946226 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 15:07:10 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [None req-2385ad8a-8027-45c3-bc3b-8b7f71503c6a tempest-VolumesListAdminTestJSON-78946226 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c" returned: 0 in 0.102s {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 15:07:10 devstack cinder-volume[83259]: DEBUG cinder.manager [None req-2385ad8a-8027-45c3-bc3b-8b7f71503c6a tempest-VolumesListAdminTestJSON-78946226 None] Notifying Schedulers of capabilities ... {{(pid=83259) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 16 15:07:10 devstack cinder-volume[83259]: INFO cinder.volume.manager [None req-2385ad8a-8027-45c3-bc3b-8b7f71503c6a tempest-VolumesListAdminTestJSON-78946226 None] Deleted volume successfully. Sep 16 15:07:10 devstack cinder-volume[83259]: DEBUG cinder.coordination [None req-2385ad8a-8027-45c3-bc3b-8b7f71503c6a tempest-VolumesListAdminTestJSON-78946226 None] Lock "cinder-da48ebf1-0b1e-4104-85f3-19dee9a63e36-delete_volume" released by "delete_volume" :: held 1.843s {{(pid=83259) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 16 15:07:20 devstack cinder-volume[83259]: DEBUG dbcounter [-] [83259] Writing DB stats cinder:SELECT=19,cinder:UPDATE=36,cinder:INSERT=11,cinder:DELETE=2 {{(pid=83259) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Sep 16 15:07:20 devstack cinder-volume[83259]: DEBUG dbcounter [-] [83259] Writing DB stats cinder:UPDATE=33,cinder:DELETE=4,cinder:SELECT=23,cinder:INSERT=5 {{(pid=83259) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Sep 16 15:07:25 devstack cinder-volume[83259]: WARNING cinder.volume.volume_utils [req-2735edcd-8d95-4545-9420-f4b1a85a8134 req-e9041a67-8457-4c8f-aa21-891d9d574d7b tempest-TestServerVolumeAttachScenarioOldVersion-929263564 None] Volume driver (QuobyteDriver 1.2) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 16 15:07:25 devstack cinder-volume[83259]: WARNING cinder.volume.volume_utils [req-2735edcd-8d95-4545-9420-f4b1a85a8134 req-e9041a67-8457-4c8f-aa21-891d9d574d7b tempest-TestServerVolumeAttachScenarioOldVersion-929263564 None] Volume driver (QuobyteDriver 1.2) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 16 15:07:25 devstack cinder-volume[83259]: INFO cinder.volume.manager [req-2735edcd-8d95-4545-9420-f4b1a85a8134 req-e9041a67-8457-4c8f-aa21-891d9d574d7b tempest-TestServerVolumeAttachScenarioOldVersion-929263564 None] Terminate volume connection completed successfully. Sep 16 15:07:25 devstack cinder-volume[83259]: DEBUG cinder.volume.manager [req-2735edcd-8d95-4545-9420-f4b1a85a8134 req-e9041a67-8457-4c8f-aa21-891d9d574d7b tempest-TestServerVolumeAttachScenarioOldVersion-929263564 None] Deleting attachment fd261355-2264-46b6-a42f-b7d8e456fa85. {{(pid=83259) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5022}} Sep 16 15:07:27 devstack cinder-volume[83259]: DEBUG cinder.coordination [None req-488ca85c-4b6a-4988-97ac-446b61dd09eb tempest-TestServerVolumeAttachScenarioOldVersion-929263564 None] Acquiring lock "cinder-179246e2-5916-4b62-9684-9e9d55587aa2-delete_volume" by "delete_volume" {{(pid=83259) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 16 15:07:27 devstack cinder-volume[83259]: DEBUG cinder.coordination [None req-488ca85c-4b6a-4988-97ac-446b61dd09eb tempest-TestServerVolumeAttachScenarioOldVersion-929263564 None] Lock "cinder-179246e2-5916-4b62-9684-9e9d55587aa2-delete_volume" acquired by "delete_volume" :: waited 0.061s {{(pid=83259) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 16 15:07:27 devstack cinder-volume[83259]: WARNING cinder.volume.volume_utils [None req-488ca85c-4b6a-4988-97ac-446b61dd09eb tempest-TestServerVolumeAttachScenarioOldVersion-929263564 None] Volume driver (QuobyteDriver 1.2) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 16 15:07:27 devstack cinder-volume[83259]: DEBUG cinder.coordination [None req-488ca85c-4b6a-4988-97ac-446b61dd09eb tempest-TestServerVolumeAttachScenarioOldVersion-929263564 None] Acquiring lock "cinder-quobyte-179246e2-5916-4b62-9684-9e9d55587aa2" by "delete_volume" {{(pid=83259) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 16 15:07:27 devstack cinder-volume[83259]: DEBUG cinder.coordination [None req-488ca85c-4b6a-4988-97ac-446b61dd09eb tempest-TestServerVolumeAttachScenarioOldVersion-929263564 None] Lock "cinder-quobyte-179246e2-5916-4b62-9684-9e9d55587aa2" acquired by "delete_volume" :: waited 0.030s {{(pid=83259) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 16 15:07:27 devstack cinder-volume[83259]: DEBUG oslo.privsep.daemon [-] privsep: reply[9ebf20f2-7b5b-4849-a2b8-2eacd87bdd95]: (4, 'qcow2') {{(pid=84312) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 16 15:07:27 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [None req-488ca85c-4b6a-4988-97ac-446b61dd09eb tempest-TestServerVolumeAttachScenarioOldVersion-929263564 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c/volume-179246e2-5916-4b62-9684-9e9d55587aa2 {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 15:07:28 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [None req-488ca85c-4b6a-4988-97ac-446b61dd09eb tempest-TestServerVolumeAttachScenarioOldVersion-929263564 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c/volume-179246e2-5916-4b62-9684-9e9d55587aa2" returned: 0 in 0.601s {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 15:07:28 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [None req-488ca85c-4b6a-4988-97ac-446b61dd09eb tempest-TestServerVolumeAttachScenarioOldVersion-929263564 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c/volume-179246e2-5916-4b62-9684-9e9d55587aa2 {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 15:07:28 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [None req-488ca85c-4b6a-4988-97ac-446b61dd09eb tempest-TestServerVolumeAttachScenarioOldVersion-929263564 None] CMD "rm -f /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c/volume-179246e2-5916-4b62-9684-9e9d55587aa2" returned: 0 in 0.222s {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 15:07:28 devstack cinder-volume[83259]: DEBUG cinder.coordination [None req-488ca85c-4b6a-4988-97ac-446b61dd09eb tempest-TestServerVolumeAttachScenarioOldVersion-929263564 None] Lock "cinder-quobyte-179246e2-5916-4b62-9684-9e9d55587aa2" released by "delete_volume" :: held 1.182s {{(pid=83259) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 16 15:07:28 devstack cinder-volume[83259]: DEBUG cinder.quota [None req-488ca85c-4b6a-4988-97ac-446b61dd09eb tempest-TestServerVolumeAttachScenarioOldVersion-929263564 None] Created reservations ['14df2830-155e-49c8-ad66-a8faff0ee302', '41732c40-2b7f-4458-8791-d98cbf052d9c', '6fbb6496-5887-445a-bc92-16e7ae4973cc', 'ecf3431a-b9f0-484a-b9ff-2d5aa7cba8eb'] {{(pid=83259) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 16 15:07:29 devstack cinder-volume[83259]: DEBUG oslo_concurrency.lockutils [None req-488ca85c-4b6a-4988-97ac-446b61dd09eb tempest-TestServerVolumeAttachScenarioOldVersion-929263564 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83259) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 16 15:07:29 devstack cinder-volume[83259]: DEBUG oslo_concurrency.lockutils [None req-488ca85c-4b6a-4988-97ac-446b61dd09eb tempest-TestServerVolumeAttachScenarioOldVersion-929263564 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=83259) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 16 15:07:29 devstack cinder-volume[83259]: DEBUG cinder.volume.drivers.quobyte [None req-488ca85c-4b6a-4988-97ac-446b61dd09eb tempest-TestServerVolumeAttachScenarioOldVersion-929263564 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-61f585ac-f8e2-4d19-a890-7ebc2726cc72': None} {{(pid=83259) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:639}} Sep 16 15:07:29 devstack cinder-volume[83259]: DEBUG cinder.volume.drivers.quobyte [None req-488ca85c-4b6a-4988-97ac-446b61dd09eb tempest-TestServerVolumeAttachScenarioOldVersion-929263564 None] Available shares ['10.10.41.181/cinder-vol-61f585ac-f8e2-4d19-a890-7ebc2726cc72'] {{(pid=83259) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:669}} Sep 16 15:07:29 devstack cinder-volume[83259]: DEBUG oslo_concurrency.lockutils [None req-488ca85c-4b6a-4988-97ac-446b61dd09eb tempest-TestServerVolumeAttachScenarioOldVersion-929263564 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=83259) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 16 15:07:29 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [None req-488ca85c-4b6a-4988-97ac-446b61dd09eb tempest-TestServerVolumeAttachScenarioOldVersion-929263564 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 15:07:29 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [None req-488ca85c-4b6a-4988-97ac-446b61dd09eb tempest-TestServerVolumeAttachScenarioOldVersion-929263564 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c" returned: 0 in 0.143s {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 15:07:29 devstack cinder-volume[83259]: DEBUG cinder.manager [None req-488ca85c-4b6a-4988-97ac-446b61dd09eb tempest-TestServerVolumeAttachScenarioOldVersion-929263564 None] Notifying Schedulers of capabilities ... {{(pid=83259) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 16 15:07:29 devstack cinder-volume[83259]: INFO cinder.volume.manager [None req-488ca85c-4b6a-4988-97ac-446b61dd09eb tempest-TestServerVolumeAttachScenarioOldVersion-929263564 None] Deleted volume successfully. Sep 16 15:07:29 devstack cinder-volume[83259]: DEBUG cinder.coordination [None req-488ca85c-4b6a-4988-97ac-446b61dd09eb tempest-TestServerVolumeAttachScenarioOldVersion-929263564 None] Lock "cinder-179246e2-5916-4b62-9684-9e9d55587aa2-delete_volume" released by "delete_volume" :: held 2.580s {{(pid=83259) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 16 15:07:32 devstack cinder-volume[83259]: WARNING cinder.volume.volume_utils [None req-f0c78144-3efe-482c-b4de-244759c1f583 tempest-VolumesDeleteCascade-2075029007 None] Volume driver (QuobyteDriver 1.2) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 16 15:07:32 devstack cinder-volume[83259]: DEBUG cinder.volume.flows.manager.create_volume [None req-f0c78144-3efe-482c-b4de-244759c1f583 tempest-VolumesDeleteCascade-2075029007 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#Quobyte'], 'hosts': ['devstack@QuobyteHD#Quobyte']} {{(pid=83259) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1387}} Sep 16 15:07:32 devstack cinder-volume[83259]: DEBUG cinder.volume.manager [None req-f0c78144-3efe-482c-b4de-244759c1f583 tempest-VolumesDeleteCascade-2075029007 None] Flow 'volume_create_manager' (808b1df3-094f-4490-bcc0-31220400b77f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83259) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 16 15:07:32 devstack cinder-volume[83259]: DEBUG cinder.volume.manager [None req-f0c78144-3efe-482c-b4de-244759c1f583 tempest-VolumesDeleteCascade-2075029007 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (74dc7974-fb21-4f00-a37c-812a73df211d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83259) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 15:07:32 devstack cinder-volume[83259]: DEBUG cinder.volume.manager [None req-f0c78144-3efe-482c-b4de-244759c1f583 tempest-VolumesDeleteCascade-2075029007 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (74dc7974-fb21-4f00-a37c-812a73df211d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-16T13:07:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-1235770654',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#Quobyte',id=1508f77e-fcee-4096-a8a5-04c66093764b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8646231716174424bb25c5dd1b061c89',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-16T13:07:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-16T13:07:32Z,use_quota=True,user_id='9471b80549a642cdaff7ac3ece0a4ce6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(485ead50-3df8-4d76-8d34-a4db136c980a),volume_type_id=485ead50-3df8-4d76-8d34-a4db136c980a)' {{(pid=83259) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 15:07:32 devstack cinder-volume[83259]: DEBUG cinder.volume.manager [None req-f0c78144-3efe-482c-b4de-244759c1f583 tempest-VolumesDeleteCascade-2075029007 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c563dcb9-1ae0-4ccc-bc11-741072892b80) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83259) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 15:07:32 devstack cinder-volume[83259]: DEBUG cinder.volume.manager [None req-f0c78144-3efe-482c-b4de-244759c1f583 tempest-VolumesDeleteCascade-2075029007 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c563dcb9-1ae0-4ccc-bc11-741072892b80) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83259) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 15:07:32 devstack cinder-volume[83259]: DEBUG cinder.volume.manager [None req-f0c78144-3efe-482c-b4de-244759c1f583 tempest-VolumesDeleteCascade-2075029007 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (aff562e4-ff9a-466d-ae47-534e89f5118b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83259) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 15:07:32 devstack cinder-volume[83259]: DEBUG cinder.volume.manager [None req-f0c78144-3efe-482c-b4de-244759c1f583 tempest-VolumesDeleteCascade-2075029007 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (aff562e4-ff9a-466d-ae47-534e89f5118b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1508f77e-fcee-4096-a8a5-04c66093764b', 'volume_name': 'volume-1508f77e-fcee-4096-a8a5-04c66093764b', 'volume_size': 1}' {{(pid=83259) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 15:07:32 devstack cinder-volume[83259]: DEBUG cinder.volume.manager [None req-f0c78144-3efe-482c-b4de-244759c1f583 tempest-VolumesDeleteCascade-2075029007 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (38189e2b-d800-4ef2-82b4-30935d11a534) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83259) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 15:07:32 devstack cinder-volume[83259]: DEBUG cinder.volume.manager [None req-f0c78144-3efe-482c-b4de-244759c1f583 tempest-VolumesDeleteCascade-2075029007 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (38189e2b-d800-4ef2-82b4-30935d11a534) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83259) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 15:07:32 devstack cinder-volume[83259]: DEBUG cinder.volume.manager [None req-f0c78144-3efe-482c-b4de-244759c1f583 tempest-VolumesDeleteCascade-2075029007 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c189912a-fa40-4ba5-995b-711609fda5a0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83259) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 15:07:32 devstack cinder-volume[83259]: INFO cinder.volume.flows.manager.create_volume [None req-f0c78144-3efe-482c-b4de-244759c1f583 tempest-VolumesDeleteCascade-2075029007 None] Volume 1508f77e-fcee-4096-a8a5-04c66093764b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1508f77e-fcee-4096-a8a5-04c66093764b', 'volume_size': 1} Sep 16 15:07:32 devstack cinder-volume[83259]: DEBUG oslo_concurrency.lockutils [None req-f0c78144-3efe-482c-b4de-244759c1f583 tempest-VolumesDeleteCascade-2075029007 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83259) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 16 15:07:32 devstack cinder-volume[83259]: DEBUG oslo_concurrency.lockutils [None req-f0c78144-3efe-482c-b4de-244759c1f583 tempest-VolumesDeleteCascade-2075029007 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=83259) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 16 15:07:32 devstack cinder-volume[83259]: DEBUG cinder.volume.drivers.quobyte [None req-f0c78144-3efe-482c-b4de-244759c1f583 tempest-VolumesDeleteCascade-2075029007 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-16T13:07:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-1235770654',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#Quobyte',id=1508f77e-fcee-4096-a8a5-04c66093764b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8646231716174424bb25c5dd1b061c89',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-16T13:07:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-16T13:07:32Z,use_quota=True,user_id='9471b80549a642cdaff7ac3ece0a4ce6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(485ead50-3df8-4d76-8d34-a4db136c980a),volume_type_id=485ead50-3df8-4d76-8d34-a4db136c980a)}" {{(pid=83259) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Sep 16 15:07:32 devstack cinder-volume[83259]: DEBUG cinder.volume.drivers.remotefs [None req-f0c78144-3efe-482c-b4de-244759c1f583 tempest-VolumesDeleteCascade-2075029007 None] Creating volume 1508f77e-fcee-4096-a8a5-04c66093764b {{(pid=83259) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}} Sep 16 15:07:32 devstack cinder-volume[83259]: DEBUG oslo_concurrency.lockutils [None req-f0c78144-3efe-482c-b4de-244759c1f583 tempest-VolumesDeleteCascade-2075029007 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83259) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 16 15:07:32 devstack cinder-volume[83259]: DEBUG oslo_concurrency.lockutils [None req-f0c78144-3efe-482c-b4de-244759c1f583 tempest-VolumesDeleteCascade-2075029007 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83259) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 16 15:07:32 devstack cinder-volume[83259]: DEBUG cinder.volume.drivers.quobyte [None req-f0c78144-3efe-482c-b4de-244759c1f583 tempest-VolumesDeleteCascade-2075029007 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-61f585ac-f8e2-4d19-a890-7ebc2726cc72': None} {{(pid=83259) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:639}} Sep 16 15:07:32 devstack cinder-volume[83259]: DEBUG cinder.volume.drivers.quobyte [None req-f0c78144-3efe-482c-b4de-244759c1f583 tempest-VolumesDeleteCascade-2075029007 None] Available shares ['10.10.41.181/cinder-vol-61f585ac-f8e2-4d19-a890-7ebc2726cc72'] {{(pid=83259) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:669}} Sep 16 15:07:32 devstack cinder-volume[83259]: DEBUG oslo_concurrency.lockutils [None req-f0c78144-3efe-482c-b4de-244759c1f583 tempest-VolumesDeleteCascade-2075029007 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=83259) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 16 15:07:32 devstack cinder-volume[83259]: DEBUG cinder.volume.drivers.quobyte [None req-f0c78144-3efe-482c-b4de-244759c1f583 tempest-VolumesDeleteCascade-2075029007 None] Selected 10.10.41.181/cinder-vol-61f585ac-f8e2-4d19-a890-7ebc2726cc72 as target Quobyte volume. {{(pid=83259) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:690}} Sep 16 15:07:32 devstack cinder-volume[83259]: INFO cinder.volume.drivers.remotefs [None req-f0c78144-3efe-482c-b4de-244759c1f583 tempest-VolumesDeleteCascade-2075029007 None] casted to 10.10.41.181/cinder-vol-61f585ac-f8e2-4d19-a890-7ebc2726cc72 Sep 16 15:07:32 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [None req-f0c78144-3efe-482c-b4de-244759c1f583 tempest-VolumesDeleteCascade-2075029007 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c/volume-1508f77e-fcee-4096-a8a5-04c66093764b 1073741824 {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 15:07:32 devstack quobyte-client[83286]: System call of process 94376 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 16 15:07:33 devstack quobyte-client[83286]: The server volume:87712ffe-8a69-446d-9ed6-4430c7ee9792@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=87712ffe-8a69-446d-9ed6-4430c7ee9792, inode=74, name=volume-1508f77e-fcee-4096-a8a5-04c66093764b, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.206), requestorAccessMask=0 Sep 16 15:07:33 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [None req-f0c78144-3efe-482c-b4de-244759c1f583 tempest-VolumesDeleteCascade-2075029007 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c/volume-1508f77e-fcee-4096-a8a5-04c66093764b 1073741824" returned: 0 in 0.590s {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 15:07:33 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [None req-f0c78144-3efe-482c-b4de-244759c1f583 tempest-VolumesDeleteCascade-2075029007 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c/volume-1508f77e-fcee-4096-a8a5-04c66093764b {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 15:07:33 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [None req-f0c78144-3efe-482c-b4de-244759c1f583 tempest-VolumesDeleteCascade-2075029007 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c/volume-1508f77e-fcee-4096-a8a5-04c66093764b" returned: 0 in 0.116s {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 15:07:33 devstack cinder-volume[83259]: DEBUG cinder.volume.drivers.quobyte [None req-f0c78144-3efe-482c-b4de-244759c1f583 tempest-VolumesDeleteCascade-2075029007 None] <== create_volume: return (770ms) {'provider_location': '10.10.41.181/cinder-vol-61f585ac-f8e2-4d19-a890-7ebc2726cc72'} {{(pid=83259) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Sep 16 15:07:33 devstack cinder-volume[83259]: DEBUG oslo_concurrency.lockutils [None req-f0c78144-3efe-482c-b4de-244759c1f583 tempest-VolumesDeleteCascade-2075029007 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.784s {{(pid=83259) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 16 15:07:33 devstack cinder-volume[83259]: DEBUG cinder.volume.manager [None req-f0c78144-3efe-482c-b4de-244759c1f583 tempest-VolumesDeleteCascade-2075029007 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c189912a-fa40-4ba5-995b-711609fda5a0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1508f77e-fcee-4096-a8a5-04c66093764b', 'volume_size': 1}' {{(pid=83259) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 15:07:33 devstack cinder-volume[83259]: DEBUG cinder.volume.manager [None req-f0c78144-3efe-482c-b4de-244759c1f583 tempest-VolumesDeleteCascade-2075029007 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (59e7bac7-6f20-4e0f-8074-f03ee913fa29) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83259) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 15:07:33 devstack cinder-volume[83259]: INFO cinder.volume.flows.manager.create_volume [None req-f0c78144-3efe-482c-b4de-244759c1f583 tempest-VolumesDeleteCascade-2075029007 None] Volume volume-1508f77e-fcee-4096-a8a5-04c66093764b (1508f77e-fcee-4096-a8a5-04c66093764b): created successfully Sep 16 15:07:33 devstack cinder-volume[83259]: DEBUG cinder.volume.manager [None req-f0c78144-3efe-482c-b4de-244759c1f583 tempest-VolumesDeleteCascade-2075029007 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (59e7bac7-6f20-4e0f-8074-f03ee913fa29) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83259) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 15:07:33 devstack cinder-volume[83259]: DEBUG cinder.volume.manager [None req-f0c78144-3efe-482c-b4de-244759c1f583 tempest-VolumesDeleteCascade-2075029007 None] Flow 'volume_create_manager' (808b1df3-094f-4490-bcc0-31220400b77f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83259) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 16 15:07:34 devstack cinder-volume[83259]: INFO cinder.volume.manager [None req-f0c78144-3efe-482c-b4de-244759c1f583 tempest-VolumesDeleteCascade-2075029007 None] Created volume successfully. Sep 16 15:07:34 devstack cinder-volume[83259]: WARNING cinder.volume.volume_utils [None req-030d00e1-9513-438b-9ed0-1495ed0b06f9 tempest-VolumesDeleteCascade-2075029007 None] Volume driver (QuobyteDriver 1.2) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 16 15:07:34 devstack cinder-volume[83259]: DEBUG oslo_concurrency.lockutils [None req-030d00e1-9513-438b-9ed0-1495ed0b06f9 tempest-VolumesDeleteCascade-2075029007 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=83259) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 16 15:07:34 devstack cinder-volume[83259]: DEBUG oslo_concurrency.lockutils [None req-030d00e1-9513-438b-9ed0-1495ed0b06f9 tempest-VolumesDeleteCascade-2075029007 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.008s {{(pid=83259) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 16 15:07:34 devstack cinder-volume[83259]: DEBUG cinder.volume.drivers.remotefs [None req-030d00e1-9513-438b-9ed0-1495ed0b06f9 tempest-VolumesDeleteCascade-2075029007 None] Creating offline snapshot b0636d78-510b-420c-b100-a7bca77e8d6b of volume 1508f77e-fcee-4096-a8a5-04c66093764b {{(pid=83259) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1694}} Sep 16 15:07:35 devstack cinder-volume[83259]: DEBUG oslo.privsep.daemon [-] privsep: reply[d892f8cd-a779-423d-91db-2ca7291613c7]: (4, 'qcow2') {{(pid=84312) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 16 15:07:35 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [None req-030d00e1-9513-438b-9ed0-1495ed0b06f9 tempest-VolumesDeleteCascade-2075029007 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c/volume-1508f77e-fcee-4096-a8a5-04c66093764b {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 15:07:35 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [None req-030d00e1-9513-438b-9ed0-1495ed0b06f9 tempest-VolumesDeleteCascade-2075029007 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c/volume-1508f77e-fcee-4096-a8a5-04c66093764b" returned: 0 in 0.760s {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 15:07:35 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [None req-030d00e1-9513-438b-9ed0-1495ed0b06f9 tempest-VolumesDeleteCascade-2075029007 None] Running cmd (subprocess): qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c/volume-1508f77e-fcee-4096-a8a5-04c66093764b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c/volume-1508f77e-fcee-4096-a8a5-04c66093764b.b0636d78-510b-420c-b100-a7bca77e8d6b 1G {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 15:07:36 devstack quobyte-client[83286]: System call of process 94388 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 16 15:07:36 devstack quobyte-client[83286]: The server volume:87712ffe-8a69-446d-9ed6-4430c7ee9792@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=87712ffe-8a69-446d-9ed6-4430c7ee9792, inode=75, name=volume-1508f77e-fcee-4096-a8a5-04c66093764b.b0636d78-510b-420c-b100-a7bca77e8d6b, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.206), requestorAccessMask=0 Sep 16 15:07:36 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [None req-030d00e1-9513-438b-9ed0-1495ed0b06f9 tempest-VolumesDeleteCascade-2075029007 None] CMD "qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c/volume-1508f77e-fcee-4096-a8a5-04c66093764b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c/volume-1508f77e-fcee-4096-a8a5-04c66093764b.b0636d78-510b-420c-b100-a7bca77e8d6b 1G" returned: 0 in 0.460s {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 15:07:36 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [None req-030d00e1-9513-438b-9ed0-1495ed0b06f9 tempest-VolumesDeleteCascade-2075029007 None] Running cmd (subprocess): qemu-img rebase -u -b volume-1508f77e-fcee-4096-a8a5-04c66093764b -F qcow2 /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c/volume-1508f77e-fcee-4096-a8a5-04c66093764b.b0636d78-510b-420c-b100-a7bca77e8d6b {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 15:07:36 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [None req-030d00e1-9513-438b-9ed0-1495ed0b06f9 tempest-VolumesDeleteCascade-2075029007 None] CMD "qemu-img rebase -u -b volume-1508f77e-fcee-4096-a8a5-04c66093764b -F qcow2 /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c/volume-1508f77e-fcee-4096-a8a5-04c66093764b.b0636d78-510b-420c-b100-a7bca77e8d6b" returned: 0 in 0.231s {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 15:07:36 devstack cinder-volume[83259]: DEBUG cinder.volume.drivers.remotefs [None req-030d00e1-9513-438b-9ed0-1495ed0b06f9 tempest-VolumesDeleteCascade-2075029007 None] File path /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c/volume-1508f77e-fcee-4096-a8a5-04c66093764b.b0636d78-510b-420c-b100-a7bca77e8d6b is being set with permissions: 660 {{(pid=83259) _set_rw_permissions /opt/stack/cinder/cinder/volume/drivers/remotefs.py:492}} Sep 16 15:07:36 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [None req-030d00e1-9513-438b-9ed0-1495ed0b06f9 tempest-VolumesDeleteCascade-2075029007 None] Running cmd (subprocess): chmod 660 /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c/volume-1508f77e-fcee-4096-a8a5-04c66093764b.b0636d78-510b-420c-b100-a7bca77e8d6b {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 15:07:36 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [None req-030d00e1-9513-438b-9ed0-1495ed0b06f9 tempest-VolumesDeleteCascade-2075029007 None] CMD "chmod 660 /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c/volume-1508f77e-fcee-4096-a8a5-04c66093764b.b0636d78-510b-420c-b100-a7bca77e8d6b" returned: 0 in 0.189s {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 15:07:36 devstack cinder-volume[83259]: DEBUG cinder.volume.drivers.remotefs [None req-030d00e1-9513-438b-9ed0-1495ed0b06f9 tempest-VolumesDeleteCascade-2075029007 None] Setting permissions: /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c/volume-1508f77e-fcee-4096-a8a5-04c66093764b -> 1000:1000 {{(pid=83259) _do_create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1584}} Sep 16 15:07:36 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [None req-030d00e1-9513-438b-9ed0-1495ed0b06f9 tempest-VolumesDeleteCascade-2075029007 None] Running cmd (subprocess): chown --reference=/opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c/volume-1508f77e-fcee-4096-a8a5-04c66093764b /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c/volume-1508f77e-fcee-4096-a8a5-04c66093764b.b0636d78-510b-420c-b100-a7bca77e8d6b {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 15:07:37 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [None req-030d00e1-9513-438b-9ed0-1495ed0b06f9 tempest-VolumesDeleteCascade-2075029007 None] CMD "chown --reference=/opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c/volume-1508f77e-fcee-4096-a8a5-04c66093764b /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c/volume-1508f77e-fcee-4096-a8a5-04c66093764b.b0636d78-510b-420c-b100-a7bca77e8d6b" returned: 0 in 0.151s {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 15:07:37 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [None req-030d00e1-9513-438b-9ed0-1495ed0b06f9 tempest-VolumesDeleteCascade-2075029007 None] Running cmd (subprocess): truncate -s0 /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c/volume-1508f77e-fcee-4096-a8a5-04c66093764b.info {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 15:07:37 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [None req-030d00e1-9513-438b-9ed0-1495ed0b06f9 tempest-VolumesDeleteCascade-2075029007 None] CMD "truncate -s0 /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c/volume-1508f77e-fcee-4096-a8a5-04c66093764b.info" returned: 0 in 0.257s {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 15:07:37 devstack cinder-volume[83259]: DEBUG cinder.volume.drivers.remotefs [None req-030d00e1-9513-438b-9ed0-1495ed0b06f9 tempest-VolumesDeleteCascade-2075029007 None] File path /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c/volume-1508f77e-fcee-4096-a8a5-04c66093764b.info is being set with permissions: 660 {{(pid=83259) _set_rw_permissions /opt/stack/cinder/cinder/volume/drivers/remotefs.py:492}} Sep 16 15:07:37 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [None req-030d00e1-9513-438b-9ed0-1495ed0b06f9 tempest-VolumesDeleteCascade-2075029007 None] Running cmd (subprocess): chmod 660 /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c/volume-1508f77e-fcee-4096-a8a5-04c66093764b.info {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 15:07:37 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [None req-030d00e1-9513-438b-9ed0-1495ed0b06f9 tempest-VolumesDeleteCascade-2075029007 None] CMD "chmod 660 /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c/volume-1508f77e-fcee-4096-a8a5-04c66093764b.info" returned: 0 in 0.153s {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 15:07:37 devstack cinder-volume[83259]: DEBUG oslo_concurrency.lockutils [None req-030d00e1-9513-438b-9ed0-1495ed0b06f9 tempest-VolumesDeleteCascade-2075029007 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.864s {{(pid=83259) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 16 15:07:38 devstack cinder-volume[83259]: INFO cinder.volume.manager [None req-030d00e1-9513-438b-9ed0-1495ed0b06f9 tempest-VolumesDeleteCascade-2075029007 None] Create snapshot completed successfully Sep 16 15:07:39 devstack cinder-volume[83259]: WARNING cinder.volume.volume_utils [None req-02b92a50-d942-4788-9d60-10f023fd624b tempest-VolumesDeleteCascade-2075029007 None] Volume driver (QuobyteDriver 1.2) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 16 15:07:39 devstack cinder-volume[83259]: DEBUG oslo_concurrency.lockutils [None req-02b92a50-d942-4788-9d60-10f023fd624b tempest-VolumesDeleteCascade-2075029007 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=83259) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 16 15:07:39 devstack cinder-volume[83259]: DEBUG oslo_concurrency.lockutils [None req-02b92a50-d942-4788-9d60-10f023fd624b tempest-VolumesDeleteCascade-2075029007 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.003s {{(pid=83259) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 16 15:07:39 devstack cinder-volume[83259]: DEBUG cinder.volume.drivers.remotefs [None req-02b92a50-d942-4788-9d60-10f023fd624b tempest-VolumesDeleteCascade-2075029007 None] Creating offline snapshot a06bff2e-8822-4256-9509-1c4dc135edec of volume 1508f77e-fcee-4096-a8a5-04c66093764b {{(pid=83259) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1694}} Sep 16 15:07:39 devstack cinder-volume[83259]: DEBUG oslo.privsep.daemon [-] privsep: reply[c8305177-9250-4594-9878-0422b5af7c28]: (4, 'qcow2') {{(pid=84312) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 16 15:07:39 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [None req-02b92a50-d942-4788-9d60-10f023fd624b tempest-VolumesDeleteCascade-2075029007 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c/volume-1508f77e-fcee-4096-a8a5-04c66093764b.b0636d78-510b-420c-b100-a7bca77e8d6b {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 15:07:40 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [None req-02b92a50-d942-4788-9d60-10f023fd624b tempest-VolumesDeleteCascade-2075029007 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c/volume-1508f77e-fcee-4096-a8a5-04c66093764b.b0636d78-510b-420c-b100-a7bca77e8d6b" returned: 0 in 0.469s {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 15:07:40 devstack cinder-volume[83259]: DEBUG cinder.volume.drivers.remotefs [None req-02b92a50-d942-4788-9d60-10f023fd624b tempest-VolumesDeleteCascade-2075029007 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-1508f77e-fcee-4096-a8a5-04c66093764b(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83259) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:886}} Sep 16 15:07:40 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [None req-02b92a50-d942-4788-9d60-10f023fd624b tempest-VolumesDeleteCascade-2075029007 None] Running cmd (subprocess): qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c/volume-1508f77e-fcee-4096-a8a5-04c66093764b.b0636d78-510b-420c-b100-a7bca77e8d6b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c/volume-1508f77e-fcee-4096-a8a5-04c66093764b.a06bff2e-8822-4256-9509-1c4dc135edec 1G {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 15:07:40 devstack quobyte-client[83286]: The server volume:87712ffe-8a69-446d-9ed6-4430c7ee9792@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=87712ffe-8a69-446d-9ed6-4430c7ee9792, inode=77, name=volume-1508f77e-fcee-4096-a8a5-04c66093764b.a06bff2e-8822-4256-9509-1c4dc135edec, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.206), requestorAccessMask=0 Sep 16 15:07:40 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [None req-02b92a50-d942-4788-9d60-10f023fd624b tempest-VolumesDeleteCascade-2075029007 None] CMD "qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c/volume-1508f77e-fcee-4096-a8a5-04c66093764b.b0636d78-510b-420c-b100-a7bca77e8d6b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c/volume-1508f77e-fcee-4096-a8a5-04c66093764b.a06bff2e-8822-4256-9509-1c4dc135edec 1G" returned: 0 in 0.339s {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 15:07:40 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [None req-02b92a50-d942-4788-9d60-10f023fd624b tempest-VolumesDeleteCascade-2075029007 None] Running cmd (subprocess): qemu-img rebase -u -b volume-1508f77e-fcee-4096-a8a5-04c66093764b.b0636d78-510b-420c-b100-a7bca77e8d6b -F qcow2 /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c/volume-1508f77e-fcee-4096-a8a5-04c66093764b.a06bff2e-8822-4256-9509-1c4dc135edec {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 15:07:40 devstack quobyte-client[83286]: System call of process 94412 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 16 15:07:40 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [None req-02b92a50-d942-4788-9d60-10f023fd624b tempest-VolumesDeleteCascade-2075029007 None] CMD "qemu-img rebase -u -b volume-1508f77e-fcee-4096-a8a5-04c66093764b.b0636d78-510b-420c-b100-a7bca77e8d6b -F qcow2 /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c/volume-1508f77e-fcee-4096-a8a5-04c66093764b.a06bff2e-8822-4256-9509-1c4dc135edec" returned: 0 in 0.210s {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 15:07:41 devstack cinder-volume[83259]: DEBUG cinder.volume.drivers.remotefs [None req-02b92a50-d942-4788-9d60-10f023fd624b tempest-VolumesDeleteCascade-2075029007 None] File path /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c/volume-1508f77e-fcee-4096-a8a5-04c66093764b.a06bff2e-8822-4256-9509-1c4dc135edec is being set with permissions: 660 {{(pid=83259) _set_rw_permissions /opt/stack/cinder/cinder/volume/drivers/remotefs.py:492}} Sep 16 15:07:41 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [None req-02b92a50-d942-4788-9d60-10f023fd624b tempest-VolumesDeleteCascade-2075029007 None] Running cmd (subprocess): chmod 660 /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c/volume-1508f77e-fcee-4096-a8a5-04c66093764b.a06bff2e-8822-4256-9509-1c4dc135edec {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 15:07:41 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [None req-02b92a50-d942-4788-9d60-10f023fd624b tempest-VolumesDeleteCascade-2075029007 None] CMD "chmod 660 /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c/volume-1508f77e-fcee-4096-a8a5-04c66093764b.a06bff2e-8822-4256-9509-1c4dc135edec" returned: 0 in 0.108s {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 15:07:41 devstack cinder-volume[83259]: DEBUG cinder.volume.drivers.remotefs [None req-02b92a50-d942-4788-9d60-10f023fd624b tempest-VolumesDeleteCascade-2075029007 None] Setting permissions: /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c/volume-1508f77e-fcee-4096-a8a5-04c66093764b.b0636d78-510b-420c-b100-a7bca77e8d6b -> 1000:1000 {{(pid=83259) _do_create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1584}} Sep 16 15:07:41 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [None req-02b92a50-d942-4788-9d60-10f023fd624b tempest-VolumesDeleteCascade-2075029007 None] Running cmd (subprocess): chown --reference=/opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c/volume-1508f77e-fcee-4096-a8a5-04c66093764b.b0636d78-510b-420c-b100-a7bca77e8d6b /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c/volume-1508f77e-fcee-4096-a8a5-04c66093764b.a06bff2e-8822-4256-9509-1c4dc135edec {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 15:07:41 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [None req-02b92a50-d942-4788-9d60-10f023fd624b tempest-VolumesDeleteCascade-2075029007 None] CMD "chown --reference=/opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c/volume-1508f77e-fcee-4096-a8a5-04c66093764b.b0636d78-510b-420c-b100-a7bca77e8d6b /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c/volume-1508f77e-fcee-4096-a8a5-04c66093764b.a06bff2e-8822-4256-9509-1c4dc135edec" returned: 0 in 0.089s {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 15:07:41 devstack cinder-volume[83259]: DEBUG oslo_concurrency.lockutils [None req-02b92a50-d942-4788-9d60-10f023fd624b tempest-VolumesDeleteCascade-2075029007 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.607s {{(pid=83259) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 16 15:07:41 devstack cinder-volume[83259]: INFO cinder.volume.manager [None req-02b92a50-d942-4788-9d60-10f023fd624b tempest-VolumesDeleteCascade-2075029007 None] Create snapshot completed successfully Sep 16 15:07:43 devstack cinder-volume[83259]: DEBUG cinder.coordination [None req-24562132-66ef-41d0-937c-ae9a5ae11021 tempest-VolumesDeleteCascade-2075029007 None] Acquiring lock "cinder-1508f77e-fcee-4096-a8a5-04c66093764b-delete_volume" by "delete_volume" {{(pid=83259) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 16 15:07:43 devstack cinder-volume[83259]: DEBUG cinder.coordination [None req-24562132-66ef-41d0-937c-ae9a5ae11021 tempest-VolumesDeleteCascade-2075029007 None] Lock "cinder-1508f77e-fcee-4096-a8a5-04c66093764b-delete_volume" acquired by "delete_volume" :: waited 0.069s {{(pid=83259) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 16 15:07:43 devstack cinder-volume[83259]: WARNING cinder.volume.volume_utils [None req-24562132-66ef-41d0-937c-ae9a5ae11021 tempest-VolumesDeleteCascade-2075029007 None] Volume driver (QuobyteDriver 1.2) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 16 15:07:43 devstack cinder-volume[83259]: DEBUG cinder.volume.manager [None req-24562132-66ef-41d0-937c-ae9a5ae11021 tempest-VolumesDeleteCascade-2075029007 None] Performing cascade delete. {{(pid=83259) delete_volume /opt/stack/cinder/cinder/volume/manager.py:995}} Sep 16 15:07:43 devstack cinder-volume[83259]: DEBUG cinder.coordination [None req-24562132-66ef-41d0-937c-ae9a5ae11021 tempest-VolumesDeleteCascade-2075029007 None] Acquiring lock "cinder-a06bff2e-8822-4256-9509-1c4dc135edec-delete_snapshot" by "delete_snapshot" {{(pid=83259) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 16 15:07:43 devstack cinder-volume[83259]: DEBUG cinder.coordination [None req-24562132-66ef-41d0-937c-ae9a5ae11021 tempest-VolumesDeleteCascade-2075029007 None] Lock "cinder-a06bff2e-8822-4256-9509-1c4dc135edec-delete_snapshot" acquired by "delete_snapshot" :: waited 0.015s {{(pid=83259) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 16 15:07:43 devstack cinder-volume[83259]: WARNING cinder.volume.volume_utils [None req-24562132-66ef-41d0-937c-ae9a5ae11021 tempest-VolumesDeleteCascade-2075029007 None] Volume driver (QuobyteDriver 1.2) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 16 15:07:43 devstack cinder-volume[83259]: DEBUG cinder.coordination [None req-24562132-66ef-41d0-937c-ae9a5ae11021 tempest-VolumesDeleteCascade-2075029007 None] Acquiring lock "cinder-quobyte-1508f77e-fcee-4096-a8a5-04c66093764b" by "delete_snapshot" {{(pid=83259) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 16 15:07:43 devstack cinder-volume[83259]: DEBUG cinder.coordination [None req-24562132-66ef-41d0-937c-ae9a5ae11021 tempest-VolumesDeleteCascade-2075029007 None] Lock "cinder-quobyte-1508f77e-fcee-4096-a8a5-04c66093764b" acquired by "delete_snapshot" :: waited 0.014s {{(pid=83259) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 16 15:07:43 devstack cinder-volume[83259]: DEBUG cinder.coordination [None req-24562132-66ef-41d0-937c-ae9a5ae11021 tempest-VolumesDeleteCascade-2075029007 None] Acquiring lock "cinder-quobyte-a06bff2e-8822-4256-9509-1c4dc135edec" by "_delete_snapshot" {{(pid=83259) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 16 15:07:43 devstack cinder-volume[83259]: DEBUG cinder.coordination [None req-24562132-66ef-41d0-937c-ae9a5ae11021 tempest-VolumesDeleteCascade-2075029007 None] Lock "cinder-quobyte-a06bff2e-8822-4256-9509-1c4dc135edec" acquired by "_delete_snapshot" :: waited 0.016s {{(pid=83259) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 16 15:07:43 devstack cinder-volume[83259]: DEBUG cinder.volume.drivers.remotefs [None req-24562132-66ef-41d0-937c-ae9a5ae11021 tempest-VolumesDeleteCascade-2075029007 None] Deleting offline snapshot a06bff2e-8822-4256-9509-1c4dc135edec of volume 1508f77e-fcee-4096-a8a5-04c66093764b {{(pid=83259) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1278}} Sep 16 15:07:43 devstack cinder-volume[83259]: DEBUG cinder.volume.drivers.remotefs [None req-24562132-66ef-41d0-937c-ae9a5ae11021 tempest-VolumesDeleteCascade-2075029007 None] snapshot_file for this snap is: volume-1508f77e-fcee-4096-a8a5-04c66093764b.a06bff2e-8822-4256-9509-1c4dc135edec {{(pid=83259) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1307}} Sep 16 15:07:43 devstack cinder-volume[83259]: DEBUG oslo.privsep.daemon [-] privsep: reply[a5c899a8-3b5b-4536-b253-9e74cfd36ec6]: (4, 'qcow2') {{(pid=84312) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 16 15:07:43 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [None req-24562132-66ef-41d0-937c-ae9a5ae11021 tempest-VolumesDeleteCascade-2075029007 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c/volume-1508f77e-fcee-4096-a8a5-04c66093764b.a06bff2e-8822-4256-9509-1c4dc135edec {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 15:07:44 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [None req-24562132-66ef-41d0-937c-ae9a5ae11021 tempest-VolumesDeleteCascade-2075029007 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c/volume-1508f77e-fcee-4096-a8a5-04c66093764b.a06bff2e-8822-4256-9509-1c4dc135edec" returned: 0 in 0.552s {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 15:07:44 devstack cinder-volume[83259]: DEBUG cinder.volume.drivers.remotefs [None req-24562132-66ef-41d0-937c-ae9a5ae11021 tempest-VolumesDeleteCascade-2075029007 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-1508f77e-fcee-4096-a8a5-04c66093764b(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83259) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:886}} Sep 16 15:07:44 devstack cinder-volume[83259]: DEBUG oslo.privsep.daemon [-] privsep: reply[f3b494b4-50f1-4a31-a50e-4e60a4c00702]: (4, 'qcow2') {{(pid=84312) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 16 15:07:44 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [None req-24562132-66ef-41d0-937c-ae9a5ae11021 tempest-VolumesDeleteCascade-2075029007 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c/volume-1508f77e-fcee-4096-a8a5-04c66093764b.b0636d78-510b-420c-b100-a7bca77e8d6b {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 15:07:44 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [None req-24562132-66ef-41d0-937c-ae9a5ae11021 tempest-VolumesDeleteCascade-2075029007 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c/volume-1508f77e-fcee-4096-a8a5-04c66093764b.b0636d78-510b-420c-b100-a7bca77e8d6b" returned: 0 in 0.504s {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 15:07:44 devstack cinder-volume[83259]: DEBUG cinder.volume.drivers.remotefs [None req-24562132-66ef-41d0-937c-ae9a5ae11021 tempest-VolumesDeleteCascade-2075029007 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-1508f77e-fcee-4096-a8a5-04c66093764b(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83259) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:886}} Sep 16 15:07:44 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [None req-24562132-66ef-41d0-937c-ae9a5ae11021 tempest-VolumesDeleteCascade-2075029007 None] Running cmd (subprocess): qemu-img commit -d /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c/volume-1508f77e-fcee-4096-a8a5-04c66093764b.a06bff2e-8822-4256-9509-1c4dc135edec {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 15:07:45 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [None req-24562132-66ef-41d0-937c-ae9a5ae11021 tempest-VolumesDeleteCascade-2075029007 None] CMD "qemu-img commit -d /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c/volume-1508f77e-fcee-4096-a8a5-04c66093764b.a06bff2e-8822-4256-9509-1c4dc135edec" returned: 0 in 0.340s {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 15:07:45 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [None req-24562132-66ef-41d0-937c-ae9a5ae11021 tempest-VolumesDeleteCascade-2075029007 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c/volume-1508f77e-fcee-4096-a8a5-04c66093764b.a06bff2e-8822-4256-9509-1c4dc135edec {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 15:07:45 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [None req-24562132-66ef-41d0-937c-ae9a5ae11021 tempest-VolumesDeleteCascade-2075029007 None] CMD "rm -f /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c/volume-1508f77e-fcee-4096-a8a5-04c66093764b.a06bff2e-8822-4256-9509-1c4dc135edec" returned: 0 in 0.119s {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 15:07:45 devstack cinder-volume[83259]: DEBUG cinder.coordination [None req-24562132-66ef-41d0-937c-ae9a5ae11021 tempest-VolumesDeleteCascade-2075029007 None] Lock "cinder-quobyte-a06bff2e-8822-4256-9509-1c4dc135edec" released by "_delete_snapshot" :: held 1.949s {{(pid=83259) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 16 15:07:45 devstack cinder-volume[83259]: DEBUG cinder.coordination [None req-24562132-66ef-41d0-937c-ae9a5ae11021 tempest-VolumesDeleteCascade-2075029007 None] Lock "cinder-quobyte-1508f77e-fcee-4096-a8a5-04c66093764b" released by "delete_snapshot" :: held 1.983s {{(pid=83259) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 16 15:07:45 devstack cinder-volume[83259]: DEBUG oslo_service.periodic_task [None req-050ec8a1-6ffd-499d-95ad-d548a84437e2 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=83259) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} Sep 16 15:07:45 devstack cinder-volume[83259]: DEBUG oslo_concurrency.lockutils [None req-050ec8a1-6ffd-499d-95ad-d548a84437e2 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83259) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 16 15:07:45 devstack cinder-volume[83259]: DEBUG oslo_concurrency.lockutils [None req-050ec8a1-6ffd-499d-95ad-d548a84437e2 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=83259) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 16 15:07:45 devstack cinder-volume[83259]: DEBUG cinder.volume.drivers.quobyte [None req-050ec8a1-6ffd-499d-95ad-d548a84437e2 None None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-61f585ac-f8e2-4d19-a890-7ebc2726cc72': None} {{(pid=83259) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:639}} Sep 16 15:07:45 devstack cinder-volume[83259]: DEBUG cinder.volume.drivers.quobyte [None req-050ec8a1-6ffd-499d-95ad-d548a84437e2 None None] Available shares ['10.10.41.181/cinder-vol-61f585ac-f8e2-4d19-a890-7ebc2726cc72'] {{(pid=83259) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:669}} Sep 16 15:07:45 devstack cinder-volume[83259]: DEBUG oslo_concurrency.lockutils [None req-050ec8a1-6ffd-499d-95ad-d548a84437e2 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.021s {{(pid=83259) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 16 15:07:45 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [None req-050ec8a1-6ffd-499d-95ad-d548a84437e2 None None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 15:07:46 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [None req-050ec8a1-6ffd-499d-95ad-d548a84437e2 None None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c" returned: 0 in 0.843s {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 15:07:46 devstack cinder-volume[83259]: DEBUG cinder.manager [None req-050ec8a1-6ffd-499d-95ad-d548a84437e2 None None] Notifying Schedulers of capabilities ... {{(pid=83259) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 16 15:07:47 devstack cinder-volume[83259]: DEBUG cinder.quota [None req-24562132-66ef-41d0-937c-ae9a5ae11021 tempest-VolumesDeleteCascade-2075029007 None] Created reservations ['176b1ac0-b4a9-48c2-b95a-3cd608344481', 'd5aab830-b818-4a9f-b0ec-eb5045393ce0', '9f878dbe-bc45-4746-bdba-5d3edd950312', 'b57e351d-55a5-4534-9cef-527500c14edb'] {{(pid=83259) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 16 15:07:47 devstack cinder-volume[83259]: INFO cinder.volume.manager [None req-24562132-66ef-41d0-937c-ae9a5ae11021 tempest-VolumesDeleteCascade-2075029007 None] Delete snapshot completed successfully. Sep 16 15:07:47 devstack cinder-volume[83259]: DEBUG cinder.coordination [None req-24562132-66ef-41d0-937c-ae9a5ae11021 tempest-VolumesDeleteCascade-2075029007 None] Lock "cinder-a06bff2e-8822-4256-9509-1c4dc135edec-delete_snapshot" released by "delete_snapshot" :: held 3.848s {{(pid=83259) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 16 15:07:47 devstack cinder-volume[83259]: DEBUG cinder.coordination [None req-24562132-66ef-41d0-937c-ae9a5ae11021 tempest-VolumesDeleteCascade-2075029007 None] Acquiring lock "cinder-b0636d78-510b-420c-b100-a7bca77e8d6b-delete_snapshot" by "delete_snapshot" {{(pid=83259) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 16 15:07:47 devstack cinder-volume[83259]: DEBUG cinder.coordination [None req-24562132-66ef-41d0-937c-ae9a5ae11021 tempest-VolumesDeleteCascade-2075029007 None] Lock "cinder-b0636d78-510b-420c-b100-a7bca77e8d6b-delete_snapshot" acquired by "delete_snapshot" :: waited 0.028s {{(pid=83259) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 16 15:07:47 devstack cinder-volume[83259]: WARNING cinder.volume.volume_utils [None req-24562132-66ef-41d0-937c-ae9a5ae11021 tempest-VolumesDeleteCascade-2075029007 None] Volume driver (QuobyteDriver 1.2) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 16 15:07:47 devstack cinder-volume[83259]: DEBUG cinder.coordination [None req-24562132-66ef-41d0-937c-ae9a5ae11021 tempest-VolumesDeleteCascade-2075029007 None] Acquiring lock "cinder-quobyte-1508f77e-fcee-4096-a8a5-04c66093764b" by "delete_snapshot" {{(pid=83259) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 16 15:07:47 devstack cinder-volume[83259]: DEBUG cinder.coordination [None req-24562132-66ef-41d0-937c-ae9a5ae11021 tempest-VolumesDeleteCascade-2075029007 None] Lock "cinder-quobyte-1508f77e-fcee-4096-a8a5-04c66093764b" acquired by "delete_snapshot" :: waited 0.016s {{(pid=83259) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 16 15:07:47 devstack cinder-volume[83259]: DEBUG cinder.coordination [None req-24562132-66ef-41d0-937c-ae9a5ae11021 tempest-VolumesDeleteCascade-2075029007 None] Acquiring lock "cinder-quobyte-b0636d78-510b-420c-b100-a7bca77e8d6b" by "_delete_snapshot" {{(pid=83259) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 16 15:07:47 devstack cinder-volume[83259]: DEBUG cinder.coordination [None req-24562132-66ef-41d0-937c-ae9a5ae11021 tempest-VolumesDeleteCascade-2075029007 None] Lock "cinder-quobyte-b0636d78-510b-420c-b100-a7bca77e8d6b" acquired by "_delete_snapshot" :: waited 0.015s {{(pid=83259) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 16 15:07:47 devstack cinder-volume[83259]: DEBUG cinder.volume.drivers.remotefs [None req-24562132-66ef-41d0-937c-ae9a5ae11021 tempest-VolumesDeleteCascade-2075029007 None] Deleting offline snapshot b0636d78-510b-420c-b100-a7bca77e8d6b of volume 1508f77e-fcee-4096-a8a5-04c66093764b {{(pid=83259) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1278}} Sep 16 15:07:47 devstack cinder-volume[83259]: DEBUG cinder.volume.drivers.remotefs [None req-24562132-66ef-41d0-937c-ae9a5ae11021 tempest-VolumesDeleteCascade-2075029007 None] snapshot_file for this snap is: volume-1508f77e-fcee-4096-a8a5-04c66093764b.b0636d78-510b-420c-b100-a7bca77e8d6b {{(pid=83259) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1307}} Sep 16 15:07:47 devstack cinder-volume[83259]: DEBUG oslo.privsep.daemon [-] privsep: reply[93778f8b-f1b4-4964-b91e-a90a122de935]: (4, 'qcow2') {{(pid=84312) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 16 15:07:47 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [None req-24562132-66ef-41d0-937c-ae9a5ae11021 tempest-VolumesDeleteCascade-2075029007 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c/volume-1508f77e-fcee-4096-a8a5-04c66093764b.b0636d78-510b-420c-b100-a7bca77e8d6b {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 15:07:48 devstack quobyte-client[83286]: System call of process 94431 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 16 15:07:48 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [None req-24562132-66ef-41d0-937c-ae9a5ae11021 tempest-VolumesDeleteCascade-2075029007 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c/volume-1508f77e-fcee-4096-a8a5-04c66093764b.b0636d78-510b-420c-b100-a7bca77e8d6b" returned: 0 in 0.672s {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 15:07:48 devstack cinder-volume[83259]: DEBUG cinder.volume.drivers.remotefs [None req-24562132-66ef-41d0-937c-ae9a5ae11021 tempest-VolumesDeleteCascade-2075029007 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-1508f77e-fcee-4096-a8a5-04c66093764b(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83259) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:886}} Sep 16 15:07:48 devstack cinder-volume[83259]: DEBUG oslo.privsep.daemon [-] privsep: reply[646468c0-6f15-4c47-9402-066ce704ee89]: (4, 'qcow2') {{(pid=84312) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 16 15:07:48 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [None req-24562132-66ef-41d0-937c-ae9a5ae11021 tempest-VolumesDeleteCascade-2075029007 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c/volume-1508f77e-fcee-4096-a8a5-04c66093764b {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 15:07:49 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [None req-24562132-66ef-41d0-937c-ae9a5ae11021 tempest-VolumesDeleteCascade-2075029007 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c/volume-1508f77e-fcee-4096-a8a5-04c66093764b" returned: 0 in 0.945s {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 15:07:49 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [None req-24562132-66ef-41d0-937c-ae9a5ae11021 tempest-VolumesDeleteCascade-2075029007 None] Running cmd (subprocess): qemu-img commit -d /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c/volume-1508f77e-fcee-4096-a8a5-04c66093764b.b0636d78-510b-420c-b100-a7bca77e8d6b {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 15:07:49 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [None req-24562132-66ef-41d0-937c-ae9a5ae11021 tempest-VolumesDeleteCascade-2075029007 None] CMD "qemu-img commit -d /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c/volume-1508f77e-fcee-4096-a8a5-04c66093764b.b0636d78-510b-420c-b100-a7bca77e8d6b" returned: 0 in 0.439s {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 15:07:50 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [None req-24562132-66ef-41d0-937c-ae9a5ae11021 tempest-VolumesDeleteCascade-2075029007 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c/volume-1508f77e-fcee-4096-a8a5-04c66093764b.b0636d78-510b-420c-b100-a7bca77e8d6b {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 15:07:50 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [None req-24562132-66ef-41d0-937c-ae9a5ae11021 tempest-VolumesDeleteCascade-2075029007 None] CMD "rm -f /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c/volume-1508f77e-fcee-4096-a8a5-04c66093764b.b0636d78-510b-420c-b100-a7bca77e8d6b" returned: 0 in 0.209s {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 15:07:50 devstack cinder-volume[83259]: DEBUG cinder.coordination [None req-24562132-66ef-41d0-937c-ae9a5ae11021 tempest-VolumesDeleteCascade-2075029007 None] Lock "cinder-quobyte-b0636d78-510b-420c-b100-a7bca77e8d6b" released by "_delete_snapshot" :: held 2.947s {{(pid=83259) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 16 15:07:50 devstack cinder-volume[83259]: DEBUG cinder.coordination [None req-24562132-66ef-41d0-937c-ae9a5ae11021 tempest-VolumesDeleteCascade-2075029007 None] Lock "cinder-quobyte-1508f77e-fcee-4096-a8a5-04c66093764b" released by "delete_snapshot" :: held 2.984s {{(pid=83259) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 16 15:07:50 devstack cinder-volume[83259]: DEBUG cinder.quota [None req-24562132-66ef-41d0-937c-ae9a5ae11021 tempest-VolumesDeleteCascade-2075029007 None] Created reservations ['d7ff13c3-aacb-49ab-ba76-43feb3da9778', 'b32c3805-a9ff-4146-9ebb-08966c8861e9', '78ac193e-1412-41b6-a4ad-be75b8f12eb5', '7a838b63-b9da-4ae1-a9e8-9fab1374d89e'] {{(pid=83259) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 16 15:07:51 devstack cinder-volume[83259]: INFO cinder.volume.manager [None req-24562132-66ef-41d0-937c-ae9a5ae11021 tempest-VolumesDeleteCascade-2075029007 None] Delete snapshot completed successfully. Sep 16 15:07:51 devstack cinder-volume[83259]: DEBUG cinder.coordination [None req-24562132-66ef-41d0-937c-ae9a5ae11021 tempest-VolumesDeleteCascade-2075029007 None] Lock "cinder-b0636d78-510b-420c-b100-a7bca77e8d6b-delete_snapshot" released by "delete_snapshot" :: held 3.725s {{(pid=83259) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 16 15:07:51 devstack cinder-volume[83259]: DEBUG cinder.volume.manager [None req-24562132-66ef-41d0-937c-ae9a5ae11021 tempest-VolumesDeleteCascade-2075029007 None] Snapshots deleted, issuing volume delete {{(pid=83259) delete_volume /opt/stack/cinder/cinder/volume/manager.py:1010}} Sep 16 15:07:51 devstack cinder-volume[83259]: DEBUG cinder.coordination [None req-24562132-66ef-41d0-937c-ae9a5ae11021 tempest-VolumesDeleteCascade-2075029007 None] Acquiring lock "cinder-quobyte-1508f77e-fcee-4096-a8a5-04c66093764b" by "delete_volume" {{(pid=83259) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 16 15:07:51 devstack cinder-volume[83259]: DEBUG cinder.coordination [None req-24562132-66ef-41d0-937c-ae9a5ae11021 tempest-VolumesDeleteCascade-2075029007 None] Lock "cinder-quobyte-1508f77e-fcee-4096-a8a5-04c66093764b" acquired by "delete_volume" :: waited 0.030s {{(pid=83259) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 16 15:07:51 devstack cinder-volume[83259]: DEBUG oslo.privsep.daemon [-] privsep: reply[b9d7b19a-66cf-4e55-ab54-288baa62ffe2]: (4, 'qcow2') {{(pid=84312) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 16 15:07:51 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [None req-24562132-66ef-41d0-937c-ae9a5ae11021 tempest-VolumesDeleteCascade-2075029007 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c/volume-1508f77e-fcee-4096-a8a5-04c66093764b {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 15:07:52 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [None req-24562132-66ef-41d0-937c-ae9a5ae11021 tempest-VolumesDeleteCascade-2075029007 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c/volume-1508f77e-fcee-4096-a8a5-04c66093764b" returned: 0 in 0.715s {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 15:07:52 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [None req-24562132-66ef-41d0-937c-ae9a5ae11021 tempest-VolumesDeleteCascade-2075029007 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c/volume-1508f77e-fcee-4096-a8a5-04c66093764b {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 15:07:52 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [None req-24562132-66ef-41d0-937c-ae9a5ae11021 tempest-VolumesDeleteCascade-2075029007 None] CMD "rm -f /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c/volume-1508f77e-fcee-4096-a8a5-04c66093764b" returned: 0 in 0.236s {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 15:07:52 devstack cinder-volume[83259]: DEBUG cinder.coordination [None req-24562132-66ef-41d0-937c-ae9a5ae11021 tempest-VolumesDeleteCascade-2075029007 None] Lock "cinder-quobyte-1508f77e-fcee-4096-a8a5-04c66093764b" released by "delete_volume" :: held 1.275s {{(pid=83259) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 16 15:07:53 devstack cinder-volume[83259]: DEBUG cinder.quota [None req-24562132-66ef-41d0-937c-ae9a5ae11021 tempest-VolumesDeleteCascade-2075029007 None] Created reservations ['503780ed-4beb-4307-ae05-549bd2d68226', '6cf3b6ac-49e0-4dc3-8717-25fcd1c61f14', '270115ad-44b5-4ab7-b361-20ac803ec599', 'e936a5d3-7715-4faa-bb4c-bac795e0d2ef'] {{(pid=83259) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 16 15:07:53 devstack cinder-volume[83259]: DEBUG oslo_concurrency.lockutils [None req-24562132-66ef-41d0-937c-ae9a5ae11021 tempest-VolumesDeleteCascade-2075029007 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83259) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 16 15:07:53 devstack cinder-volume[83259]: DEBUG oslo_concurrency.lockutils [None req-24562132-66ef-41d0-937c-ae9a5ae11021 tempest-VolumesDeleteCascade-2075029007 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.009s {{(pid=83259) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 16 15:07:53 devstack cinder-volume[83259]: DEBUG cinder.volume.drivers.quobyte [None req-24562132-66ef-41d0-937c-ae9a5ae11021 tempest-VolumesDeleteCascade-2075029007 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-61f585ac-f8e2-4d19-a890-7ebc2726cc72': None} {{(pid=83259) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:639}} Sep 16 15:07:53 devstack cinder-volume[83259]: DEBUG cinder.volume.drivers.quobyte [None req-24562132-66ef-41d0-937c-ae9a5ae11021 tempest-VolumesDeleteCascade-2075029007 None] Available shares ['10.10.41.181/cinder-vol-61f585ac-f8e2-4d19-a890-7ebc2726cc72'] {{(pid=83259) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:669}} Sep 16 15:07:53 devstack cinder-volume[83259]: DEBUG oslo_concurrency.lockutils [None req-24562132-66ef-41d0-937c-ae9a5ae11021 tempest-VolumesDeleteCascade-2075029007 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=83259) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 16 15:07:53 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [None req-24562132-66ef-41d0-937c-ae9a5ae11021 tempest-VolumesDeleteCascade-2075029007 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 15:07:53 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [None req-24562132-66ef-41d0-937c-ae9a5ae11021 tempest-VolumesDeleteCascade-2075029007 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c" returned: 0 in 0.162s {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 15:07:53 devstack cinder-volume[83259]: DEBUG cinder.manager [None req-24562132-66ef-41d0-937c-ae9a5ae11021 tempest-VolumesDeleteCascade-2075029007 None] Notifying Schedulers of capabilities ... {{(pid=83259) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 16 15:07:53 devstack cinder-volume[83259]: INFO cinder.volume.manager [None req-24562132-66ef-41d0-937c-ae9a5ae11021 tempest-VolumesDeleteCascade-2075029007 None] Deleted volume successfully. Sep 16 15:07:53 devstack cinder-volume[83259]: DEBUG cinder.coordination [None req-24562132-66ef-41d0-937c-ae9a5ae11021 tempest-VolumesDeleteCascade-2075029007 None] Lock "cinder-1508f77e-fcee-4096-a8a5-04c66093764b-delete_volume" released by "delete_volume" :: held 10.497s {{(pid=83259) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 16 15:07:54 devstack cinder-volume[83259]: WARNING cinder.volume.volume_utils [None req-89785460-c646-490b-b8b0-9e6fe80ead8c tempest-VolumesDeleteCascade-2075029007 None] Volume driver (QuobyteDriver 1.2) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 16 15:07:54 devstack cinder-volume[83259]: DEBUG cinder.volume.flows.manager.create_volume [None req-89785460-c646-490b-b8b0-9e6fe80ead8c tempest-VolumesDeleteCascade-2075029007 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#Quobyte'], 'hosts': ['devstack@QuobyteHD#Quobyte']} {{(pid=83259) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1387}} Sep 16 15:07:54 devstack cinder-volume[83259]: DEBUG cinder.volume.manager [None req-89785460-c646-490b-b8b0-9e6fe80ead8c tempest-VolumesDeleteCascade-2075029007 None] Flow 'volume_create_manager' (cc988a00-7753-4960-95d8-b0340647d62b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83259) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 16 15:07:54 devstack cinder-volume[83259]: DEBUG cinder.volume.manager [None req-89785460-c646-490b-b8b0-9e6fe80ead8c tempest-VolumesDeleteCascade-2075029007 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3e813ff8-bea7-4780-b5d2-83bd82b2ec1f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83259) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 15:07:55 devstack cinder-volume[83259]: DEBUG cinder.volume.manager [None req-89785460-c646-490b-b8b0-9e6fe80ead8c tempest-VolumesDeleteCascade-2075029007 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3e813ff8-bea7-4780-b5d2-83bd82b2ec1f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-16T13:07:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-1245337171',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#Quobyte',id=0b6f05ce-27c5-4cfd-aaf8-f9e718a2f81b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8646231716174424bb25c5dd1b061c89',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-16T13:07:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-16T13:07:55Z,use_quota=True,user_id='9471b80549a642cdaff7ac3ece0a4ce6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(485ead50-3df8-4d76-8d34-a4db136c980a),volume_type_id=485ead50-3df8-4d76-8d34-a4db136c980a)' {{(pid=83259) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 15:07:55 devstack cinder-volume[83259]: DEBUG cinder.volume.manager [None req-89785460-c646-490b-b8b0-9e6fe80ead8c tempest-VolumesDeleteCascade-2075029007 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9b4dd9a4-c243-4466-a819-bb26a7bf445d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83259) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 15:07:55 devstack cinder-volume[83259]: DEBUG cinder.volume.manager [None req-89785460-c646-490b-b8b0-9e6fe80ead8c tempest-VolumesDeleteCascade-2075029007 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9b4dd9a4-c243-4466-a819-bb26a7bf445d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83259) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 15:07:55 devstack cinder-volume[83259]: DEBUG cinder.volume.manager [None req-89785460-c646-490b-b8b0-9e6fe80ead8c tempest-VolumesDeleteCascade-2075029007 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c3545ad4-25c7-46f4-a29a-af37eba3c832) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83259) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 15:07:55 devstack cinder-volume[83259]: DEBUG cinder.volume.manager [None req-89785460-c646-490b-b8b0-9e6fe80ead8c tempest-VolumesDeleteCascade-2075029007 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c3545ad4-25c7-46f4-a29a-af37eba3c832) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0b6f05ce-27c5-4cfd-aaf8-f9e718a2f81b', 'volume_name': 'volume-0b6f05ce-27c5-4cfd-aaf8-f9e718a2f81b', 'volume_size': 1}' {{(pid=83259) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 15:07:55 devstack cinder-volume[83259]: DEBUG cinder.volume.manager [None req-89785460-c646-490b-b8b0-9e6fe80ead8c tempest-VolumesDeleteCascade-2075029007 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (89337e9a-844e-4c16-be0d-7d8ec42da6a9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83259) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 15:07:55 devstack cinder-volume[83259]: DEBUG cinder.volume.manager [None req-89785460-c646-490b-b8b0-9e6fe80ead8c tempest-VolumesDeleteCascade-2075029007 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (89337e9a-844e-4c16-be0d-7d8ec42da6a9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83259) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 15:07:55 devstack cinder-volume[83259]: DEBUG cinder.volume.manager [None req-89785460-c646-490b-b8b0-9e6fe80ead8c tempest-VolumesDeleteCascade-2075029007 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d105026b-6e33-4ec1-8847-3dc6969699e9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83259) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 15:07:55 devstack cinder-volume[83259]: INFO cinder.volume.flows.manager.create_volume [None req-89785460-c646-490b-b8b0-9e6fe80ead8c tempest-VolumesDeleteCascade-2075029007 None] Volume 0b6f05ce-27c5-4cfd-aaf8-f9e718a2f81b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0b6f05ce-27c5-4cfd-aaf8-f9e718a2f81b', 'volume_size': 1} Sep 16 15:07:55 devstack cinder-volume[83259]: DEBUG oslo_concurrency.lockutils [None req-89785460-c646-490b-b8b0-9e6fe80ead8c tempest-VolumesDeleteCascade-2075029007 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83259) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 16 15:07:55 devstack cinder-volume[83259]: DEBUG oslo_concurrency.lockutils [None req-89785460-c646-490b-b8b0-9e6fe80ead8c tempest-VolumesDeleteCascade-2075029007 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=83259) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 16 15:07:55 devstack cinder-volume[83259]: DEBUG cinder.volume.drivers.quobyte [None req-89785460-c646-490b-b8b0-9e6fe80ead8c tempest-VolumesDeleteCascade-2075029007 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-16T13:07:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-1245337171',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#Quobyte',id=0b6f05ce-27c5-4cfd-aaf8-f9e718a2f81b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8646231716174424bb25c5dd1b061c89',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-16T13:07:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-16T13:07:55Z,use_quota=True,user_id='9471b80549a642cdaff7ac3ece0a4ce6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(485ead50-3df8-4d76-8d34-a4db136c980a),volume_type_id=485ead50-3df8-4d76-8d34-a4db136c980a)}" {{(pid=83259) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Sep 16 15:07:55 devstack cinder-volume[83259]: DEBUG cinder.volume.drivers.remotefs [None req-89785460-c646-490b-b8b0-9e6fe80ead8c tempest-VolumesDeleteCascade-2075029007 None] Creating volume 0b6f05ce-27c5-4cfd-aaf8-f9e718a2f81b {{(pid=83259) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}} Sep 16 15:07:55 devstack cinder-volume[83259]: DEBUG oslo_concurrency.lockutils [None req-89785460-c646-490b-b8b0-9e6fe80ead8c tempest-VolumesDeleteCascade-2075029007 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83259) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 16 15:07:55 devstack cinder-volume[83259]: DEBUG oslo_concurrency.lockutils [None req-89785460-c646-490b-b8b0-9e6fe80ead8c tempest-VolumesDeleteCascade-2075029007 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83259) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 16 15:07:55 devstack cinder-volume[83259]: DEBUG cinder.volume.drivers.quobyte [None req-89785460-c646-490b-b8b0-9e6fe80ead8c tempest-VolumesDeleteCascade-2075029007 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-61f585ac-f8e2-4d19-a890-7ebc2726cc72': None} {{(pid=83259) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:639}} Sep 16 15:07:55 devstack cinder-volume[83259]: DEBUG cinder.volume.drivers.quobyte [None req-89785460-c646-490b-b8b0-9e6fe80ead8c tempest-VolumesDeleteCascade-2075029007 None] Available shares ['10.10.41.181/cinder-vol-61f585ac-f8e2-4d19-a890-7ebc2726cc72'] {{(pid=83259) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:669}} Sep 16 15:07:55 devstack cinder-volume[83259]: DEBUG oslo_concurrency.lockutils [None req-89785460-c646-490b-b8b0-9e6fe80ead8c tempest-VolumesDeleteCascade-2075029007 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=83259) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 16 15:07:55 devstack cinder-volume[83259]: DEBUG cinder.volume.drivers.quobyte [None req-89785460-c646-490b-b8b0-9e6fe80ead8c tempest-VolumesDeleteCascade-2075029007 None] Selected 10.10.41.181/cinder-vol-61f585ac-f8e2-4d19-a890-7ebc2726cc72 as target Quobyte volume. {{(pid=83259) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:690}} Sep 16 15:07:55 devstack cinder-volume[83259]: INFO cinder.volume.drivers.remotefs [None req-89785460-c646-490b-b8b0-9e6fe80ead8c tempest-VolumesDeleteCascade-2075029007 None] casted to 10.10.41.181/cinder-vol-61f585ac-f8e2-4d19-a890-7ebc2726cc72 Sep 16 15:07:55 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [None req-89785460-c646-490b-b8b0-9e6fe80ead8c tempest-VolumesDeleteCascade-2075029007 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c/volume-0b6f05ce-27c5-4cfd-aaf8-f9e718a2f81b 1073741824 {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 15:07:55 devstack quobyte-client[83286]: System call of process 94465 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 16 15:07:55 devstack quobyte-client[83286]: The server volume:87712ffe-8a69-446d-9ed6-4430c7ee9792@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=87712ffe-8a69-446d-9ed6-4430c7ee9792, inode=78, name=volume-0b6f05ce-27c5-4cfd-aaf8-f9e718a2f81b, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.206), requestorAccessMask=0 Sep 16 15:07:55 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [None req-89785460-c646-490b-b8b0-9e6fe80ead8c tempest-VolumesDeleteCascade-2075029007 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c/volume-0b6f05ce-27c5-4cfd-aaf8-f9e718a2f81b 1073741824" returned: 0 in 0.515s {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 15:07:55 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [None req-89785460-c646-490b-b8b0-9e6fe80ead8c tempest-VolumesDeleteCascade-2075029007 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c/volume-0b6f05ce-27c5-4cfd-aaf8-f9e718a2f81b {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 15:07:56 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [None req-89785460-c646-490b-b8b0-9e6fe80ead8c tempest-VolumesDeleteCascade-2075029007 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c/volume-0b6f05ce-27c5-4cfd-aaf8-f9e718a2f81b" returned: 0 in 0.301s {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 15:07:56 devstack cinder-volume[83259]: DEBUG cinder.volume.drivers.quobyte [None req-89785460-c646-490b-b8b0-9e6fe80ead8c tempest-VolumesDeleteCascade-2075029007 None] <== create_volume: return (918ms) {'provider_location': '10.10.41.181/cinder-vol-61f585ac-f8e2-4d19-a890-7ebc2726cc72'} {{(pid=83259) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Sep 16 15:07:56 devstack cinder-volume[83259]: DEBUG oslo_concurrency.lockutils [None req-89785460-c646-490b-b8b0-9e6fe80ead8c tempest-VolumesDeleteCascade-2075029007 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.935s {{(pid=83259) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 16 15:07:56 devstack cinder-volume[83259]: DEBUG cinder.volume.manager [None req-89785460-c646-490b-b8b0-9e6fe80ead8c tempest-VolumesDeleteCascade-2075029007 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d105026b-6e33-4ec1-8847-3dc6969699e9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0b6f05ce-27c5-4cfd-aaf8-f9e718a2f81b', 'volume_size': 1}' {{(pid=83259) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 15:07:56 devstack cinder-volume[83259]: DEBUG cinder.volume.manager [None req-89785460-c646-490b-b8b0-9e6fe80ead8c tempest-VolumesDeleteCascade-2075029007 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b0e90cc9-822f-4f3c-9132-2caef479a085) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83259) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 15:07:56 devstack cinder-volume[83259]: INFO cinder.volume.flows.manager.create_volume [None req-89785460-c646-490b-b8b0-9e6fe80ead8c tempest-VolumesDeleteCascade-2075029007 None] Volume volume-0b6f05ce-27c5-4cfd-aaf8-f9e718a2f81b (0b6f05ce-27c5-4cfd-aaf8-f9e718a2f81b): created successfully Sep 16 15:07:56 devstack cinder-volume[83259]: DEBUG cinder.volume.manager [None req-89785460-c646-490b-b8b0-9e6fe80ead8c tempest-VolumesDeleteCascade-2075029007 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b0e90cc9-822f-4f3c-9132-2caef479a085) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83259) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 15:07:56 devstack cinder-volume[83259]: DEBUG cinder.volume.manager [None req-89785460-c646-490b-b8b0-9e6fe80ead8c tempest-VolumesDeleteCascade-2075029007 None] Flow 'volume_create_manager' (cc988a00-7753-4960-95d8-b0340647d62b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83259) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 16 15:07:56 devstack cinder-volume[83259]: INFO cinder.volume.manager [None req-89785460-c646-490b-b8b0-9e6fe80ead8c tempest-VolumesDeleteCascade-2075029007 None] Created volume successfully. Sep 16 15:07:57 devstack cinder-volume[83259]: WARNING cinder.volume.volume_utils [None req-204c4bb5-5577-411f-8731-9dcc1b8a326d tempest-VolumesDeleteCascade-2075029007 None] Volume driver (QuobyteDriver 1.2) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 16 15:07:57 devstack cinder-volume[83259]: DEBUG oslo_concurrency.lockutils [None req-204c4bb5-5577-411f-8731-9dcc1b8a326d tempest-VolumesDeleteCascade-2075029007 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=83259) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 16 15:07:57 devstack cinder-volume[83259]: DEBUG oslo_concurrency.lockutils [None req-204c4bb5-5577-411f-8731-9dcc1b8a326d tempest-VolumesDeleteCascade-2075029007 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.003s {{(pid=83259) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 16 15:07:57 devstack cinder-volume[83259]: DEBUG cinder.volume.drivers.remotefs [None req-204c4bb5-5577-411f-8731-9dcc1b8a326d tempest-VolumesDeleteCascade-2075029007 None] Creating offline snapshot 6bb22662-e572-4904-9864-5ba91765e463 of volume 0b6f05ce-27c5-4cfd-aaf8-f9e718a2f81b {{(pid=83259) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1694}} Sep 16 15:07:57 devstack cinder-volume[83259]: DEBUG oslo.privsep.daemon [-] privsep: reply[965c257b-992f-4dce-a79f-a4197169a3e0]: (4, 'qcow2') {{(pid=84312) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 16 15:07:57 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [None req-204c4bb5-5577-411f-8731-9dcc1b8a326d tempest-VolumesDeleteCascade-2075029007 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c/volume-0b6f05ce-27c5-4cfd-aaf8-f9e718a2f81b {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 15:07:57 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [None req-204c4bb5-5577-411f-8731-9dcc1b8a326d tempest-VolumesDeleteCascade-2075029007 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c/volume-0b6f05ce-27c5-4cfd-aaf8-f9e718a2f81b" returned: 0 in 0.584s {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 15:07:57 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [None req-204c4bb5-5577-411f-8731-9dcc1b8a326d tempest-VolumesDeleteCascade-2075029007 None] Running cmd (subprocess): qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c/volume-0b6f05ce-27c5-4cfd-aaf8-f9e718a2f81b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c/volume-0b6f05ce-27c5-4cfd-aaf8-f9e718a2f81b.6bb22662-e572-4904-9864-5ba91765e463 1G {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 15:07:58 devstack quobyte-client[83286]: The server volume:87712ffe-8a69-446d-9ed6-4430c7ee9792@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=87712ffe-8a69-446d-9ed6-4430c7ee9792, inode=79, name=volume-0b6f05ce-27c5-4cfd-aaf8-f9e718a2f81b.6bb22662-e572-4904-9864-5ba91765e463, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.206), requestorAccessMask=0 Sep 16 15:07:58 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [None req-204c4bb5-5577-411f-8731-9dcc1b8a326d tempest-VolumesDeleteCascade-2075029007 None] CMD "qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c/volume-0b6f05ce-27c5-4cfd-aaf8-f9e718a2f81b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c/volume-0b6f05ce-27c5-4cfd-aaf8-f9e718a2f81b.6bb22662-e572-4904-9864-5ba91765e463 1G" returned: 0 in 0.263s {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 15:07:58 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [None req-204c4bb5-5577-411f-8731-9dcc1b8a326d tempest-VolumesDeleteCascade-2075029007 None] Running cmd (subprocess): qemu-img rebase -u -b volume-0b6f05ce-27c5-4cfd-aaf8-f9e718a2f81b -F qcow2 /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c/volume-0b6f05ce-27c5-4cfd-aaf8-f9e718a2f81b.6bb22662-e572-4904-9864-5ba91765e463 {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 15:07:58 devstack quobyte-client[83286]: System call of process 94479 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 16 15:07:58 devstack quobyte-client[83286]: System call of process 94479 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 16 15:07:58 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [None req-204c4bb5-5577-411f-8731-9dcc1b8a326d tempest-VolumesDeleteCascade-2075029007 None] CMD "qemu-img rebase -u -b volume-0b6f05ce-27c5-4cfd-aaf8-f9e718a2f81b -F qcow2 /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c/volume-0b6f05ce-27c5-4cfd-aaf8-f9e718a2f81b.6bb22662-e572-4904-9864-5ba91765e463" returned: 0 in 0.237s {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 15:07:58 devstack cinder-volume[83259]: DEBUG cinder.volume.drivers.remotefs [None req-204c4bb5-5577-411f-8731-9dcc1b8a326d tempest-VolumesDeleteCascade-2075029007 None] File path /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c/volume-0b6f05ce-27c5-4cfd-aaf8-f9e718a2f81b.6bb22662-e572-4904-9864-5ba91765e463 is being set with permissions: 660 {{(pid=83259) _set_rw_permissions /opt/stack/cinder/cinder/volume/drivers/remotefs.py:492}} Sep 16 15:07:58 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [None req-204c4bb5-5577-411f-8731-9dcc1b8a326d tempest-VolumesDeleteCascade-2075029007 None] Running cmd (subprocess): chmod 660 /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c/volume-0b6f05ce-27c5-4cfd-aaf8-f9e718a2f81b.6bb22662-e572-4904-9864-5ba91765e463 {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 15:07:58 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [None req-204c4bb5-5577-411f-8731-9dcc1b8a326d tempest-VolumesDeleteCascade-2075029007 None] CMD "chmod 660 /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c/volume-0b6f05ce-27c5-4cfd-aaf8-f9e718a2f81b.6bb22662-e572-4904-9864-5ba91765e463" returned: 0 in 0.153s {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 15:07:58 devstack cinder-volume[83259]: DEBUG cinder.volume.drivers.remotefs [None req-204c4bb5-5577-411f-8731-9dcc1b8a326d tempest-VolumesDeleteCascade-2075029007 None] Setting permissions: /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c/volume-0b6f05ce-27c5-4cfd-aaf8-f9e718a2f81b -> 1000:1000 {{(pid=83259) _do_create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1584}} Sep 16 15:07:58 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [None req-204c4bb5-5577-411f-8731-9dcc1b8a326d tempest-VolumesDeleteCascade-2075029007 None] Running cmd (subprocess): chown --reference=/opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c/volume-0b6f05ce-27c5-4cfd-aaf8-f9e718a2f81b /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c/volume-0b6f05ce-27c5-4cfd-aaf8-f9e718a2f81b.6bb22662-e572-4904-9864-5ba91765e463 {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 15:07:58 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [None req-204c4bb5-5577-411f-8731-9dcc1b8a326d tempest-VolumesDeleteCascade-2075029007 None] CMD "chown --reference=/opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c/volume-0b6f05ce-27c5-4cfd-aaf8-f9e718a2f81b /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c/volume-0b6f05ce-27c5-4cfd-aaf8-f9e718a2f81b.6bb22662-e572-4904-9864-5ba91765e463" returned: 0 in 0.161s {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 15:07:58 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [None req-204c4bb5-5577-411f-8731-9dcc1b8a326d tempest-VolumesDeleteCascade-2075029007 None] Running cmd (subprocess): truncate -s0 /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c/volume-0b6f05ce-27c5-4cfd-aaf8-f9e718a2f81b.info {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 15:07:59 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [None req-204c4bb5-5577-411f-8731-9dcc1b8a326d tempest-VolumesDeleteCascade-2075029007 None] CMD "truncate -s0 /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c/volume-0b6f05ce-27c5-4cfd-aaf8-f9e718a2f81b.info" returned: 0 in 0.106s {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 15:07:59 devstack cinder-volume[83259]: DEBUG cinder.volume.drivers.remotefs [None req-204c4bb5-5577-411f-8731-9dcc1b8a326d tempest-VolumesDeleteCascade-2075029007 None] File path /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c/volume-0b6f05ce-27c5-4cfd-aaf8-f9e718a2f81b.info is being set with permissions: 660 {{(pid=83259) _set_rw_permissions /opt/stack/cinder/cinder/volume/drivers/remotefs.py:492}} Sep 16 15:07:59 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [None req-204c4bb5-5577-411f-8731-9dcc1b8a326d tempest-VolumesDeleteCascade-2075029007 None] Running cmd (subprocess): chmod 660 /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c/volume-0b6f05ce-27c5-4cfd-aaf8-f9e718a2f81b.info {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 15:07:59 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [None req-204c4bb5-5577-411f-8731-9dcc1b8a326d tempest-VolumesDeleteCascade-2075029007 None] CMD "chmod 660 /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c/volume-0b6f05ce-27c5-4cfd-aaf8-f9e718a2f81b.info" returned: 0 in 0.095s {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 15:07:59 devstack cinder-volume[83259]: DEBUG oslo_concurrency.lockutils [None req-204c4bb5-5577-411f-8731-9dcc1b8a326d tempest-VolumesDeleteCascade-2075029007 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.071s {{(pid=83259) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 16 15:07:59 devstack cinder-volume[83259]: INFO cinder.volume.manager [None req-204c4bb5-5577-411f-8731-9dcc1b8a326d tempest-VolumesDeleteCascade-2075029007 None] Create snapshot completed successfully Sep 16 15:08:01 devstack cinder-volume[83259]: WARNING cinder.volume.volume_utils [None req-108a5e3f-244c-462c-ade9-b2e90c705785 tempest-VolumesDeleteCascade-2075029007 None] Volume driver (QuobyteDriver 1.2) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 16 15:08:01 devstack cinder-volume[83259]: DEBUG cinder.volume.flows.manager.create_volume [None req-108a5e3f-244c-462c-ade9-b2e90c705785 tempest-VolumesDeleteCascade-2075029007 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#Quobyte'], 'hosts': ['devstack@QuobyteHD#Quobyte']} {{(pid=83259) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1387}} Sep 16 15:08:01 devstack cinder-volume[83259]: DEBUG cinder.volume.manager [None req-108a5e3f-244c-462c-ade9-b2e90c705785 tempest-VolumesDeleteCascade-2075029007 None] Flow 'volume_create_manager' (1eee375f-2084-43f1-afc4-1c3495ad0b64) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83259) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 16 15:08:01 devstack cinder-volume[83259]: DEBUG cinder.volume.manager [None req-108a5e3f-244c-462c-ade9-b2e90c705785 tempest-VolumesDeleteCascade-2075029007 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (73f47136-2b6e-41ca-90bb-ecf54ddac192) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83259) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 15:08:01 devstack cinder-volume[83259]: DEBUG cinder.volume.manager [None req-108a5e3f-244c-462c-ade9-b2e90c705785 tempest-VolumesDeleteCascade-2075029007 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (73f47136-2b6e-41ca-90bb-ecf54ddac192) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-16T13:08:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-2050365978',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#Quobyte',id=ea988d1d-9a89-46ef-91ac-fbff3425f7f1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8646231716174424bb25c5dd1b061c89',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-16T13:08:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=6bb22662-e572-4904-9864-5ba91765e463,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-16T13:08:01Z,use_quota=True,user_id='9471b80549a642cdaff7ac3ece0a4ce6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(485ead50-3df8-4d76-8d34-a4db136c980a),volume_type_id=485ead50-3df8-4d76-8d34-a4db136c980a)' {{(pid=83259) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 15:08:01 devstack cinder-volume[83259]: DEBUG cinder.volume.manager [None req-108a5e3f-244c-462c-ade9-b2e90c705785 tempest-VolumesDeleteCascade-2075029007 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f6c6533e-7b65-450c-a0a1-c070991e8f3f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83259) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 15:08:01 devstack cinder-volume[83259]: DEBUG cinder.volume.manager [None req-108a5e3f-244c-462c-ade9-b2e90c705785 tempest-VolumesDeleteCascade-2075029007 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f6c6533e-7b65-450c-a0a1-c070991e8f3f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83259) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 15:08:01 devstack cinder-volume[83259]: DEBUG cinder.volume.manager [None req-108a5e3f-244c-462c-ade9-b2e90c705785 tempest-VolumesDeleteCascade-2075029007 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e329342a-2ce2-4a9b-8bf7-fb15cc4667a7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83259) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 15:08:01 devstack cinder-volume[83259]: DEBUG cinder.volume.manager [None req-108a5e3f-244c-462c-ade9-b2e90c705785 tempest-VolumesDeleteCascade-2075029007 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e329342a-2ce2-4a9b-8bf7-fb15cc4667a7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': 'ea988d1d-9a89-46ef-91ac-fbff3425f7f1', 'volume_name': 'volume-ea988d1d-9a89-46ef-91ac-fbff3425f7f1', 'volume_size': 1, 'snapshot_id': '6bb22662-e572-4904-9864-5ba91765e463'}' {{(pid=83259) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 15:08:01 devstack cinder-volume[83259]: DEBUG cinder.volume.manager [None req-108a5e3f-244c-462c-ade9-b2e90c705785 tempest-VolumesDeleteCascade-2075029007 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b3f4279e-d472-4ff6-a952-568e1d8f5fcd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83259) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 15:08:01 devstack cinder-volume[83259]: DEBUG cinder.volume.manager [None req-108a5e3f-244c-462c-ade9-b2e90c705785 tempest-VolumesDeleteCascade-2075029007 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b3f4279e-d472-4ff6-a952-568e1d8f5fcd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83259) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 15:08:01 devstack cinder-volume[83259]: DEBUG cinder.volume.manager [None req-108a5e3f-244c-462c-ade9-b2e90c705785 tempest-VolumesDeleteCascade-2075029007 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (40490c16-ec85-4f13-afd2-5e76e76fb9e6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83259) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 15:08:01 devstack cinder-volume[83259]: INFO cinder.volume.flows.manager.create_volume [None req-108a5e3f-244c-462c-ade9-b2e90c705785 tempest-VolumesDeleteCascade-2075029007 None] Volume ea988d1d-9a89-46ef-91ac-fbff3425f7f1: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-ea988d1d-9a89-46ef-91ac-fbff3425f7f1', 'volume_size': 1, 'snapshot_id': '6bb22662-e572-4904-9864-5ba91765e463'} Sep 16 15:08:01 devstack cinder-volume[83259]: DEBUG oslo_concurrency.lockutils [None req-108a5e3f-244c-462c-ade9-b2e90c705785 tempest-VolumesDeleteCascade-2075029007 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=83259) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 16 15:08:01 devstack cinder-volume[83259]: DEBUG oslo_concurrency.lockutils [None req-108a5e3f-244c-462c-ade9-b2e90c705785 tempest-VolumesDeleteCascade-2075029007 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.003s {{(pid=83259) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 16 15:08:01 devstack cinder-volume[83259]: DEBUG cinder.coordination [None req-108a5e3f-244c-462c-ade9-b2e90c705785 tempest-VolumesDeleteCascade-2075029007 None] Acquiring lock "cinder-quobyte-6bb22662-e572-4904-9864-5ba91765e463-ea988d1d-9a89-46ef-91ac-fbff3425f7f1" by "_create_volume_from_snapshot" {{(pid=83259) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 16 15:08:01 devstack cinder-volume[83259]: DEBUG cinder.coordination [None req-108a5e3f-244c-462c-ade9-b2e90c705785 tempest-VolumesDeleteCascade-2075029007 None] Lock "cinder-quobyte-6bb22662-e572-4904-9864-5ba91765e463-ea988d1d-9a89-46ef-91ac-fbff3425f7f1" acquired by "_create_volume_from_snapshot" :: waited 0.025s {{(pid=83259) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 16 15:08:01 devstack cinder-volume[83259]: DEBUG cinder.volume.drivers.quobyte [None req-108a5e3f-244c-462c-ade9-b2e90c705785 tempest-VolumesDeleteCascade-2075029007 None] Creating volume ea988d1d-9a89-46ef-91ac-fbff3425f7f1 from snapshot 6bb22662-e572-4904-9864-5ba91765e463 {{(pid=83259) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:361}} Sep 16 15:08:01 devstack cinder-volume[83259]: DEBUG oslo_concurrency.lockutils [None req-108a5e3f-244c-462c-ade9-b2e90c705785 tempest-VolumesDeleteCascade-2075029007 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83259) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 16 15:08:01 devstack cinder-volume[83259]: DEBUG oslo_concurrency.lockutils [None req-108a5e3f-244c-462c-ade9-b2e90c705785 tempest-VolumesDeleteCascade-2075029007 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83259) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 16 15:08:01 devstack cinder-volume[83259]: DEBUG cinder.volume.drivers.quobyte [None req-108a5e3f-244c-462c-ade9-b2e90c705785 tempest-VolumesDeleteCascade-2075029007 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-61f585ac-f8e2-4d19-a890-7ebc2726cc72': None} {{(pid=83259) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:639}} Sep 16 15:08:01 devstack cinder-volume[83259]: DEBUG cinder.volume.drivers.quobyte [None req-108a5e3f-244c-462c-ade9-b2e90c705785 tempest-VolumesDeleteCascade-2075029007 None] Available shares ['10.10.41.181/cinder-vol-61f585ac-f8e2-4d19-a890-7ebc2726cc72'] {{(pid=83259) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:669}} Sep 16 15:08:01 devstack cinder-volume[83259]: DEBUG oslo_concurrency.lockutils [None req-108a5e3f-244c-462c-ade9-b2e90c705785 tempest-VolumesDeleteCascade-2075029007 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=83259) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 16 15:08:01 devstack cinder-volume[83259]: DEBUG cinder.volume.drivers.quobyte [None req-108a5e3f-244c-462c-ade9-b2e90c705785 tempest-VolumesDeleteCascade-2075029007 None] Selected 10.10.41.181/cinder-vol-61f585ac-f8e2-4d19-a890-7ebc2726cc72 as target Quobyte volume. {{(pid=83259) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:690}} Sep 16 15:08:01 devstack cinder-volume[83259]: DEBUG cinder.coordination [None req-108a5e3f-244c-462c-ade9-b2e90c705785 tempest-VolumesDeleteCascade-2075029007 None] Acquiring lock "cinder-quobyte-ea988d1d-9a89-46ef-91ac-fbff3425f7f1" by "_copy_volume_from_snapshot" {{(pid=83259) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 16 15:08:01 devstack cinder-volume[83259]: DEBUG cinder.coordination [None req-108a5e3f-244c-462c-ade9-b2e90c705785 tempest-VolumesDeleteCascade-2075029007 None] Lock "cinder-quobyte-ea988d1d-9a89-46ef-91ac-fbff3425f7f1" acquired by "_copy_volume_from_snapshot" :: waited 0.018s {{(pid=83259) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 16 15:08:01 devstack cinder-volume[83259]: DEBUG cinder.volume.drivers.quobyte [None req-108a5e3f-244c-462c-ade9-b2e90c705785 tempest-VolumesDeleteCascade-2075029007 None] snapshot: 6bb22662-e572-4904-9864-5ba91765e463, volume: ea988d1d-9a89-46ef-91ac-fbff3425f7f1, {{(pid=83259) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:406}} Sep 16 15:08:01 devstack cinder-volume[83259]: DEBUG oslo_concurrency.lockutils [None req-108a5e3f-244c-462c-ade9-b2e90c705785 tempest-VolumesDeleteCascade-2075029007 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83259) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 16 15:08:01 devstack cinder-volume[83259]: DEBUG oslo_concurrency.lockutils [None req-108a5e3f-244c-462c-ade9-b2e90c705785 tempest-VolumesDeleteCascade-2075029007 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83259) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 16 15:08:01 devstack cinder-volume[83259]: DEBUG cinder.volume.drivers.quobyte [None req-108a5e3f-244c-462c-ade9-b2e90c705785 tempest-VolumesDeleteCascade-2075029007 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-61f585ac-f8e2-4d19-a890-7ebc2726cc72': None} {{(pid=83259) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:639}} Sep 16 15:08:01 devstack cinder-volume[83259]: DEBUG cinder.volume.drivers.quobyte [None req-108a5e3f-244c-462c-ade9-b2e90c705785 tempest-VolumesDeleteCascade-2075029007 None] Available shares ['10.10.41.181/cinder-vol-61f585ac-f8e2-4d19-a890-7ebc2726cc72'] {{(pid=83259) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:669}} Sep 16 15:08:01 devstack cinder-volume[83259]: DEBUG oslo_concurrency.lockutils [None req-108a5e3f-244c-462c-ade9-b2e90c705785 tempest-VolumesDeleteCascade-2075029007 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=83259) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 16 15:08:01 devstack cinder-volume[83259]: DEBUG oslo.privsep.daemon [-] privsep: reply[4d3d70f6-144e-4e17-982c-c00f0a89f5bf]: (4, 'qcow2') {{(pid=84312) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 16 15:08:01 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [None req-108a5e3f-244c-462c-ade9-b2e90c705785 tempest-VolumesDeleteCascade-2075029007 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c/volume-0b6f05ce-27c5-4cfd-aaf8-f9e718a2f81b.6bb22662-e572-4904-9864-5ba91765e463 {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 15:08:02 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [None req-108a5e3f-244c-462c-ade9-b2e90c705785 tempest-VolumesDeleteCascade-2075029007 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c/volume-0b6f05ce-27c5-4cfd-aaf8-f9e718a2f81b.6bb22662-e572-4904-9864-5ba91765e463" returned: 0 in 0.967s {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 15:08:02 devstack cinder-volume[83259]: DEBUG cinder.volume.drivers.remotefs [None req-108a5e3f-244c-462c-ade9-b2e90c705785 tempest-VolumesDeleteCascade-2075029007 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-0b6f05ce-27c5-4cfd-aaf8-f9e718a2f81b(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83259) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:886}} Sep 16 15:08:02 devstack cinder-volume[83259]: DEBUG cinder.volume.drivers.quobyte [None req-108a5e3f-244c-462c-ade9-b2e90c705785 tempest-VolumesDeleteCascade-2075029007 None] will copy from snapshot at /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c/volume-0b6f05ce-27c5-4cfd-aaf8-f9e718a2f81b {{(pid=83259) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:425}} Sep 16 15:08:02 devstack cinder-volume[83259]: DEBUG cinder.volume.drivers.quobyte [None req-108a5e3f-244c-462c-ade9-b2e90c705785 tempest-VolumesDeleteCascade-2075029007 None] Creating direct copy from snapshot {{(pid=83259) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:433}} Sep 16 15:08:02 devstack cinder-volume[83259]: DEBUG oslo.privsep.daemon [-] privsep: reply[43540f74-026c-417d-ac11-8cc2f36f054f]: (4, 'qcow2') {{(pid=84312) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 16 15:08:02 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [None req-108a5e3f-244c-462c-ade9-b2e90c705785 tempest-VolumesDeleteCascade-2075029007 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c/volume-0b6f05ce-27c5-4cfd-aaf8-f9e718a2f81b {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 15:08:04 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [None req-108a5e3f-244c-462c-ade9-b2e90c705785 tempest-VolumesDeleteCascade-2075029007 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c/volume-0b6f05ce-27c5-4cfd-aaf8-f9e718a2f81b" returned: 0 in 1.963s {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 15:08:04 devstack cinder-volume[83259]: DEBUG cinder.utils [None req-108a5e3f-244c-462c-ade9-b2e90c705785 tempest-VolumesDeleteCascade-2075029007 None] Path /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c/volume-ea988d1d-9a89-46ef-91ac-fbff3425f7f1 not found in is_blk_device check {{(pid=83259) is_blk_device /opt/stack/cinder/cinder/utils.py:591}} Sep 16 15:08:04 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [None req-108a5e3f-244c-462c-ade9-b2e90c705785 tempest-VolumesDeleteCascade-2075029007 None] Running cmd (subprocess): qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c/volume-0b6f05ce-27c5-4cfd-aaf8-f9e718a2f81b /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c/volume-ea988d1d-9a89-46ef-91ac-fbff3425f7f1 {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 15:08:05 devstack quobyte-client[83286]: System call of process 94555 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 16 15:08:05 devstack quobyte-client[83286]: The server volume:87712ffe-8a69-446d-9ed6-4430c7ee9792@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=87712ffe-8a69-446d-9ed6-4430c7ee9792, inode=81, name=volume-ea988d1d-9a89-46ef-91ac-fbff3425f7f1, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.206), requestorAccessMask=0 Sep 16 15:08:11 devstack cinder-volume[83259]: DEBUG dbcounter [-] [83259] Writing DB stats cinder:SELECT=30,cinder:UPDATE=42,cinder:INSERT=6,cinder:DELETE=3 {{(pid=83259) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Sep 16 15:08:11 devstack cinder-volume[83259]: DEBUG dbcounter [-] [83259] Writing DB stats cinder:SELECT=31,cinder:INSERT=10,cinder:UPDATE=28,cinder:DELETE=4 {{(pid=83259) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Sep 16 15:08:15 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [None req-108a5e3f-244c-462c-ade9-b2e90c705785 tempest-VolumesDeleteCascade-2075029007 None] CMD "qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c/volume-0b6f05ce-27c5-4cfd-aaf8-f9e718a2f81b /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c/volume-ea988d1d-9a89-46ef-91ac-fbff3425f7f1" returned: 0 in 10.295s {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 15:08:15 devstack cinder-volume[83259]: DEBUG oslo.privsep.daemon [-] privsep: reply[f9ff3e27-9a86-496c-a10c-189a3199b7a9]: (4, 'qcow2') {{(pid=84312) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 16 15:08:15 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [None req-108a5e3f-244c-462c-ade9-b2e90c705785 tempest-VolumesDeleteCascade-2075029007 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c/volume-0b6f05ce-27c5-4cfd-aaf8-f9e718a2f81b {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 15:08:16 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [None req-108a5e3f-244c-462c-ade9-b2e90c705785 tempest-VolumesDeleteCascade-2075029007 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c/volume-0b6f05ce-27c5-4cfd-aaf8-f9e718a2f81b" returned: 0 in 1.435s {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 15:08:16 devstack cinder-volume[83259]: DEBUG cinder.image.image_utils [None req-108a5e3f-244c-462c-ade9-b2e90c705785 tempest-VolumesDeleteCascade-2075029007 None] Image conversion details: src /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c/volume-0b6f05ce-27c5-4cfd-aaf8-f9e718a2f81b, size 1024.00 MB, duration 10.32 sec, destination /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c/volume-ea988d1d-9a89-46ef-91ac-fbff3425f7f1 {{(pid=83259) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:501}} Sep 16 15:08:16 devstack cinder-volume[83259]: INFO cinder.image.image_utils [None req-108a5e3f-244c-462c-ade9-b2e90c705785 tempest-VolumesDeleteCascade-2075029007 None] Converted 1024.00 MB image at 99.27 MB/s Sep 16 15:08:16 devstack cinder-volume[83259]: DEBUG cinder.volume.drivers.remotefs [None req-108a5e3f-244c-462c-ade9-b2e90c705785 tempest-VolumesDeleteCascade-2075029007 None] File path /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c/volume-ea988d1d-9a89-46ef-91ac-fbff3425f7f1 is being set with permissions: 660 {{(pid=83259) _set_rw_permissions /opt/stack/cinder/cinder/volume/drivers/remotefs.py:492}} Sep 16 15:08:16 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [None req-108a5e3f-244c-462c-ade9-b2e90c705785 tempest-VolumesDeleteCascade-2075029007 None] Running cmd (subprocess): chmod 660 /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c/volume-ea988d1d-9a89-46ef-91ac-fbff3425f7f1 {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 15:08:17 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [None req-108a5e3f-244c-462c-ade9-b2e90c705785 tempest-VolumesDeleteCascade-2075029007 None] CMD "chmod 660 /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c/volume-ea988d1d-9a89-46ef-91ac-fbff3425f7f1" returned: 0 in 0.389s {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 15:08:17 devstack cinder-volume[83259]: DEBUG cinder.coordination [None req-108a5e3f-244c-462c-ade9-b2e90c705785 tempest-VolumesDeleteCascade-2075029007 None] Lock "cinder-quobyte-ea988d1d-9a89-46ef-91ac-fbff3425f7f1" released by "_copy_volume_from_snapshot" :: held 15.772s {{(pid=83259) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 16 15:08:17 devstack cinder-volume[83259]: WARNING cinder.volume.volume_utils [None req-4a82afe7-86b8-4362-bb44-f7c68eb834db tempest-VolumesActionsTest-508093061 None] Volume driver (QuobyteDriver 1.2) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 16 15:08:17 devstack cinder-volume[83259]: DEBUG cinder.volume.flows.manager.create_volume [None req-4a82afe7-86b8-4362-bb44-f7c68eb834db tempest-VolumesActionsTest-508093061 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#Quobyte'], 'hosts': ['devstack@QuobyteHD#Quobyte']} {{(pid=83259) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1387}} Sep 16 15:08:17 devstack cinder-volume[83259]: DEBUG cinder.volume.manager [None req-4a82afe7-86b8-4362-bb44-f7c68eb834db tempest-VolumesActionsTest-508093061 None] Flow 'volume_create_manager' (14ffa9be-614c-4e69-8b4a-728899aa5c71) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83259) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 16 15:08:17 devstack cinder-volume[83259]: DEBUG cinder.volume.manager [None req-4a82afe7-86b8-4362-bb44-f7c68eb834db tempest-VolumesActionsTest-508093061 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (62ff3ccc-a6ca-47a1-bf76-92e685d17e81) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83259) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 15:08:17 devstack cinder-volume[83259]: DEBUG cinder.coordination [None req-108a5e3f-244c-462c-ade9-b2e90c705785 tempest-VolumesDeleteCascade-2075029007 None] Lock "cinder-quobyte-6bb22662-e572-4904-9864-5ba91765e463-ea988d1d-9a89-46ef-91ac-fbff3425f7f1" released by "_create_volume_from_snapshot" :: held 15.927s {{(pid=83259) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 16 15:08:17 devstack cinder-volume[83259]: DEBUG oslo_concurrency.lockutils [None req-108a5e3f-244c-462c-ade9-b2e90c705785 tempest-VolumesDeleteCascade-2075029007 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 15.957s {{(pid=83259) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 16 15:08:17 devstack cinder-volume[83259]: DEBUG cinder.volume.manager [None req-4a82afe7-86b8-4362-bb44-f7c68eb834db tempest-VolumesActionsTest-508093061 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (62ff3ccc-a6ca-47a1-bf76-92e685d17e81) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-16T13:08:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1102915084',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#Quobyte',id=b15bd3a4-dfd8-4aea-8ea8-26d3e0185a72,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f76dd0e8e4304d289547abd09461849a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-16T13:08:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-16T13:08:17Z,use_quota=True,user_id='a584ed30e8d24546b164fe840aeb32ec',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(485ead50-3df8-4d76-8d34-a4db136c980a),volume_type_id=485ead50-3df8-4d76-8d34-a4db136c980a)' {{(pid=83259) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 15:08:17 devstack cinder-volume[83259]: DEBUG cinder.volume.manager [None req-4a82afe7-86b8-4362-bb44-f7c68eb834db tempest-VolumesActionsTest-508093061 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (db69c57f-fffa-4fc2-ba8c-c64735708ec7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83259) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 15:08:17 devstack cinder-volume[83259]: DEBUG cinder.volume.manager [None req-4a82afe7-86b8-4362-bb44-f7c68eb834db tempest-VolumesActionsTest-508093061 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (db69c57f-fffa-4fc2-ba8c-c64735708ec7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83259) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 15:08:17 devstack cinder-volume[83259]: DEBUG cinder.volume.manager [None req-4a82afe7-86b8-4362-bb44-f7c68eb834db tempest-VolumesActionsTest-508093061 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f4f238ba-1966-4328-a4f0-d5593134e461) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83259) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 15:08:17 devstack cinder-volume[83259]: DEBUG cinder.volume.manager [None req-4a82afe7-86b8-4362-bb44-f7c68eb834db tempest-VolumesActionsTest-508093061 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f4f238ba-1966-4328-a4f0-d5593134e461) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b15bd3a4-dfd8-4aea-8ea8-26d3e0185a72', 'volume_name': 'volume-b15bd3a4-dfd8-4aea-8ea8-26d3e0185a72', 'volume_size': 1}' {{(pid=83259) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 15:08:17 devstack cinder-volume[83259]: DEBUG cinder.volume.manager [None req-4a82afe7-86b8-4362-bb44-f7c68eb834db tempest-VolumesActionsTest-508093061 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (341a2a5d-bdc8-41cf-8b44-6f7eeee45a99) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83259) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 15:08:17 devstack cinder-volume[83259]: DEBUG cinder.volume.manager [None req-4a82afe7-86b8-4362-bb44-f7c68eb834db tempest-VolumesActionsTest-508093061 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (341a2a5d-bdc8-41cf-8b44-6f7eeee45a99) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83259) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 15:08:17 devstack cinder-volume[83259]: DEBUG cinder.volume.manager [None req-4a82afe7-86b8-4362-bb44-f7c68eb834db tempest-VolumesActionsTest-508093061 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (89ce9094-7dc5-49f7-b888-8a864785e9a6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83259) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 15:08:17 devstack cinder-volume[83259]: INFO cinder.volume.flows.manager.create_volume [None req-4a82afe7-86b8-4362-bb44-f7c68eb834db tempest-VolumesActionsTest-508093061 None] Volume b15bd3a4-dfd8-4aea-8ea8-26d3e0185a72: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b15bd3a4-dfd8-4aea-8ea8-26d3e0185a72', 'volume_size': 1} Sep 16 15:08:17 devstack cinder-volume[83259]: DEBUG oslo_concurrency.lockutils [None req-4a82afe7-86b8-4362-bb44-f7c68eb834db tempest-VolumesActionsTest-508093061 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83259) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 16 15:08:17 devstack cinder-volume[83259]: DEBUG oslo_concurrency.lockutils [None req-4a82afe7-86b8-4362-bb44-f7c68eb834db tempest-VolumesActionsTest-508093061 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=83259) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 16 15:08:17 devstack cinder-volume[83259]: DEBUG cinder.volume.drivers.quobyte [None req-4a82afe7-86b8-4362-bb44-f7c68eb834db tempest-VolumesActionsTest-508093061 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-16T13:08:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1102915084',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#Quobyte',id=b15bd3a4-dfd8-4aea-8ea8-26d3e0185a72,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f76dd0e8e4304d289547abd09461849a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-16T13:08:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-16T13:08:17Z,use_quota=True,user_id='a584ed30e8d24546b164fe840aeb32ec',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(485ead50-3df8-4d76-8d34-a4db136c980a),volume_type_id=485ead50-3df8-4d76-8d34-a4db136c980a)}" {{(pid=83259) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Sep 16 15:08:17 devstack cinder-volume[83259]: DEBUG cinder.volume.drivers.remotefs [None req-4a82afe7-86b8-4362-bb44-f7c68eb834db tempest-VolumesActionsTest-508093061 None] Creating volume b15bd3a4-dfd8-4aea-8ea8-26d3e0185a72 {{(pid=83259) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}} Sep 16 15:08:17 devstack cinder-volume[83259]: DEBUG oslo_concurrency.lockutils [None req-4a82afe7-86b8-4362-bb44-f7c68eb834db tempest-VolumesActionsTest-508093061 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83259) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 16 15:08:17 devstack cinder-volume[83259]: DEBUG oslo_concurrency.lockutils [None req-4a82afe7-86b8-4362-bb44-f7c68eb834db tempest-VolumesActionsTest-508093061 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83259) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 16 15:08:17 devstack cinder-volume[83259]: DEBUG cinder.volume.drivers.quobyte [None req-4a82afe7-86b8-4362-bb44-f7c68eb834db tempest-VolumesActionsTest-508093061 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-61f585ac-f8e2-4d19-a890-7ebc2726cc72': None} {{(pid=83259) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:639}} Sep 16 15:08:17 devstack cinder-volume[83259]: DEBUG cinder.volume.drivers.quobyte [None req-4a82afe7-86b8-4362-bb44-f7c68eb834db tempest-VolumesActionsTest-508093061 None] Available shares ['10.10.41.181/cinder-vol-61f585ac-f8e2-4d19-a890-7ebc2726cc72'] {{(pid=83259) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:669}} Sep 16 15:08:17 devstack cinder-volume[83259]: DEBUG oslo_concurrency.lockutils [None req-4a82afe7-86b8-4362-bb44-f7c68eb834db tempest-VolumesActionsTest-508093061 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=83259) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 16 15:08:17 devstack cinder-volume[83259]: DEBUG cinder.volume.drivers.quobyte [None req-4a82afe7-86b8-4362-bb44-f7c68eb834db tempest-VolumesActionsTest-508093061 None] Selected 10.10.41.181/cinder-vol-61f585ac-f8e2-4d19-a890-7ebc2726cc72 as target Quobyte volume. {{(pid=83259) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:690}} Sep 16 15:08:17 devstack cinder-volume[83259]: INFO cinder.volume.drivers.remotefs [None req-4a82afe7-86b8-4362-bb44-f7c68eb834db tempest-VolumesActionsTest-508093061 None] casted to 10.10.41.181/cinder-vol-61f585ac-f8e2-4d19-a890-7ebc2726cc72 Sep 16 15:08:17 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [None req-4a82afe7-86b8-4362-bb44-f7c68eb834db tempest-VolumesActionsTest-508093061 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c/volume-b15bd3a4-dfd8-4aea-8ea8-26d3e0185a72 1073741824 {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 15:08:17 devstack quobyte-client[83286]: The server volume:87712ffe-8a69-446d-9ed6-4430c7ee9792@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=87712ffe-8a69-446d-9ed6-4430c7ee9792, inode=82, name=volume-b15bd3a4-dfd8-4aea-8ea8-26d3e0185a72, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.206), requestorAccessMask=0 Sep 16 15:08:18 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [None req-4a82afe7-86b8-4362-bb44-f7c68eb834db tempest-VolumesActionsTest-508093061 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c/volume-b15bd3a4-dfd8-4aea-8ea8-26d3e0185a72 1073741824" returned: 0 in 0.513s {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 15:08:18 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [None req-4a82afe7-86b8-4362-bb44-f7c68eb834db tempest-VolumesActionsTest-508093061 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c/volume-b15bd3a4-dfd8-4aea-8ea8-26d3e0185a72 {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 15:08:18 devstack cinder-volume[83259]: DEBUG cinder.volume.manager [None req-108a5e3f-244c-462c-ade9-b2e90c705785 tempest-VolumesDeleteCascade-2075029007 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (40490c16-ec85-4f13-afd2-5e76e76fb9e6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ea988d1d-9a89-46ef-91ac-fbff3425f7f1', 'volume_size': 1, 'snapshot_id': '6bb22662-e572-4904-9864-5ba91765e463'}' {{(pid=83259) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 15:08:18 devstack cinder-volume[83259]: DEBUG cinder.volume.manager [None req-108a5e3f-244c-462c-ade9-b2e90c705785 tempest-VolumesDeleteCascade-2075029007 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (83c6a478-242a-4108-80e5-04550c134999) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83259) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 15:08:18 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [None req-4a82afe7-86b8-4362-bb44-f7c68eb834db tempest-VolumesActionsTest-508093061 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c/volume-b15bd3a4-dfd8-4aea-8ea8-26d3e0185a72" returned: 0 in 0.459s {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 15:08:18 devstack cinder-volume[83259]: DEBUG cinder.volume.drivers.quobyte [None req-4a82afe7-86b8-4362-bb44-f7c68eb834db tempest-VolumesActionsTest-508093061 None] <== create_volume: return (1006ms) {'provider_location': '10.10.41.181/cinder-vol-61f585ac-f8e2-4d19-a890-7ebc2726cc72'} {{(pid=83259) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Sep 16 15:08:18 devstack cinder-volume[83259]: DEBUG oslo_concurrency.lockutils [None req-4a82afe7-86b8-4362-bb44-f7c68eb834db tempest-VolumesActionsTest-508093061 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.013s {{(pid=83259) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 16 15:08:18 devstack cinder-volume[83259]: INFO cinder.volume.flows.manager.create_volume [None req-108a5e3f-244c-462c-ade9-b2e90c705785 tempest-VolumesDeleteCascade-2075029007 None] Volume volume-ea988d1d-9a89-46ef-91ac-fbff3425f7f1 (ea988d1d-9a89-46ef-91ac-fbff3425f7f1): created successfully Sep 16 15:08:18 devstack cinder-volume[83259]: DEBUG cinder.volume.manager [None req-108a5e3f-244c-462c-ade9-b2e90c705785 tempest-VolumesDeleteCascade-2075029007 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (83c6a478-242a-4108-80e5-04550c134999) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83259) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 15:08:18 devstack cinder-volume[83259]: DEBUG cinder.volume.manager [None req-108a5e3f-244c-462c-ade9-b2e90c705785 tempest-VolumesDeleteCascade-2075029007 None] Flow 'volume_create_manager' (1eee375f-2084-43f1-afc4-1c3495ad0b64) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83259) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 16 15:08:18 devstack cinder-volume[83259]: DEBUG cinder.volume.manager [None req-4a82afe7-86b8-4362-bb44-f7c68eb834db tempest-VolumesActionsTest-508093061 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (89ce9094-7dc5-49f7-b888-8a864785e9a6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b15bd3a4-dfd8-4aea-8ea8-26d3e0185a72', 'volume_size': 1}' {{(pid=83259) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 15:08:18 devstack cinder-volume[83259]: DEBUG cinder.volume.manager [None req-4a82afe7-86b8-4362-bb44-f7c68eb834db tempest-VolumesActionsTest-508093061 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6d2f0661-4b5e-4d0f-961a-39cc52b2e5a0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83259) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 15:08:18 devstack cinder-volume[83259]: INFO cinder.volume.manager [None req-108a5e3f-244c-462c-ade9-b2e90c705785 tempest-VolumesDeleteCascade-2075029007 None] Created volume successfully. Sep 16 15:08:18 devstack cinder-volume[83259]: INFO cinder.volume.flows.manager.create_volume [None req-4a82afe7-86b8-4362-bb44-f7c68eb834db tempest-VolumesActionsTest-508093061 None] Volume volume-b15bd3a4-dfd8-4aea-8ea8-26d3e0185a72 (b15bd3a4-dfd8-4aea-8ea8-26d3e0185a72): created successfully Sep 16 15:08:18 devstack cinder-volume[83259]: DEBUG cinder.volume.manager [None req-4a82afe7-86b8-4362-bb44-f7c68eb834db tempest-VolumesActionsTest-508093061 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6d2f0661-4b5e-4d0f-961a-39cc52b2e5a0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83259) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 15:08:18 devstack cinder-volume[83259]: DEBUG cinder.volume.manager [None req-4a82afe7-86b8-4362-bb44-f7c68eb834db tempest-VolumesActionsTest-508093061 None] Flow 'volume_create_manager' (14ffa9be-614c-4e69-8b4a-728899aa5c71) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83259) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 16 15:08:18 devstack cinder-volume[83259]: INFO cinder.volume.manager [None req-4a82afe7-86b8-4362-bb44-f7c68eb834db tempest-VolumesActionsTest-508093061 None] Created volume successfully. Sep 16 15:08:19 devstack cinder-volume[83259]: DEBUG cinder.coordination [None req-de064807-70e2-4e48-8201-06bf0fbfd3ea tempest-VolumesActionsTest-508093061 None] Acquiring lock "cinder-b15bd3a4-dfd8-4aea-8ea8-26d3e0185a72" by "attach_volume" {{(pid=83259) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 16 15:08:19 devstack cinder-volume[83259]: DEBUG cinder.coordination [None req-de064807-70e2-4e48-8201-06bf0fbfd3ea tempest-VolumesActionsTest-508093061 None] Lock "cinder-b15bd3a4-dfd8-4aea-8ea8-26d3e0185a72" acquired by "attach_volume" :: waited 0.026s {{(pid=83259) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 16 15:08:19 devstack cinder-volume[83259]: WARNING cinder.volume.volume_utils [None req-de064807-70e2-4e48-8201-06bf0fbfd3ea tempest-VolumesActionsTest-508093061 None] Volume driver (QuobyteDriver 1.2) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 16 15:08:19 devstack cinder-volume[83259]: INFO cinder.volume.manager [None req-de064807-70e2-4e48-8201-06bf0fbfd3ea tempest-VolumesActionsTest-508093061 None] Attaching volume b15bd3a4-dfd8-4aea-8ea8-26d3e0185a72 to instance 3bf44ba1-aed1-4140-a1e0-80c84bcadfe8 at mountpoint /dev/vdb on host None. Sep 16 15:08:19 devstack cinder-volume[83259]: INFO cinder.volume.manager [None req-de064807-70e2-4e48-8201-06bf0fbfd3ea tempest-VolumesActionsTest-508093061 None] Attach volume completed successfully. Sep 16 15:08:19 devstack cinder-volume[83259]: DEBUG cinder.coordination [None req-de064807-70e2-4e48-8201-06bf0fbfd3ea tempest-VolumesActionsTest-508093061 None] Lock "cinder-b15bd3a4-dfd8-4aea-8ea8-26d3e0185a72" released by "attach_volume" :: held 0.543s {{(pid=83259) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 16 15:08:19 devstack cinder-volume[83259]: DEBUG cinder.coordination [None req-6b32f56f-ff5e-4875-8873-0e147991ab3d tempest-VolumesDeleteCascade-2075029007 None] Acquiring lock "cinder-0b6f05ce-27c5-4cfd-aaf8-f9e718a2f81b-delete_volume" by "delete_volume" {{(pid=83259) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 16 15:08:19 devstack cinder-volume[83259]: DEBUG cinder.coordination [None req-6b32f56f-ff5e-4875-8873-0e147991ab3d tempest-VolumesDeleteCascade-2075029007 None] Lock "cinder-0b6f05ce-27c5-4cfd-aaf8-f9e718a2f81b-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=83259) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 16 15:08:19 devstack cinder-volume[83259]: WARNING cinder.volume.volume_utils [None req-6b32f56f-ff5e-4875-8873-0e147991ab3d tempest-VolumesDeleteCascade-2075029007 None] Volume driver (QuobyteDriver 1.2) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 16 15:08:20 devstack cinder-volume[83259]: DEBUG cinder.volume.manager [None req-6b32f56f-ff5e-4875-8873-0e147991ab3d tempest-VolumesDeleteCascade-2075029007 None] Performing cascade delete. {{(pid=83259) delete_volume /opt/stack/cinder/cinder/volume/manager.py:995}} Sep 16 15:08:20 devstack cinder-volume[83259]: DEBUG cinder.coordination [None req-6b32f56f-ff5e-4875-8873-0e147991ab3d tempest-VolumesDeleteCascade-2075029007 None] Acquiring lock "cinder-6bb22662-e572-4904-9864-5ba91765e463-delete_snapshot" by "delete_snapshot" {{(pid=83259) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 16 15:08:20 devstack cinder-volume[83259]: DEBUG cinder.coordination [None req-6b32f56f-ff5e-4875-8873-0e147991ab3d tempest-VolumesDeleteCascade-2075029007 None] Lock "cinder-6bb22662-e572-4904-9864-5ba91765e463-delete_snapshot" acquired by "delete_snapshot" :: waited 0.016s {{(pid=83259) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 16 15:08:20 devstack cinder-volume[83259]: WARNING cinder.volume.volume_utils [None req-6b32f56f-ff5e-4875-8873-0e147991ab3d tempest-VolumesDeleteCascade-2075029007 None] Volume driver (QuobyteDriver 1.2) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 16 15:08:20 devstack cinder-volume[83259]: DEBUG cinder.coordination [None req-6b32f56f-ff5e-4875-8873-0e147991ab3d tempest-VolumesDeleteCascade-2075029007 None] Acquiring lock "cinder-quobyte-0b6f05ce-27c5-4cfd-aaf8-f9e718a2f81b" by "delete_snapshot" {{(pid=83259) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 16 15:08:20 devstack cinder-volume[83259]: DEBUG cinder.coordination [None req-6b32f56f-ff5e-4875-8873-0e147991ab3d tempest-VolumesDeleteCascade-2075029007 None] Lock "cinder-quobyte-0b6f05ce-27c5-4cfd-aaf8-f9e718a2f81b" acquired by "delete_snapshot" :: waited 0.014s {{(pid=83259) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 16 15:08:20 devstack cinder-volume[83259]: DEBUG cinder.coordination [None req-6b32f56f-ff5e-4875-8873-0e147991ab3d tempest-VolumesDeleteCascade-2075029007 None] Acquiring lock "cinder-quobyte-6bb22662-e572-4904-9864-5ba91765e463" by "_delete_snapshot" {{(pid=83259) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 16 15:08:20 devstack cinder-volume[83259]: DEBUG cinder.coordination [None req-6b32f56f-ff5e-4875-8873-0e147991ab3d tempest-VolumesDeleteCascade-2075029007 None] Lock "cinder-quobyte-6bb22662-e572-4904-9864-5ba91765e463" acquired by "_delete_snapshot" :: waited 0.015s {{(pid=83259) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 16 15:08:20 devstack cinder-volume[83259]: DEBUG cinder.volume.drivers.remotefs [None req-6b32f56f-ff5e-4875-8873-0e147991ab3d tempest-VolumesDeleteCascade-2075029007 None] Deleting offline snapshot 6bb22662-e572-4904-9864-5ba91765e463 of volume 0b6f05ce-27c5-4cfd-aaf8-f9e718a2f81b {{(pid=83259) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1278}} Sep 16 15:08:20 devstack cinder-volume[83259]: DEBUG cinder.volume.drivers.remotefs [None req-6b32f56f-ff5e-4875-8873-0e147991ab3d tempest-VolumesDeleteCascade-2075029007 None] snapshot_file for this snap is: volume-0b6f05ce-27c5-4cfd-aaf8-f9e718a2f81b.6bb22662-e572-4904-9864-5ba91765e463 {{(pid=83259) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1307}} Sep 16 15:08:20 devstack cinder-volume[83259]: DEBUG oslo.privsep.daemon [-] privsep: reply[8811edca-7660-4a55-abc3-1ac62a99fb09]: (4, 'qcow2') {{(pid=84312) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 16 15:08:20 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [None req-6b32f56f-ff5e-4875-8873-0e147991ab3d tempest-VolumesDeleteCascade-2075029007 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c/volume-0b6f05ce-27c5-4cfd-aaf8-f9e718a2f81b.6bb22662-e572-4904-9864-5ba91765e463 {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 15:08:21 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [None req-6b32f56f-ff5e-4875-8873-0e147991ab3d tempest-VolumesDeleteCascade-2075029007 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c/volume-0b6f05ce-27c5-4cfd-aaf8-f9e718a2f81b.6bb22662-e572-4904-9864-5ba91765e463" returned: 0 in 0.894s {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 15:08:21 devstack cinder-volume[83259]: DEBUG cinder.volume.drivers.remotefs [None req-6b32f56f-ff5e-4875-8873-0e147991ab3d tempest-VolumesDeleteCascade-2075029007 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-0b6f05ce-27c5-4cfd-aaf8-f9e718a2f81b(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83259) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:886}} Sep 16 15:08:21 devstack cinder-volume[83259]: DEBUG oslo.privsep.daemon [-] privsep: reply[459bd7f0-b885-4b21-9644-899ef75327ba]: (4, 'qcow2') {{(pid=84312) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 16 15:08:21 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [None req-6b32f56f-ff5e-4875-8873-0e147991ab3d tempest-VolumesDeleteCascade-2075029007 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c/volume-0b6f05ce-27c5-4cfd-aaf8-f9e718a2f81b {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 15:08:21 devstack cinder-volume[83259]: WARNING cinder.volume.volume_utils [None req-b39a0c38-cf8d-421b-8108-b7530b4b6df3 tempest-VolumesActionsTest-690774992 None] Volume driver (QuobyteDriver 1.2) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 16 15:08:22 devstack cinder-volume[83259]: INFO cinder.volume.manager [None req-b39a0c38-cf8d-421b-8108-b7530b4b6df3 tempest-VolumesActionsTest-690774992 None] Terminate volume connection completed successfully. Sep 16 15:08:22 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [None req-6b32f56f-ff5e-4875-8873-0e147991ab3d tempest-VolumesDeleteCascade-2075029007 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c/volume-0b6f05ce-27c5-4cfd-aaf8-f9e718a2f81b" returned: 0 in 1.047s {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 15:08:22 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [None req-6b32f56f-ff5e-4875-8873-0e147991ab3d tempest-VolumesDeleteCascade-2075029007 None] Running cmd (subprocess): qemu-img commit -d /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c/volume-0b6f05ce-27c5-4cfd-aaf8-f9e718a2f81b.6bb22662-e572-4904-9864-5ba91765e463 {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 15:08:22 devstack cinder-volume[83259]: DEBUG cinder.coordination [None req-b39a0c38-cf8d-421b-8108-b7530b4b6df3 tempest-VolumesActionsTest-690774992 None] Acquiring lock "cinder-b15bd3a4-dfd8-4aea-8ea8-26d3e0185a72-detach_volume" by "detach_volume" {{(pid=83259) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 16 15:08:23 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [None req-6b32f56f-ff5e-4875-8873-0e147991ab3d tempest-VolumesDeleteCascade-2075029007 None] CMD "qemu-img commit -d /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c/volume-0b6f05ce-27c5-4cfd-aaf8-f9e718a2f81b.6bb22662-e572-4904-9864-5ba91765e463" returned: 0 in 0.663s {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 15:08:23 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [None req-6b32f56f-ff5e-4875-8873-0e147991ab3d tempest-VolumesDeleteCascade-2075029007 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c/volume-0b6f05ce-27c5-4cfd-aaf8-f9e718a2f81b.6bb22662-e572-4904-9864-5ba91765e463 {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 15:08:23 devstack cinder-volume[83259]: DEBUG cinder.coordination [None req-b39a0c38-cf8d-421b-8108-b7530b4b6df3 tempest-VolumesActionsTest-690774992 None] Lock "cinder-b15bd3a4-dfd8-4aea-8ea8-26d3e0185a72-detach_volume" acquired by "detach_volume" :: waited 0.438s {{(pid=83259) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 16 15:08:23 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [None req-6b32f56f-ff5e-4875-8873-0e147991ab3d tempest-VolumesDeleteCascade-2075029007 None] CMD "rm -f /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c/volume-0b6f05ce-27c5-4cfd-aaf8-f9e718a2f81b.6bb22662-e572-4904-9864-5ba91765e463" returned: 0 in 0.675s {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 15:08:23 devstack cinder-volume[83259]: DEBUG cinder.coordination [None req-6b32f56f-ff5e-4875-8873-0e147991ab3d tempest-VolumesDeleteCascade-2075029007 None] Lock "cinder-quobyte-6bb22662-e572-4904-9864-5ba91765e463" released by "_delete_snapshot" :: held 3.733s {{(pid=83259) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 16 15:08:23 devstack cinder-volume[83259]: WARNING cinder.volume.volume_utils [None req-b39a0c38-cf8d-421b-8108-b7530b4b6df3 tempest-VolumesActionsTest-690774992 None] Volume driver (QuobyteDriver 1.2) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 16 15:08:23 devstack cinder-volume[83259]: INFO cinder.volume.manager [None req-b39a0c38-cf8d-421b-8108-b7530b4b6df3 tempest-VolumesActionsTest-690774992 None] Detaching volume b15bd3a4-dfd8-4aea-8ea8-26d3e0185a72 from instance 3bf44ba1-aed1-4140-a1e0-80c84bcadfe8. Sep 16 15:08:23 devstack cinder-volume[83259]: WARNING cinder.volume.volume_utils [None req-b39a0c38-cf8d-421b-8108-b7530b4b6df3 tempest-VolumesActionsTest-690774992 None] Volume driver (QuobyteDriver 1.2) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 16 15:08:24 devstack cinder-volume[83259]: DEBUG cinder.coordination [None req-6b32f56f-ff5e-4875-8873-0e147991ab3d tempest-VolumesDeleteCascade-2075029007 None] Lock "cinder-quobyte-0b6f05ce-27c5-4cfd-aaf8-f9e718a2f81b" released by "delete_snapshot" :: held 4.013s {{(pid=83259) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 16 15:08:24 devstack cinder-volume[83259]: DEBUG cinder.quota [None req-6b32f56f-ff5e-4875-8873-0e147991ab3d tempest-VolumesDeleteCascade-2075029007 None] Created reservations ['5b259d03-1daf-479a-accb-b7ec20dc7127', '66abc033-e79c-4e05-bb63-ea872cf4f5d3', 'ba1eadf7-0d85-4df4-84b4-3556c9647ad1', '783a98e2-9b51-4d7d-9295-ffcfe1c1fd9f'] {{(pid=83259) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 16 15:08:24 devstack cinder-volume[83259]: INFO cinder.volume.manager [None req-b39a0c38-cf8d-421b-8108-b7530b4b6df3 tempest-VolumesActionsTest-690774992 None] Detach volume completed successfully. Sep 16 15:08:24 devstack cinder-volume[83259]: DEBUG cinder.coordination [None req-b39a0c38-cf8d-421b-8108-b7530b4b6df3 tempest-VolumesActionsTest-690774992 None] Lock "cinder-b15bd3a4-dfd8-4aea-8ea8-26d3e0185a72-detach_volume" released by "detach_volume" :: held 1.196s {{(pid=83259) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 16 15:08:24 devstack cinder-volume[83259]: INFO cinder.volume.manager [None req-6b32f56f-ff5e-4875-8873-0e147991ab3d tempest-VolumesDeleteCascade-2075029007 None] Delete snapshot completed successfully. Sep 16 15:08:24 devstack cinder-volume[83259]: DEBUG cinder.coordination [None req-6b32f56f-ff5e-4875-8873-0e147991ab3d tempest-VolumesDeleteCascade-2075029007 None] Lock "cinder-6bb22662-e572-4904-9864-5ba91765e463-delete_snapshot" released by "delete_snapshot" :: held 4.714s {{(pid=83259) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 16 15:08:24 devstack cinder-volume[83259]: DEBUG cinder.volume.manager [None req-6b32f56f-ff5e-4875-8873-0e147991ab3d tempest-VolumesDeleteCascade-2075029007 None] Snapshots deleted, issuing volume delete {{(pid=83259) delete_volume /opt/stack/cinder/cinder/volume/manager.py:1010}} Sep 16 15:08:24 devstack cinder-volume[83259]: DEBUG cinder.coordination [None req-6b32f56f-ff5e-4875-8873-0e147991ab3d tempest-VolumesDeleteCascade-2075029007 None] Acquiring lock "cinder-quobyte-0b6f05ce-27c5-4cfd-aaf8-f9e718a2f81b" by "delete_volume" {{(pid=83259) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 16 15:08:24 devstack cinder-volume[83259]: DEBUG cinder.coordination [None req-6b32f56f-ff5e-4875-8873-0e147991ab3d tempest-VolumesDeleteCascade-2075029007 None] Lock "cinder-quobyte-0b6f05ce-27c5-4cfd-aaf8-f9e718a2f81b" acquired by "delete_volume" :: waited 0.036s {{(pid=83259) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 16 15:08:24 devstack cinder-volume[83259]: DEBUG oslo.privsep.daemon [-] privsep: reply[3fb5c376-38bf-484d-ba99-25da8758da4d]: (4, 'qcow2') {{(pid=84312) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 16 15:08:24 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [None req-6b32f56f-ff5e-4875-8873-0e147991ab3d tempest-VolumesDeleteCascade-2075029007 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c/volume-0b6f05ce-27c5-4cfd-aaf8-f9e718a2f81b {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 15:08:25 devstack quobyte-client[83286]: System call of process 94633 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 16 15:08:25 devstack quobyte-client[83286]: System call of process 94633 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 16 15:08:26 devstack cinder-volume[83259]: DEBUG cinder.coordination [None req-8c215e60-00c7-42cc-8b18-e53fbf4825ea tempest-VolumesActionsTest-508093061 None] Acquiring lock "cinder-b15bd3a4-dfd8-4aea-8ea8-26d3e0185a72-detach_volume" by "detach_volume" {{(pid=83259) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 16 15:08:26 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [None req-6b32f56f-ff5e-4875-8873-0e147991ab3d tempest-VolumesDeleteCascade-2075029007 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c/volume-0b6f05ce-27c5-4cfd-aaf8-f9e718a2f81b" returned: 0 in 1.226s {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 15:08:26 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [None req-6b32f56f-ff5e-4875-8873-0e147991ab3d tempest-VolumesDeleteCascade-2075029007 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c/volume-0b6f05ce-27c5-4cfd-aaf8-f9e718a2f81b {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 15:08:26 devstack cinder-volume[83259]: DEBUG cinder.coordination [None req-8c215e60-00c7-42cc-8b18-e53fbf4825ea tempest-VolumesActionsTest-508093061 None] Lock "cinder-b15bd3a4-dfd8-4aea-8ea8-26d3e0185a72-detach_volume" acquired by "detach_volume" :: waited 0.705s {{(pid=83259) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 16 15:08:26 devstack cinder-volume[83259]: INFO cinder.volume.manager [None req-8c215e60-00c7-42cc-8b18-e53fbf4825ea tempest-VolumesActionsTest-508093061 None] Volume detach called, but volume not attached. Sep 16 15:08:27 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [None req-6b32f56f-ff5e-4875-8873-0e147991ab3d tempest-VolumesDeleteCascade-2075029007 None] CMD "rm -f /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c/volume-0b6f05ce-27c5-4cfd-aaf8-f9e718a2f81b" returned: 0 in 1.306s {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 15:08:27 devstack cinder-volume[83259]: DEBUG cinder.coordination [None req-8c215e60-00c7-42cc-8b18-e53fbf4825ea tempest-VolumesActionsTest-508093061 None] Lock "cinder-b15bd3a4-dfd8-4aea-8ea8-26d3e0185a72-detach_volume" released by "detach_volume" :: held 0.864s {{(pid=83259) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 16 15:08:27 devstack cinder-volume[83259]: DEBUG cinder.coordination [None req-6b32f56f-ff5e-4875-8873-0e147991ab3d tempest-VolumesDeleteCascade-2075029007 None] Lock "cinder-quobyte-0b6f05ce-27c5-4cfd-aaf8-f9e718a2f81b" released by "delete_volume" :: held 2.844s {{(pid=83259) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 16 15:08:28 devstack cinder-volume[83259]: DEBUG cinder.quota [None req-6b32f56f-ff5e-4875-8873-0e147991ab3d tempest-VolumesDeleteCascade-2075029007 None] Created reservations ['863f5357-0887-4ecb-97e4-29f8bd27c725', '4b17efa1-4447-48b5-92de-d29ad4d5b892', '3481c641-33f2-432d-bc32-e916227eb5f8', '52710c59-8ddc-40d3-bc07-626087ef0776'] {{(pid=83259) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 16 15:08:28 devstack cinder-volume[83259]: DEBUG cinder.coordination [None req-3a560e9f-da14-488a-8a4a-ca1e0dc0f93f tempest-VolumesActionsTest-508093061 None] Acquiring lock "cinder-b15bd3a4-dfd8-4aea-8ea8-26d3e0185a72-delete_volume" by "delete_volume" {{(pid=83259) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 16 15:08:28 devstack cinder-volume[83259]: DEBUG cinder.coordination [None req-3a560e9f-da14-488a-8a4a-ca1e0dc0f93f tempest-VolumesActionsTest-508093061 None] Lock "cinder-b15bd3a4-dfd8-4aea-8ea8-26d3e0185a72-delete_volume" acquired by "delete_volume" :: waited 0.210s {{(pid=83259) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 16 15:08:28 devstack cinder-volume[83259]: DEBUG oslo_concurrency.lockutils [None req-6b32f56f-ff5e-4875-8873-0e147991ab3d tempest-VolumesDeleteCascade-2075029007 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83259) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 16 15:08:28 devstack cinder-volume[83259]: DEBUG oslo_concurrency.lockutils [None req-6b32f56f-ff5e-4875-8873-0e147991ab3d tempest-VolumesDeleteCascade-2075029007 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.018s {{(pid=83259) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 16 15:08:29 devstack cinder-volume[83259]: DEBUG cinder.volume.drivers.quobyte [None req-6b32f56f-ff5e-4875-8873-0e147991ab3d tempest-VolumesDeleteCascade-2075029007 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-61f585ac-f8e2-4d19-a890-7ebc2726cc72': None} {{(pid=83259) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:639}} Sep 16 15:08:29 devstack cinder-volume[83259]: DEBUG cinder.volume.drivers.quobyte [None req-6b32f56f-ff5e-4875-8873-0e147991ab3d tempest-VolumesDeleteCascade-2075029007 None] Available shares ['10.10.41.181/cinder-vol-61f585ac-f8e2-4d19-a890-7ebc2726cc72'] {{(pid=83259) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:669}} Sep 16 15:08:29 devstack cinder-volume[83259]: DEBUG oslo_concurrency.lockutils [None req-6b32f56f-ff5e-4875-8873-0e147991ab3d tempest-VolumesDeleteCascade-2075029007 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.027s {{(pid=83259) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 16 15:08:29 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [None req-6b32f56f-ff5e-4875-8873-0e147991ab3d tempest-VolumesDeleteCascade-2075029007 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 15:08:30 devstack cinder-volume[83259]: WARNING cinder.volume.volume_utils [None req-3a560e9f-da14-488a-8a4a-ca1e0dc0f93f tempest-VolumesActionsTest-508093061 None] Volume driver (QuobyteDriver 1.2) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 16 15:08:30 devstack cinder-volume[83259]: DEBUG cinder.coordination [None req-3a560e9f-da14-488a-8a4a-ca1e0dc0f93f tempest-VolumesActionsTest-508093061 None] Acquiring lock "cinder-quobyte-b15bd3a4-dfd8-4aea-8ea8-26d3e0185a72" by "delete_volume" {{(pid=83259) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 16 15:08:30 devstack cinder-volume[83259]: DEBUG cinder.coordination [None req-2a69df7c-a7ef-425c-a251-89a4ba3871ab tempest-VolumesDeleteCascade-2075029007 None] Acquiring lock "cinder-ea988d1d-9a89-46ef-91ac-fbff3425f7f1-delete_volume" by "delete_volume" {{(pid=83259) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 16 15:08:30 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [None req-6b32f56f-ff5e-4875-8873-0e147991ab3d tempest-VolumesDeleteCascade-2075029007 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c" returned: 0 in 1.966s {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 15:08:31 devstack cinder-volume[83259]: DEBUG cinder.manager [None req-6b32f56f-ff5e-4875-8873-0e147991ab3d tempest-VolumesDeleteCascade-2075029007 None] Notifying Schedulers of capabilities ... {{(pid=83259) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 16 15:08:31 devstack cinder-volume[83259]: INFO cinder.volume.manager [None req-6b32f56f-ff5e-4875-8873-0e147991ab3d tempest-VolumesDeleteCascade-2075029007 None] Deleted volume successfully. Sep 16 15:08:31 devstack cinder-volume[83259]: DEBUG cinder.coordination [None req-2a69df7c-a7ef-425c-a251-89a4ba3871ab tempest-VolumesDeleteCascade-2075029007 None] Lock "cinder-ea988d1d-9a89-46ef-91ac-fbff3425f7f1-delete_volume" acquired by "delete_volume" :: waited 0.784s {{(pid=83259) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 16 15:08:31 devstack cinder-volume[83259]: DEBUG cinder.coordination [None req-3a560e9f-da14-488a-8a4a-ca1e0dc0f93f tempest-VolumesActionsTest-508093061 None] Lock "cinder-quobyte-b15bd3a4-dfd8-4aea-8ea8-26d3e0185a72" acquired by "delete_volume" :: waited 1.158s {{(pid=83259) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 16 15:08:31 devstack cinder-volume[83259]: DEBUG oslo.privsep.daemon [-] privsep: reply[311a7e3d-8736-475f-8f5a-c5d60660a611]: (4, 'qcow2') {{(pid=84312) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 16 15:08:31 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [None req-3a560e9f-da14-488a-8a4a-ca1e0dc0f93f tempest-VolumesActionsTest-508093061 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c/volume-b15bd3a4-dfd8-4aea-8ea8-26d3e0185a72 {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 15:08:32 devstack cinder-volume[83259]: DEBUG cinder.coordination [None req-6b32f56f-ff5e-4875-8873-0e147991ab3d tempest-VolumesDeleteCascade-2075029007 None] Lock "cinder-0b6f05ce-27c5-4cfd-aaf8-f9e718a2f81b-delete_volume" released by "delete_volume" :: held 12.487s {{(pid=83259) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 16 15:08:33 devstack quobyte-client[83286]: System call of process 94646 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 16 15:08:33 devstack cinder-volume[83259]: WARNING cinder.volume.volume_utils [None req-2a69df7c-a7ef-425c-a251-89a4ba3871ab tempest-VolumesDeleteCascade-2075029007 None] Volume driver (QuobyteDriver 1.2) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 16 15:08:33 devstack cinder-volume[83259]: DEBUG cinder.coordination [None req-2a69df7c-a7ef-425c-a251-89a4ba3871ab tempest-VolumesDeleteCascade-2075029007 None] Acquiring lock "cinder-quobyte-ea988d1d-9a89-46ef-91ac-fbff3425f7f1" by "delete_volume" {{(pid=83259) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 16 15:08:33 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [None req-3a560e9f-da14-488a-8a4a-ca1e0dc0f93f tempest-VolumesActionsTest-508093061 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c/volume-b15bd3a4-dfd8-4aea-8ea8-26d3e0185a72" returned: 0 in 1.660s {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 15:08:33 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [None req-3a560e9f-da14-488a-8a4a-ca1e0dc0f93f tempest-VolumesActionsTest-508093061 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c/volume-b15bd3a4-dfd8-4aea-8ea8-26d3e0185a72 {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 15:08:33 devstack cinder-volume[83259]: DEBUG cinder.coordination [None req-2a69df7c-a7ef-425c-a251-89a4ba3871ab tempest-VolumesDeleteCascade-2075029007 None] Lock "cinder-quobyte-ea988d1d-9a89-46ef-91ac-fbff3425f7f1" acquired by "delete_volume" :: waited 0.400s {{(pid=83259) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 16 15:08:33 devstack cinder-volume[83259]: DEBUG oslo.privsep.daemon [-] privsep: reply[07cf297f-818b-4c46-87a8-ad8f1959d0bf]: (4, 'qcow2') {{(pid=84312) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 16 15:08:34 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [None req-2a69df7c-a7ef-425c-a251-89a4ba3871ab tempest-VolumesDeleteCascade-2075029007 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c/volume-ea988d1d-9a89-46ef-91ac-fbff3425f7f1 {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 15:08:34 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [None req-3a560e9f-da14-488a-8a4a-ca1e0dc0f93f tempest-VolumesActionsTest-508093061 None] CMD "rm -f /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c/volume-b15bd3a4-dfd8-4aea-8ea8-26d3e0185a72" returned: 0 in 1.281s {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 15:08:34 devstack cinder-volume[83259]: DEBUG cinder.coordination [None req-3a560e9f-da14-488a-8a4a-ca1e0dc0f93f tempest-VolumesActionsTest-508093061 None] Lock "cinder-quobyte-b15bd3a4-dfd8-4aea-8ea8-26d3e0185a72" released by "delete_volume" :: held 3.205s {{(pid=83259) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 16 15:08:35 devstack quobyte-client[83286]: System call of process 94651 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 16 15:08:35 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [None req-2a69df7c-a7ef-425c-a251-89a4ba3871ab tempest-VolumesDeleteCascade-2075029007 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c/volume-ea988d1d-9a89-46ef-91ac-fbff3425f7f1" returned: 0 in 1.275s {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 15:08:35 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [None req-2a69df7c-a7ef-425c-a251-89a4ba3871ab tempest-VolumesDeleteCascade-2075029007 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c/volume-ea988d1d-9a89-46ef-91ac-fbff3425f7f1 {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 15:08:35 devstack cinder-volume[83259]: DEBUG cinder.quota [None req-3a560e9f-da14-488a-8a4a-ca1e0dc0f93f tempest-VolumesActionsTest-508093061 None] Created reservations ['24da2e73-0d94-4055-a3f4-3969553dc8f6', 'e1c53584-462c-48ed-b583-ae278e1be8ee', 'd7357e1a-fb94-405d-bf4e-eeda6bd690c4', '41f5a8ca-b73f-410d-a72c-7db4f6b45127'] {{(pid=83259) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 16 15:08:35 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [None req-2a69df7c-a7ef-425c-a251-89a4ba3871ab tempest-VolumesDeleteCascade-2075029007 None] CMD "rm -f /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c/volume-ea988d1d-9a89-46ef-91ac-fbff3425f7f1" returned: 0 in 0.515s {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 15:08:36 devstack cinder-volume[83259]: DEBUG cinder.coordination [None req-2a69df7c-a7ef-425c-a251-89a4ba3871ab tempest-VolumesDeleteCascade-2075029007 None] Lock "cinder-quobyte-ea988d1d-9a89-46ef-91ac-fbff3425f7f1" released by "delete_volume" :: held 2.297s {{(pid=83259) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 16 15:08:36 devstack cinder-volume[83259]: DEBUG oslo_concurrency.lockutils [None req-3a560e9f-da14-488a-8a4a-ca1e0dc0f93f tempest-VolumesActionsTest-508093061 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83259) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 16 15:08:36 devstack cinder-volume[83259]: DEBUG oslo_concurrency.lockutils [None req-3a560e9f-da14-488a-8a4a-ca1e0dc0f93f tempest-VolumesActionsTest-508093061 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=83259) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 16 15:08:36 devstack cinder-volume[83259]: DEBUG cinder.volume.drivers.quobyte [None req-3a560e9f-da14-488a-8a4a-ca1e0dc0f93f tempest-VolumesActionsTest-508093061 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-61f585ac-f8e2-4d19-a890-7ebc2726cc72': None} {{(pid=83259) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:639}} Sep 16 15:08:36 devstack cinder-volume[83259]: DEBUG cinder.volume.drivers.quobyte [None req-3a560e9f-da14-488a-8a4a-ca1e0dc0f93f tempest-VolumesActionsTest-508093061 None] Available shares ['10.10.41.181/cinder-vol-61f585ac-f8e2-4d19-a890-7ebc2726cc72'] {{(pid=83259) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:669}} Sep 16 15:08:36 devstack cinder-volume[83259]: DEBUG oslo_concurrency.lockutils [None req-3a560e9f-da14-488a-8a4a-ca1e0dc0f93f tempest-VolumesActionsTest-508093061 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=83259) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 16 15:08:36 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [None req-3a560e9f-da14-488a-8a4a-ca1e0dc0f93f tempest-VolumesActionsTest-508093061 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 15:08:36 devstack cinder-volume[83259]: DEBUG cinder.quota [None req-2a69df7c-a7ef-425c-a251-89a4ba3871ab tempest-VolumesDeleteCascade-2075029007 None] Created reservations ['bf432dde-2e93-4efc-bd18-a0372f719f9d', 'ef1f98a2-10d8-4e4c-ad95-adf71e759ae9', '75b6e506-1a34-4cb9-ac0f-89f925a94ab6', 'f4cf6a30-aac0-4840-9122-ba29ea8601a4'] {{(pid=83259) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 16 15:08:36 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [None req-3a560e9f-da14-488a-8a4a-ca1e0dc0f93f tempest-VolumesActionsTest-508093061 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c" returned: 0 in 0.441s {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 15:08:36 devstack cinder-volume[83259]: DEBUG cinder.manager [None req-3a560e9f-da14-488a-8a4a-ca1e0dc0f93f tempest-VolumesActionsTest-508093061 None] Notifying Schedulers of capabilities ... {{(pid=83259) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 16 15:08:36 devstack cinder-volume[83259]: INFO cinder.volume.manager [None req-3a560e9f-da14-488a-8a4a-ca1e0dc0f93f tempest-VolumesActionsTest-508093061 None] Deleted volume successfully. Sep 16 15:08:37 devstack cinder-volume[83259]: DEBUG cinder.coordination [None req-3a560e9f-da14-488a-8a4a-ca1e0dc0f93f tempest-VolumesActionsTest-508093061 None] Lock "cinder-b15bd3a4-dfd8-4aea-8ea8-26d3e0185a72-delete_volume" released by "delete_volume" :: held 8.523s {{(pid=83259) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 16 15:08:37 devstack cinder-volume[83259]: DEBUG oslo_concurrency.lockutils [None req-2a69df7c-a7ef-425c-a251-89a4ba3871ab tempest-VolumesDeleteCascade-2075029007 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83259) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 16 15:08:37 devstack cinder-volume[83259]: DEBUG oslo_concurrency.lockutils [None req-2a69df7c-a7ef-425c-a251-89a4ba3871ab tempest-VolumesDeleteCascade-2075029007 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.007s {{(pid=83259) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 16 15:08:37 devstack cinder-volume[83259]: DEBUG cinder.volume.drivers.quobyte [None req-2a69df7c-a7ef-425c-a251-89a4ba3871ab tempest-VolumesDeleteCascade-2075029007 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-61f585ac-f8e2-4d19-a890-7ebc2726cc72': None} {{(pid=83259) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:639}} Sep 16 15:08:37 devstack cinder-volume[83259]: DEBUG cinder.volume.drivers.quobyte [None req-2a69df7c-a7ef-425c-a251-89a4ba3871ab tempest-VolumesDeleteCascade-2075029007 None] Available shares ['10.10.41.181/cinder-vol-61f585ac-f8e2-4d19-a890-7ebc2726cc72'] {{(pid=83259) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:669}} Sep 16 15:08:37 devstack cinder-volume[83259]: DEBUG oslo_concurrency.lockutils [None req-2a69df7c-a7ef-425c-a251-89a4ba3871ab tempest-VolumesDeleteCascade-2075029007 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.035s {{(pid=83259) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 16 15:08:37 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [None req-2a69df7c-a7ef-425c-a251-89a4ba3871ab tempest-VolumesDeleteCascade-2075029007 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 15:08:37 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [None req-2a69df7c-a7ef-425c-a251-89a4ba3871ab tempest-VolumesDeleteCascade-2075029007 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c" returned: 0 in 0.342s {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 15:08:37 devstack cinder-volume[83259]: DEBUG cinder.manager [None req-2a69df7c-a7ef-425c-a251-89a4ba3871ab tempest-VolumesDeleteCascade-2075029007 None] Notifying Schedulers of capabilities ... {{(pid=83259) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 16 15:08:38 devstack cinder-volume[83259]: INFO cinder.volume.manager [None req-2a69df7c-a7ef-425c-a251-89a4ba3871ab tempest-VolumesDeleteCascade-2075029007 None] Deleted volume successfully. Sep 16 15:08:39 devstack cinder-volume[83259]: DEBUG cinder.coordination [None req-2a69df7c-a7ef-425c-a251-89a4ba3871ab tempest-VolumesDeleteCascade-2075029007 None] Lock "cinder-ea988d1d-9a89-46ef-91ac-fbff3425f7f1-delete_volume" released by "delete_volume" :: held 7.893s {{(pid=83259) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 16 15:08:45 devstack cinder-volume[83259]: WARNING cinder.volume.volume_utils [None req-bc2e166f-ba66-492d-b090-07e2335b69e7 tempest-VolumesTransfersTest-1573726027 None] Volume driver (QuobyteDriver 1.2) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 16 15:08:45 devstack cinder-volume[83259]: DEBUG cinder.volume.flows.manager.create_volume [None req-bc2e166f-ba66-492d-b090-07e2335b69e7 tempest-VolumesTransfersTest-1573726027 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#Quobyte'], 'hosts': ['devstack@QuobyteHD#Quobyte']} {{(pid=83259) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1387}} Sep 16 15:08:45 devstack cinder-volume[83259]: DEBUG cinder.volume.manager [None req-bc2e166f-ba66-492d-b090-07e2335b69e7 tempest-VolumesTransfersTest-1573726027 None] Flow 'volume_create_manager' (fd79b92d-429a-413d-872e-8a66f34ac405) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83259) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 16 15:08:45 devstack cinder-volume[83259]: DEBUG cinder.volume.manager [None req-bc2e166f-ba66-492d-b090-07e2335b69e7 tempest-VolumesTransfersTest-1573726027 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d10615f0-466c-419f-ac8b-f13b66a78d3b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83259) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 15:08:45 devstack cinder-volume[83259]: DEBUG cinder.volume.manager [None req-bc2e166f-ba66-492d-b090-07e2335b69e7 tempest-VolumesTransfersTest-1573726027 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d10615f0-466c-419f-ac8b-f13b66a78d3b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-16T13:08:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-1876437218',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#Quobyte',id=a6f0d243-7e18-40aa-b2c4-97d60824e082,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='40431d8873904810871b315ef41b6e18',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-16T13:08:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-16T13:08:45Z,use_quota=True,user_id='9cac11e851d24d12893ee03f30bcd0b4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(485ead50-3df8-4d76-8d34-a4db136c980a),volume_type_id=485ead50-3df8-4d76-8d34-a4db136c980a)' {{(pid=83259) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 15:08:45 devstack cinder-volume[83259]: DEBUG cinder.volume.manager [None req-bc2e166f-ba66-492d-b090-07e2335b69e7 tempest-VolumesTransfersTest-1573726027 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1849b52b-b115-44c9-8eb1-16c3eca3f301) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83259) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 15:08:45 devstack cinder-volume[83259]: DEBUG cinder.volume.manager [None req-bc2e166f-ba66-492d-b090-07e2335b69e7 tempest-VolumesTransfersTest-1573726027 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1849b52b-b115-44c9-8eb1-16c3eca3f301) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83259) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 15:08:45 devstack cinder-volume[83259]: DEBUG cinder.volume.manager [None req-bc2e166f-ba66-492d-b090-07e2335b69e7 tempest-VolumesTransfersTest-1573726027 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4933886e-f433-4bc8-99d2-e92bdb2f77d5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83259) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 15:08:45 devstack cinder-volume[83259]: DEBUG cinder.volume.manager [None req-bc2e166f-ba66-492d-b090-07e2335b69e7 tempest-VolumesTransfersTest-1573726027 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4933886e-f433-4bc8-99d2-e92bdb2f77d5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a6f0d243-7e18-40aa-b2c4-97d60824e082', 'volume_name': 'volume-a6f0d243-7e18-40aa-b2c4-97d60824e082', 'volume_size': 1}' {{(pid=83259) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 15:08:45 devstack cinder-volume[83259]: DEBUG cinder.volume.manager [None req-bc2e166f-ba66-492d-b090-07e2335b69e7 tempest-VolumesTransfersTest-1573726027 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (49e72382-37f9-429e-b57a-bd4129de81cb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83259) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 15:08:45 devstack cinder-volume[83259]: DEBUG cinder.volume.manager [None req-bc2e166f-ba66-492d-b090-07e2335b69e7 tempest-VolumesTransfersTest-1573726027 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (49e72382-37f9-429e-b57a-bd4129de81cb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83259) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 15:08:45 devstack cinder-volume[83259]: DEBUG cinder.volume.manager [None req-bc2e166f-ba66-492d-b090-07e2335b69e7 tempest-VolumesTransfersTest-1573726027 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (15ed08ff-0689-4eb1-80dc-6ee9b0735b25) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83259) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 15:08:45 devstack cinder-volume[83259]: INFO cinder.volume.flows.manager.create_volume [None req-bc2e166f-ba66-492d-b090-07e2335b69e7 tempest-VolumesTransfersTest-1573726027 None] Volume a6f0d243-7e18-40aa-b2c4-97d60824e082: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a6f0d243-7e18-40aa-b2c4-97d60824e082', 'volume_size': 1} Sep 16 15:08:45 devstack cinder-volume[83259]: DEBUG oslo_concurrency.lockutils [None req-bc2e166f-ba66-492d-b090-07e2335b69e7 tempest-VolumesTransfersTest-1573726027 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83259) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 16 15:08:45 devstack cinder-volume[83259]: DEBUG oslo_concurrency.lockutils [None req-bc2e166f-ba66-492d-b090-07e2335b69e7 tempest-VolumesTransfersTest-1573726027 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=83259) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 16 15:08:45 devstack cinder-volume[83259]: DEBUG cinder.volume.drivers.quobyte [None req-bc2e166f-ba66-492d-b090-07e2335b69e7 tempest-VolumesTransfersTest-1573726027 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-16T13:08:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-1876437218',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#Quobyte',id=a6f0d243-7e18-40aa-b2c4-97d60824e082,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='40431d8873904810871b315ef41b6e18',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-16T13:08:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-16T13:08:45Z,use_quota=True,user_id='9cac11e851d24d12893ee03f30bcd0b4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(485ead50-3df8-4d76-8d34-a4db136c980a),volume_type_id=485ead50-3df8-4d76-8d34-a4db136c980a)}" {{(pid=83259) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Sep 16 15:08:45 devstack cinder-volume[83259]: DEBUG cinder.volume.drivers.remotefs [None req-bc2e166f-ba66-492d-b090-07e2335b69e7 tempest-VolumesTransfersTest-1573726027 None] Creating volume a6f0d243-7e18-40aa-b2c4-97d60824e082 {{(pid=83259) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}} Sep 16 15:08:45 devstack cinder-volume[83259]: DEBUG oslo_concurrency.lockutils [None req-bc2e166f-ba66-492d-b090-07e2335b69e7 tempest-VolumesTransfersTest-1573726027 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83259) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 16 15:08:45 devstack cinder-volume[83259]: DEBUG oslo_concurrency.lockutils [None req-bc2e166f-ba66-492d-b090-07e2335b69e7 tempest-VolumesTransfersTest-1573726027 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83259) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 16 15:08:45 devstack cinder-volume[83259]: DEBUG cinder.volume.drivers.quobyte [None req-bc2e166f-ba66-492d-b090-07e2335b69e7 tempest-VolumesTransfersTest-1573726027 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-61f585ac-f8e2-4d19-a890-7ebc2726cc72': None} {{(pid=83259) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:639}} Sep 16 15:08:45 devstack cinder-volume[83259]: DEBUG cinder.volume.drivers.quobyte [None req-bc2e166f-ba66-492d-b090-07e2335b69e7 tempest-VolumesTransfersTest-1573726027 None] Available shares ['10.10.41.181/cinder-vol-61f585ac-f8e2-4d19-a890-7ebc2726cc72'] {{(pid=83259) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:669}} Sep 16 15:08:45 devstack cinder-volume[83259]: DEBUG oslo_concurrency.lockutils [None req-bc2e166f-ba66-492d-b090-07e2335b69e7 tempest-VolumesTransfersTest-1573726027 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=83259) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 16 15:08:45 devstack cinder-volume[83259]: DEBUG cinder.volume.drivers.quobyte [None req-bc2e166f-ba66-492d-b090-07e2335b69e7 tempest-VolumesTransfersTest-1573726027 None] Selected 10.10.41.181/cinder-vol-61f585ac-f8e2-4d19-a890-7ebc2726cc72 as target Quobyte volume. {{(pid=83259) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:690}} Sep 16 15:08:45 devstack cinder-volume[83259]: INFO cinder.volume.drivers.remotefs [None req-bc2e166f-ba66-492d-b090-07e2335b69e7 tempest-VolumesTransfersTest-1573726027 None] casted to 10.10.41.181/cinder-vol-61f585ac-f8e2-4d19-a890-7ebc2726cc72 Sep 16 15:08:45 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [None req-bc2e166f-ba66-492d-b090-07e2335b69e7 tempest-VolumesTransfersTest-1573726027 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c/volume-a6f0d243-7e18-40aa-b2c4-97d60824e082 1073741824 {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 15:08:45 devstack quobyte-client[83286]: System call of process 94709 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 16 15:08:45 devstack quobyte-client[83286]: The server volume:87712ffe-8a69-446d-9ed6-4430c7ee9792@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=87712ffe-8a69-446d-9ed6-4430c7ee9792, inode=83, name=volume-a6f0d243-7e18-40aa-b2c4-97d60824e082, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.206), requestorAccessMask=0 Sep 16 15:08:45 devstack cinder-volume[83259]: DEBUG oslo_service.periodic_task [None req-050ec8a1-6ffd-499d-95ad-d548a84437e2 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=83259) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} Sep 16 15:08:45 devstack cinder-volume[83259]: DEBUG oslo_concurrency.lockutils [None req-050ec8a1-6ffd-499d-95ad-d548a84437e2 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83259) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 16 15:08:45 devstack cinder-volume[83259]: DEBUG oslo_concurrency.lockutils [None req-050ec8a1-6ffd-499d-95ad-d548a84437e2 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.012s {{(pid=83259) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 16 15:08:45 devstack cinder-volume[83259]: DEBUG cinder.volume.drivers.quobyte [None req-050ec8a1-6ffd-499d-95ad-d548a84437e2 None None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-61f585ac-f8e2-4d19-a890-7ebc2726cc72': None} {{(pid=83259) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:639}} Sep 16 15:08:45 devstack cinder-volume[83259]: DEBUG cinder.volume.drivers.quobyte [None req-050ec8a1-6ffd-499d-95ad-d548a84437e2 None None] Available shares ['10.10.41.181/cinder-vol-61f585ac-f8e2-4d19-a890-7ebc2726cc72'] {{(pid=83259) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:669}} Sep 16 15:08:45 devstack cinder-volume[83259]: DEBUG oslo_concurrency.lockutils [None req-050ec8a1-6ffd-499d-95ad-d548a84437e2 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.029s {{(pid=83259) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 16 15:08:45 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [None req-050ec8a1-6ffd-499d-95ad-d548a84437e2 None None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 15:08:46 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [None req-050ec8a1-6ffd-499d-95ad-d548a84437e2 None None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c" returned: 0 in 0.225s {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 15:08:46 devstack cinder-volume[83259]: DEBUG cinder.manager [None req-050ec8a1-6ffd-499d-95ad-d548a84437e2 None None] Notifying Schedulers of capabilities ... {{(pid=83259) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 16 15:08:46 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [None req-bc2e166f-ba66-492d-b090-07e2335b69e7 tempest-VolumesTransfersTest-1573726027 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c/volume-a6f0d243-7e18-40aa-b2c4-97d60824e082 1073741824" returned: 0 in 0.752s {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 15:08:46 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [None req-bc2e166f-ba66-492d-b090-07e2335b69e7 tempest-VolumesTransfersTest-1573726027 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c/volume-a6f0d243-7e18-40aa-b2c4-97d60824e082 {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 15:08:46 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [None req-bc2e166f-ba66-492d-b090-07e2335b69e7 tempest-VolumesTransfersTest-1573726027 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c/volume-a6f0d243-7e18-40aa-b2c4-97d60824e082" returned: 0 in 0.302s {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 15:08:46 devstack cinder-volume[83259]: DEBUG cinder.volume.drivers.quobyte [None req-bc2e166f-ba66-492d-b090-07e2335b69e7 tempest-VolumesTransfersTest-1573726027 None] <== create_volume: return (1129ms) {'provider_location': '10.10.41.181/cinder-vol-61f585ac-f8e2-4d19-a890-7ebc2726cc72'} {{(pid=83259) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Sep 16 15:08:46 devstack cinder-volume[83259]: DEBUG oslo_concurrency.lockutils [None req-bc2e166f-ba66-492d-b090-07e2335b69e7 tempest-VolumesTransfersTest-1573726027 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.145s {{(pid=83259) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 16 15:08:47 devstack cinder-volume[83259]: DEBUG cinder.volume.manager [None req-bc2e166f-ba66-492d-b090-07e2335b69e7 tempest-VolumesTransfersTest-1573726027 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (15ed08ff-0689-4eb1-80dc-6ee9b0735b25) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a6f0d243-7e18-40aa-b2c4-97d60824e082', 'volume_size': 1}' {{(pid=83259) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 15:08:47 devstack cinder-volume[83259]: DEBUG cinder.volume.manager [None req-bc2e166f-ba66-492d-b090-07e2335b69e7 tempest-VolumesTransfersTest-1573726027 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (34369ab2-f568-40c0-8965-0007ac76a690) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83259) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 15:08:47 devstack cinder-volume[83259]: INFO cinder.volume.flows.manager.create_volume [None req-bc2e166f-ba66-492d-b090-07e2335b69e7 tempest-VolumesTransfersTest-1573726027 None] Volume volume-a6f0d243-7e18-40aa-b2c4-97d60824e082 (a6f0d243-7e18-40aa-b2c4-97d60824e082): created successfully Sep 16 15:08:47 devstack cinder-volume[83259]: DEBUG cinder.volume.manager [None req-bc2e166f-ba66-492d-b090-07e2335b69e7 tempest-VolumesTransfersTest-1573726027 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (34369ab2-f568-40c0-8965-0007ac76a690) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83259) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 15:08:47 devstack cinder-volume[83259]: DEBUG cinder.volume.manager [None req-bc2e166f-ba66-492d-b090-07e2335b69e7 tempest-VolumesTransfersTest-1573726027 None] Flow 'volume_create_manager' (fd79b92d-429a-413d-872e-8a66f34ac405) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83259) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 16 15:08:47 devstack cinder-volume[83259]: INFO cinder.volume.manager [None req-bc2e166f-ba66-492d-b090-07e2335b69e7 tempest-VolumesTransfersTest-1573726027 None] Created volume successfully. Sep 16 15:08:47 devstack cinder-volume[83259]: WARNING cinder.volume.volume_utils [None req-70a46e20-0f80-4e5e-8efd-ac31524c8e76 tempest-VolumesActionsTest-508093061 None] Volume driver (QuobyteDriver 1.2) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 16 15:08:47 devstack cinder-volume[83259]: DEBUG cinder.volume.flows.manager.create_volume [None req-70a46e20-0f80-4e5e-8efd-ac31524c8e76 tempest-VolumesActionsTest-508093061 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#Quobyte'], 'hosts': ['devstack@QuobyteHD#Quobyte']} {{(pid=83259) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1387}} Sep 16 15:08:47 devstack cinder-volume[83259]: DEBUG cinder.volume.manager [None req-70a46e20-0f80-4e5e-8efd-ac31524c8e76 tempest-VolumesActionsTest-508093061 None] Flow 'volume_create_manager' (a11ef8fc-d257-4960-a7f3-d988037b3451) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83259) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 16 15:08:47 devstack cinder-volume[83259]: DEBUG cinder.volume.manager [None req-70a46e20-0f80-4e5e-8efd-ac31524c8e76 tempest-VolumesActionsTest-508093061 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0acf1502-21f6-4b02-96be-fb306ec726ba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83259) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 15:08:47 devstack cinder-volume[83259]: DEBUG cinder.volume.manager [None req-70a46e20-0f80-4e5e-8efd-ac31524c8e76 tempest-VolumesActionsTest-508093061 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0acf1502-21f6-4b02-96be-fb306ec726ba) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-16T13:08:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-573523478',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#Quobyte',id=79011863-9eea-4ff2-9c01-930ebc1290c5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f76dd0e8e4304d289547abd09461849a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-16T13:08:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-16T13:08:47Z,use_quota=True,user_id='a584ed30e8d24546b164fe840aeb32ec',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(485ead50-3df8-4d76-8d34-a4db136c980a),volume_type_id=485ead50-3df8-4d76-8d34-a4db136c980a)' {{(pid=83259) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 15:08:47 devstack cinder-volume[83259]: DEBUG cinder.volume.manager [None req-70a46e20-0f80-4e5e-8efd-ac31524c8e76 tempest-VolumesActionsTest-508093061 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dd634d84-7184-4716-9531-a84cbba6f057) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83259) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 15:08:47 devstack cinder-volume[83259]: DEBUG cinder.volume.manager [None req-70a46e20-0f80-4e5e-8efd-ac31524c8e76 tempest-VolumesActionsTest-508093061 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dd634d84-7184-4716-9531-a84cbba6f057) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83259) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 15:08:47 devstack cinder-volume[83259]: DEBUG cinder.volume.manager [None req-70a46e20-0f80-4e5e-8efd-ac31524c8e76 tempest-VolumesActionsTest-508093061 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3afb8e1b-0965-4522-a96b-5af9fa61fd1e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83259) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 15:08:47 devstack cinder-volume[83259]: DEBUG cinder.volume.manager [None req-70a46e20-0f80-4e5e-8efd-ac31524c8e76 tempest-VolumesActionsTest-508093061 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3afb8e1b-0965-4522-a96b-5af9fa61fd1e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '79011863-9eea-4ff2-9c01-930ebc1290c5', 'volume_name': 'volume-79011863-9eea-4ff2-9c01-930ebc1290c5', 'volume_size': 1}' {{(pid=83259) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 15:08:47 devstack cinder-volume[83259]: DEBUG cinder.volume.manager [None req-70a46e20-0f80-4e5e-8efd-ac31524c8e76 tempest-VolumesActionsTest-508093061 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ca536b70-deb6-4cbf-b2e5-01ea19fa047d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83259) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 15:08:47 devstack cinder-volume[83259]: DEBUG cinder.volume.manager [None req-70a46e20-0f80-4e5e-8efd-ac31524c8e76 tempest-VolumesActionsTest-508093061 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ca536b70-deb6-4cbf-b2e5-01ea19fa047d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83259) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 15:08:47 devstack cinder-volume[83259]: DEBUG cinder.volume.manager [None req-70a46e20-0f80-4e5e-8efd-ac31524c8e76 tempest-VolumesActionsTest-508093061 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6de14aba-4c92-4033-8a6b-fbae555770b0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83259) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 15:08:47 devstack cinder-volume[83259]: INFO cinder.volume.flows.manager.create_volume [None req-70a46e20-0f80-4e5e-8efd-ac31524c8e76 tempest-VolumesActionsTest-508093061 None] Volume 79011863-9eea-4ff2-9c01-930ebc1290c5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-79011863-9eea-4ff2-9c01-930ebc1290c5', 'volume_size': 1} Sep 16 15:08:47 devstack cinder-volume[83259]: DEBUG oslo_concurrency.lockutils [None req-70a46e20-0f80-4e5e-8efd-ac31524c8e76 tempest-VolumesActionsTest-508093061 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83259) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 16 15:08:47 devstack cinder-volume[83259]: DEBUG oslo_concurrency.lockutils [None req-70a46e20-0f80-4e5e-8efd-ac31524c8e76 tempest-VolumesActionsTest-508093061 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.003s {{(pid=83259) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 16 15:08:47 devstack cinder-volume[83259]: DEBUG cinder.volume.drivers.quobyte [None req-70a46e20-0f80-4e5e-8efd-ac31524c8e76 tempest-VolumesActionsTest-508093061 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-16T13:08:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-573523478',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#Quobyte',id=79011863-9eea-4ff2-9c01-930ebc1290c5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f76dd0e8e4304d289547abd09461849a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-16T13:08:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-16T13:08:47Z,use_quota=True,user_id='a584ed30e8d24546b164fe840aeb32ec',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(485ead50-3df8-4d76-8d34-a4db136c980a),volume_type_id=485ead50-3df8-4d76-8d34-a4db136c980a)}" {{(pid=83259) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Sep 16 15:08:47 devstack cinder-volume[83259]: DEBUG cinder.volume.drivers.remotefs [None req-70a46e20-0f80-4e5e-8efd-ac31524c8e76 tempest-VolumesActionsTest-508093061 None] Creating volume 79011863-9eea-4ff2-9c01-930ebc1290c5 {{(pid=83259) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}} Sep 16 15:08:47 devstack cinder-volume[83259]: DEBUG oslo_concurrency.lockutils [None req-70a46e20-0f80-4e5e-8efd-ac31524c8e76 tempest-VolumesActionsTest-508093061 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83259) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 16 15:08:47 devstack cinder-volume[83259]: DEBUG oslo_concurrency.lockutils [None req-70a46e20-0f80-4e5e-8efd-ac31524c8e76 tempest-VolumesActionsTest-508093061 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83259) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 16 15:08:47 devstack cinder-volume[83259]: DEBUG cinder.volume.drivers.quobyte [None req-70a46e20-0f80-4e5e-8efd-ac31524c8e76 tempest-VolumesActionsTest-508093061 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-61f585ac-f8e2-4d19-a890-7ebc2726cc72': None} {{(pid=83259) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:639}} Sep 16 15:08:47 devstack cinder-volume[83259]: DEBUG cinder.volume.drivers.quobyte [None req-70a46e20-0f80-4e5e-8efd-ac31524c8e76 tempest-VolumesActionsTest-508093061 None] Available shares ['10.10.41.181/cinder-vol-61f585ac-f8e2-4d19-a890-7ebc2726cc72'] {{(pid=83259) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:669}} Sep 16 15:08:47 devstack cinder-volume[83259]: DEBUG oslo_concurrency.lockutils [None req-70a46e20-0f80-4e5e-8efd-ac31524c8e76 tempest-VolumesActionsTest-508093061 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=83259) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 16 15:08:47 devstack cinder-volume[83259]: DEBUG cinder.volume.drivers.quobyte [None req-70a46e20-0f80-4e5e-8efd-ac31524c8e76 tempest-VolumesActionsTest-508093061 None] Selected 10.10.41.181/cinder-vol-61f585ac-f8e2-4d19-a890-7ebc2726cc72 as target Quobyte volume. {{(pid=83259) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:690}} Sep 16 15:08:47 devstack cinder-volume[83259]: INFO cinder.volume.drivers.remotefs [None req-70a46e20-0f80-4e5e-8efd-ac31524c8e76 tempest-VolumesActionsTest-508093061 None] casted to 10.10.41.181/cinder-vol-61f585ac-f8e2-4d19-a890-7ebc2726cc72 Sep 16 15:08:47 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [None req-70a46e20-0f80-4e5e-8efd-ac31524c8e76 tempest-VolumesActionsTest-508093061 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c/volume-79011863-9eea-4ff2-9c01-930ebc1290c5 1073741824 {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 15:08:47 devstack quobyte-client[83286]: The server volume:87712ffe-8a69-446d-9ed6-4430c7ee9792@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=87712ffe-8a69-446d-9ed6-4430c7ee9792, inode=84, name=volume-79011863-9eea-4ff2-9c01-930ebc1290c5, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.206), requestorAccessMask=0 Sep 16 15:08:48 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [None req-70a46e20-0f80-4e5e-8efd-ac31524c8e76 tempest-VolumesActionsTest-508093061 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c/volume-79011863-9eea-4ff2-9c01-930ebc1290c5 1073741824" returned: 0 in 0.462s {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 15:08:48 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [None req-70a46e20-0f80-4e5e-8efd-ac31524c8e76 tempest-VolumesActionsTest-508093061 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c/volume-79011863-9eea-4ff2-9c01-930ebc1290c5 {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 15:08:48 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [None req-70a46e20-0f80-4e5e-8efd-ac31524c8e76 tempest-VolumesActionsTest-508093061 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c/volume-79011863-9eea-4ff2-9c01-930ebc1290c5" returned: 0 in 0.238s {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 15:08:48 devstack cinder-volume[83259]: DEBUG cinder.volume.drivers.quobyte [None req-70a46e20-0f80-4e5e-8efd-ac31524c8e76 tempest-VolumesActionsTest-508093061 None] <== create_volume: return (800ms) {'provider_location': '10.10.41.181/cinder-vol-61f585ac-f8e2-4d19-a890-7ebc2726cc72'} {{(pid=83259) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Sep 16 15:08:48 devstack cinder-volume[83259]: DEBUG oslo_concurrency.lockutils [None req-70a46e20-0f80-4e5e-8efd-ac31524c8e76 tempest-VolumesActionsTest-508093061 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.818s {{(pid=83259) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 16 15:08:48 devstack cinder-volume[83259]: WARNING cinder.volume.volume_utils [None req-eba809e2-f602-4005-b2d6-a2c1d0c371ae tempest-VolumesTransfersTest-1848594036 None] Volume driver (QuobyteDriver 1.2) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 16 15:08:48 devstack cinder-volume[83259]: DEBUG cinder.volume.manager [None req-70a46e20-0f80-4e5e-8efd-ac31524c8e76 tempest-VolumesActionsTest-508093061 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6de14aba-4c92-4033-8a6b-fbae555770b0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-79011863-9eea-4ff2-9c01-930ebc1290c5', 'volume_size': 1}' {{(pid=83259) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 15:08:48 devstack cinder-volume[83259]: DEBUG cinder.volume.manager [None req-70a46e20-0f80-4e5e-8efd-ac31524c8e76 tempest-VolumesActionsTest-508093061 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (441655fc-6a3b-4813-9694-d58fb2ee83e5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83259) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 15:08:48 devstack cinder-volume[83259]: INFO cinder.volume.manager [None req-eba809e2-f602-4005-b2d6-a2c1d0c371ae tempest-VolumesTransfersTest-1848594036 None] Transfer volume completed successfully. Sep 16 15:08:48 devstack cinder-volume[83259]: INFO cinder.volume.flows.manager.create_volume [None req-70a46e20-0f80-4e5e-8efd-ac31524c8e76 tempest-VolumesActionsTest-508093061 None] Volume volume-79011863-9eea-4ff2-9c01-930ebc1290c5 (79011863-9eea-4ff2-9c01-930ebc1290c5): created successfully Sep 16 15:08:48 devstack cinder-volume[83259]: DEBUG cinder.volume.manager [None req-70a46e20-0f80-4e5e-8efd-ac31524c8e76 tempest-VolumesActionsTest-508093061 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (441655fc-6a3b-4813-9694-d58fb2ee83e5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83259) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 15:08:48 devstack cinder-volume[83259]: DEBUG cinder.volume.manager [None req-70a46e20-0f80-4e5e-8efd-ac31524c8e76 tempest-VolumesActionsTest-508093061 None] Flow 'volume_create_manager' (a11ef8fc-d257-4960-a7f3-d988037b3451) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83259) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 16 15:08:48 devstack cinder-volume[83259]: INFO cinder.volume.manager [None req-70a46e20-0f80-4e5e-8efd-ac31524c8e76 tempest-VolumesActionsTest-508093061 None] Created volume successfully. Sep 16 15:08:49 devstack cinder-volume[83259]: DEBUG cinder.coordination [None req-4bed321b-25ac-42b1-ae78-57a95fec00b2 tempest-VolumesActionsTest-690774992 None] Acquiring lock "cinder-79011863-9eea-4ff2-9c01-930ebc1290c5-delete_volume" by "delete_volume" {{(pid=83259) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 16 15:08:49 devstack cinder-volume[83259]: DEBUG cinder.coordination [None req-1ebd2c4b-4066-4d38-9198-5ce0fb35d8ab tempest-VolumesTransfersTest-1284889958 None] Acquiring lock "cinder-a6f0d243-7e18-40aa-b2c4-97d60824e082-delete_volume" by "delete_volume" {{(pid=83259) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 16 15:08:49 devstack cinder-volume[83259]: DEBUG cinder.coordination [None req-4bed321b-25ac-42b1-ae78-57a95fec00b2 tempest-VolumesActionsTest-690774992 None] Lock "cinder-79011863-9eea-4ff2-9c01-930ebc1290c5-delete_volume" acquired by "delete_volume" :: waited 0.112s {{(pid=83259) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 16 15:08:49 devstack cinder-volume[83259]: DEBUG cinder.coordination [None req-1ebd2c4b-4066-4d38-9198-5ce0fb35d8ab tempest-VolumesTransfersTest-1284889958 None] Lock "cinder-a6f0d243-7e18-40aa-b2c4-97d60824e082-delete_volume" acquired by "delete_volume" :: waited 0.059s {{(pid=83259) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 16 15:08:49 devstack cinder-volume[83259]: WARNING cinder.volume.volume_utils [None req-4bed321b-25ac-42b1-ae78-57a95fec00b2 tempest-VolumesActionsTest-690774992 None] Volume driver (QuobyteDriver 1.2) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 16 15:08:49 devstack cinder-volume[83259]: DEBUG cinder.coordination [None req-4bed321b-25ac-42b1-ae78-57a95fec00b2 tempest-VolumesActionsTest-690774992 None] Acquiring lock "cinder-quobyte-79011863-9eea-4ff2-9c01-930ebc1290c5" by "delete_volume" {{(pid=83259) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 16 15:08:49 devstack cinder-volume[83259]: WARNING cinder.volume.volume_utils [None req-1ebd2c4b-4066-4d38-9198-5ce0fb35d8ab tempest-VolumesTransfersTest-1284889958 None] Volume driver (QuobyteDriver 1.2) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 16 15:08:49 devstack cinder-volume[83259]: DEBUG cinder.coordination [None req-1ebd2c4b-4066-4d38-9198-5ce0fb35d8ab tempest-VolumesTransfersTest-1284889958 None] Acquiring lock "cinder-quobyte-a6f0d243-7e18-40aa-b2c4-97d60824e082" by "delete_volume" {{(pid=83259) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 16 15:08:49 devstack cinder-volume[83259]: DEBUG cinder.coordination [None req-4bed321b-25ac-42b1-ae78-57a95fec00b2 tempest-VolumesActionsTest-690774992 None] Lock "cinder-quobyte-79011863-9eea-4ff2-9c01-930ebc1290c5" acquired by "delete_volume" :: waited 0.025s {{(pid=83259) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 16 15:08:50 devstack cinder-volume[83259]: DEBUG cinder.coordination [None req-1ebd2c4b-4066-4d38-9198-5ce0fb35d8ab tempest-VolumesTransfersTest-1284889958 None] Lock "cinder-quobyte-a6f0d243-7e18-40aa-b2c4-97d60824e082" acquired by "delete_volume" :: waited 0.029s {{(pid=83259) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 16 15:08:50 devstack cinder-volume[83259]: DEBUG oslo.privsep.daemon [-] privsep: reply[bc5ae268-a453-4141-8eae-0ed250f2ca08]: (4, 'qcow2') {{(pid=84312) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 16 15:08:50 devstack cinder-volume[83259]: DEBUG oslo.privsep.daemon [-] privsep: reply[ed4c8774-9b81-4a75-aec4-9657a72f29b6]: (4, 'qcow2') {{(pid=84312) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 16 15:08:50 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [None req-4bed321b-25ac-42b1-ae78-57a95fec00b2 tempest-VolumesActionsTest-690774992 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c/volume-79011863-9eea-4ff2-9c01-930ebc1290c5 {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 15:08:50 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [None req-1ebd2c4b-4066-4d38-9198-5ce0fb35d8ab tempest-VolumesTransfersTest-1284889958 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c/volume-a6f0d243-7e18-40aa-b2c4-97d60824e082 {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 15:08:50 devstack quobyte-client[83286]: System call of process 94720 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 16 15:08:50 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [None req-1ebd2c4b-4066-4d38-9198-5ce0fb35d8ab tempest-VolumesTransfersTest-1284889958 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c/volume-a6f0d243-7e18-40aa-b2c4-97d60824e082" returned: 0 in 0.548s {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 15:08:50 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [None req-1ebd2c4b-4066-4d38-9198-5ce0fb35d8ab tempest-VolumesTransfersTest-1284889958 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c/volume-a6f0d243-7e18-40aa-b2c4-97d60824e082 {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 15:08:50 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [None req-1ebd2c4b-4066-4d38-9198-5ce0fb35d8ab tempest-VolumesTransfersTest-1284889958 None] CMD "rm -f /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c/volume-a6f0d243-7e18-40aa-b2c4-97d60824e082" returned: 0 in 0.143s {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 15:08:51 devstack cinder-volume[83259]: DEBUG cinder.coordination [None req-1ebd2c4b-4066-4d38-9198-5ce0fb35d8ab tempest-VolumesTransfersTest-1284889958 None] Lock "cinder-quobyte-a6f0d243-7e18-40aa-b2c4-97d60824e082" released by "delete_volume" :: held 1.030s {{(pid=83259) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 16 15:08:51 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [None req-4bed321b-25ac-42b1-ae78-57a95fec00b2 tempest-VolumesActionsTest-690774992 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c/volume-79011863-9eea-4ff2-9c01-930ebc1290c5" returned: 0 in 1.203s {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 15:08:51 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [None req-4bed321b-25ac-42b1-ae78-57a95fec00b2 tempest-VolumesActionsTest-690774992 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c/volume-79011863-9eea-4ff2-9c01-930ebc1290c5 {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 15:08:51 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [None req-4bed321b-25ac-42b1-ae78-57a95fec00b2 tempest-VolumesActionsTest-690774992 None] CMD "rm -f /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c/volume-79011863-9eea-4ff2-9c01-930ebc1290c5" returned: 0 in 0.292s {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 15:08:51 devstack cinder-volume[83259]: DEBUG cinder.coordination [None req-4bed321b-25ac-42b1-ae78-57a95fec00b2 tempest-VolumesActionsTest-690774992 None] Lock "cinder-quobyte-79011863-9eea-4ff2-9c01-930ebc1290c5" released by "delete_volume" :: held 1.632s {{(pid=83259) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 16 15:08:51 devstack cinder-volume[83259]: DEBUG cinder.quota [None req-4bed321b-25ac-42b1-ae78-57a95fec00b2 tempest-VolumesActionsTest-690774992 None] Created reservations ['ec2ed9cf-e00a-44bd-9a17-57b912d5a31c', '713f30f7-818f-41ae-b1d0-a1d1b28abf49', '722e62f4-83a7-4029-a325-3e7b04bdd2ed', '5ad547fb-3ab3-45c2-b73c-52e2a0bc97cd'] {{(pid=83259) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 16 15:08:51 devstack cinder-volume[83259]: DEBUG cinder.quota [None req-1ebd2c4b-4066-4d38-9198-5ce0fb35d8ab tempest-VolumesTransfersTest-1284889958 None] Created reservations ['33a2a807-31ff-478e-9b31-f987624eef16', 'e458ff35-2106-4d7c-a0ca-f8dd6b97ef85', '160241fd-601a-4e9f-be6c-432fb756e6e5', 'b69b8c63-8720-414f-8b8b-ae9d89efdb23'] {{(pid=83259) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 16 15:08:52 devstack cinder-volume[83259]: DEBUG oslo_concurrency.lockutils [None req-1ebd2c4b-4066-4d38-9198-5ce0fb35d8ab tempest-VolumesTransfersTest-1284889958 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83259) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 16 15:08:52 devstack cinder-volume[83259]: DEBUG oslo_concurrency.lockutils [None req-1ebd2c4b-4066-4d38-9198-5ce0fb35d8ab tempest-VolumesTransfersTest-1284889958 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=83259) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 16 15:08:52 devstack cinder-volume[83259]: DEBUG cinder.volume.drivers.quobyte [None req-1ebd2c4b-4066-4d38-9198-5ce0fb35d8ab tempest-VolumesTransfersTest-1284889958 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-61f585ac-f8e2-4d19-a890-7ebc2726cc72': None} {{(pid=83259) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:639}} Sep 16 15:08:52 devstack cinder-volume[83259]: DEBUG cinder.volume.drivers.quobyte [None req-1ebd2c4b-4066-4d38-9198-5ce0fb35d8ab tempest-VolumesTransfersTest-1284889958 None] Available shares ['10.10.41.181/cinder-vol-61f585ac-f8e2-4d19-a890-7ebc2726cc72'] {{(pid=83259) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:669}} Sep 16 15:08:52 devstack cinder-volume[83259]: DEBUG oslo_concurrency.lockutils [None req-1ebd2c4b-4066-4d38-9198-5ce0fb35d8ab tempest-VolumesTransfersTest-1284889958 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.028s {{(pid=83259) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 16 15:08:52 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [None req-1ebd2c4b-4066-4d38-9198-5ce0fb35d8ab tempest-VolumesTransfersTest-1284889958 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 15:08:52 devstack cinder-volume[83259]: DEBUG oslo_concurrency.lockutils [None req-4bed321b-25ac-42b1-ae78-57a95fec00b2 tempest-VolumesActionsTest-690774992 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83259) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 16 15:08:52 devstack cinder-volume[83259]: DEBUG oslo_concurrency.lockutils [None req-4bed321b-25ac-42b1-ae78-57a95fec00b2 tempest-VolumesActionsTest-690774992 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.024s {{(pid=83259) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 16 15:08:52 devstack cinder-volume[83259]: DEBUG cinder.volume.drivers.quobyte [None req-4bed321b-25ac-42b1-ae78-57a95fec00b2 tempest-VolumesActionsTest-690774992 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-61f585ac-f8e2-4d19-a890-7ebc2726cc72': None} {{(pid=83259) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:639}} Sep 16 15:08:52 devstack cinder-volume[83259]: DEBUG cinder.volume.drivers.quobyte [None req-4bed321b-25ac-42b1-ae78-57a95fec00b2 tempest-VolumesActionsTest-690774992 None] Available shares ['10.10.41.181/cinder-vol-61f585ac-f8e2-4d19-a890-7ebc2726cc72'] {{(pid=83259) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:669}} Sep 16 15:08:52 devstack cinder-volume[83259]: DEBUG oslo_concurrency.lockutils [None req-4bed321b-25ac-42b1-ae78-57a95fec00b2 tempest-VolumesActionsTest-690774992 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.030s {{(pid=83259) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 16 15:08:52 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [None req-4bed321b-25ac-42b1-ae78-57a95fec00b2 tempest-VolumesActionsTest-690774992 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 15:08:52 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [None req-1ebd2c4b-4066-4d38-9198-5ce0fb35d8ab tempest-VolumesTransfersTest-1284889958 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c" returned: 0 in 0.549s {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 15:08:52 devstack cinder-volume[83259]: DEBUG cinder.manager [None req-1ebd2c4b-4066-4d38-9198-5ce0fb35d8ab tempest-VolumesTransfersTest-1284889958 None] Notifying Schedulers of capabilities ... {{(pid=83259) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 16 15:08:52 devstack cinder-volume[83259]: INFO cinder.volume.manager [None req-1ebd2c4b-4066-4d38-9198-5ce0fb35d8ab tempest-VolumesTransfersTest-1284889958 None] Deleted volume successfully. Sep 16 15:08:53 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [None req-4bed321b-25ac-42b1-ae78-57a95fec00b2 tempest-VolumesActionsTest-690774992 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c" returned: 0 in 0.501s {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 15:08:53 devstack cinder-volume[83259]: DEBUG cinder.manager [None req-4bed321b-25ac-42b1-ae78-57a95fec00b2 tempest-VolumesActionsTest-690774992 None] Notifying Schedulers of capabilities ... {{(pid=83259) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 16 15:08:53 devstack cinder-volume[83259]: INFO cinder.volume.manager [None req-4bed321b-25ac-42b1-ae78-57a95fec00b2 tempest-VolumesActionsTest-690774992 None] Deleted volume successfully. Sep 16 15:08:53 devstack cinder-volume[83259]: DEBUG cinder.coordination [None req-1ebd2c4b-4066-4d38-9198-5ce0fb35d8ab tempest-VolumesTransfersTest-1284889958 None] Lock "cinder-a6f0d243-7e18-40aa-b2c4-97d60824e082-delete_volume" released by "delete_volume" :: held 3.427s {{(pid=83259) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 16 15:08:53 devstack cinder-volume[83259]: DEBUG cinder.coordination [None req-4bed321b-25ac-42b1-ae78-57a95fec00b2 tempest-VolumesActionsTest-690774992 None] Lock "cinder-79011863-9eea-4ff2-9c01-930ebc1290c5-delete_volume" released by "delete_volume" :: held 3.656s {{(pid=83259) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 16 15:08:53 devstack cinder-volume[83259]: WARNING cinder.volume.volume_utils [None req-5add00f9-cf4c-4153-922a-17a66f31391d tempest-VolumesTransfersTest-1573726027 None] Volume driver (QuobyteDriver 1.2) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 16 15:08:53 devstack cinder-volume[83259]: DEBUG cinder.volume.flows.manager.create_volume [None req-5add00f9-cf4c-4153-922a-17a66f31391d tempest-VolumesTransfersTest-1573726027 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#Quobyte'], 'hosts': ['devstack@QuobyteHD#Quobyte']} {{(pid=83259) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1387}} Sep 16 15:08:53 devstack cinder-volume[83259]: DEBUG cinder.volume.manager [None req-5add00f9-cf4c-4153-922a-17a66f31391d tempest-VolumesTransfersTest-1573726027 None] Flow 'volume_create_manager' (e930f30f-f172-4f45-a508-149eceb15195) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83259) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 16 15:08:53 devstack cinder-volume[83259]: DEBUG cinder.volume.manager [None req-5add00f9-cf4c-4153-922a-17a66f31391d tempest-VolumesTransfersTest-1573726027 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f0b75d83-6ed0-4dec-8825-c8672b7b2d76) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83259) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 15:08:53 devstack cinder-volume[83259]: WARNING cinder.volume.volume_utils [None req-6d4d853a-830d-4945-928b-6074824d85b2 tempest-VolumesActionsTest-508093061 None] Volume driver (QuobyteDriver 1.2) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 16 15:08:53 devstack cinder-volume[83259]: DEBUG cinder.volume.flows.manager.create_volume [None req-6d4d853a-830d-4945-928b-6074824d85b2 tempest-VolumesActionsTest-508093061 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#Quobyte'], 'hosts': ['devstack@QuobyteHD#Quobyte']} {{(pid=83259) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1387}} Sep 16 15:08:53 devstack cinder-volume[83259]: DEBUG cinder.volume.manager [None req-6d4d853a-830d-4945-928b-6074824d85b2 tempest-VolumesActionsTest-508093061 None] Flow 'volume_create_manager' (61d9cd16-d0fc-4a75-9265-8b372094a01b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83259) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 16 15:08:53 devstack cinder-volume[83259]: DEBUG cinder.volume.manager [None req-6d4d853a-830d-4945-928b-6074824d85b2 tempest-VolumesActionsTest-508093061 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f15e078a-730b-46ef-964f-cec425b0f9c9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83259) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 15:08:53 devstack cinder-volume[83259]: DEBUG cinder.volume.manager [None req-6d4d853a-830d-4945-928b-6074824d85b2 tempest-VolumesActionsTest-508093061 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f15e078a-730b-46ef-964f-cec425b0f9c9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-16T13:08:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-29853053',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#Quobyte',id=b29ebfc8-8041-4ea7-9e05-e55767574976,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f76dd0e8e4304d289547abd09461849a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-16T13:08:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-16T13:08:53Z,use_quota=True,user_id='a584ed30e8d24546b164fe840aeb32ec',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(485ead50-3df8-4d76-8d34-a4db136c980a),volume_type_id=485ead50-3df8-4d76-8d34-a4db136c980a)' {{(pid=83259) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 15:08:53 devstack cinder-volume[83259]: DEBUG cinder.volume.manager [None req-6d4d853a-830d-4945-928b-6074824d85b2 tempest-VolumesActionsTest-508093061 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c79ba870-6f03-464a-99c1-411194f9d725) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83259) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 15:08:53 devstack cinder-volume[83259]: DEBUG cinder.volume.manager [None req-6d4d853a-830d-4945-928b-6074824d85b2 tempest-VolumesActionsTest-508093061 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c79ba870-6f03-464a-99c1-411194f9d725) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83259) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 15:08:53 devstack cinder-volume[83259]: DEBUG cinder.volume.manager [None req-6d4d853a-830d-4945-928b-6074824d85b2 tempest-VolumesActionsTest-508093061 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3c653e06-c9cf-47e2-8e7b-6efd49fcb4d3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83259) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 15:08:53 devstack cinder-volume[83259]: DEBUG cinder.volume.manager [None req-6d4d853a-830d-4945-928b-6074824d85b2 tempest-VolumesActionsTest-508093061 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3c653e06-c9cf-47e2-8e7b-6efd49fcb4d3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b29ebfc8-8041-4ea7-9e05-e55767574976', 'volume_name': 'volume-b29ebfc8-8041-4ea7-9e05-e55767574976', 'volume_size': 1}' {{(pid=83259) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 15:08:53 devstack cinder-volume[83259]: DEBUG cinder.volume.manager [None req-6d4d853a-830d-4945-928b-6074824d85b2 tempest-VolumesActionsTest-508093061 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0ee819f4-db3c-4652-afcd-a7efae47adc6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83259) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 15:08:53 devstack cinder-volume[83259]: DEBUG cinder.volume.manager [None req-6d4d853a-830d-4945-928b-6074824d85b2 tempest-VolumesActionsTest-508093061 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0ee819f4-db3c-4652-afcd-a7efae47adc6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83259) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 15:08:53 devstack cinder-volume[83259]: DEBUG cinder.volume.manager [None req-6d4d853a-830d-4945-928b-6074824d85b2 tempest-VolumesActionsTest-508093061 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0c3d0c8d-3dd3-45e8-9f9c-6d9a8be7bce2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83259) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 15:08:53 devstack cinder-volume[83259]: INFO cinder.volume.flows.manager.create_volume [None req-6d4d853a-830d-4945-928b-6074824d85b2 tempest-VolumesActionsTest-508093061 None] Volume b29ebfc8-8041-4ea7-9e05-e55767574976: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b29ebfc8-8041-4ea7-9e05-e55767574976', 'volume_size': 1} Sep 16 15:08:53 devstack cinder-volume[83259]: DEBUG oslo_concurrency.lockutils [None req-6d4d853a-830d-4945-928b-6074824d85b2 tempest-VolumesActionsTest-508093061 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83259) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 16 15:08:53 devstack cinder-volume[83259]: DEBUG oslo_concurrency.lockutils [None req-6d4d853a-830d-4945-928b-6074824d85b2 tempest-VolumesActionsTest-508093061 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=83259) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 16 15:08:53 devstack cinder-volume[83259]: DEBUG cinder.volume.drivers.quobyte [None req-6d4d853a-830d-4945-928b-6074824d85b2 tempest-VolumesActionsTest-508093061 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-16T13:08:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-29853053',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#Quobyte',id=b29ebfc8-8041-4ea7-9e05-e55767574976,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f76dd0e8e4304d289547abd09461849a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-16T13:08:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-16T13:08:53Z,use_quota=True,user_id='a584ed30e8d24546b164fe840aeb32ec',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(485ead50-3df8-4d76-8d34-a4db136c980a),volume_type_id=485ead50-3df8-4d76-8d34-a4db136c980a)}" {{(pid=83259) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Sep 16 15:08:53 devstack cinder-volume[83259]: DEBUG cinder.volume.drivers.remotefs [None req-6d4d853a-830d-4945-928b-6074824d85b2 tempest-VolumesActionsTest-508093061 None] Creating volume b29ebfc8-8041-4ea7-9e05-e55767574976 {{(pid=83259) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}} Sep 16 15:08:53 devstack cinder-volume[83259]: DEBUG oslo_concurrency.lockutils [None req-6d4d853a-830d-4945-928b-6074824d85b2 tempest-VolumesActionsTest-508093061 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83259) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 16 15:08:53 devstack cinder-volume[83259]: DEBUG oslo_concurrency.lockutils [None req-6d4d853a-830d-4945-928b-6074824d85b2 tempest-VolumesActionsTest-508093061 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83259) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 16 15:08:53 devstack cinder-volume[83259]: DEBUG cinder.volume.drivers.quobyte [None req-6d4d853a-830d-4945-928b-6074824d85b2 tempest-VolumesActionsTest-508093061 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-61f585ac-f8e2-4d19-a890-7ebc2726cc72': None} {{(pid=83259) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:639}} Sep 16 15:08:53 devstack cinder-volume[83259]: DEBUG cinder.volume.drivers.quobyte [None req-6d4d853a-830d-4945-928b-6074824d85b2 tempest-VolumesActionsTest-508093061 None] Available shares ['10.10.41.181/cinder-vol-61f585ac-f8e2-4d19-a890-7ebc2726cc72'] {{(pid=83259) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:669}} Sep 16 15:08:53 devstack cinder-volume[83259]: DEBUG oslo_concurrency.lockutils [None req-6d4d853a-830d-4945-928b-6074824d85b2 tempest-VolumesActionsTest-508093061 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=83259) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 16 15:08:53 devstack cinder-volume[83259]: DEBUG cinder.volume.drivers.quobyte [None req-6d4d853a-830d-4945-928b-6074824d85b2 tempest-VolumesActionsTest-508093061 None] Selected 10.10.41.181/cinder-vol-61f585ac-f8e2-4d19-a890-7ebc2726cc72 as target Quobyte volume. {{(pid=83259) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:690}} Sep 16 15:08:53 devstack cinder-volume[83259]: INFO cinder.volume.drivers.remotefs [None req-6d4d853a-830d-4945-928b-6074824d85b2 tempest-VolumesActionsTest-508093061 None] casted to 10.10.41.181/cinder-vol-61f585ac-f8e2-4d19-a890-7ebc2726cc72 Sep 16 15:08:53 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [None req-6d4d853a-830d-4945-928b-6074824d85b2 tempest-VolumesActionsTest-508093061 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c/volume-b29ebfc8-8041-4ea7-9e05-e55767574976 1073741824 {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 15:08:54 devstack quobyte-client[83286]: The server volume:87712ffe-8a69-446d-9ed6-4430c7ee9792@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=87712ffe-8a69-446d-9ed6-4430c7ee9792, inode=85, name=volume-b29ebfc8-8041-4ea7-9e05-e55767574976, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.206), requestorAccessMask=0 Sep 16 15:08:54 devstack cinder-volume[83259]: DEBUG cinder.volume.manager [None req-5add00f9-cf4c-4153-922a-17a66f31391d tempest-VolumesTransfersTest-1573726027 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f0b75d83-6ed0-4dec-8825-c8672b7b2d76) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-16T13:08:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-988217952',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#Quobyte',id=03b07204-cf7d-414d-8858-5b7c697a7ca5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='40431d8873904810871b315ef41b6e18',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-16T13:08:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-16T13:08:53Z,use_quota=True,user_id='9cac11e851d24d12893ee03f30bcd0b4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(485ead50-3df8-4d76-8d34-a4db136c980a),volume_type_id=485ead50-3df8-4d76-8d34-a4db136c980a)' {{(pid=83259) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 15:08:54 devstack cinder-volume[83259]: DEBUG cinder.volume.manager [None req-5add00f9-cf4c-4153-922a-17a66f31391d tempest-VolumesTransfersTest-1573726027 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (303794a3-6168-42ca-9f87-d77718cf1a6c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83259) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 15:08:54 devstack cinder-volume[83259]: DEBUG cinder.volume.manager [None req-5add00f9-cf4c-4153-922a-17a66f31391d tempest-VolumesTransfersTest-1573726027 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (303794a3-6168-42ca-9f87-d77718cf1a6c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83259) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 15:08:54 devstack cinder-volume[83259]: DEBUG cinder.volume.manager [None req-5add00f9-cf4c-4153-922a-17a66f31391d tempest-VolumesTransfersTest-1573726027 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3366b7b5-3f5b-4d48-84f9-4e5e7af582da) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83259) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 15:08:54 devstack cinder-volume[83259]: DEBUG cinder.volume.manager [None req-5add00f9-cf4c-4153-922a-17a66f31391d tempest-VolumesTransfersTest-1573726027 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3366b7b5-3f5b-4d48-84f9-4e5e7af582da) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '03b07204-cf7d-414d-8858-5b7c697a7ca5', 'volume_name': 'volume-03b07204-cf7d-414d-8858-5b7c697a7ca5', 'volume_size': 1}' {{(pid=83259) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 15:08:54 devstack cinder-volume[83259]: DEBUG cinder.volume.manager [None req-5add00f9-cf4c-4153-922a-17a66f31391d tempest-VolumesTransfersTest-1573726027 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fb4ad9c2-a38b-428c-b448-d2683313b834) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83259) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 15:08:54 devstack cinder-volume[83259]: DEBUG cinder.volume.manager [None req-5add00f9-cf4c-4153-922a-17a66f31391d tempest-VolumesTransfersTest-1573726027 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fb4ad9c2-a38b-428c-b448-d2683313b834) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83259) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 15:08:54 devstack cinder-volume[83259]: DEBUG cinder.volume.manager [None req-5add00f9-cf4c-4153-922a-17a66f31391d tempest-VolumesTransfersTest-1573726027 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f9336108-abb9-4be4-ac61-31941e90f103) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83259) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 15:08:54 devstack cinder-volume[83259]: INFO cinder.volume.flows.manager.create_volume [None req-5add00f9-cf4c-4153-922a-17a66f31391d tempest-VolumesTransfersTest-1573726027 None] Volume 03b07204-cf7d-414d-8858-5b7c697a7ca5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-03b07204-cf7d-414d-8858-5b7c697a7ca5', 'volume_size': 1} Sep 16 15:08:54 devstack cinder-volume[83259]: DEBUG oslo_concurrency.lockutils [None req-5add00f9-cf4c-4153-922a-17a66f31391d tempest-VolumesTransfersTest-1573726027 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83259) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 16 15:08:54 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [None req-6d4d853a-830d-4945-928b-6074824d85b2 tempest-VolumesActionsTest-508093061 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c/volume-b29ebfc8-8041-4ea7-9e05-e55767574976 1073741824" returned: 0 in 0.615s {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 15:08:54 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [None req-6d4d853a-830d-4945-928b-6074824d85b2 tempest-VolumesActionsTest-508093061 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c/volume-b29ebfc8-8041-4ea7-9e05-e55767574976 {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 15:08:54 devstack cinder-volume[83259]: WARNING cinder.volume.volume_utils [None req-63219942-d83f-4fa1-825a-94a5bfba8af1 tempest-TestServerVolumeAttachmentScenario-757686503 None] Volume driver (QuobyteDriver 1.2) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 16 15:08:54 devstack cinder-volume[83259]: DEBUG cinder.volume.flows.manager.create_volume [None req-63219942-d83f-4fa1-825a-94a5bfba8af1 tempest-TestServerVolumeAttachmentScenario-757686503 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#Quobyte'], 'hosts': ['devstack@QuobyteHD#Quobyte']} {{(pid=83259) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1387}} Sep 16 15:08:54 devstack cinder-volume[83259]: DEBUG cinder.volume.manager [None req-63219942-d83f-4fa1-825a-94a5bfba8af1 tempest-TestServerVolumeAttachmentScenario-757686503 None] Flow 'volume_create_manager' (cd74fe63-978f-4feb-b52f-501a961bd0b0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83259) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 16 15:08:54 devstack cinder-volume[83259]: DEBUG cinder.volume.manager [None req-63219942-d83f-4fa1-825a-94a5bfba8af1 tempest-TestServerVolumeAttachmentScenario-757686503 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (72ed648b-3e69-4808-812a-8562ef3d658c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83259) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 15:08:55 devstack cinder-volume[83259]: DEBUG cinder.volume.manager [None req-63219942-d83f-4fa1-825a-94a5bfba8af1 tempest-TestServerVolumeAttachmentScenario-757686503 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (72ed648b-3e69-4808-812a-8562ef3d658c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-16T13:08:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-1562942043',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#Quobyte',id=dde63480-6417-458e-9a53-9c562b2718bc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='371e7b580cb14aa8854f497df13d4727',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-16T13:08:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-16T13:08:54Z,use_quota=True,user_id='57781791246b4c1fb9f9647ffc5c6186',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(485ead50-3df8-4d76-8d34-a4db136c980a),volume_type_id=485ead50-3df8-4d76-8d34-a4db136c980a)' {{(pid=83259) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 15:08:55 devstack cinder-volume[83259]: DEBUG cinder.volume.manager [None req-63219942-d83f-4fa1-825a-94a5bfba8af1 tempest-TestServerVolumeAttachmentScenario-757686503 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ac4f8c49-af5c-4dbe-89bf-d7e484cbbd33) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83259) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 15:08:55 devstack cinder-volume[83259]: DEBUG cinder.volume.manager [None req-63219942-d83f-4fa1-825a-94a5bfba8af1 tempest-TestServerVolumeAttachmentScenario-757686503 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ac4f8c49-af5c-4dbe-89bf-d7e484cbbd33) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83259) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 15:08:55 devstack cinder-volume[83259]: DEBUG cinder.volume.manager [None req-63219942-d83f-4fa1-825a-94a5bfba8af1 tempest-TestServerVolumeAttachmentScenario-757686503 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7bfc8243-6144-4712-82a0-ecbbbb511ea6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83259) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 15:08:55 devstack cinder-volume[83259]: DEBUG cinder.volume.manager [None req-63219942-d83f-4fa1-825a-94a5bfba8af1 tempest-TestServerVolumeAttachmentScenario-757686503 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7bfc8243-6144-4712-82a0-ecbbbb511ea6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'dde63480-6417-458e-9a53-9c562b2718bc', 'volume_name': 'volume-dde63480-6417-458e-9a53-9c562b2718bc', 'volume_size': 1}' {{(pid=83259) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 15:08:55 devstack cinder-volume[83259]: DEBUG cinder.volume.manager [None req-63219942-d83f-4fa1-825a-94a5bfba8af1 tempest-TestServerVolumeAttachmentScenario-757686503 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (595b9451-a330-4f9b-a11a-c525997e5164) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83259) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 15:08:55 devstack cinder-volume[83259]: DEBUG cinder.volume.manager [None req-63219942-d83f-4fa1-825a-94a5bfba8af1 tempest-TestServerVolumeAttachmentScenario-757686503 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (595b9451-a330-4f9b-a11a-c525997e5164) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83259) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 15:08:55 devstack cinder-volume[83259]: DEBUG cinder.volume.manager [None req-63219942-d83f-4fa1-825a-94a5bfba8af1 tempest-TestServerVolumeAttachmentScenario-757686503 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5b4dbba3-bab3-42f0-b0ef-63d0fe514abb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83259) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 15:08:55 devstack cinder-volume[83259]: INFO cinder.volume.flows.manager.create_volume [None req-63219942-d83f-4fa1-825a-94a5bfba8af1 tempest-TestServerVolumeAttachmentScenario-757686503 None] Volume dde63480-6417-458e-9a53-9c562b2718bc: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-dde63480-6417-458e-9a53-9c562b2718bc', 'volume_size': 1} Sep 16 15:08:55 devstack cinder-volume[83259]: DEBUG oslo_concurrency.lockutils [None req-63219942-d83f-4fa1-825a-94a5bfba8af1 tempest-TestServerVolumeAttachmentScenario-757686503 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83259) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 16 15:08:55 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [None req-6d4d853a-830d-4945-928b-6074824d85b2 tempest-VolumesActionsTest-508093061 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c/volume-b29ebfc8-8041-4ea7-9e05-e55767574976" returned: 0 in 0.683s {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 15:08:55 devstack cinder-volume[83259]: DEBUG cinder.volume.drivers.quobyte [None req-6d4d853a-830d-4945-928b-6074824d85b2 tempest-VolumesActionsTest-508093061 None] <== create_volume: return (1353ms) {'provider_location': '10.10.41.181/cinder-vol-61f585ac-f8e2-4d19-a890-7ebc2726cc72'} {{(pid=83259) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Sep 16 15:08:55 devstack cinder-volume[83259]: DEBUG oslo_concurrency.lockutils [None req-6d4d853a-830d-4945-928b-6074824d85b2 tempest-VolumesActionsTest-508093061 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.360s {{(pid=83259) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 16 15:08:55 devstack cinder-volume[83259]: DEBUG oslo_concurrency.lockutils [None req-5add00f9-cf4c-4153-922a-17a66f31391d tempest-VolumesTransfersTest-1573726027 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.980s {{(pid=83259) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 16 15:08:55 devstack cinder-volume[83259]: DEBUG cinder.volume.drivers.quobyte [None req-5add00f9-cf4c-4153-922a-17a66f31391d tempest-VolumesTransfersTest-1573726027 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-16T13:08:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-988217952',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#Quobyte',id=03b07204-cf7d-414d-8858-5b7c697a7ca5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='40431d8873904810871b315ef41b6e18',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-16T13:08:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-16T13:08:53Z,use_quota=True,user_id='9cac11e851d24d12893ee03f30bcd0b4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(485ead50-3df8-4d76-8d34-a4db136c980a),volume_type_id=485ead50-3df8-4d76-8d34-a4db136c980a)}" {{(pid=83259) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Sep 16 15:08:55 devstack cinder-volume[83259]: DEBUG cinder.volume.drivers.remotefs [None req-5add00f9-cf4c-4153-922a-17a66f31391d tempest-VolumesTransfersTest-1573726027 None] Creating volume 03b07204-cf7d-414d-8858-5b7c697a7ca5 {{(pid=83259) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}} Sep 16 15:08:55 devstack cinder-volume[83259]: DEBUG oslo_concurrency.lockutils [None req-5add00f9-cf4c-4153-922a-17a66f31391d tempest-VolumesTransfersTest-1573726027 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83259) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 16 15:08:55 devstack cinder-volume[83259]: DEBUG oslo_concurrency.lockutils [None req-5add00f9-cf4c-4153-922a-17a66f31391d tempest-VolumesTransfersTest-1573726027 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83259) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 16 15:08:55 devstack cinder-volume[83259]: DEBUG cinder.volume.drivers.quobyte [None req-5add00f9-cf4c-4153-922a-17a66f31391d tempest-VolumesTransfersTest-1573726027 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-61f585ac-f8e2-4d19-a890-7ebc2726cc72': None} {{(pid=83259) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:639}} Sep 16 15:08:55 devstack cinder-volume[83259]: DEBUG cinder.volume.drivers.quobyte [None req-5add00f9-cf4c-4153-922a-17a66f31391d tempest-VolumesTransfersTest-1573726027 None] Available shares ['10.10.41.181/cinder-vol-61f585ac-f8e2-4d19-a890-7ebc2726cc72'] {{(pid=83259) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:669}} Sep 16 15:08:55 devstack cinder-volume[83259]: DEBUG oslo_concurrency.lockutils [None req-5add00f9-cf4c-4153-922a-17a66f31391d tempest-VolumesTransfersTest-1573726027 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=83259) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 16 15:08:55 devstack cinder-volume[83259]: DEBUG cinder.volume.drivers.quobyte [None req-5add00f9-cf4c-4153-922a-17a66f31391d tempest-VolumesTransfersTest-1573726027 None] Selected 10.10.41.181/cinder-vol-61f585ac-f8e2-4d19-a890-7ebc2726cc72 as target Quobyte volume. {{(pid=83259) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:690}} Sep 16 15:08:55 devstack cinder-volume[83259]: INFO cinder.volume.drivers.remotefs [None req-5add00f9-cf4c-4153-922a-17a66f31391d tempest-VolumesTransfersTest-1573726027 None] casted to 10.10.41.181/cinder-vol-61f585ac-f8e2-4d19-a890-7ebc2726cc72 Sep 16 15:08:55 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [None req-5add00f9-cf4c-4153-922a-17a66f31391d tempest-VolumesTransfersTest-1573726027 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c/volume-03b07204-cf7d-414d-8858-5b7c697a7ca5 1073741824 {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 15:08:55 devstack quobyte-client[83286]: The server volume:87712ffe-8a69-446d-9ed6-4430c7ee9792@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=87712ffe-8a69-446d-9ed6-4430c7ee9792, inode=86, name=volume-03b07204-cf7d-414d-8858-5b7c697a7ca5, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.206), requestorAccessMask=0 Sep 16 15:08:55 devstack cinder-volume[83259]: WARNING cinder.volume.volume_utils [None req-1d8e06e6-1f00-47af-8b97-58c5db1a854a tempest-TestServerVolumeAttachmentScenario-757686503 None] Volume driver (QuobyteDriver 1.2) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 16 15:08:55 devstack cinder-volume[83259]: DEBUG cinder.volume.flows.manager.create_volume [None req-1d8e06e6-1f00-47af-8b97-58c5db1a854a tempest-TestServerVolumeAttachmentScenario-757686503 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#Quobyte'], 'hosts': ['devstack@QuobyteHD#Quobyte']} {{(pid=83259) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1387}} Sep 16 15:08:55 devstack cinder-volume[83259]: DEBUG cinder.volume.manager [None req-1d8e06e6-1f00-47af-8b97-58c5db1a854a tempest-TestServerVolumeAttachmentScenario-757686503 None] Flow 'volume_create_manager' (e1cf13f5-a723-4ff1-9ac6-e51a78912845) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83259) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 16 15:08:55 devstack cinder-volume[83259]: DEBUG cinder.volume.manager [None req-1d8e06e6-1f00-47af-8b97-58c5db1a854a tempest-TestServerVolumeAttachmentScenario-757686503 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ba749328-3704-4531-986f-e04462566d76) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83259) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 15:08:55 devstack cinder-volume[83259]: DEBUG cinder.volume.manager [None req-6d4d853a-830d-4945-928b-6074824d85b2 tempest-VolumesActionsTest-508093061 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0c3d0c8d-3dd3-45e8-9f9c-6d9a8be7bce2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b29ebfc8-8041-4ea7-9e05-e55767574976', 'volume_size': 1}' {{(pid=83259) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 15:08:55 devstack cinder-volume[83259]: DEBUG cinder.volume.manager [None req-6d4d853a-830d-4945-928b-6074824d85b2 tempest-VolumesActionsTest-508093061 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bfcfdc31-276b-425c-81c0-8faff76d89ce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83259) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 15:08:55 devstack cinder-volume[83259]: DEBUG cinder.volume.manager [None req-1d8e06e6-1f00-47af-8b97-58c5db1a854a tempest-TestServerVolumeAttachmentScenario-757686503 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ba749328-3704-4531-986f-e04462566d76) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-16T13:08:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-329775557',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#Quobyte',id=89469ddc-4f11-4f5f-9b33-4ff39e729f69,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='371e7b580cb14aa8854f497df13d4727',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-16T13:08:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-16T13:08:55Z,use_quota=True,user_id='57781791246b4c1fb9f9647ffc5c6186',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(485ead50-3df8-4d76-8d34-a4db136c980a),volume_type_id=485ead50-3df8-4d76-8d34-a4db136c980a)' {{(pid=83259) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 15:08:55 devstack cinder-volume[83259]: DEBUG cinder.volume.manager [None req-1d8e06e6-1f00-47af-8b97-58c5db1a854a tempest-TestServerVolumeAttachmentScenario-757686503 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (aee34782-713a-4769-90b1-2a298fe56281) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83259) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 15:08:55 devstack cinder-volume[83259]: DEBUG cinder.volume.manager [None req-1d8e06e6-1f00-47af-8b97-58c5db1a854a tempest-TestServerVolumeAttachmentScenario-757686503 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (aee34782-713a-4769-90b1-2a298fe56281) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83259) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 15:08:55 devstack cinder-volume[83259]: DEBUG cinder.volume.manager [None req-1d8e06e6-1f00-47af-8b97-58c5db1a854a tempest-TestServerVolumeAttachmentScenario-757686503 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (567453e8-cc61-44de-ad3c-5517dc4419ea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83259) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 15:08:55 devstack cinder-volume[83259]: DEBUG cinder.volume.manager [None req-1d8e06e6-1f00-47af-8b97-58c5db1a854a tempest-TestServerVolumeAttachmentScenario-757686503 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (567453e8-cc61-44de-ad3c-5517dc4419ea) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '89469ddc-4f11-4f5f-9b33-4ff39e729f69', 'volume_name': 'volume-89469ddc-4f11-4f5f-9b33-4ff39e729f69', 'volume_size': 1}' {{(pid=83259) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 15:08:55 devstack cinder-volume[83259]: DEBUG cinder.volume.manager [None req-1d8e06e6-1f00-47af-8b97-58c5db1a854a tempest-TestServerVolumeAttachmentScenario-757686503 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2d4089f2-de66-407c-ac64-1d1a53fcb294) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83259) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 15:08:55 devstack cinder-volume[83259]: DEBUG cinder.volume.manager [None req-1d8e06e6-1f00-47af-8b97-58c5db1a854a tempest-TestServerVolumeAttachmentScenario-757686503 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2d4089f2-de66-407c-ac64-1d1a53fcb294) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83259) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 15:08:55 devstack cinder-volume[83259]: DEBUG cinder.volume.manager [None req-1d8e06e6-1f00-47af-8b97-58c5db1a854a tempest-TestServerVolumeAttachmentScenario-757686503 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (23872e3b-d91a-46dd-a1d3-cee591fcd5ae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83259) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 15:08:55 devstack cinder-volume[83259]: INFO cinder.volume.flows.manager.create_volume [None req-1d8e06e6-1f00-47af-8b97-58c5db1a854a tempest-TestServerVolumeAttachmentScenario-757686503 None] Volume 89469ddc-4f11-4f5f-9b33-4ff39e729f69: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-89469ddc-4f11-4f5f-9b33-4ff39e729f69', 'volume_size': 1} Sep 16 15:08:55 devstack cinder-volume[83259]: DEBUG oslo_concurrency.lockutils [None req-1d8e06e6-1f00-47af-8b97-58c5db1a854a tempest-TestServerVolumeAttachmentScenario-757686503 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83259) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 16 15:08:55 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [None req-5add00f9-cf4c-4153-922a-17a66f31391d tempest-VolumesTransfersTest-1573726027 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c/volume-03b07204-cf7d-414d-8858-5b7c697a7ca5 1073741824" returned: 0 in 0.713s {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 15:08:55 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [None req-5add00f9-cf4c-4153-922a-17a66f31391d tempest-VolumesTransfersTest-1573726027 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c/volume-03b07204-cf7d-414d-8858-5b7c697a7ca5 {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 15:08:56 devstack cinder-volume[83259]: INFO cinder.volume.flows.manager.create_volume [None req-6d4d853a-830d-4945-928b-6074824d85b2 tempest-VolumesActionsTest-508093061 None] Volume volume-b29ebfc8-8041-4ea7-9e05-e55767574976 (b29ebfc8-8041-4ea7-9e05-e55767574976): created successfully Sep 16 15:08:56 devstack cinder-volume[83259]: DEBUG cinder.volume.manager [None req-6d4d853a-830d-4945-928b-6074824d85b2 tempest-VolumesActionsTest-508093061 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bfcfdc31-276b-425c-81c0-8faff76d89ce) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83259) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 15:08:56 devstack cinder-volume[83259]: DEBUG cinder.volume.manager [None req-6d4d853a-830d-4945-928b-6074824d85b2 tempest-VolumesActionsTest-508093061 None] Flow 'volume_create_manager' (61d9cd16-d0fc-4a75-9265-8b372094a01b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83259) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 16 15:08:56 devstack cinder-volume[83259]: INFO cinder.volume.manager [None req-6d4d853a-830d-4945-928b-6074824d85b2 tempest-VolumesActionsTest-508093061 None] Created volume successfully. Sep 16 15:08:56 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [None req-5add00f9-cf4c-4153-922a-17a66f31391d tempest-VolumesTransfersTest-1573726027 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c/volume-03b07204-cf7d-414d-8858-5b7c697a7ca5" returned: 0 in 0.410s {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 15:08:56 devstack cinder-volume[83259]: DEBUG cinder.volume.drivers.quobyte [None req-5add00f9-cf4c-4153-922a-17a66f31391d tempest-VolumesTransfersTest-1573726027 None] <== create_volume: return (1146ms) {'provider_location': '10.10.41.181/cinder-vol-61f585ac-f8e2-4d19-a890-7ebc2726cc72'} {{(pid=83259) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Sep 16 15:08:56 devstack cinder-volume[83259]: DEBUG oslo_concurrency.lockutils [None req-5add00f9-cf4c-4153-922a-17a66f31391d tempest-VolumesTransfersTest-1573726027 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.156s {{(pid=83259) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 16 15:08:56 devstack cinder-volume[83259]: DEBUG oslo_concurrency.lockutils [None req-63219942-d83f-4fa1-825a-94a5bfba8af1 tempest-TestServerVolumeAttachmentScenario-757686503 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.210s {{(pid=83259) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 16 15:08:56 devstack cinder-volume[83259]: DEBUG cinder.volume.drivers.quobyte [None req-63219942-d83f-4fa1-825a-94a5bfba8af1 tempest-TestServerVolumeAttachmentScenario-757686503 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-16T13:08:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-1562942043',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#Quobyte',id=dde63480-6417-458e-9a53-9c562b2718bc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='371e7b580cb14aa8854f497df13d4727',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-16T13:08:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-16T13:08:54Z,use_quota=True,user_id='57781791246b4c1fb9f9647ffc5c6186',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(485ead50-3df8-4d76-8d34-a4db136c980a),volume_type_id=485ead50-3df8-4d76-8d34-a4db136c980a)}" {{(pid=83259) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Sep 16 15:08:56 devstack cinder-volume[83259]: DEBUG cinder.volume.drivers.remotefs [None req-63219942-d83f-4fa1-825a-94a5bfba8af1 tempest-TestServerVolumeAttachmentScenario-757686503 None] Creating volume dde63480-6417-458e-9a53-9c562b2718bc {{(pid=83259) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}} Sep 16 15:08:56 devstack cinder-volume[83259]: DEBUG oslo_concurrency.lockutils [None req-63219942-d83f-4fa1-825a-94a5bfba8af1 tempest-TestServerVolumeAttachmentScenario-757686503 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83259) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 16 15:08:56 devstack cinder-volume[83259]: DEBUG oslo_concurrency.lockutils [None req-63219942-d83f-4fa1-825a-94a5bfba8af1 tempest-TestServerVolumeAttachmentScenario-757686503 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=83259) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 16 15:08:56 devstack cinder-volume[83259]: DEBUG cinder.volume.drivers.quobyte [None req-63219942-d83f-4fa1-825a-94a5bfba8af1 tempest-TestServerVolumeAttachmentScenario-757686503 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-61f585ac-f8e2-4d19-a890-7ebc2726cc72': None} {{(pid=83259) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:639}} Sep 16 15:08:56 devstack cinder-volume[83259]: DEBUG cinder.volume.drivers.quobyte [None req-63219942-d83f-4fa1-825a-94a5bfba8af1 tempest-TestServerVolumeAttachmentScenario-757686503 None] Available shares ['10.10.41.181/cinder-vol-61f585ac-f8e2-4d19-a890-7ebc2726cc72'] {{(pid=83259) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:669}} Sep 16 15:08:56 devstack cinder-volume[83259]: DEBUG oslo_concurrency.lockutils [None req-63219942-d83f-4fa1-825a-94a5bfba8af1 tempest-TestServerVolumeAttachmentScenario-757686503 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=83259) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 16 15:08:56 devstack cinder-volume[83259]: DEBUG cinder.volume.drivers.quobyte [None req-63219942-d83f-4fa1-825a-94a5bfba8af1 tempest-TestServerVolumeAttachmentScenario-757686503 None] Selected 10.10.41.181/cinder-vol-61f585ac-f8e2-4d19-a890-7ebc2726cc72 as target Quobyte volume. {{(pid=83259) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:690}} Sep 16 15:08:56 devstack cinder-volume[83259]: INFO cinder.volume.drivers.remotefs [None req-63219942-d83f-4fa1-825a-94a5bfba8af1 tempest-TestServerVolumeAttachmentScenario-757686503 None] casted to 10.10.41.181/cinder-vol-61f585ac-f8e2-4d19-a890-7ebc2726cc72 Sep 16 15:08:56 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [None req-63219942-d83f-4fa1-825a-94a5bfba8af1 tempest-TestServerVolumeAttachmentScenario-757686503 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c/volume-dde63480-6417-458e-9a53-9c562b2718bc 1073741824 {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 15:08:56 devstack quobyte-client[83286]: System call of process 94739 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 16 15:08:56 devstack quobyte-client[83286]: The server volume:87712ffe-8a69-446d-9ed6-4430c7ee9792@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=87712ffe-8a69-446d-9ed6-4430c7ee9792, inode=87, name=volume-dde63480-6417-458e-9a53-9c562b2718bc, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.206), requestorAccessMask=0 Sep 16 15:08:56 devstack cinder-volume[83259]: DEBUG cinder.volume.manager [None req-5add00f9-cf4c-4153-922a-17a66f31391d tempest-VolumesTransfersTest-1573726027 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f9336108-abb9-4be4-ac61-31941e90f103) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-03b07204-cf7d-414d-8858-5b7c697a7ca5', 'volume_size': 1}' {{(pid=83259) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 15:08:56 devstack cinder-volume[83259]: DEBUG cinder.volume.manager [None req-5add00f9-cf4c-4153-922a-17a66f31391d tempest-VolumesTransfersTest-1573726027 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (98b8d30a-6d64-458d-9301-e1a22b8601e6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83259) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 15:08:56 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [None req-63219942-d83f-4fa1-825a-94a5bfba8af1 tempest-TestServerVolumeAttachmentScenario-757686503 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c/volume-dde63480-6417-458e-9a53-9c562b2718bc 1073741824" returned: 0 in 0.567s {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 15:08:56 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [None req-63219942-d83f-4fa1-825a-94a5bfba8af1 tempest-TestServerVolumeAttachmentScenario-757686503 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c/volume-dde63480-6417-458e-9a53-9c562b2718bc {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 15:08:57 devstack cinder-volume[83259]: INFO cinder.volume.flows.manager.create_volume [None req-5add00f9-cf4c-4153-922a-17a66f31391d tempest-VolumesTransfersTest-1573726027 None] Volume volume-03b07204-cf7d-414d-8858-5b7c697a7ca5 (03b07204-cf7d-414d-8858-5b7c697a7ca5): created successfully Sep 16 15:08:57 devstack cinder-volume[83259]: DEBUG cinder.volume.manager [None req-5add00f9-cf4c-4153-922a-17a66f31391d tempest-VolumesTransfersTest-1573726027 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (98b8d30a-6d64-458d-9301-e1a22b8601e6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83259) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 15:08:57 devstack cinder-volume[83259]: DEBUG cinder.volume.manager [None req-5add00f9-cf4c-4153-922a-17a66f31391d tempest-VolumesTransfersTest-1573726027 None] Flow 'volume_create_manager' (e930f30f-f172-4f45-a508-149eceb15195) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83259) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 16 15:08:57 devstack cinder-volume[83259]: DEBUG cinder.coordination [None req-3f37ab39-a72f-449a-9fc2-ed2d1aebd918 tempest-VolumesActionsTest-690774992 None] Acquiring lock "cinder-b29ebfc8-8041-4ea7-9e05-e55767574976-delete_volume" by "delete_volume" {{(pid=83259) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 16 15:08:57 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [None req-63219942-d83f-4fa1-825a-94a5bfba8af1 tempest-TestServerVolumeAttachmentScenario-757686503 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c/volume-dde63480-6417-458e-9a53-9c562b2718bc" returned: 0 in 0.477s {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 15:08:57 devstack cinder-volume[83259]: DEBUG cinder.volume.drivers.quobyte [None req-63219942-d83f-4fa1-825a-94a5bfba8af1 tempest-TestServerVolumeAttachmentScenario-757686503 None] <== create_volume: return (1077ms) {'provider_location': '10.10.41.181/cinder-vol-61f585ac-f8e2-4d19-a890-7ebc2726cc72'} {{(pid=83259) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Sep 16 15:08:57 devstack cinder-volume[83259]: DEBUG oslo_concurrency.lockutils [None req-63219942-d83f-4fa1-825a-94a5bfba8af1 tempest-TestServerVolumeAttachmentScenario-757686503 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.098s {{(pid=83259) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 16 15:08:57 devstack cinder-volume[83259]: DEBUG oslo_concurrency.lockutils [None req-1d8e06e6-1f00-47af-8b97-58c5db1a854a tempest-TestServerVolumeAttachmentScenario-757686503 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.579s {{(pid=83259) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 16 15:08:57 devstack cinder-volume[83259]: DEBUG cinder.volume.drivers.quobyte [None req-1d8e06e6-1f00-47af-8b97-58c5db1a854a tempest-TestServerVolumeAttachmentScenario-757686503 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-16T13:08:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-329775557',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#Quobyte',id=89469ddc-4f11-4f5f-9b33-4ff39e729f69,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='371e7b580cb14aa8854f497df13d4727',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-16T13:08:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-16T13:08:55Z,use_quota=True,user_id='57781791246b4c1fb9f9647ffc5c6186',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(485ead50-3df8-4d76-8d34-a4db136c980a),volume_type_id=485ead50-3df8-4d76-8d34-a4db136c980a)}" {{(pid=83259) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Sep 16 15:08:57 devstack cinder-volume[83259]: DEBUG cinder.volume.drivers.remotefs [None req-1d8e06e6-1f00-47af-8b97-58c5db1a854a tempest-TestServerVolumeAttachmentScenario-757686503 None] Creating volume 89469ddc-4f11-4f5f-9b33-4ff39e729f69 {{(pid=83259) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}} Sep 16 15:08:57 devstack cinder-volume[83259]: DEBUG oslo_concurrency.lockutils [None req-1d8e06e6-1f00-47af-8b97-58c5db1a854a tempest-TestServerVolumeAttachmentScenario-757686503 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83259) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 16 15:08:57 devstack cinder-volume[83259]: DEBUG oslo_concurrency.lockutils [None req-1d8e06e6-1f00-47af-8b97-58c5db1a854a tempest-TestServerVolumeAttachmentScenario-757686503 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83259) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 16 15:08:57 devstack cinder-volume[83259]: DEBUG cinder.volume.drivers.quobyte [None req-1d8e06e6-1f00-47af-8b97-58c5db1a854a tempest-TestServerVolumeAttachmentScenario-757686503 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-61f585ac-f8e2-4d19-a890-7ebc2726cc72': None} {{(pid=83259) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:639}} Sep 16 15:08:57 devstack cinder-volume[83259]: DEBUG cinder.volume.drivers.quobyte [None req-1d8e06e6-1f00-47af-8b97-58c5db1a854a tempest-TestServerVolumeAttachmentScenario-757686503 None] Available shares ['10.10.41.181/cinder-vol-61f585ac-f8e2-4d19-a890-7ebc2726cc72'] {{(pid=83259) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:669}} Sep 16 15:08:57 devstack cinder-volume[83259]: DEBUG oslo_concurrency.lockutils [None req-1d8e06e6-1f00-47af-8b97-58c5db1a854a tempest-TestServerVolumeAttachmentScenario-757686503 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=83259) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 16 15:08:57 devstack cinder-volume[83259]: DEBUG cinder.volume.drivers.quobyte [None req-1d8e06e6-1f00-47af-8b97-58c5db1a854a tempest-TestServerVolumeAttachmentScenario-757686503 None] Selected 10.10.41.181/cinder-vol-61f585ac-f8e2-4d19-a890-7ebc2726cc72 as target Quobyte volume. {{(pid=83259) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:690}} Sep 16 15:08:57 devstack cinder-volume[83259]: INFO cinder.volume.drivers.remotefs [None req-1d8e06e6-1f00-47af-8b97-58c5db1a854a tempest-TestServerVolumeAttachmentScenario-757686503 None] casted to 10.10.41.181/cinder-vol-61f585ac-f8e2-4d19-a890-7ebc2726cc72 Sep 16 15:08:57 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [None req-1d8e06e6-1f00-47af-8b97-58c5db1a854a tempest-TestServerVolumeAttachmentScenario-757686503 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c/volume-89469ddc-4f11-4f5f-9b33-4ff39e729f69 1073741824 {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 15:08:57 devstack quobyte-client[83286]: System call of process 94743 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 16 15:08:57 devstack quobyte-client[83286]: The server volume:87712ffe-8a69-446d-9ed6-4430c7ee9792@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=87712ffe-8a69-446d-9ed6-4430c7ee9792, inode=88, name=volume-89469ddc-4f11-4f5f-9b33-4ff39e729f69, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.206), requestorAccessMask=0 Sep 16 15:08:57 devstack cinder-volume[83259]: DEBUG cinder.coordination [None req-3f37ab39-a72f-449a-9fc2-ed2d1aebd918 tempest-VolumesActionsTest-690774992 None] Lock "cinder-b29ebfc8-8041-4ea7-9e05-e55767574976-delete_volume" acquired by "delete_volume" :: waited 0.360s {{(pid=83259) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 16 15:08:57 devstack cinder-volume[83259]: INFO cinder.volume.manager [None req-5add00f9-cf4c-4153-922a-17a66f31391d tempest-VolumesTransfersTest-1573726027 None] Created volume successfully. Sep 16 15:08:57 devstack cinder-volume[83259]: DEBUG cinder.volume.manager [None req-63219942-d83f-4fa1-825a-94a5bfba8af1 tempest-TestServerVolumeAttachmentScenario-757686503 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5b4dbba3-bab3-42f0-b0ef-63d0fe514abb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-dde63480-6417-458e-9a53-9c562b2718bc', 'volume_size': 1}' {{(pid=83259) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 15:08:57 devstack cinder-volume[83259]: DEBUG cinder.volume.manager [None req-63219942-d83f-4fa1-825a-94a5bfba8af1 tempest-TestServerVolumeAttachmentScenario-757686503 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4376382f-62fe-4401-8f23-c3c1f0722ae1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83259) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 15:08:58 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [None req-1d8e06e6-1f00-47af-8b97-58c5db1a854a tempest-TestServerVolumeAttachmentScenario-757686503 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c/volume-89469ddc-4f11-4f5f-9b33-4ff39e729f69 1073741824" returned: 0 in 0.549s {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 15:08:58 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [None req-1d8e06e6-1f00-47af-8b97-58c5db1a854a tempest-TestServerVolumeAttachmentScenario-757686503 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c/volume-89469ddc-4f11-4f5f-9b33-4ff39e729f69 {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 15:08:58 devstack cinder-volume[83259]: INFO cinder.volume.flows.manager.create_volume [None req-63219942-d83f-4fa1-825a-94a5bfba8af1 tempest-TestServerVolumeAttachmentScenario-757686503 None] Volume volume-dde63480-6417-458e-9a53-9c562b2718bc (dde63480-6417-458e-9a53-9c562b2718bc): created successfully Sep 16 15:08:58 devstack cinder-volume[83259]: DEBUG cinder.volume.manager [None req-63219942-d83f-4fa1-825a-94a5bfba8af1 tempest-TestServerVolumeAttachmentScenario-757686503 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4376382f-62fe-4401-8f23-c3c1f0722ae1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83259) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 15:08:58 devstack cinder-volume[83259]: DEBUG cinder.volume.manager [None req-63219942-d83f-4fa1-825a-94a5bfba8af1 tempest-TestServerVolumeAttachmentScenario-757686503 None] Flow 'volume_create_manager' (cd74fe63-978f-4feb-b52f-501a961bd0b0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83259) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 16 15:08:58 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [None req-1d8e06e6-1f00-47af-8b97-58c5db1a854a tempest-TestServerVolumeAttachmentScenario-757686503 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c/volume-89469ddc-4f11-4f5f-9b33-4ff39e729f69" returned: 0 in 0.568s {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 15:08:58 devstack cinder-volume[83259]: INFO cinder.volume.manager [None req-63219942-d83f-4fa1-825a-94a5bfba8af1 tempest-TestServerVolumeAttachmentScenario-757686503 None] Created volume successfully. Sep 16 15:08:58 devstack cinder-volume[83259]: DEBUG cinder.volume.drivers.quobyte [None req-1d8e06e6-1f00-47af-8b97-58c5db1a854a tempest-TestServerVolumeAttachmentScenario-757686503 None] <== create_volume: return (1160ms) {'provider_location': '10.10.41.181/cinder-vol-61f585ac-f8e2-4d19-a890-7ebc2726cc72'} {{(pid=83259) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Sep 16 15:08:58 devstack cinder-volume[83259]: DEBUG oslo_concurrency.lockutils [None req-1d8e06e6-1f00-47af-8b97-58c5db1a854a tempest-TestServerVolumeAttachmentScenario-757686503 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.170s {{(pid=83259) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 16 15:08:58 devstack cinder-volume[83259]: WARNING cinder.volume.volume_utils [None req-3f37ab39-a72f-449a-9fc2-ed2d1aebd918 tempest-VolumesActionsTest-690774992 None] Volume driver (QuobyteDriver 1.2) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 16 15:08:58 devstack cinder-volume[83259]: DEBUG cinder.coordination [None req-3f37ab39-a72f-449a-9fc2-ed2d1aebd918 tempest-VolumesActionsTest-690774992 None] Acquiring lock "cinder-quobyte-b29ebfc8-8041-4ea7-9e05-e55767574976" by "delete_volume" {{(pid=83259) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 16 15:08:58 devstack cinder-volume[83259]: DEBUG cinder.volume.manager [None req-1d8e06e6-1f00-47af-8b97-58c5db1a854a tempest-TestServerVolumeAttachmentScenario-757686503 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (23872e3b-d91a-46dd-a1d3-cee591fcd5ae) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-89469ddc-4f11-4f5f-9b33-4ff39e729f69', 'volume_size': 1}' {{(pid=83259) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 15:08:58 devstack cinder-volume[83259]: DEBUG cinder.volume.manager [None req-1d8e06e6-1f00-47af-8b97-58c5db1a854a tempest-TestServerVolumeAttachmentScenario-757686503 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5ccea7e5-b9da-407b-9be4-32d870431758) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83259) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 15:08:58 devstack cinder-volume[83259]: DEBUG cinder.coordination [None req-3f37ab39-a72f-449a-9fc2-ed2d1aebd918 tempest-VolumesActionsTest-690774992 None] Lock "cinder-quobyte-b29ebfc8-8041-4ea7-9e05-e55767574976" acquired by "delete_volume" :: waited 0.119s {{(pid=83259) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 16 15:08:58 devstack cinder-volume[83259]: DEBUG cinder.coordination [None req-bb8e78f3-9d8f-4156-b915-558b08ebc512 tempest-VolumesTransfersTest-1284889958 None] Acquiring lock "cinder-03b07204-cf7d-414d-8858-5b7c697a7ca5-delete_volume" by "delete_volume" {{(pid=83259) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 16 15:08:58 devstack cinder-volume[83259]: DEBUG oslo.privsep.daemon [-] privsep: reply[b66e5fd8-e053-4572-931f-15a1cae414f0]: (4, 'qcow2') {{(pid=84312) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 16 15:08:58 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [None req-3f37ab39-a72f-449a-9fc2-ed2d1aebd918 tempest-VolumesActionsTest-690774992 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c/volume-b29ebfc8-8041-4ea7-9e05-e55767574976 {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 15:08:59 devstack cinder-volume[83259]: INFO cinder.volume.flows.manager.create_volume [None req-1d8e06e6-1f00-47af-8b97-58c5db1a854a tempest-TestServerVolumeAttachmentScenario-757686503 None] Volume volume-89469ddc-4f11-4f5f-9b33-4ff39e729f69 (89469ddc-4f11-4f5f-9b33-4ff39e729f69): created successfully Sep 16 15:08:59 devstack cinder-volume[83259]: DEBUG cinder.volume.manager [None req-1d8e06e6-1f00-47af-8b97-58c5db1a854a tempest-TestServerVolumeAttachmentScenario-757686503 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5ccea7e5-b9da-407b-9be4-32d870431758) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83259) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 15:08:59 devstack cinder-volume[83259]: DEBUG cinder.volume.manager [None req-1d8e06e6-1f00-47af-8b97-58c5db1a854a tempest-TestServerVolumeAttachmentScenario-757686503 None] Flow 'volume_create_manager' (e1cf13f5-a723-4ff1-9ac6-e51a78912845) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83259) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 16 15:08:59 devstack cinder-volume[83259]: DEBUG cinder.coordination [None req-bb8e78f3-9d8f-4156-b915-558b08ebc512 tempest-VolumesTransfersTest-1284889958 None] Lock "cinder-03b07204-cf7d-414d-8858-5b7c697a7ca5-delete_volume" acquired by "delete_volume" :: waited 0.504s {{(pid=83259) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 16 15:08:59 devstack cinder-volume[83259]: INFO cinder.volume.manager [None req-1d8e06e6-1f00-47af-8b97-58c5db1a854a tempest-TestServerVolumeAttachmentScenario-757686503 None] Created volume successfully. Sep 16 15:08:59 devstack cinder-volume[83259]: WARNING cinder.volume.volume_utils [None req-bb8e78f3-9d8f-4156-b915-558b08ebc512 tempest-VolumesTransfersTest-1284889958 None] Volume driver (QuobyteDriver 1.2) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 16 15:08:59 devstack cinder-volume[83259]: DEBUG cinder.coordination [None req-bb8e78f3-9d8f-4156-b915-558b08ebc512 tempest-VolumesTransfersTest-1284889958 None] Acquiring lock "cinder-quobyte-03b07204-cf7d-414d-8858-5b7c697a7ca5" by "delete_volume" {{(pid=83259) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 16 15:08:59 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [None req-3f37ab39-a72f-449a-9fc2-ed2d1aebd918 tempest-VolumesActionsTest-690774992 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c/volume-b29ebfc8-8041-4ea7-9e05-e55767574976" returned: 0 in 0.715s {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 15:08:59 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [None req-3f37ab39-a72f-449a-9fc2-ed2d1aebd918 tempest-VolumesActionsTest-690774992 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c/volume-b29ebfc8-8041-4ea7-9e05-e55767574976 {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 15:08:59 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [None req-3f37ab39-a72f-449a-9fc2-ed2d1aebd918 tempest-VolumesActionsTest-690774992 None] CMD "rm -f /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c/volume-b29ebfc8-8041-4ea7-9e05-e55767574976" returned: 0 in 0.247s {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 15:08:59 devstack cinder-volume[83259]: DEBUG cinder.coordination [None req-bb8e78f3-9d8f-4156-b915-558b08ebc512 tempest-VolumesTransfersTest-1284889958 None] Lock "cinder-quobyte-03b07204-cf7d-414d-8858-5b7c697a7ca5" acquired by "delete_volume" :: waited 0.310s {{(pid=83259) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 16 15:08:59 devstack cinder-volume[83259]: DEBUG oslo.privsep.daemon [-] privsep: reply[ffad5658-b466-4c5d-b131-df8f33a8dd0c]: (4, 'qcow2') {{(pid=84312) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 16 15:08:59 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [None req-bb8e78f3-9d8f-4156-b915-558b08ebc512 tempest-VolumesTransfersTest-1284889958 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c/volume-03b07204-cf7d-414d-8858-5b7c697a7ca5 {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 15:09:00 devstack cinder-volume[83259]: DEBUG cinder.coordination [None req-3f37ab39-a72f-449a-9fc2-ed2d1aebd918 tempest-VolumesActionsTest-690774992 None] Lock "cinder-quobyte-b29ebfc8-8041-4ea7-9e05-e55767574976" released by "delete_volume" :: held 1.255s {{(pid=83259) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 16 15:09:00 devstack cinder-volume[83259]: DEBUG cinder.quota [None req-3f37ab39-a72f-449a-9fc2-ed2d1aebd918 tempest-VolumesActionsTest-690774992 None] Created reservations ['69fb3cb9-f480-4192-be7d-b47353fa1103', 'cbc21bbd-2b09-4193-ae58-f07e5368b470', 'ef52e2b7-e3e9-4423-bac3-7c8a5579c5d7', 'f1ffd9c8-a31b-4143-9a8b-1d7c818aad60'] {{(pid=83259) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 16 15:09:00 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [None req-bb8e78f3-9d8f-4156-b915-558b08ebc512 tempest-VolumesTransfersTest-1284889958 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c/volume-03b07204-cf7d-414d-8858-5b7c697a7ca5" returned: 0 in 0.607s {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 15:09:00 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [None req-bb8e78f3-9d8f-4156-b915-558b08ebc512 tempest-VolumesTransfersTest-1284889958 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c/volume-03b07204-cf7d-414d-8858-5b7c697a7ca5 {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 15:09:00 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [None req-bb8e78f3-9d8f-4156-b915-558b08ebc512 tempest-VolumesTransfersTest-1284889958 None] CMD "rm -f /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c/volume-03b07204-cf7d-414d-8858-5b7c697a7ca5" returned: 0 in 0.380s {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 15:09:01 devstack cinder-volume[83259]: DEBUG cinder.coordination [None req-bb8e78f3-9d8f-4156-b915-558b08ebc512 tempest-VolumesTransfersTest-1284889958 None] Lock "cinder-quobyte-03b07204-cf7d-414d-8858-5b7c697a7ca5" released by "delete_volume" :: held 1.130s {{(pid=83259) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 16 15:09:01 devstack cinder-volume[83259]: DEBUG oslo_concurrency.lockutils [None req-3f37ab39-a72f-449a-9fc2-ed2d1aebd918 tempest-VolumesActionsTest-690774992 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83259) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 16 15:09:01 devstack cinder-volume[83259]: DEBUG oslo_concurrency.lockutils [None req-3f37ab39-a72f-449a-9fc2-ed2d1aebd918 tempest-VolumesActionsTest-690774992 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=83259) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 16 15:09:01 devstack cinder-volume[83259]: DEBUG cinder.volume.drivers.quobyte [None req-3f37ab39-a72f-449a-9fc2-ed2d1aebd918 tempest-VolumesActionsTest-690774992 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-61f585ac-f8e2-4d19-a890-7ebc2726cc72': None} {{(pid=83259) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:639}} Sep 16 15:09:01 devstack cinder-volume[83259]: DEBUG cinder.volume.drivers.quobyte [None req-3f37ab39-a72f-449a-9fc2-ed2d1aebd918 tempest-VolumesActionsTest-690774992 None] Available shares ['10.10.41.181/cinder-vol-61f585ac-f8e2-4d19-a890-7ebc2726cc72'] {{(pid=83259) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:669}} Sep 16 15:09:01 devstack cinder-volume[83259]: DEBUG oslo_concurrency.lockutils [None req-3f37ab39-a72f-449a-9fc2-ed2d1aebd918 tempest-VolumesActionsTest-690774992 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=83259) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 16 15:09:01 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [None req-3f37ab39-a72f-449a-9fc2-ed2d1aebd918 tempest-VolumesActionsTest-690774992 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 15:09:01 devstack cinder-volume[83259]: DEBUG cinder.quota [None req-bb8e78f3-9d8f-4156-b915-558b08ebc512 tempest-VolumesTransfersTest-1284889958 None] Created reservations ['15301294-ba82-4a47-acc9-b25062a344bf', '06411c2b-8ca1-4351-8068-55569db414e8', '9a9aed60-e106-4569-88f0-339901c01e50', 'f53d7a65-093d-45ad-b6d5-869a16afdc4f'] {{(pid=83259) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 16 15:09:01 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [None req-3f37ab39-a72f-449a-9fc2-ed2d1aebd918 tempest-VolumesActionsTest-690774992 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c" returned: 0 in 0.279s {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 15:09:01 devstack cinder-volume[83259]: DEBUG cinder.manager [None req-3f37ab39-a72f-449a-9fc2-ed2d1aebd918 tempest-VolumesActionsTest-690774992 None] Notifying Schedulers of capabilities ... {{(pid=83259) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 16 15:09:01 devstack cinder-volume[83259]: INFO cinder.volume.manager [None req-3f37ab39-a72f-449a-9fc2-ed2d1aebd918 tempest-VolumesActionsTest-690774992 None] Deleted volume successfully. Sep 16 15:09:01 devstack cinder-volume[83259]: DEBUG cinder.coordination [None req-3f37ab39-a72f-449a-9fc2-ed2d1aebd918 tempest-VolumesActionsTest-690774992 None] Lock "cinder-b29ebfc8-8041-4ea7-9e05-e55767574976-delete_volume" released by "delete_volume" :: held 3.892s {{(pid=83259) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 16 15:09:01 devstack cinder-volume[83259]: DEBUG oslo_concurrency.lockutils [None req-bb8e78f3-9d8f-4156-b915-558b08ebc512 tempest-VolumesTransfersTest-1284889958 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83259) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 16 15:09:01 devstack cinder-volume[83259]: DEBUG oslo_concurrency.lockutils [None req-bb8e78f3-9d8f-4156-b915-558b08ebc512 tempest-VolumesTransfersTest-1284889958 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=83259) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 16 15:09:01 devstack cinder-volume[83259]: DEBUG cinder.volume.drivers.quobyte [None req-bb8e78f3-9d8f-4156-b915-558b08ebc512 tempest-VolumesTransfersTest-1284889958 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-61f585ac-f8e2-4d19-a890-7ebc2726cc72': None} {{(pid=83259) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:639}} Sep 16 15:09:01 devstack cinder-volume[83259]: DEBUG cinder.volume.drivers.quobyte [None req-bb8e78f3-9d8f-4156-b915-558b08ebc512 tempest-VolumesTransfersTest-1284889958 None] Available shares ['10.10.41.181/cinder-vol-61f585ac-f8e2-4d19-a890-7ebc2726cc72'] {{(pid=83259) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:669}} Sep 16 15:09:01 devstack cinder-volume[83259]: DEBUG oslo_concurrency.lockutils [None req-bb8e78f3-9d8f-4156-b915-558b08ebc512 tempest-VolumesTransfersTest-1284889958 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=83259) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 16 15:09:01 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [None req-bb8e78f3-9d8f-4156-b915-558b08ebc512 tempest-VolumesTransfersTest-1284889958 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 15:09:02 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [None req-bb8e78f3-9d8f-4156-b915-558b08ebc512 tempest-VolumesTransfersTest-1284889958 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c" returned: 0 in 0.310s {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 15:09:02 devstack cinder-volume[83259]: DEBUG cinder.manager [None req-bb8e78f3-9d8f-4156-b915-558b08ebc512 tempest-VolumesTransfersTest-1284889958 None] Notifying Schedulers of capabilities ... {{(pid=83259) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 16 15:09:02 devstack cinder-volume[83259]: INFO cinder.volume.manager [None req-bb8e78f3-9d8f-4156-b915-558b08ebc512 tempest-VolumesTransfersTest-1284889958 None] Deleted volume successfully. Sep 16 15:09:02 devstack cinder-volume[83259]: DEBUG cinder.coordination [None req-bb8e78f3-9d8f-4156-b915-558b08ebc512 tempest-VolumesTransfersTest-1284889958 None] Lock "cinder-03b07204-cf7d-414d-8858-5b7c697a7ca5-delete_volume" released by "delete_volume" :: held 3.370s {{(pid=83259) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 16 15:09:02 devstack cinder-volume[83259]: WARNING cinder.volume.volume_utils [None req-195cbf21-43b1-43df-8167-3ad2c4410772 tempest-VolumesActionsTest-508093061 None] Volume driver (QuobyteDriver 1.2) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 16 15:09:02 devstack cinder-volume[83259]: DEBUG cinder.volume.flows.manager.create_volume [None req-195cbf21-43b1-43df-8167-3ad2c4410772 tempest-VolumesActionsTest-508093061 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#Quobyte'], 'hosts': ['devstack@QuobyteHD#Quobyte']} {{(pid=83259) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1387}} Sep 16 15:09:02 devstack cinder-volume[83259]: DEBUG cinder.volume.manager [None req-195cbf21-43b1-43df-8167-3ad2c4410772 tempest-VolumesActionsTest-508093061 None] Flow 'volume_create_manager' (a5ea9eee-79ce-4264-8527-0bd6e5227ba3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83259) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 16 15:09:02 devstack cinder-volume[83259]: DEBUG cinder.volume.manager [None req-195cbf21-43b1-43df-8167-3ad2c4410772 tempest-VolumesActionsTest-508093061 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (39ad1d55-3053-4927-a313-4bb767fa13fd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83259) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 15:09:02 devstack cinder-volume[83259]: DEBUG cinder.volume.manager [None req-195cbf21-43b1-43df-8167-3ad2c4410772 tempest-VolumesActionsTest-508093061 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (39ad1d55-3053-4927-a313-4bb767fa13fd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-16T13:09:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1588589663',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#Quobyte',id=8cf7211c-f09b-411d-bb61-9b4ff6c92b1b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f76dd0e8e4304d289547abd09461849a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-16T13:09:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-16T13:09:03Z,use_quota=True,user_id='a584ed30e8d24546b164fe840aeb32ec',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(485ead50-3df8-4d76-8d34-a4db136c980a),volume_type_id=485ead50-3df8-4d76-8d34-a4db136c980a)' {{(pid=83259) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 15:09:02 devstack cinder-volume[83259]: DEBUG cinder.volume.manager [None req-195cbf21-43b1-43df-8167-3ad2c4410772 tempest-VolumesActionsTest-508093061 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3fd8dd82-b5d1-413c-a259-5764df74a459) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83259) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 15:09:02 devstack cinder-volume[83259]: DEBUG cinder.volume.manager [None req-195cbf21-43b1-43df-8167-3ad2c4410772 tempest-VolumesActionsTest-508093061 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3fd8dd82-b5d1-413c-a259-5764df74a459) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83259) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 15:09:02 devstack cinder-volume[83259]: DEBUG cinder.volume.manager [None req-195cbf21-43b1-43df-8167-3ad2c4410772 tempest-VolumesActionsTest-508093061 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (709313dd-d68c-47ee-8283-71e9abdcb9f8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83259) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 15:09:02 devstack cinder-volume[83259]: DEBUG cinder.volume.manager [None req-195cbf21-43b1-43df-8167-3ad2c4410772 tempest-VolumesActionsTest-508093061 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (709313dd-d68c-47ee-8283-71e9abdcb9f8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8cf7211c-f09b-411d-bb61-9b4ff6c92b1b', 'volume_name': 'volume-8cf7211c-f09b-411d-bb61-9b4ff6c92b1b', 'volume_size': 1}' {{(pid=83259) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 15:09:02 devstack cinder-volume[83259]: DEBUG cinder.volume.manager [None req-195cbf21-43b1-43df-8167-3ad2c4410772 tempest-VolumesActionsTest-508093061 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1de31be9-928b-4bfc-b436-86c76cb6d0ec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83259) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 15:09:02 devstack cinder-volume[83259]: DEBUG cinder.volume.manager [None req-195cbf21-43b1-43df-8167-3ad2c4410772 tempest-VolumesActionsTest-508093061 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1de31be9-928b-4bfc-b436-86c76cb6d0ec) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83259) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 15:09:02 devstack cinder-volume[83259]: DEBUG cinder.volume.manager [None req-195cbf21-43b1-43df-8167-3ad2c4410772 tempest-VolumesActionsTest-508093061 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5ece5891-4b23-422c-9acc-23aca69b02fc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83259) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 15:09:02 devstack cinder-volume[83259]: INFO cinder.volume.flows.manager.create_volume [None req-195cbf21-43b1-43df-8167-3ad2c4410772 tempest-VolumesActionsTest-508093061 None] Volume 8cf7211c-f09b-411d-bb61-9b4ff6c92b1b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8cf7211c-f09b-411d-bb61-9b4ff6c92b1b', 'volume_size': 1} Sep 16 15:09:02 devstack cinder-volume[83259]: DEBUG oslo_concurrency.lockutils [None req-195cbf21-43b1-43df-8167-3ad2c4410772 tempest-VolumesActionsTest-508093061 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83259) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 16 15:09:02 devstack cinder-volume[83259]: DEBUG oslo_concurrency.lockutils [None req-195cbf21-43b1-43df-8167-3ad2c4410772 tempest-VolumesActionsTest-508093061 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=83259) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 16 15:09:02 devstack cinder-volume[83259]: DEBUG cinder.volume.drivers.quobyte [None req-195cbf21-43b1-43df-8167-3ad2c4410772 tempest-VolumesActionsTest-508093061 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-16T13:09:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1588589663',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#Quobyte',id=8cf7211c-f09b-411d-bb61-9b4ff6c92b1b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f76dd0e8e4304d289547abd09461849a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-16T13:09:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-16T13:09:03Z,use_quota=True,user_id='a584ed30e8d24546b164fe840aeb32ec',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(485ead50-3df8-4d76-8d34-a4db136c980a),volume_type_id=485ead50-3df8-4d76-8d34-a4db136c980a)}" {{(pid=83259) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Sep 16 15:09:02 devstack cinder-volume[83259]: DEBUG cinder.volume.drivers.remotefs [None req-195cbf21-43b1-43df-8167-3ad2c4410772 tempest-VolumesActionsTest-508093061 None] Creating volume 8cf7211c-f09b-411d-bb61-9b4ff6c92b1b {{(pid=83259) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}} Sep 16 15:09:02 devstack cinder-volume[83259]: DEBUG oslo_concurrency.lockutils [None req-195cbf21-43b1-43df-8167-3ad2c4410772 tempest-VolumesActionsTest-508093061 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83259) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 16 15:09:02 devstack cinder-volume[83259]: DEBUG oslo_concurrency.lockutils [None req-195cbf21-43b1-43df-8167-3ad2c4410772 tempest-VolumesActionsTest-508093061 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83259) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 16 15:09:02 devstack cinder-volume[83259]: DEBUG cinder.volume.drivers.quobyte [None req-195cbf21-43b1-43df-8167-3ad2c4410772 tempest-VolumesActionsTest-508093061 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-61f585ac-f8e2-4d19-a890-7ebc2726cc72': None} {{(pid=83259) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:639}} Sep 16 15:09:02 devstack cinder-volume[83259]: DEBUG cinder.volume.drivers.quobyte [None req-195cbf21-43b1-43df-8167-3ad2c4410772 tempest-VolumesActionsTest-508093061 None] Available shares ['10.10.41.181/cinder-vol-61f585ac-f8e2-4d19-a890-7ebc2726cc72'] {{(pid=83259) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:669}} Sep 16 15:09:02 devstack cinder-volume[83259]: DEBUG oslo_concurrency.lockutils [None req-195cbf21-43b1-43df-8167-3ad2c4410772 tempest-VolumesActionsTest-508093061 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=83259) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 16 15:09:02 devstack cinder-volume[83259]: DEBUG cinder.volume.drivers.quobyte [None req-195cbf21-43b1-43df-8167-3ad2c4410772 tempest-VolumesActionsTest-508093061 None] Selected 10.10.41.181/cinder-vol-61f585ac-f8e2-4d19-a890-7ebc2726cc72 as target Quobyte volume. {{(pid=83259) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:690}} Sep 16 15:09:02 devstack cinder-volume[83259]: INFO cinder.volume.drivers.remotefs [None req-195cbf21-43b1-43df-8167-3ad2c4410772 tempest-VolumesActionsTest-508093061 None] casted to 10.10.41.181/cinder-vol-61f585ac-f8e2-4d19-a890-7ebc2726cc72 Sep 16 15:09:02 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [None req-195cbf21-43b1-43df-8167-3ad2c4410772 tempest-VolumesActionsTest-508093061 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c/volume-8cf7211c-f09b-411d-bb61-9b4ff6c92b1b 1073741824 {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 15:09:03 devstack quobyte-client[83286]: System call of process 94757 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 16 15:09:03 devstack quobyte-client[83286]: The server volume:87712ffe-8a69-446d-9ed6-4430c7ee9792@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=87712ffe-8a69-446d-9ed6-4430c7ee9792, inode=89, name=volume-8cf7211c-f09b-411d-bb61-9b4ff6c92b1b, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.206), requestorAccessMask=0 Sep 16 15:09:03 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [None req-195cbf21-43b1-43df-8167-3ad2c4410772 tempest-VolumesActionsTest-508093061 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c/volume-8cf7211c-f09b-411d-bb61-9b4ff6c92b1b 1073741824" returned: 0 in 0.423s {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 15:09:03 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [None req-195cbf21-43b1-43df-8167-3ad2c4410772 tempest-VolumesActionsTest-508093061 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c/volume-8cf7211c-f09b-411d-bb61-9b4ff6c92b1b {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 15:09:03 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [None req-195cbf21-43b1-43df-8167-3ad2c4410772 tempest-VolumesActionsTest-508093061 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c/volume-8cf7211c-f09b-411d-bb61-9b4ff6c92b1b" returned: 0 in 0.117s {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 15:09:03 devstack cinder-volume[83259]: DEBUG cinder.volume.drivers.quobyte [None req-195cbf21-43b1-43df-8167-3ad2c4410772 tempest-VolumesActionsTest-508093061 None] <== create_volume: return (648ms) {'provider_location': '10.10.41.181/cinder-vol-61f585ac-f8e2-4d19-a890-7ebc2726cc72'} {{(pid=83259) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Sep 16 15:09:03 devstack cinder-volume[83259]: DEBUG oslo_concurrency.lockutils [None req-195cbf21-43b1-43df-8167-3ad2c4410772 tempest-VolumesActionsTest-508093061 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.664s {{(pid=83259) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 16 15:09:03 devstack cinder-volume[83259]: DEBUG cinder.volume.manager [None req-195cbf21-43b1-43df-8167-3ad2c4410772 tempest-VolumesActionsTest-508093061 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5ece5891-4b23-422c-9acc-23aca69b02fc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8cf7211c-f09b-411d-bb61-9b4ff6c92b1b', 'volume_size': 1}' {{(pid=83259) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 15:09:03 devstack cinder-volume[83259]: DEBUG cinder.volume.manager [None req-195cbf21-43b1-43df-8167-3ad2c4410772 tempest-VolumesActionsTest-508093061 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (eb518d5d-8f63-408e-ba67-41ed76054fa0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83259) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 15:09:03 devstack cinder-volume[83259]: INFO cinder.volume.flows.manager.create_volume [None req-195cbf21-43b1-43df-8167-3ad2c4410772 tempest-VolumesActionsTest-508093061 None] Volume volume-8cf7211c-f09b-411d-bb61-9b4ff6c92b1b (8cf7211c-f09b-411d-bb61-9b4ff6c92b1b): created successfully Sep 16 15:09:03 devstack cinder-volume[83259]: DEBUG cinder.volume.manager [None req-195cbf21-43b1-43df-8167-3ad2c4410772 tempest-VolumesActionsTest-508093061 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (eb518d5d-8f63-408e-ba67-41ed76054fa0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83259) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 15:09:03 devstack cinder-volume[83259]: DEBUG cinder.volume.manager [None req-195cbf21-43b1-43df-8167-3ad2c4410772 tempest-VolumesActionsTest-508093061 None] Flow 'volume_create_manager' (a5ea9eee-79ce-4264-8527-0bd6e5227ba3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83259) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 16 15:09:03 devstack cinder-volume[83259]: INFO cinder.volume.manager [None req-195cbf21-43b1-43df-8167-3ad2c4410772 tempest-VolumesActionsTest-508093061 None] Created volume successfully. Sep 16 15:09:05 devstack cinder-volume[83259]: DEBUG cinder.coordination [None req-998c35f9-9610-41f5-a701-aacd3a62d6bd tempest-VolumesActionsTest-690774992 None] Acquiring lock "cinder-8cf7211c-f09b-411d-bb61-9b4ff6c92b1b-delete_volume" by "delete_volume" {{(pid=83259) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 16 15:09:05 devstack cinder-volume[83259]: DEBUG cinder.coordination [None req-998c35f9-9610-41f5-a701-aacd3a62d6bd tempest-VolumesActionsTest-690774992 None] Lock "cinder-8cf7211c-f09b-411d-bb61-9b4ff6c92b1b-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=83259) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 16 15:09:05 devstack cinder-volume[83259]: WARNING cinder.volume.volume_utils [None req-998c35f9-9610-41f5-a701-aacd3a62d6bd tempest-VolumesActionsTest-690774992 None] Volume driver (QuobyteDriver 1.2) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 16 15:09:05 devstack cinder-volume[83259]: DEBUG cinder.coordination [None req-998c35f9-9610-41f5-a701-aacd3a62d6bd tempest-VolumesActionsTest-690774992 None] Acquiring lock "cinder-quobyte-8cf7211c-f09b-411d-bb61-9b4ff6c92b1b" by "delete_volume" {{(pid=83259) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 16 15:09:05 devstack cinder-volume[83259]: DEBUG cinder.coordination [None req-998c35f9-9610-41f5-a701-aacd3a62d6bd tempest-VolumesActionsTest-690774992 None] Lock "cinder-quobyte-8cf7211c-f09b-411d-bb61-9b4ff6c92b1b" acquired by "delete_volume" :: waited 0.023s {{(pid=83259) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 16 15:09:05 devstack cinder-volume[83259]: DEBUG oslo.privsep.daemon [-] privsep: reply[ea0a7043-6bcd-45a2-8bf6-c75aaf8c9476]: (4, 'qcow2') {{(pid=84312) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 16 15:09:05 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [None req-998c35f9-9610-41f5-a701-aacd3a62d6bd tempest-VolumesActionsTest-690774992 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c/volume-8cf7211c-f09b-411d-bb61-9b4ff6c92b1b {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 15:09:05 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [None req-998c35f9-9610-41f5-a701-aacd3a62d6bd tempest-VolumesActionsTest-690774992 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c/volume-8cf7211c-f09b-411d-bb61-9b4ff6c92b1b" returned: 0 in 0.549s {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 15:09:05 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [None req-998c35f9-9610-41f5-a701-aacd3a62d6bd tempest-VolumesActionsTest-690774992 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c/volume-8cf7211c-f09b-411d-bb61-9b4ff6c92b1b {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 15:09:06 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [None req-998c35f9-9610-41f5-a701-aacd3a62d6bd tempest-VolumesActionsTest-690774992 None] CMD "rm -f /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c/volume-8cf7211c-f09b-411d-bb61-9b4ff6c92b1b" returned: 0 in 0.148s {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 15:09:06 devstack cinder-volume[83259]: DEBUG cinder.coordination [None req-998c35f9-9610-41f5-a701-aacd3a62d6bd tempest-VolumesActionsTest-690774992 None] Lock "cinder-quobyte-8cf7211c-f09b-411d-bb61-9b4ff6c92b1b" released by "delete_volume" :: held 0.912s {{(pid=83259) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 16 15:09:06 devstack cinder-volume[83259]: DEBUG cinder.quota [None req-998c35f9-9610-41f5-a701-aacd3a62d6bd tempest-VolumesActionsTest-690774992 None] Created reservations ['2b5e0b3a-1053-423a-bd48-d90c87e572cf', '0de1250c-764a-46db-85d4-0d1c97d928fb', 'fbe2315b-724f-47a8-8a30-f8dd5189324e', 'f400f2c2-e1e8-4498-b5df-b0d36c9370ff'] {{(pid=83259) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 16 15:09:07 devstack cinder-volume[83259]: DEBUG oslo_concurrency.lockutils [None req-998c35f9-9610-41f5-a701-aacd3a62d6bd tempest-VolumesActionsTest-690774992 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83259) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 16 15:09:07 devstack cinder-volume[83259]: DEBUG oslo_concurrency.lockutils [None req-998c35f9-9610-41f5-a701-aacd3a62d6bd tempest-VolumesActionsTest-690774992 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=83259) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 16 15:09:07 devstack cinder-volume[83259]: DEBUG cinder.volume.drivers.quobyte [None req-998c35f9-9610-41f5-a701-aacd3a62d6bd tempest-VolumesActionsTest-690774992 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-61f585ac-f8e2-4d19-a890-7ebc2726cc72': None} {{(pid=83259) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:639}} Sep 16 15:09:07 devstack cinder-volume[83259]: DEBUG cinder.volume.drivers.quobyte [None req-998c35f9-9610-41f5-a701-aacd3a62d6bd tempest-VolumesActionsTest-690774992 None] Available shares ['10.10.41.181/cinder-vol-61f585ac-f8e2-4d19-a890-7ebc2726cc72'] {{(pid=83259) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:669}} Sep 16 15:09:07 devstack cinder-volume[83259]: DEBUG oslo_concurrency.lockutils [None req-998c35f9-9610-41f5-a701-aacd3a62d6bd tempest-VolumesActionsTest-690774992 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=83259) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 16 15:09:07 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [None req-998c35f9-9610-41f5-a701-aacd3a62d6bd tempest-VolumesActionsTest-690774992 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 15:09:07 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [None req-998c35f9-9610-41f5-a701-aacd3a62d6bd tempest-VolumesActionsTest-690774992 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c" returned: 0 in 0.127s {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 15:09:07 devstack cinder-volume[83259]: DEBUG cinder.manager [None req-998c35f9-9610-41f5-a701-aacd3a62d6bd tempest-VolumesActionsTest-690774992 None] Notifying Schedulers of capabilities ... {{(pid=83259) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 16 15:09:07 devstack cinder-volume[83259]: INFO cinder.volume.manager [None req-998c35f9-9610-41f5-a701-aacd3a62d6bd tempest-VolumesActionsTest-690774992 None] Deleted volume successfully. Sep 16 15:09:07 devstack cinder-volume[83259]: DEBUG cinder.coordination [None req-998c35f9-9610-41f5-a701-aacd3a62d6bd tempest-VolumesActionsTest-690774992 None] Lock "cinder-8cf7211c-f09b-411d-bb61-9b4ff6c92b1b-delete_volume" released by "delete_volume" :: held 2.715s {{(pid=83259) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 16 15:09:08 devstack cinder-volume[83259]: WARNING cinder.volume.volume_utils [None req-0213570d-17dc-45b0-a29a-03e8bf9157a9 tempest-VolumesActionsTest-508093061 None] Volume driver (QuobyteDriver 1.2) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 16 15:09:08 devstack cinder-volume[83259]: DEBUG cinder.volume.flows.manager.create_volume [None req-0213570d-17dc-45b0-a29a-03e8bf9157a9 tempest-VolumesActionsTest-508093061 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#Quobyte'], 'hosts': ['devstack@QuobyteHD#Quobyte']} {{(pid=83259) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1387}} Sep 16 15:09:09 devstack cinder-volume[83259]: DEBUG cinder.volume.manager [None req-0213570d-17dc-45b0-a29a-03e8bf9157a9 tempest-VolumesActionsTest-508093061 None] Flow 'volume_create_manager' (cbb3d363-10e2-4233-9fc4-5eeef3a59493) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83259) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 16 15:09:09 devstack cinder-volume[83259]: DEBUG cinder.volume.manager [None req-0213570d-17dc-45b0-a29a-03e8bf9157a9 tempest-VolumesActionsTest-508093061 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ff7ab9dc-a39b-4327-9a91-2eed6542607e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83259) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 15:09:09 devstack cinder-volume[83259]: DEBUG cinder.volume.manager [None req-0213570d-17dc-45b0-a29a-03e8bf9157a9 tempest-VolumesActionsTest-508093061 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ff7ab9dc-a39b-4327-9a91-2eed6542607e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-16T13:09:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1053353884',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#Quobyte',id=ed394021-dc38-4afe-b8be-d369a15fd079,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f76dd0e8e4304d289547abd09461849a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-16T13:09:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-16T13:09:09Z,use_quota=True,user_id='a584ed30e8d24546b164fe840aeb32ec',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(485ead50-3df8-4d76-8d34-a4db136c980a),volume_type_id=485ead50-3df8-4d76-8d34-a4db136c980a)' {{(pid=83259) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 15:09:09 devstack cinder-volume[83259]: DEBUG cinder.volume.manager [None req-0213570d-17dc-45b0-a29a-03e8bf9157a9 tempest-VolumesActionsTest-508093061 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (20472834-b1c0-46c2-84de-ccd15a548340) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83259) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 15:09:09 devstack cinder-volume[83259]: DEBUG cinder.volume.manager [None req-0213570d-17dc-45b0-a29a-03e8bf9157a9 tempest-VolumesActionsTest-508093061 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (20472834-b1c0-46c2-84de-ccd15a548340) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83259) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 15:09:09 devstack cinder-volume[83259]: DEBUG cinder.volume.manager [None req-0213570d-17dc-45b0-a29a-03e8bf9157a9 tempest-VolumesActionsTest-508093061 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7bb6ddd7-96ae-4f29-b667-21a5d7177a4c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83259) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 15:09:09 devstack cinder-volume[83259]: DEBUG cinder.volume.manager [None req-0213570d-17dc-45b0-a29a-03e8bf9157a9 tempest-VolumesActionsTest-508093061 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7bb6ddd7-96ae-4f29-b667-21a5d7177a4c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ed394021-dc38-4afe-b8be-d369a15fd079', 'volume_name': 'volume-ed394021-dc38-4afe-b8be-d369a15fd079', 'volume_size': 1}' {{(pid=83259) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 15:09:09 devstack cinder-volume[83259]: DEBUG cinder.volume.manager [None req-0213570d-17dc-45b0-a29a-03e8bf9157a9 tempest-VolumesActionsTest-508093061 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (465e72fb-bece-48b9-a02c-2e3b2b1362fe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83259) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 15:09:09 devstack cinder-volume[83259]: DEBUG cinder.volume.manager [None req-0213570d-17dc-45b0-a29a-03e8bf9157a9 tempest-VolumesActionsTest-508093061 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (465e72fb-bece-48b9-a02c-2e3b2b1362fe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83259) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 15:09:09 devstack cinder-volume[83259]: DEBUG cinder.volume.manager [None req-0213570d-17dc-45b0-a29a-03e8bf9157a9 tempest-VolumesActionsTest-508093061 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (75197abe-8cdf-465e-8dd6-c1b7428696b4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83259) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 15:09:09 devstack cinder-volume[83259]: INFO cinder.volume.flows.manager.create_volume [None req-0213570d-17dc-45b0-a29a-03e8bf9157a9 tempest-VolumesActionsTest-508093061 None] Volume ed394021-dc38-4afe-b8be-d369a15fd079: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ed394021-dc38-4afe-b8be-d369a15fd079', 'volume_size': 1} Sep 16 15:09:09 devstack cinder-volume[83259]: DEBUG oslo_concurrency.lockutils [None req-0213570d-17dc-45b0-a29a-03e8bf9157a9 tempest-VolumesActionsTest-508093061 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83259) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 16 15:09:09 devstack cinder-volume[83259]: DEBUG oslo_concurrency.lockutils [None req-0213570d-17dc-45b0-a29a-03e8bf9157a9 tempest-VolumesActionsTest-508093061 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=83259) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 16 15:09:09 devstack cinder-volume[83259]: DEBUG cinder.volume.drivers.quobyte [None req-0213570d-17dc-45b0-a29a-03e8bf9157a9 tempest-VolumesActionsTest-508093061 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-16T13:09:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1053353884',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#Quobyte',id=ed394021-dc38-4afe-b8be-d369a15fd079,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f76dd0e8e4304d289547abd09461849a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-16T13:09:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-16T13:09:09Z,use_quota=True,user_id='a584ed30e8d24546b164fe840aeb32ec',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(485ead50-3df8-4d76-8d34-a4db136c980a),volume_type_id=485ead50-3df8-4d76-8d34-a4db136c980a)}" {{(pid=83259) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Sep 16 15:09:09 devstack cinder-volume[83259]: DEBUG cinder.volume.drivers.remotefs [None req-0213570d-17dc-45b0-a29a-03e8bf9157a9 tempest-VolumesActionsTest-508093061 None] Creating volume ed394021-dc38-4afe-b8be-d369a15fd079 {{(pid=83259) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}} Sep 16 15:09:09 devstack cinder-volume[83259]: DEBUG oslo_concurrency.lockutils [None req-0213570d-17dc-45b0-a29a-03e8bf9157a9 tempest-VolumesActionsTest-508093061 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83259) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 16 15:09:09 devstack cinder-volume[83259]: DEBUG oslo_concurrency.lockutils [None req-0213570d-17dc-45b0-a29a-03e8bf9157a9 tempest-VolumesActionsTest-508093061 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83259) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 16 15:09:09 devstack cinder-volume[83259]: DEBUG cinder.volume.drivers.quobyte [None req-0213570d-17dc-45b0-a29a-03e8bf9157a9 tempest-VolumesActionsTest-508093061 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-61f585ac-f8e2-4d19-a890-7ebc2726cc72': None} {{(pid=83259) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:639}} Sep 16 15:09:09 devstack cinder-volume[83259]: DEBUG cinder.volume.drivers.quobyte [None req-0213570d-17dc-45b0-a29a-03e8bf9157a9 tempest-VolumesActionsTest-508093061 None] Available shares ['10.10.41.181/cinder-vol-61f585ac-f8e2-4d19-a890-7ebc2726cc72'] {{(pid=83259) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:669}} Sep 16 15:09:09 devstack cinder-volume[83259]: DEBUG oslo_concurrency.lockutils [None req-0213570d-17dc-45b0-a29a-03e8bf9157a9 tempest-VolumesActionsTest-508093061 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=83259) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 16 15:09:09 devstack cinder-volume[83259]: DEBUG cinder.volume.drivers.quobyte [None req-0213570d-17dc-45b0-a29a-03e8bf9157a9 tempest-VolumesActionsTest-508093061 None] Selected 10.10.41.181/cinder-vol-61f585ac-f8e2-4d19-a890-7ebc2726cc72 as target Quobyte volume. {{(pid=83259) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:690}} Sep 16 15:09:09 devstack cinder-volume[83259]: INFO cinder.volume.drivers.remotefs [None req-0213570d-17dc-45b0-a29a-03e8bf9157a9 tempest-VolumesActionsTest-508093061 None] casted to 10.10.41.181/cinder-vol-61f585ac-f8e2-4d19-a890-7ebc2726cc72 Sep 16 15:09:09 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [None req-0213570d-17dc-45b0-a29a-03e8bf9157a9 tempest-VolumesActionsTest-508093061 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c/volume-ed394021-dc38-4afe-b8be-d369a15fd079 1073741824 {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 15:09:09 devstack quobyte-client[83286]: The server volume:87712ffe-8a69-446d-9ed6-4430c7ee9792@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=87712ffe-8a69-446d-9ed6-4430c7ee9792, inode=90, name=volume-ed394021-dc38-4afe-b8be-d369a15fd079, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.206), requestorAccessMask=0 Sep 16 15:09:09 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [None req-0213570d-17dc-45b0-a29a-03e8bf9157a9 tempest-VolumesActionsTest-508093061 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c/volume-ed394021-dc38-4afe-b8be-d369a15fd079 1073741824" returned: 0 in 0.615s {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 15:09:09 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [None req-0213570d-17dc-45b0-a29a-03e8bf9157a9 tempest-VolumesActionsTest-508093061 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c/volume-ed394021-dc38-4afe-b8be-d369a15fd079 {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 15:09:10 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [None req-0213570d-17dc-45b0-a29a-03e8bf9157a9 tempest-VolumesActionsTest-508093061 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c/volume-ed394021-dc38-4afe-b8be-d369a15fd079" returned: 0 in 0.192s {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 15:09:10 devstack cinder-volume[83259]: DEBUG cinder.volume.drivers.quobyte [None req-0213570d-17dc-45b0-a29a-03e8bf9157a9 tempest-VolumesActionsTest-508093061 None] <== create_volume: return (948ms) {'provider_location': '10.10.41.181/cinder-vol-61f585ac-f8e2-4d19-a890-7ebc2726cc72'} {{(pid=83259) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Sep 16 15:09:10 devstack cinder-volume[83259]: DEBUG oslo_concurrency.lockutils [None req-0213570d-17dc-45b0-a29a-03e8bf9157a9 tempest-VolumesActionsTest-508093061 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.978s {{(pid=83259) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 16 15:09:10 devstack cinder-volume[83259]: DEBUG cinder.volume.manager [None req-0213570d-17dc-45b0-a29a-03e8bf9157a9 tempest-VolumesActionsTest-508093061 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (75197abe-8cdf-465e-8dd6-c1b7428696b4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ed394021-dc38-4afe-b8be-d369a15fd079', 'volume_size': 1}' {{(pid=83259) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 15:09:10 devstack cinder-volume[83259]: DEBUG cinder.volume.manager [None req-0213570d-17dc-45b0-a29a-03e8bf9157a9 tempest-VolumesActionsTest-508093061 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (59e994b0-f742-4bca-af2a-f4301f053513) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83259) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 15:09:10 devstack cinder-volume[83259]: INFO cinder.volume.flows.manager.create_volume [None req-0213570d-17dc-45b0-a29a-03e8bf9157a9 tempest-VolumesActionsTest-508093061 None] Volume volume-ed394021-dc38-4afe-b8be-d369a15fd079 (ed394021-dc38-4afe-b8be-d369a15fd079): created successfully Sep 16 15:09:10 devstack cinder-volume[83259]: DEBUG cinder.volume.manager [None req-0213570d-17dc-45b0-a29a-03e8bf9157a9 tempest-VolumesActionsTest-508093061 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (59e994b0-f742-4bca-af2a-f4301f053513) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83259) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 15:09:10 devstack cinder-volume[83259]: DEBUG cinder.volume.manager [None req-0213570d-17dc-45b0-a29a-03e8bf9157a9 tempest-VolumesActionsTest-508093061 None] Flow 'volume_create_manager' (cbb3d363-10e2-4233-9fc4-5eeef3a59493) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83259) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 16 15:09:10 devstack cinder-volume[83259]: INFO cinder.volume.manager [None req-0213570d-17dc-45b0-a29a-03e8bf9157a9 tempest-VolumesActionsTest-508093061 None] Created volume successfully. Sep 16 15:09:11 devstack cinder-volume[83259]: DEBUG cinder.coordination [None req-fdeb62e6-00d5-48aa-9194-6b338b3e7f52 tempest-VolumesActionsTest-690774992 None] Acquiring lock "cinder-ed394021-dc38-4afe-b8be-d369a15fd079-delete_volume" by "delete_volume" {{(pid=83259) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 16 15:09:11 devstack cinder-volume[83259]: DEBUG cinder.coordination [None req-fdeb62e6-00d5-48aa-9194-6b338b3e7f52 tempest-VolumesActionsTest-690774992 None] Lock "cinder-ed394021-dc38-4afe-b8be-d369a15fd079-delete_volume" acquired by "delete_volume" :: waited 0.135s {{(pid=83259) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 16 15:09:11 devstack cinder-volume[83259]: WARNING cinder.volume.volume_utils [None req-fdeb62e6-00d5-48aa-9194-6b338b3e7f52 tempest-VolumesActionsTest-690774992 None] Volume driver (QuobyteDriver 1.2) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 16 15:09:11 devstack cinder-volume[83259]: DEBUG cinder.coordination [None req-fdeb62e6-00d5-48aa-9194-6b338b3e7f52 tempest-VolumesActionsTest-690774992 None] Acquiring lock "cinder-quobyte-ed394021-dc38-4afe-b8be-d369a15fd079" by "delete_volume" {{(pid=83259) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 16 15:09:11 devstack cinder-volume[83259]: DEBUG cinder.coordination [None req-fdeb62e6-00d5-48aa-9194-6b338b3e7f52 tempest-VolumesActionsTest-690774992 None] Lock "cinder-quobyte-ed394021-dc38-4afe-b8be-d369a15fd079" acquired by "delete_volume" :: waited 0.015s {{(pid=83259) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 16 15:09:11 devstack cinder-volume[83259]: DEBUG oslo.privsep.daemon [-] privsep: reply[1c360313-3955-4d1c-925c-a513d7413e9b]: (4, 'qcow2') {{(pid=84312) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 16 15:09:11 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [None req-fdeb62e6-00d5-48aa-9194-6b338b3e7f52 tempest-VolumesActionsTest-690774992 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c/volume-ed394021-dc38-4afe-b8be-d369a15fd079 {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 15:09:12 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [None req-fdeb62e6-00d5-48aa-9194-6b338b3e7f52 tempest-VolumesActionsTest-690774992 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c/volume-ed394021-dc38-4afe-b8be-d369a15fd079" returned: 0 in 0.495s {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 15:09:12 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [None req-fdeb62e6-00d5-48aa-9194-6b338b3e7f52 tempest-VolumesActionsTest-690774992 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c/volume-ed394021-dc38-4afe-b8be-d369a15fd079 {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 15:09:12 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [None req-fdeb62e6-00d5-48aa-9194-6b338b3e7f52 tempest-VolumesActionsTest-690774992 None] CMD "rm -f /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c/volume-ed394021-dc38-4afe-b8be-d369a15fd079" returned: 0 in 0.107s {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 15:09:12 devstack cinder-volume[83259]: DEBUG cinder.coordination [None req-fdeb62e6-00d5-48aa-9194-6b338b3e7f52 tempest-VolumesActionsTest-690774992 None] Lock "cinder-quobyte-ed394021-dc38-4afe-b8be-d369a15fd079" released by "delete_volume" :: held 0.810s {{(pid=83259) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 16 15:09:12 devstack cinder-volume[83259]: DEBUG dbcounter [-] [83259] Writing DB stats cinder:UPDATE=99,cinder:DELETE=9,cinder:INSERT=21,cinder:SELECT=64 {{(pid=83259) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Sep 16 15:09:12 devstack cinder-volume[83259]: DEBUG dbcounter [-] [83259] Writing DB stats cinder:SELECT=66,cinder:UPDATE=87,cinder:INSERT=17,cinder:DELETE=9 {{(pid=83259) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Sep 16 15:09:12 devstack cinder-volume[83259]: DEBUG cinder.quota [None req-fdeb62e6-00d5-48aa-9194-6b338b3e7f52 tempest-VolumesActionsTest-690774992 None] Created reservations ['e09ba453-8ba6-4dee-a5b3-eb27ff6647db', '13b95034-8e5e-41f0-9de1-8a4a6653077f', '258e3324-47e0-4fdc-af4c-19c80d462c74', 'ac5bfb8b-781d-4f51-b42b-d8c62f3cc8c9'] {{(pid=83259) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 16 15:09:13 devstack cinder-volume[83259]: DEBUG oslo_concurrency.lockutils [None req-fdeb62e6-00d5-48aa-9194-6b338b3e7f52 tempest-VolumesActionsTest-690774992 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83259) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 16 15:09:13 devstack cinder-volume[83259]: DEBUG oslo_concurrency.lockutils [None req-fdeb62e6-00d5-48aa-9194-6b338b3e7f52 tempest-VolumesActionsTest-690774992 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=83259) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 16 15:09:13 devstack cinder-volume[83259]: DEBUG cinder.volume.drivers.quobyte [None req-fdeb62e6-00d5-48aa-9194-6b338b3e7f52 tempest-VolumesActionsTest-690774992 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-61f585ac-f8e2-4d19-a890-7ebc2726cc72': None} {{(pid=83259) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:639}} Sep 16 15:09:13 devstack cinder-volume[83259]: DEBUG cinder.volume.drivers.quobyte [None req-fdeb62e6-00d5-48aa-9194-6b338b3e7f52 tempest-VolumesActionsTest-690774992 None] Available shares ['10.10.41.181/cinder-vol-61f585ac-f8e2-4d19-a890-7ebc2726cc72'] {{(pid=83259) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:669}} Sep 16 15:09:13 devstack cinder-volume[83259]: DEBUG oslo_concurrency.lockutils [None req-fdeb62e6-00d5-48aa-9194-6b338b3e7f52 tempest-VolumesActionsTest-690774992 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=83259) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 16 15:09:13 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [None req-fdeb62e6-00d5-48aa-9194-6b338b3e7f52 tempest-VolumesActionsTest-690774992 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 15:09:13 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [None req-fdeb62e6-00d5-48aa-9194-6b338b3e7f52 tempest-VolumesActionsTest-690774992 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c" returned: 0 in 0.172s {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 15:09:13 devstack cinder-volume[83259]: DEBUG cinder.manager [None req-fdeb62e6-00d5-48aa-9194-6b338b3e7f52 tempest-VolumesActionsTest-690774992 None] Notifying Schedulers of capabilities ... {{(pid=83259) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 16 15:09:13 devstack cinder-volume[83259]: INFO cinder.volume.manager [None req-fdeb62e6-00d5-48aa-9194-6b338b3e7f52 tempest-VolumesActionsTest-690774992 None] Deleted volume successfully. Sep 16 15:09:13 devstack cinder-volume[83259]: DEBUG cinder.coordination [None req-fdeb62e6-00d5-48aa-9194-6b338b3e7f52 tempest-VolumesActionsTest-690774992 None] Lock "cinder-ed394021-dc38-4afe-b8be-d369a15fd079-delete_volume" released by "delete_volume" :: held 2.451s {{(pid=83259) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 16 15:09:14 devstack cinder-volume[83259]: WARNING cinder.volume.volume_utils [None req-9e55cfb5-ce85-4229-bc7d-b7c4f8aefb86 tempest-VolumesActionsTest-508093061 None] Volume driver (QuobyteDriver 1.2) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 16 15:09:14 devstack cinder-volume[83259]: DEBUG cinder.volume.flows.manager.create_volume [None req-9e55cfb5-ce85-4229-bc7d-b7c4f8aefb86 tempest-VolumesActionsTest-508093061 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#Quobyte'], 'hosts': ['devstack@QuobyteHD#Quobyte']} {{(pid=83259) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1387}} Sep 16 15:09:14 devstack cinder-volume[83259]: DEBUG cinder.volume.manager [None req-9e55cfb5-ce85-4229-bc7d-b7c4f8aefb86 tempest-VolumesActionsTest-508093061 None] Flow 'volume_create_manager' (2509292f-9b3d-4d03-942d-e10c099b1eaa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83259) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 16 15:09:14 devstack cinder-volume[83259]: DEBUG cinder.volume.manager [None req-9e55cfb5-ce85-4229-bc7d-b7c4f8aefb86 tempest-VolumesActionsTest-508093061 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (70f4fe90-c015-4e53-bbdc-3f6c7857570e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83259) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 15:09:14 devstack cinder-volume[83259]: DEBUG cinder.volume.manager [None req-9e55cfb5-ce85-4229-bc7d-b7c4f8aefb86 tempest-VolumesActionsTest-508093061 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (70f4fe90-c015-4e53-bbdc-3f6c7857570e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-16T13:09:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1884977940',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#Quobyte',id=b1b6ef82-9936-4262-bd8d-0331eb314efa,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f76dd0e8e4304d289547abd09461849a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-16T13:09:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-16T13:09:14Z,use_quota=True,user_id='a584ed30e8d24546b164fe840aeb32ec',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(485ead50-3df8-4d76-8d34-a4db136c980a),volume_type_id=485ead50-3df8-4d76-8d34-a4db136c980a)' {{(pid=83259) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 15:09:14 devstack cinder-volume[83259]: DEBUG cinder.volume.manager [None req-9e55cfb5-ce85-4229-bc7d-b7c4f8aefb86 tempest-VolumesActionsTest-508093061 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (39dc4a21-5c95-43fd-855c-a5a0b10173a2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83259) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 15:09:14 devstack cinder-volume[83259]: DEBUG cinder.volume.manager [None req-9e55cfb5-ce85-4229-bc7d-b7c4f8aefb86 tempest-VolumesActionsTest-508093061 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (39dc4a21-5c95-43fd-855c-a5a0b10173a2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83259) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 15:09:14 devstack cinder-volume[83259]: DEBUG cinder.volume.manager [None req-9e55cfb5-ce85-4229-bc7d-b7c4f8aefb86 tempest-VolumesActionsTest-508093061 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (494a4885-fbdc-48df-bba3-f427c7271e32) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83259) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 15:09:14 devstack cinder-volume[83259]: DEBUG cinder.volume.manager [None req-9e55cfb5-ce85-4229-bc7d-b7c4f8aefb86 tempest-VolumesActionsTest-508093061 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (494a4885-fbdc-48df-bba3-f427c7271e32) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b1b6ef82-9936-4262-bd8d-0331eb314efa', 'volume_name': 'volume-b1b6ef82-9936-4262-bd8d-0331eb314efa', 'volume_size': 1}' {{(pid=83259) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 15:09:14 devstack cinder-volume[83259]: DEBUG cinder.volume.manager [None req-9e55cfb5-ce85-4229-bc7d-b7c4f8aefb86 tempest-VolumesActionsTest-508093061 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1073703d-3964-4dd2-a50d-811aa3f9b8a5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83259) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 15:09:14 devstack cinder-volume[83259]: DEBUG cinder.volume.manager [None req-9e55cfb5-ce85-4229-bc7d-b7c4f8aefb86 tempest-VolumesActionsTest-508093061 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1073703d-3964-4dd2-a50d-811aa3f9b8a5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83259) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 15:09:14 devstack cinder-volume[83259]: DEBUG cinder.volume.manager [None req-9e55cfb5-ce85-4229-bc7d-b7c4f8aefb86 tempest-VolumesActionsTest-508093061 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cbd0f14a-8e6c-43cd-bf80-4a17a6a23d43) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83259) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 15:09:14 devstack cinder-volume[83259]: INFO cinder.volume.flows.manager.create_volume [None req-9e55cfb5-ce85-4229-bc7d-b7c4f8aefb86 tempest-VolumesActionsTest-508093061 None] Volume b1b6ef82-9936-4262-bd8d-0331eb314efa: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b1b6ef82-9936-4262-bd8d-0331eb314efa', 'volume_size': 1} Sep 16 15:09:14 devstack cinder-volume[83259]: DEBUG oslo_concurrency.lockutils [None req-9e55cfb5-ce85-4229-bc7d-b7c4f8aefb86 tempest-VolumesActionsTest-508093061 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83259) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 16 15:09:14 devstack cinder-volume[83259]: DEBUG oslo_concurrency.lockutils [None req-9e55cfb5-ce85-4229-bc7d-b7c4f8aefb86 tempest-VolumesActionsTest-508093061 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=83259) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 16 15:09:14 devstack cinder-volume[83259]: DEBUG cinder.volume.drivers.quobyte [None req-9e55cfb5-ce85-4229-bc7d-b7c4f8aefb86 tempest-VolumesActionsTest-508093061 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-16T13:09:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1884977940',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#Quobyte',id=b1b6ef82-9936-4262-bd8d-0331eb314efa,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f76dd0e8e4304d289547abd09461849a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-16T13:09:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-16T13:09:14Z,use_quota=True,user_id='a584ed30e8d24546b164fe840aeb32ec',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(485ead50-3df8-4d76-8d34-a4db136c980a),volume_type_id=485ead50-3df8-4d76-8d34-a4db136c980a)}" {{(pid=83259) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Sep 16 15:09:14 devstack cinder-volume[83259]: DEBUG cinder.volume.drivers.remotefs [None req-9e55cfb5-ce85-4229-bc7d-b7c4f8aefb86 tempest-VolumesActionsTest-508093061 None] Creating volume b1b6ef82-9936-4262-bd8d-0331eb314efa {{(pid=83259) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}} Sep 16 15:09:14 devstack cinder-volume[83259]: DEBUG oslo_concurrency.lockutils [None req-9e55cfb5-ce85-4229-bc7d-b7c4f8aefb86 tempest-VolumesActionsTest-508093061 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83259) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 16 15:09:14 devstack cinder-volume[83259]: DEBUG oslo_concurrency.lockutils [None req-9e55cfb5-ce85-4229-bc7d-b7c4f8aefb86 tempest-VolumesActionsTest-508093061 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83259) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 16 15:09:14 devstack cinder-volume[83259]: DEBUG cinder.volume.drivers.quobyte [None req-9e55cfb5-ce85-4229-bc7d-b7c4f8aefb86 tempest-VolumesActionsTest-508093061 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-61f585ac-f8e2-4d19-a890-7ebc2726cc72': None} {{(pid=83259) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:639}} Sep 16 15:09:14 devstack cinder-volume[83259]: DEBUG cinder.volume.drivers.quobyte [None req-9e55cfb5-ce85-4229-bc7d-b7c4f8aefb86 tempest-VolumesActionsTest-508093061 None] Available shares ['10.10.41.181/cinder-vol-61f585ac-f8e2-4d19-a890-7ebc2726cc72'] {{(pid=83259) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:669}} Sep 16 15:09:14 devstack cinder-volume[83259]: DEBUG oslo_concurrency.lockutils [None req-9e55cfb5-ce85-4229-bc7d-b7c4f8aefb86 tempest-VolumesActionsTest-508093061 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=83259) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 16 15:09:14 devstack cinder-volume[83259]: DEBUG cinder.volume.drivers.quobyte [None req-9e55cfb5-ce85-4229-bc7d-b7c4f8aefb86 tempest-VolumesActionsTest-508093061 None] Selected 10.10.41.181/cinder-vol-61f585ac-f8e2-4d19-a890-7ebc2726cc72 as target Quobyte volume. {{(pid=83259) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:690}} Sep 16 15:09:14 devstack cinder-volume[83259]: INFO cinder.volume.drivers.remotefs [None req-9e55cfb5-ce85-4229-bc7d-b7c4f8aefb86 tempest-VolumesActionsTest-508093061 None] casted to 10.10.41.181/cinder-vol-61f585ac-f8e2-4d19-a890-7ebc2726cc72 Sep 16 15:09:14 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [None req-9e55cfb5-ce85-4229-bc7d-b7c4f8aefb86 tempest-VolumesActionsTest-508093061 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c/volume-b1b6ef82-9936-4262-bd8d-0331eb314efa 1073741824 {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 15:09:14 devstack quobyte-client[83286]: System call of process 94794 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 16 15:09:14 devstack cinder-volume[83259]: WARNING cinder.volume.volume_utils [None req-f06848e1-76c0-4357-b4ad-4f5137e699f8 tempest-VolumesTransfersV355Test-1122864685 None] Volume driver (QuobyteDriver 1.2) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 16 15:09:15 devstack quobyte-client[83286]: The server volume:87712ffe-8a69-446d-9ed6-4430c7ee9792@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=87712ffe-8a69-446d-9ed6-4430c7ee9792, inode=91, name=volume-b1b6ef82-9936-4262-bd8d-0331eb314efa, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.206), requestorAccessMask=0 Sep 16 15:09:15 devstack cinder-volume[83259]: DEBUG cinder.volume.flows.manager.create_volume [None req-f06848e1-76c0-4357-b4ad-4f5137e699f8 tempest-VolumesTransfersV355Test-1122864685 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#Quobyte'], 'hosts': ['devstack@QuobyteHD#Quobyte']} {{(pid=83259) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1387}} Sep 16 15:09:15 devstack cinder-volume[83259]: DEBUG cinder.volume.manager [None req-f06848e1-76c0-4357-b4ad-4f5137e699f8 tempest-VolumesTransfersV355Test-1122864685 None] Flow 'volume_create_manager' (334d9734-5b19-4417-85de-eb5b3dbd87f5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83259) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 16 15:09:15 devstack cinder-volume[83259]: DEBUG cinder.volume.manager [None req-f06848e1-76c0-4357-b4ad-4f5137e699f8 tempest-VolumesTransfersV355Test-1122864685 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (77fbfcc7-7bbf-4c12-831e-d675cc8cb54a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83259) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 15:09:15 devstack cinder-volume[83259]: DEBUG cinder.volume.manager [None req-f06848e1-76c0-4357-b4ad-4f5137e699f8 tempest-VolumesTransfersV355Test-1122864685 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (77fbfcc7-7bbf-4c12-831e-d675cc8cb54a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-16T13:09:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-1935109604',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#Quobyte',id=4c6ab68a-ab39-42a1-92d0-13765e70193f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4fb935e5a18440d6a46fee42610dd375',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-16T13:09:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-16T13:09:15Z,use_quota=True,user_id='f584ab00bb9c4ce09be69a573a3d06b2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(485ead50-3df8-4d76-8d34-a4db136c980a),volume_type_id=485ead50-3df8-4d76-8d34-a4db136c980a)' {{(pid=83259) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 15:09:15 devstack cinder-volume[83259]: DEBUG cinder.volume.manager [None req-f06848e1-76c0-4357-b4ad-4f5137e699f8 tempest-VolumesTransfersV355Test-1122864685 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (30d6f0e4-e9c5-40d0-b1f7-84688d9a9228) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83259) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 15:09:15 devstack cinder-volume[83259]: DEBUG cinder.volume.manager [None req-f06848e1-76c0-4357-b4ad-4f5137e699f8 tempest-VolumesTransfersV355Test-1122864685 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (30d6f0e4-e9c5-40d0-b1f7-84688d9a9228) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83259) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 15:09:15 devstack cinder-volume[83259]: DEBUG cinder.volume.manager [None req-f06848e1-76c0-4357-b4ad-4f5137e699f8 tempest-VolumesTransfersV355Test-1122864685 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (195a1b87-6c4b-4092-b65f-d41ef89a538b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83259) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 15:09:15 devstack cinder-volume[83259]: DEBUG cinder.volume.manager [None req-f06848e1-76c0-4357-b4ad-4f5137e699f8 tempest-VolumesTransfersV355Test-1122864685 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (195a1b87-6c4b-4092-b65f-d41ef89a538b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4c6ab68a-ab39-42a1-92d0-13765e70193f', 'volume_name': 'volume-4c6ab68a-ab39-42a1-92d0-13765e70193f', 'volume_size': 1}' {{(pid=83259) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 15:09:15 devstack cinder-volume[83259]: DEBUG cinder.volume.manager [None req-f06848e1-76c0-4357-b4ad-4f5137e699f8 tempest-VolumesTransfersV355Test-1122864685 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (63cb5959-6ba2-4a3f-8725-8b7fdcb91e53) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83259) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 15:09:15 devstack cinder-volume[83259]: DEBUG cinder.volume.manager [None req-f06848e1-76c0-4357-b4ad-4f5137e699f8 tempest-VolumesTransfersV355Test-1122864685 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (63cb5959-6ba2-4a3f-8725-8b7fdcb91e53) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83259) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 15:09:15 devstack cinder-volume[83259]: DEBUG cinder.volume.manager [None req-f06848e1-76c0-4357-b4ad-4f5137e699f8 tempest-VolumesTransfersV355Test-1122864685 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (981564e6-6b1e-4c4e-9c28-a43fbe894352) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83259) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 15:09:15 devstack cinder-volume[83259]: INFO cinder.volume.flows.manager.create_volume [None req-f06848e1-76c0-4357-b4ad-4f5137e699f8 tempest-VolumesTransfersV355Test-1122864685 None] Volume 4c6ab68a-ab39-42a1-92d0-13765e70193f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4c6ab68a-ab39-42a1-92d0-13765e70193f', 'volume_size': 1} Sep 16 15:09:15 devstack cinder-volume[83259]: DEBUG oslo_concurrency.lockutils [None req-f06848e1-76c0-4357-b4ad-4f5137e699f8 tempest-VolumesTransfersV355Test-1122864685 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83259) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 16 15:09:15 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [None req-9e55cfb5-ce85-4229-bc7d-b7c4f8aefb86 tempest-VolumesActionsTest-508093061 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c/volume-b1b6ef82-9936-4262-bd8d-0331eb314efa 1073741824" returned: 0 in 0.569s {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 15:09:15 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [None req-9e55cfb5-ce85-4229-bc7d-b7c4f8aefb86 tempest-VolumesActionsTest-508093061 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c/volume-b1b6ef82-9936-4262-bd8d-0331eb314efa {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 15:09:15 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [None req-9e55cfb5-ce85-4229-bc7d-b7c4f8aefb86 tempest-VolumesActionsTest-508093061 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c/volume-b1b6ef82-9936-4262-bd8d-0331eb314efa" returned: 0 in 0.109s {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 15:09:15 devstack cinder-volume[83259]: DEBUG cinder.volume.drivers.quobyte [None req-9e55cfb5-ce85-4229-bc7d-b7c4f8aefb86 tempest-VolumesActionsTest-508093061 None] <== create_volume: return (732ms) {'provider_location': '10.10.41.181/cinder-vol-61f585ac-f8e2-4d19-a890-7ebc2726cc72'} {{(pid=83259) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Sep 16 15:09:15 devstack cinder-volume[83259]: DEBUG oslo_concurrency.lockutils [None req-9e55cfb5-ce85-4229-bc7d-b7c4f8aefb86 tempest-VolumesActionsTest-508093061 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.757s {{(pid=83259) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 16 15:09:15 devstack cinder-volume[83259]: DEBUG oslo_concurrency.lockutils [None req-f06848e1-76c0-4357-b4ad-4f5137e699f8 tempest-VolumesTransfersV355Test-1122864685 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.306s {{(pid=83259) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 16 15:09:15 devstack cinder-volume[83259]: DEBUG cinder.volume.drivers.quobyte [None req-f06848e1-76c0-4357-b4ad-4f5137e699f8 tempest-VolumesTransfersV355Test-1122864685 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-16T13:09:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-1935109604',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#Quobyte',id=4c6ab68a-ab39-42a1-92d0-13765e70193f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4fb935e5a18440d6a46fee42610dd375',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-16T13:09:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-16T13:09:15Z,use_quota=True,user_id='f584ab00bb9c4ce09be69a573a3d06b2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(485ead50-3df8-4d76-8d34-a4db136c980a),volume_type_id=485ead50-3df8-4d76-8d34-a4db136c980a)}" {{(pid=83259) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Sep 16 15:09:15 devstack cinder-volume[83259]: DEBUG cinder.volume.drivers.remotefs [None req-f06848e1-76c0-4357-b4ad-4f5137e699f8 tempest-VolumesTransfersV355Test-1122864685 None] Creating volume 4c6ab68a-ab39-42a1-92d0-13765e70193f {{(pid=83259) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}} Sep 16 15:09:15 devstack cinder-volume[83259]: DEBUG oslo_concurrency.lockutils [None req-f06848e1-76c0-4357-b4ad-4f5137e699f8 tempest-VolumesTransfersV355Test-1122864685 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83259) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 16 15:09:15 devstack cinder-volume[83259]: DEBUG oslo_concurrency.lockutils [None req-f06848e1-76c0-4357-b4ad-4f5137e699f8 tempest-VolumesTransfersV355Test-1122864685 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=83259) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 16 15:09:15 devstack cinder-volume[83259]: DEBUG cinder.volume.drivers.quobyte [None req-f06848e1-76c0-4357-b4ad-4f5137e699f8 tempest-VolumesTransfersV355Test-1122864685 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-61f585ac-f8e2-4d19-a890-7ebc2726cc72': None} {{(pid=83259) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:639}} Sep 16 15:09:15 devstack cinder-volume[83259]: DEBUG cinder.volume.drivers.quobyte [None req-f06848e1-76c0-4357-b4ad-4f5137e699f8 tempest-VolumesTransfersV355Test-1122864685 None] Available shares ['10.10.41.181/cinder-vol-61f585ac-f8e2-4d19-a890-7ebc2726cc72'] {{(pid=83259) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:669}} Sep 16 15:09:15 devstack cinder-volume[83259]: DEBUG oslo_concurrency.lockutils [None req-f06848e1-76c0-4357-b4ad-4f5137e699f8 tempest-VolumesTransfersV355Test-1122864685 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=83259) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 16 15:09:15 devstack cinder-volume[83259]: DEBUG cinder.volume.drivers.quobyte [None req-f06848e1-76c0-4357-b4ad-4f5137e699f8 tempest-VolumesTransfersV355Test-1122864685 None] Selected 10.10.41.181/cinder-vol-61f585ac-f8e2-4d19-a890-7ebc2726cc72 as target Quobyte volume. {{(pid=83259) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:690}} Sep 16 15:09:15 devstack cinder-volume[83259]: INFO cinder.volume.drivers.remotefs [None req-f06848e1-76c0-4357-b4ad-4f5137e699f8 tempest-VolumesTransfersV355Test-1122864685 None] casted to 10.10.41.181/cinder-vol-61f585ac-f8e2-4d19-a890-7ebc2726cc72 Sep 16 15:09:15 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [None req-f06848e1-76c0-4357-b4ad-4f5137e699f8 tempest-VolumesTransfersV355Test-1122864685 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c/volume-4c6ab68a-ab39-42a1-92d0-13765e70193f 1073741824 {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 15:09:15 devstack quobyte-client[83286]: The server volume:87712ffe-8a69-446d-9ed6-4430c7ee9792@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=87712ffe-8a69-446d-9ed6-4430c7ee9792, inode=92, name=volume-4c6ab68a-ab39-42a1-92d0-13765e70193f, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.206), requestorAccessMask=0 Sep 16 15:09:15 devstack cinder-volume[83259]: DEBUG cinder.volume.manager [None req-9e55cfb5-ce85-4229-bc7d-b7c4f8aefb86 tempest-VolumesActionsTest-508093061 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cbd0f14a-8e6c-43cd-bf80-4a17a6a23d43) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b1b6ef82-9936-4262-bd8d-0331eb314efa', 'volume_size': 1}' {{(pid=83259) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 15:09:15 devstack cinder-volume[83259]: DEBUG cinder.volume.manager [None req-9e55cfb5-ce85-4229-bc7d-b7c4f8aefb86 tempest-VolumesActionsTest-508093061 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (357c4220-489b-4f7f-b76d-0c793285363c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83259) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 15:09:16 devstack cinder-volume[83259]: INFO cinder.volume.flows.manager.create_volume [None req-9e55cfb5-ce85-4229-bc7d-b7c4f8aefb86 tempest-VolumesActionsTest-508093061 None] Volume volume-b1b6ef82-9936-4262-bd8d-0331eb314efa (b1b6ef82-9936-4262-bd8d-0331eb314efa): created successfully Sep 16 15:09:16 devstack cinder-volume[83259]: DEBUG cinder.volume.manager [None req-9e55cfb5-ce85-4229-bc7d-b7c4f8aefb86 tempest-VolumesActionsTest-508093061 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (357c4220-489b-4f7f-b76d-0c793285363c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83259) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 15:09:16 devstack cinder-volume[83259]: DEBUG cinder.volume.manager [None req-9e55cfb5-ce85-4229-bc7d-b7c4f8aefb86 tempest-VolumesActionsTest-508093061 None] Flow 'volume_create_manager' (2509292f-9b3d-4d03-942d-e10c099b1eaa) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83259) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 16 15:09:16 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [None req-f06848e1-76c0-4357-b4ad-4f5137e699f8 tempest-VolumesTransfersV355Test-1122864685 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c/volume-4c6ab68a-ab39-42a1-92d0-13765e70193f 1073741824" returned: 0 in 0.483s {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 15:09:16 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [None req-f06848e1-76c0-4357-b4ad-4f5137e699f8 tempest-VolumesTransfersV355Test-1122864685 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c/volume-4c6ab68a-ab39-42a1-92d0-13765e70193f {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 15:09:16 devstack cinder-volume[83259]: INFO cinder.volume.manager [None req-9e55cfb5-ce85-4229-bc7d-b7c4f8aefb86 tempest-VolumesActionsTest-508093061 None] Created volume successfully. Sep 16 15:09:16 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [None req-f06848e1-76c0-4357-b4ad-4f5137e699f8 tempest-VolumesTransfersV355Test-1122864685 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c/volume-4c6ab68a-ab39-42a1-92d0-13765e70193f" returned: 0 in 0.297s {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 15:09:16 devstack cinder-volume[83259]: DEBUG cinder.volume.drivers.quobyte [None req-f06848e1-76c0-4357-b4ad-4f5137e699f8 tempest-VolumesTransfersV355Test-1122864685 None] <== create_volume: return (812ms) {'provider_location': '10.10.41.181/cinder-vol-61f585ac-f8e2-4d19-a890-7ebc2726cc72'} {{(pid=83259) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Sep 16 15:09:16 devstack cinder-volume[83259]: DEBUG oslo_concurrency.lockutils [None req-f06848e1-76c0-4357-b4ad-4f5137e699f8 tempest-VolumesTransfersV355Test-1122864685 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.844s {{(pid=83259) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 16 15:09:16 devstack cinder-volume[83259]: DEBUG cinder.volume.manager [None req-f06848e1-76c0-4357-b4ad-4f5137e699f8 tempest-VolumesTransfersV355Test-1122864685 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (981564e6-6b1e-4c4e-9c28-a43fbe894352) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4c6ab68a-ab39-42a1-92d0-13765e70193f', 'volume_size': 1}' {{(pid=83259) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 15:09:16 devstack cinder-volume[83259]: DEBUG cinder.volume.manager [None req-f06848e1-76c0-4357-b4ad-4f5137e699f8 tempest-VolumesTransfersV355Test-1122864685 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (be3870aa-ab4b-4908-9b99-b332b72a9fcd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83259) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 15:09:16 devstack cinder-volume[83259]: INFO cinder.volume.flows.manager.create_volume [None req-f06848e1-76c0-4357-b4ad-4f5137e699f8 tempest-VolumesTransfersV355Test-1122864685 None] Volume volume-4c6ab68a-ab39-42a1-92d0-13765e70193f (4c6ab68a-ab39-42a1-92d0-13765e70193f): created successfully Sep 16 15:09:16 devstack cinder-volume[83259]: DEBUG cinder.volume.manager [None req-f06848e1-76c0-4357-b4ad-4f5137e699f8 tempest-VolumesTransfersV355Test-1122864685 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (be3870aa-ab4b-4908-9b99-b332b72a9fcd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83259) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 15:09:16 devstack cinder-volume[83259]: DEBUG cinder.volume.manager [None req-f06848e1-76c0-4357-b4ad-4f5137e699f8 tempest-VolumesTransfersV355Test-1122864685 None] Flow 'volume_create_manager' (334d9734-5b19-4417-85de-eb5b3dbd87f5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83259) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 16 15:09:17 devstack cinder-volume[83259]: INFO cinder.volume.manager [None req-f06848e1-76c0-4357-b4ad-4f5137e699f8 tempest-VolumesTransfersV355Test-1122864685 None] Created volume successfully. Sep 16 15:09:18 devstack cinder-volume[83259]: DEBUG cinder.coordination [None req-a54c3470-98c1-49bc-8dd0-9d075c4c4444 tempest-VolumesActionsTest-508093061 None] Acquiring lock "cinder-b1b6ef82-9936-4262-bd8d-0331eb314efa-delete_volume" by "delete_volume" {{(pid=83259) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 16 15:09:18 devstack cinder-volume[83259]: DEBUG cinder.coordination [None req-a54c3470-98c1-49bc-8dd0-9d075c4c4444 tempest-VolumesActionsTest-508093061 None] Lock "cinder-b1b6ef82-9936-4262-bd8d-0331eb314efa-delete_volume" acquired by "delete_volume" :: waited 0.090s {{(pid=83259) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 16 15:09:18 devstack cinder-volume[83259]: WARNING cinder.volume.volume_utils [None req-a54c3470-98c1-49bc-8dd0-9d075c4c4444 tempest-VolumesActionsTest-508093061 None] Volume driver (QuobyteDriver 1.2) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 16 15:09:18 devstack cinder-volume[83259]: DEBUG cinder.coordination [None req-a54c3470-98c1-49bc-8dd0-9d075c4c4444 tempest-VolumesActionsTest-508093061 None] Acquiring lock "cinder-quobyte-b1b6ef82-9936-4262-bd8d-0331eb314efa" by "delete_volume" {{(pid=83259) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 16 15:09:18 devstack cinder-volume[83259]: DEBUG cinder.coordination [None req-a54c3470-98c1-49bc-8dd0-9d075c4c4444 tempest-VolumesActionsTest-508093061 None] Lock "cinder-quobyte-b1b6ef82-9936-4262-bd8d-0331eb314efa" acquired by "delete_volume" :: waited 0.015s {{(pid=83259) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 16 15:09:18 devstack cinder-volume[83259]: DEBUG oslo.privsep.daemon [-] privsep: reply[48f3a6b3-8468-41d0-8858-a2b1824e6500]: (4, 'qcow2') {{(pid=84312) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 16 15:09:18 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [None req-a54c3470-98c1-49bc-8dd0-9d075c4c4444 tempest-VolumesActionsTest-508093061 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c/volume-b1b6ef82-9936-4262-bd8d-0331eb314efa {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 15:09:19 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [None req-a54c3470-98c1-49bc-8dd0-9d075c4c4444 tempest-VolumesActionsTest-508093061 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c/volume-b1b6ef82-9936-4262-bd8d-0331eb314efa" returned: 0 in 0.587s {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 15:09:19 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [None req-a54c3470-98c1-49bc-8dd0-9d075c4c4444 tempest-VolumesActionsTest-508093061 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c/volume-b1b6ef82-9936-4262-bd8d-0331eb314efa {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 15:09:19 devstack cinder-volume[83259]: WARNING cinder.volume.volume_utils [None req-a9d8af6f-1e41-4aa9-ae21-baee9c37bda7 tempest-VolumesTransfersV355Test-1621314413 None] Volume driver (QuobyteDriver 1.2) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 16 15:09:19 devstack cinder-volume[83259]: INFO cinder.volume.manager [None req-a9d8af6f-1e41-4aa9-ae21-baee9c37bda7 tempest-VolumesTransfersV355Test-1621314413 None] Transfer volume completed successfully. Sep 16 15:09:19 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [None req-a54c3470-98c1-49bc-8dd0-9d075c4c4444 tempest-VolumesActionsTest-508093061 None] CMD "rm -f /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c/volume-b1b6ef82-9936-4262-bd8d-0331eb314efa" returned: 0 in 0.759s {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 15:09:19 devstack cinder-volume[83259]: DEBUG cinder.coordination [None req-a54c3470-98c1-49bc-8dd0-9d075c4c4444 tempest-VolumesActionsTest-508093061 None] Lock "cinder-quobyte-b1b6ef82-9936-4262-bd8d-0331eb314efa" released by "delete_volume" :: held 1.557s {{(pid=83259) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 16 15:09:20 devstack cinder-volume[83259]: DEBUG cinder.quota [None req-a54c3470-98c1-49bc-8dd0-9d075c4c4444 tempest-VolumesActionsTest-508093061 None] Created reservations ['fcffb568-0199-4208-9ffa-73523afd513b', '7cd90def-b611-4271-a58b-e6c1046c4578', 'a5a72063-2b68-4170-a06c-797f20c81bb4', '15720d4e-133f-4a99-a502-d2431431142f'] {{(pid=83259) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 16 15:09:20 devstack cinder-volume[83259]: DEBUG oslo_concurrency.lockutils [None req-a54c3470-98c1-49bc-8dd0-9d075c4c4444 tempest-VolumesActionsTest-508093061 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83259) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 16 15:09:20 devstack cinder-volume[83259]: DEBUG oslo_concurrency.lockutils [None req-a54c3470-98c1-49bc-8dd0-9d075c4c4444 tempest-VolumesActionsTest-508093061 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.075s {{(pid=83259) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 16 15:09:20 devstack cinder-volume[83259]: DEBUG cinder.volume.drivers.quobyte [None req-a54c3470-98c1-49bc-8dd0-9d075c4c4444 tempest-VolumesActionsTest-508093061 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-61f585ac-f8e2-4d19-a890-7ebc2726cc72': None} {{(pid=83259) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:639}} Sep 16 15:09:20 devstack cinder-volume[83259]: DEBUG cinder.volume.drivers.quobyte [None req-a54c3470-98c1-49bc-8dd0-9d075c4c4444 tempest-VolumesActionsTest-508093061 None] Available shares ['10.10.41.181/cinder-vol-61f585ac-f8e2-4d19-a890-7ebc2726cc72'] {{(pid=83259) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:669}} Sep 16 15:09:20 devstack cinder-volume[83259]: DEBUG oslo_concurrency.lockutils [None req-a54c3470-98c1-49bc-8dd0-9d075c4c4444 tempest-VolumesActionsTest-508093061 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.127s {{(pid=83259) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 16 15:09:20 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [None req-a54c3470-98c1-49bc-8dd0-9d075c4c4444 tempest-VolumesActionsTest-508093061 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 15:09:21 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [None req-a54c3470-98c1-49bc-8dd0-9d075c4c4444 tempest-VolumesActionsTest-508093061 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c" returned: 0 in 0.400s {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 15:09:21 devstack cinder-volume[83259]: DEBUG cinder.manager [None req-a54c3470-98c1-49bc-8dd0-9d075c4c4444 tempest-VolumesActionsTest-508093061 None] Notifying Schedulers of capabilities ... {{(pid=83259) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 16 15:09:21 devstack cinder-volume[83259]: INFO cinder.volume.manager [None req-a54c3470-98c1-49bc-8dd0-9d075c4c4444 tempest-VolumesActionsTest-508093061 None] Deleted volume successfully. Sep 16 15:09:22 devstack cinder-volume[83259]: DEBUG cinder.coordination [None req-213dfcb6-d3aa-40a5-b9b9-c6c5d428e996 tempest-VolumesTransfersV355Test-2076298425 None] Acquiring lock "cinder-4c6ab68a-ab39-42a1-92d0-13765e70193f-delete_volume" by "delete_volume" {{(pid=83259) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 16 15:09:22 devstack cinder-volume[83259]: DEBUG cinder.coordination [None req-a54c3470-98c1-49bc-8dd0-9d075c4c4444 tempest-VolumesActionsTest-508093061 None] Lock "cinder-b1b6ef82-9936-4262-bd8d-0331eb314efa-delete_volume" released by "delete_volume" :: held 4.552s {{(pid=83259) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 16 15:09:22 devstack cinder-volume[83259]: DEBUG cinder.coordination [None req-213dfcb6-d3aa-40a5-b9b9-c6c5d428e996 tempest-VolumesTransfersV355Test-2076298425 None] Lock "cinder-4c6ab68a-ab39-42a1-92d0-13765e70193f-delete_volume" acquired by "delete_volume" :: waited 0.258s {{(pid=83259) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 16 15:09:23 devstack cinder-volume[83259]: WARNING cinder.volume.volume_utils [None req-213dfcb6-d3aa-40a5-b9b9-c6c5d428e996 tempest-VolumesTransfersV355Test-2076298425 None] Volume driver (QuobyteDriver 1.2) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 16 15:09:23 devstack cinder-volume[83259]: DEBUG cinder.coordination [None req-213dfcb6-d3aa-40a5-b9b9-c6c5d428e996 tempest-VolumesTransfersV355Test-2076298425 None] Acquiring lock "cinder-quobyte-4c6ab68a-ab39-42a1-92d0-13765e70193f" by "delete_volume" {{(pid=83259) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 16 15:09:23 devstack cinder-volume[83259]: DEBUG cinder.coordination [None req-213dfcb6-d3aa-40a5-b9b9-c6c5d428e996 tempest-VolumesTransfersV355Test-2076298425 None] Lock "cinder-quobyte-4c6ab68a-ab39-42a1-92d0-13765e70193f" acquired by "delete_volume" :: waited 0.041s {{(pid=83259) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 16 15:09:23 devstack cinder-volume[83259]: DEBUG oslo.privsep.daemon [-] privsep: reply[3be3f8f8-c941-479c-b037-041f4a9e3204]: (4, 'qcow2') {{(pid=84312) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 16 15:09:23 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [None req-213dfcb6-d3aa-40a5-b9b9-c6c5d428e996 tempest-VolumesTransfersV355Test-2076298425 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c/volume-4c6ab68a-ab39-42a1-92d0-13765e70193f {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 15:09:24 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [None req-213dfcb6-d3aa-40a5-b9b9-c6c5d428e996 tempest-VolumesTransfersV355Test-2076298425 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c/volume-4c6ab68a-ab39-42a1-92d0-13765e70193f" returned: 0 in 1.121s {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 15:09:24 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [None req-213dfcb6-d3aa-40a5-b9b9-c6c5d428e996 tempest-VolumesTransfersV355Test-2076298425 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c/volume-4c6ab68a-ab39-42a1-92d0-13765e70193f {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 15:09:24 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [None req-213dfcb6-d3aa-40a5-b9b9-c6c5d428e996 tempest-VolumesTransfersV355Test-2076298425 None] CMD "rm -f /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c/volume-4c6ab68a-ab39-42a1-92d0-13765e70193f" returned: 0 in 0.338s {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 15:09:25 devstack cinder-volume[83259]: DEBUG cinder.coordination [None req-213dfcb6-d3aa-40a5-b9b9-c6c5d428e996 tempest-VolumesTransfersV355Test-2076298425 None] Lock "cinder-quobyte-4c6ab68a-ab39-42a1-92d0-13765e70193f" released by "delete_volume" :: held 1.842s {{(pid=83259) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 16 15:09:25 devstack cinder-volume[83259]: DEBUG cinder.quota [None req-213dfcb6-d3aa-40a5-b9b9-c6c5d428e996 tempest-VolumesTransfersV355Test-2076298425 None] Created reservations ['c0afa15e-c3d5-4fe4-b045-5b0eef3b0ec2', '7988f214-2ce7-4b6b-a64e-505b0e7e2cbb', 'bf991dbb-93d2-49fe-9be1-4d09dce83839', 'c87e8ef6-bc92-496f-8975-d2e96996c14d'] {{(pid=83259) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 16 15:09:25 devstack cinder-volume[83259]: DEBUG oslo_concurrency.lockutils [None req-213dfcb6-d3aa-40a5-b9b9-c6c5d428e996 tempest-VolumesTransfersV355Test-2076298425 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83259) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 16 15:09:25 devstack cinder-volume[83259]: DEBUG oslo_concurrency.lockutils [None req-213dfcb6-d3aa-40a5-b9b9-c6c5d428e996 tempest-VolumesTransfersV355Test-2076298425 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.006s {{(pid=83259) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 16 15:09:25 devstack cinder-volume[83259]: DEBUG cinder.volume.drivers.quobyte [None req-213dfcb6-d3aa-40a5-b9b9-c6c5d428e996 tempest-VolumesTransfersV355Test-2076298425 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-61f585ac-f8e2-4d19-a890-7ebc2726cc72': None} {{(pid=83259) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:639}} Sep 16 15:09:25 devstack cinder-volume[83259]: DEBUG cinder.volume.drivers.quobyte [None req-213dfcb6-d3aa-40a5-b9b9-c6c5d428e996 tempest-VolumesTransfersV355Test-2076298425 None] Available shares ['10.10.41.181/cinder-vol-61f585ac-f8e2-4d19-a890-7ebc2726cc72'] {{(pid=83259) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:669}} Sep 16 15:09:25 devstack cinder-volume[83259]: DEBUG oslo_concurrency.lockutils [None req-213dfcb6-d3aa-40a5-b9b9-c6c5d428e996 tempest-VolumesTransfersV355Test-2076298425 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.030s {{(pid=83259) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 16 15:09:25 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [None req-213dfcb6-d3aa-40a5-b9b9-c6c5d428e996 tempest-VolumesTransfersV355Test-2076298425 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 15:09:26 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [None req-213dfcb6-d3aa-40a5-b9b9-c6c5d428e996 tempest-VolumesTransfersV355Test-2076298425 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c" returned: 0 in 0.438s {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 15:09:26 devstack cinder-volume[83259]: DEBUG cinder.manager [None req-213dfcb6-d3aa-40a5-b9b9-c6c5d428e996 tempest-VolumesTransfersV355Test-2076298425 None] Notifying Schedulers of capabilities ... {{(pid=83259) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 16 15:09:26 devstack cinder-volume[83259]: INFO cinder.volume.manager [None req-213dfcb6-d3aa-40a5-b9b9-c6c5d428e996 tempest-VolumesTransfersV355Test-2076298425 None] Deleted volume successfully. Sep 16 15:09:27 devstack cinder-volume[83259]: DEBUG cinder.coordination [None req-213dfcb6-d3aa-40a5-b9b9-c6c5d428e996 tempest-VolumesTransfersV355Test-2076298425 None] Lock "cinder-4c6ab68a-ab39-42a1-92d0-13765e70193f-delete_volume" released by "delete_volume" :: held 4.765s {{(pid=83259) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 16 15:09:27 devstack cinder-volume[83259]: WARNING cinder.volume.volume_utils [None req-3a9c4b7f-dcdd-4df5-84a0-e8183fadb92c tempest-VolumesTransfersV355Test-1122864685 None] Volume driver (QuobyteDriver 1.2) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 16 15:09:27 devstack cinder-volume[83259]: DEBUG cinder.volume.flows.manager.create_volume [None req-3a9c4b7f-dcdd-4df5-84a0-e8183fadb92c tempest-VolumesTransfersV355Test-1122864685 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#Quobyte'], 'hosts': ['devstack@QuobyteHD#Quobyte']} {{(pid=83259) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1387}} Sep 16 15:09:28 devstack cinder-volume[83259]: DEBUG cinder.volume.manager [None req-3a9c4b7f-dcdd-4df5-84a0-e8183fadb92c tempest-VolumesTransfersV355Test-1122864685 None] Flow 'volume_create_manager' (d8c22761-4bb4-4529-a83f-d288d0f6c1bf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83259) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 16 15:09:28 devstack cinder-volume[83259]: DEBUG cinder.volume.manager [None req-3a9c4b7f-dcdd-4df5-84a0-e8183fadb92c tempest-VolumesTransfersV355Test-1122864685 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d95b0a2b-1be2-43b5-8e00-09cdd9b957c2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83259) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 15:09:28 devstack cinder-volume[83259]: DEBUG cinder.volume.manager [None req-3a9c4b7f-dcdd-4df5-84a0-e8183fadb92c tempest-VolumesTransfersV355Test-1122864685 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d95b0a2b-1be2-43b5-8e00-09cdd9b957c2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-16T13:09:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-286559754',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#Quobyte',id=853935b3-9d12-4cca-b90f-f1acee18de09,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4fb935e5a18440d6a46fee42610dd375',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-16T13:09:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-16T13:09:28Z,use_quota=True,user_id='f584ab00bb9c4ce09be69a573a3d06b2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(485ead50-3df8-4d76-8d34-a4db136c980a),volume_type_id=485ead50-3df8-4d76-8d34-a4db136c980a)' {{(pid=83259) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 15:09:28 devstack cinder-volume[83259]: DEBUG cinder.volume.manager [None req-3a9c4b7f-dcdd-4df5-84a0-e8183fadb92c tempest-VolumesTransfersV355Test-1122864685 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5883e7fe-9efe-4761-8414-767b885190dd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83259) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 15:09:28 devstack cinder-volume[83259]: DEBUG cinder.volume.manager [None req-3a9c4b7f-dcdd-4df5-84a0-e8183fadb92c tempest-VolumesTransfersV355Test-1122864685 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5883e7fe-9efe-4761-8414-767b885190dd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83259) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 15:09:28 devstack cinder-volume[83259]: DEBUG cinder.volume.manager [None req-3a9c4b7f-dcdd-4df5-84a0-e8183fadb92c tempest-VolumesTransfersV355Test-1122864685 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d66ce0c9-ed7f-4941-95b0-e1b115035bb0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83259) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 15:09:28 devstack cinder-volume[83259]: DEBUG cinder.volume.manager [None req-3a9c4b7f-dcdd-4df5-84a0-e8183fadb92c tempest-VolumesTransfersV355Test-1122864685 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d66ce0c9-ed7f-4941-95b0-e1b115035bb0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '853935b3-9d12-4cca-b90f-f1acee18de09', 'volume_name': 'volume-853935b3-9d12-4cca-b90f-f1acee18de09', 'volume_size': 1}' {{(pid=83259) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 15:09:28 devstack cinder-volume[83259]: DEBUG cinder.volume.manager [None req-3a9c4b7f-dcdd-4df5-84a0-e8183fadb92c tempest-VolumesTransfersV355Test-1122864685 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (696d38d2-8477-49d9-a85d-560dc4a054ab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83259) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 15:09:28 devstack cinder-volume[83259]: DEBUG cinder.volume.manager [None req-3a9c4b7f-dcdd-4df5-84a0-e8183fadb92c tempest-VolumesTransfersV355Test-1122864685 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (696d38d2-8477-49d9-a85d-560dc4a054ab) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83259) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 15:09:28 devstack cinder-volume[83259]: DEBUG cinder.volume.manager [None req-3a9c4b7f-dcdd-4df5-84a0-e8183fadb92c tempest-VolumesTransfersV355Test-1122864685 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2547db16-68c5-4bc7-a270-e8fc569bd511) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83259) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 15:09:28 devstack cinder-volume[83259]: INFO cinder.volume.flows.manager.create_volume [None req-3a9c4b7f-dcdd-4df5-84a0-e8183fadb92c tempest-VolumesTransfersV355Test-1122864685 None] Volume 853935b3-9d12-4cca-b90f-f1acee18de09: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-853935b3-9d12-4cca-b90f-f1acee18de09', 'volume_size': 1} Sep 16 15:09:28 devstack cinder-volume[83259]: DEBUG oslo_concurrency.lockutils [None req-3a9c4b7f-dcdd-4df5-84a0-e8183fadb92c tempest-VolumesTransfersV355Test-1122864685 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83259) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 16 15:09:28 devstack cinder-volume[83259]: DEBUG oslo_concurrency.lockutils [None req-3a9c4b7f-dcdd-4df5-84a0-e8183fadb92c tempest-VolumesTransfersV355Test-1122864685 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=83259) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 16 15:09:28 devstack cinder-volume[83259]: DEBUG cinder.volume.drivers.quobyte [None req-3a9c4b7f-dcdd-4df5-84a0-e8183fadb92c tempest-VolumesTransfersV355Test-1122864685 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-16T13:09:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-286559754',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#Quobyte',id=853935b3-9d12-4cca-b90f-f1acee18de09,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4fb935e5a18440d6a46fee42610dd375',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-16T13:09:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-16T13:09:28Z,use_quota=True,user_id='f584ab00bb9c4ce09be69a573a3d06b2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(485ead50-3df8-4d76-8d34-a4db136c980a),volume_type_id=485ead50-3df8-4d76-8d34-a4db136c980a)}" {{(pid=83259) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Sep 16 15:09:28 devstack cinder-volume[83259]: DEBUG cinder.volume.drivers.remotefs [None req-3a9c4b7f-dcdd-4df5-84a0-e8183fadb92c tempest-VolumesTransfersV355Test-1122864685 None] Creating volume 853935b3-9d12-4cca-b90f-f1acee18de09 {{(pid=83259) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}} Sep 16 15:09:28 devstack cinder-volume[83259]: DEBUG oslo_concurrency.lockutils [None req-3a9c4b7f-dcdd-4df5-84a0-e8183fadb92c tempest-VolumesTransfersV355Test-1122864685 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83259) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 16 15:09:28 devstack cinder-volume[83259]: DEBUG oslo_concurrency.lockutils [None req-3a9c4b7f-dcdd-4df5-84a0-e8183fadb92c tempest-VolumesTransfersV355Test-1122864685 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83259) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 16 15:09:28 devstack cinder-volume[83259]: DEBUG cinder.volume.drivers.quobyte [None req-3a9c4b7f-dcdd-4df5-84a0-e8183fadb92c tempest-VolumesTransfersV355Test-1122864685 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-61f585ac-f8e2-4d19-a890-7ebc2726cc72': None} {{(pid=83259) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:639}} Sep 16 15:09:28 devstack cinder-volume[83259]: DEBUG cinder.volume.drivers.quobyte [None req-3a9c4b7f-dcdd-4df5-84a0-e8183fadb92c tempest-VolumesTransfersV355Test-1122864685 None] Available shares ['10.10.41.181/cinder-vol-61f585ac-f8e2-4d19-a890-7ebc2726cc72'] {{(pid=83259) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:669}} Sep 16 15:09:28 devstack cinder-volume[83259]: DEBUG oslo_concurrency.lockutils [None req-3a9c4b7f-dcdd-4df5-84a0-e8183fadb92c tempest-VolumesTransfersV355Test-1122864685 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=83259) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 16 15:09:28 devstack cinder-volume[83259]: DEBUG cinder.volume.drivers.quobyte [None req-3a9c4b7f-dcdd-4df5-84a0-e8183fadb92c tempest-VolumesTransfersV355Test-1122864685 None] Selected 10.10.41.181/cinder-vol-61f585ac-f8e2-4d19-a890-7ebc2726cc72 as target Quobyte volume. {{(pid=83259) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:690}} Sep 16 15:09:28 devstack cinder-volume[83259]: INFO cinder.volume.drivers.remotefs [None req-3a9c4b7f-dcdd-4df5-84a0-e8183fadb92c tempest-VolumesTransfersV355Test-1122864685 None] casted to 10.10.41.181/cinder-vol-61f585ac-f8e2-4d19-a890-7ebc2726cc72 Sep 16 15:09:28 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [None req-3a9c4b7f-dcdd-4df5-84a0-e8183fadb92c tempest-VolumesTransfersV355Test-1122864685 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c/volume-853935b3-9d12-4cca-b90f-f1acee18de09 1073741824 {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 15:09:28 devstack quobyte-client[83286]: The server volume:87712ffe-8a69-446d-9ed6-4430c7ee9792@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=87712ffe-8a69-446d-9ed6-4430c7ee9792, inode=93, name=volume-853935b3-9d12-4cca-b90f-f1acee18de09, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.206), requestorAccessMask=0 Sep 16 15:09:28 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [None req-3a9c4b7f-dcdd-4df5-84a0-e8183fadb92c tempest-VolumesTransfersV355Test-1122864685 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c/volume-853935b3-9d12-4cca-b90f-f1acee18de09 1073741824" returned: 0 in 0.594s {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 15:09:29 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [None req-3a9c4b7f-dcdd-4df5-84a0-e8183fadb92c tempest-VolumesTransfersV355Test-1122864685 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c/volume-853935b3-9d12-4cca-b90f-f1acee18de09 {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 15:09:29 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [None req-3a9c4b7f-dcdd-4df5-84a0-e8183fadb92c tempest-VolumesTransfersV355Test-1122864685 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c/volume-853935b3-9d12-4cca-b90f-f1acee18de09" returned: 0 in 0.202s {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 15:09:29 devstack cinder-volume[83259]: DEBUG cinder.volume.drivers.quobyte [None req-3a9c4b7f-dcdd-4df5-84a0-e8183fadb92c tempest-VolumesTransfersV355Test-1122864685 None] <== create_volume: return (955ms) {'provider_location': '10.10.41.181/cinder-vol-61f585ac-f8e2-4d19-a890-7ebc2726cc72'} {{(pid=83259) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Sep 16 15:09:29 devstack cinder-volume[83259]: DEBUG oslo_concurrency.lockutils [None req-3a9c4b7f-dcdd-4df5-84a0-e8183fadb92c tempest-VolumesTransfersV355Test-1122864685 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.972s {{(pid=83259) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 16 15:09:29 devstack cinder-volume[83259]: DEBUG cinder.volume.manager [None req-3a9c4b7f-dcdd-4df5-84a0-e8183fadb92c tempest-VolumesTransfersV355Test-1122864685 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2547db16-68c5-4bc7-a270-e8fc569bd511) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-853935b3-9d12-4cca-b90f-f1acee18de09', 'volume_size': 1}' {{(pid=83259) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 15:09:29 devstack cinder-volume[83259]: DEBUG cinder.volume.manager [None req-3a9c4b7f-dcdd-4df5-84a0-e8183fadb92c tempest-VolumesTransfersV355Test-1122864685 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8069eb93-2bb9-4b55-8215-4970dca536ac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83259) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 15:09:29 devstack cinder-volume[83259]: INFO cinder.volume.flows.manager.create_volume [None req-3a9c4b7f-dcdd-4df5-84a0-e8183fadb92c tempest-VolumesTransfersV355Test-1122864685 None] Volume volume-853935b3-9d12-4cca-b90f-f1acee18de09 (853935b3-9d12-4cca-b90f-f1acee18de09): created successfully Sep 16 15:09:29 devstack cinder-volume[83259]: DEBUG cinder.volume.manager [None req-3a9c4b7f-dcdd-4df5-84a0-e8183fadb92c tempest-VolumesTransfersV355Test-1122864685 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8069eb93-2bb9-4b55-8215-4970dca536ac) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83259) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 15:09:30 devstack cinder-volume[83259]: DEBUG cinder.volume.manager [None req-3a9c4b7f-dcdd-4df5-84a0-e8183fadb92c tempest-VolumesTransfersV355Test-1122864685 None] Flow 'volume_create_manager' (d8c22761-4bb4-4529-a83f-d288d0f6c1bf) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83259) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 16 15:09:30 devstack cinder-volume[83259]: INFO cinder.volume.manager [None req-3a9c4b7f-dcdd-4df5-84a0-e8183fadb92c tempest-VolumesTransfersV355Test-1122864685 None] Created volume successfully. Sep 16 15:09:32 devstack cinder-volume[83259]: DEBUG cinder.coordination [None req-91fa1a9f-9c13-4236-95a7-4f56004e1c54 tempest-VolumesTransfersV355Test-2076298425 None] Acquiring lock "cinder-853935b3-9d12-4cca-b90f-f1acee18de09-delete_volume" by "delete_volume" {{(pid=83259) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 16 15:09:32 devstack cinder-volume[83259]: DEBUG cinder.coordination [None req-91fa1a9f-9c13-4236-95a7-4f56004e1c54 tempest-VolumesTransfersV355Test-2076298425 None] Lock "cinder-853935b3-9d12-4cca-b90f-f1acee18de09-delete_volume" acquired by "delete_volume" :: waited 0.164s {{(pid=83259) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 16 15:09:32 devstack cinder-volume[83259]: WARNING cinder.volume.volume_utils [None req-91fa1a9f-9c13-4236-95a7-4f56004e1c54 tempest-VolumesTransfersV355Test-2076298425 None] Volume driver (QuobyteDriver 1.2) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 16 15:09:32 devstack cinder-volume[83259]: DEBUG cinder.coordination [None req-91fa1a9f-9c13-4236-95a7-4f56004e1c54 tempest-VolumesTransfersV355Test-2076298425 None] Acquiring lock "cinder-quobyte-853935b3-9d12-4cca-b90f-f1acee18de09" by "delete_volume" {{(pid=83259) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 16 15:09:32 devstack cinder-volume[83259]: DEBUG cinder.coordination [None req-91fa1a9f-9c13-4236-95a7-4f56004e1c54 tempest-VolumesTransfersV355Test-2076298425 None] Lock "cinder-quobyte-853935b3-9d12-4cca-b90f-f1acee18de09" acquired by "delete_volume" :: waited 0.022s {{(pid=83259) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 16 15:09:32 devstack cinder-volume[83259]: DEBUG oslo.privsep.daemon [-] privsep: reply[1dbea220-ea09-46d8-aa1a-ae26dd57f57b]: (4, 'qcow2') {{(pid=84312) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 16 15:09:32 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [None req-91fa1a9f-9c13-4236-95a7-4f56004e1c54 tempest-VolumesTransfersV355Test-2076298425 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c/volume-853935b3-9d12-4cca-b90f-f1acee18de09 {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 15:09:33 devstack quobyte-client[83286]: System call of process 94938 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 16 15:09:33 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [None req-91fa1a9f-9c13-4236-95a7-4f56004e1c54 tempest-VolumesTransfersV355Test-2076298425 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c/volume-853935b3-9d12-4cca-b90f-f1acee18de09" returned: 0 in 1.153s {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 15:09:33 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [None req-91fa1a9f-9c13-4236-95a7-4f56004e1c54 tempest-VolumesTransfersV355Test-2076298425 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c/volume-853935b3-9d12-4cca-b90f-f1acee18de09 {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 15:09:34 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [None req-91fa1a9f-9c13-4236-95a7-4f56004e1c54 tempest-VolumesTransfersV355Test-2076298425 None] CMD "rm -f /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c/volume-853935b3-9d12-4cca-b90f-f1acee18de09" returned: 0 in 0.265s {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 15:09:34 devstack cinder-volume[83259]: DEBUG cinder.coordination [None req-91fa1a9f-9c13-4236-95a7-4f56004e1c54 tempest-VolumesTransfersV355Test-2076298425 None] Lock "cinder-quobyte-853935b3-9d12-4cca-b90f-f1acee18de09" released by "delete_volume" :: held 1.852s {{(pid=83259) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 16 15:09:35 devstack cinder-volume[83259]: DEBUG cinder.quota [None req-91fa1a9f-9c13-4236-95a7-4f56004e1c54 tempest-VolumesTransfersV355Test-2076298425 None] Created reservations ['89c1cb8c-3bc4-4512-9555-4d01b7667991', '0bdbc7b1-9b4a-4d91-9584-49cf364f67c2', 'ff99921a-4d66-4650-b8aa-3f469420eab3', '37c147e7-e8d5-45e9-a632-9e9960ec8771'] {{(pid=83259) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 16 15:09:35 devstack cinder-volume[83259]: DEBUG oslo_concurrency.lockutils [None req-91fa1a9f-9c13-4236-95a7-4f56004e1c54 tempest-VolumesTransfersV355Test-2076298425 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83259) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 16 15:09:35 devstack cinder-volume[83259]: DEBUG oslo_concurrency.lockutils [None req-91fa1a9f-9c13-4236-95a7-4f56004e1c54 tempest-VolumesTransfersV355Test-2076298425 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.008s {{(pid=83259) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 16 15:09:35 devstack cinder-volume[83259]: DEBUG cinder.volume.drivers.quobyte [None req-91fa1a9f-9c13-4236-95a7-4f56004e1c54 tempest-VolumesTransfersV355Test-2076298425 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-61f585ac-f8e2-4d19-a890-7ebc2726cc72': None} {{(pid=83259) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:639}} Sep 16 15:09:35 devstack cinder-volume[83259]: DEBUG cinder.volume.drivers.quobyte [None req-91fa1a9f-9c13-4236-95a7-4f56004e1c54 tempest-VolumesTransfersV355Test-2076298425 None] Available shares ['10.10.41.181/cinder-vol-61f585ac-f8e2-4d19-a890-7ebc2726cc72'] {{(pid=83259) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:669}} Sep 16 15:09:35 devstack cinder-volume[83259]: DEBUG oslo_concurrency.lockutils [None req-91fa1a9f-9c13-4236-95a7-4f56004e1c54 tempest-VolumesTransfersV355Test-2076298425 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.032s {{(pid=83259) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 16 15:09:35 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [None req-91fa1a9f-9c13-4236-95a7-4f56004e1c54 tempest-VolumesTransfersV355Test-2076298425 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 15:09:35 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [None req-91fa1a9f-9c13-4236-95a7-4f56004e1c54 tempest-VolumesTransfersV355Test-2076298425 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c" returned: 0 in 0.236s {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 15:09:35 devstack cinder-volume[83259]: DEBUG cinder.manager [None req-91fa1a9f-9c13-4236-95a7-4f56004e1c54 tempest-VolumesTransfersV355Test-2076298425 None] Notifying Schedulers of capabilities ... {{(pid=83259) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 16 15:09:36 devstack cinder-volume[83259]: INFO cinder.volume.manager [None req-91fa1a9f-9c13-4236-95a7-4f56004e1c54 tempest-VolumesTransfersV355Test-2076298425 None] Deleted volume successfully. Sep 16 15:09:36 devstack cinder-volume[83259]: DEBUG cinder.coordination [None req-91fa1a9f-9c13-4236-95a7-4f56004e1c54 tempest-VolumesTransfersV355Test-2076298425 None] Lock "cinder-853935b3-9d12-4cca-b90f-f1acee18de09-delete_volume" released by "delete_volume" :: held 4.331s {{(pid=83259) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 16 15:09:45 devstack cinder-volume[83259]: DEBUG dbcounter [-] [83259] Writing DB stats cinder:UPDATE=40,cinder:SELECT=22,cinder:DELETE=3,cinder:INSERT=4 {{(pid=83259) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Sep 16 15:09:45 devstack cinder-volume[83259]: DEBUG oslo_service.periodic_task [None req-050ec8a1-6ffd-499d-95ad-d548a84437e2 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=83259) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} Sep 16 15:09:45 devstack cinder-volume[83259]: DEBUG oslo_concurrency.lockutils [None req-050ec8a1-6ffd-499d-95ad-d548a84437e2 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83259) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 16 15:09:45 devstack cinder-volume[83259]: DEBUG oslo_concurrency.lockutils [None req-050ec8a1-6ffd-499d-95ad-d548a84437e2 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.007s {{(pid=83259) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 16 15:09:45 devstack cinder-volume[83259]: DEBUG cinder.volume.drivers.quobyte [None req-050ec8a1-6ffd-499d-95ad-d548a84437e2 None None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-61f585ac-f8e2-4d19-a890-7ebc2726cc72': None} {{(pid=83259) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:639}} Sep 16 15:09:45 devstack cinder-volume[83259]: DEBUG cinder.volume.drivers.quobyte [None req-050ec8a1-6ffd-499d-95ad-d548a84437e2 None None] Available shares ['10.10.41.181/cinder-vol-61f585ac-f8e2-4d19-a890-7ebc2726cc72'] {{(pid=83259) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:669}} Sep 16 15:09:45 devstack cinder-volume[83259]: DEBUG oslo_concurrency.lockutils [None req-050ec8a1-6ffd-499d-95ad-d548a84437e2 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.026s {{(pid=83259) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 16 15:09:45 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [None req-050ec8a1-6ffd-499d-95ad-d548a84437e2 None None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 15:09:46 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [None req-050ec8a1-6ffd-499d-95ad-d548a84437e2 None None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c" returned: 0 in 0.333s {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 15:09:46 devstack cinder-volume[83259]: DEBUG cinder.manager [None req-050ec8a1-6ffd-499d-95ad-d548a84437e2 None None] Notifying Schedulers of capabilities ... {{(pid=83259) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 16 15:09:46 devstack cinder-volume[83259]: DEBUG dbcounter [-] [83259] Writing DB stats cinder:SELECT=21,cinder:INSERT=12,cinder:UPDATE=35,cinder:DELETE=4 {{(pid=83259) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Sep 16 15:09:51 devstack cinder-volume[83259]: WARNING cinder.volume.volume_utils [None req-1361e390-530b-4bc6-9393-1688ed7ec209 tempest-VolumesTransfersV357Test-481525416 None] Volume driver (QuobyteDriver 1.2) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 16 15:09:51 devstack cinder-volume[83259]: DEBUG cinder.volume.flows.manager.create_volume [None req-1361e390-530b-4bc6-9393-1688ed7ec209 tempest-VolumesTransfersV357Test-481525416 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#Quobyte'], 'hosts': ['devstack@QuobyteHD#Quobyte']} {{(pid=83259) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1387}} Sep 16 15:09:51 devstack cinder-volume[83259]: DEBUG cinder.volume.manager [None req-1361e390-530b-4bc6-9393-1688ed7ec209 tempest-VolumesTransfersV357Test-481525416 None] Flow 'volume_create_manager' (d0e1e2e8-fde4-4fba-b7cb-82811fc64754) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83259) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 16 15:09:51 devstack cinder-volume[83259]: DEBUG cinder.volume.manager [None req-1361e390-530b-4bc6-9393-1688ed7ec209 tempest-VolumesTransfersV357Test-481525416 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2d2ef86b-dd89-4e47-95dd-87bc9d4b2214) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83259) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 15:09:51 devstack cinder-volume[83259]: DEBUG cinder.volume.manager [None req-1361e390-530b-4bc6-9393-1688ed7ec209 tempest-VolumesTransfersV357Test-481525416 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2d2ef86b-dd89-4e47-95dd-87bc9d4b2214) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-16T13:09:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-438506166',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#Quobyte',id=02ba9a3a-2816-41a0-9b1a-73037e545a12,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0444c383f6d74626a28899e05622c605',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-16T13:09:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-16T13:09:50Z,use_quota=True,user_id='4b90c33874d741a39b30896fa6a5d46d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(485ead50-3df8-4d76-8d34-a4db136c980a),volume_type_id=485ead50-3df8-4d76-8d34-a4db136c980a)' {{(pid=83259) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 15:09:51 devstack cinder-volume[83259]: DEBUG cinder.volume.manager [None req-1361e390-530b-4bc6-9393-1688ed7ec209 tempest-VolumesTransfersV357Test-481525416 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (de8aacb2-e49e-47c2-ac86-66f94c653f8c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83259) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 15:09:51 devstack cinder-volume[83259]: DEBUG cinder.volume.manager [None req-1361e390-530b-4bc6-9393-1688ed7ec209 tempest-VolumesTransfersV357Test-481525416 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (de8aacb2-e49e-47c2-ac86-66f94c653f8c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83259) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 15:09:51 devstack cinder-volume[83259]: DEBUG cinder.volume.manager [None req-1361e390-530b-4bc6-9393-1688ed7ec209 tempest-VolumesTransfersV357Test-481525416 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8fa32b32-a2f7-4157-897d-4957fcd6afec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83259) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 15:09:51 devstack cinder-volume[83259]: DEBUG cinder.volume.manager [None req-1361e390-530b-4bc6-9393-1688ed7ec209 tempest-VolumesTransfersV357Test-481525416 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8fa32b32-a2f7-4157-897d-4957fcd6afec) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '02ba9a3a-2816-41a0-9b1a-73037e545a12', 'volume_name': 'volume-02ba9a3a-2816-41a0-9b1a-73037e545a12', 'volume_size': 1}' {{(pid=83259) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 15:09:51 devstack cinder-volume[83259]: DEBUG cinder.volume.manager [None req-1361e390-530b-4bc6-9393-1688ed7ec209 tempest-VolumesTransfersV357Test-481525416 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5f118e68-4348-4124-9ee6-20db03b5e0a1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83259) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 15:09:51 devstack cinder-volume[83259]: DEBUG cinder.volume.manager [None req-1361e390-530b-4bc6-9393-1688ed7ec209 tempest-VolumesTransfersV357Test-481525416 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5f118e68-4348-4124-9ee6-20db03b5e0a1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83259) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 15:09:51 devstack cinder-volume[83259]: DEBUG cinder.volume.manager [None req-1361e390-530b-4bc6-9393-1688ed7ec209 tempest-VolumesTransfersV357Test-481525416 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (244ac674-e776-4a0e-a6a4-9bae3bb2557a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83259) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 15:09:51 devstack cinder-volume[83259]: INFO cinder.volume.flows.manager.create_volume [None req-1361e390-530b-4bc6-9393-1688ed7ec209 tempest-VolumesTransfersV357Test-481525416 None] Volume 02ba9a3a-2816-41a0-9b1a-73037e545a12: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-02ba9a3a-2816-41a0-9b1a-73037e545a12', 'volume_size': 1} Sep 16 15:09:51 devstack cinder-volume[83259]: DEBUG oslo_concurrency.lockutils [None req-1361e390-530b-4bc6-9393-1688ed7ec209 tempest-VolumesTransfersV357Test-481525416 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83259) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 16 15:09:51 devstack cinder-volume[83259]: DEBUG oslo_concurrency.lockutils [None req-1361e390-530b-4bc6-9393-1688ed7ec209 tempest-VolumesTransfersV357Test-481525416 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.003s {{(pid=83259) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 16 15:09:51 devstack cinder-volume[83259]: DEBUG cinder.volume.drivers.quobyte [None req-1361e390-530b-4bc6-9393-1688ed7ec209 tempest-VolumesTransfersV357Test-481525416 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-16T13:09:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-438506166',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#Quobyte',id=02ba9a3a-2816-41a0-9b1a-73037e545a12,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0444c383f6d74626a28899e05622c605',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-16T13:09:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-16T13:09:50Z,use_quota=True,user_id='4b90c33874d741a39b30896fa6a5d46d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(485ead50-3df8-4d76-8d34-a4db136c980a),volume_type_id=485ead50-3df8-4d76-8d34-a4db136c980a)}" {{(pid=83259) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Sep 16 15:09:51 devstack cinder-volume[83259]: DEBUG cinder.volume.drivers.remotefs [None req-1361e390-530b-4bc6-9393-1688ed7ec209 tempest-VolumesTransfersV357Test-481525416 None] Creating volume 02ba9a3a-2816-41a0-9b1a-73037e545a12 {{(pid=83259) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}} Sep 16 15:09:51 devstack cinder-volume[83259]: DEBUG oslo_concurrency.lockutils [None req-1361e390-530b-4bc6-9393-1688ed7ec209 tempest-VolumesTransfersV357Test-481525416 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83259) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 16 15:09:51 devstack cinder-volume[83259]: DEBUG oslo_concurrency.lockutils [None req-1361e390-530b-4bc6-9393-1688ed7ec209 tempest-VolumesTransfersV357Test-481525416 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83259) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 16 15:09:51 devstack cinder-volume[83259]: DEBUG cinder.volume.drivers.quobyte [None req-1361e390-530b-4bc6-9393-1688ed7ec209 tempest-VolumesTransfersV357Test-481525416 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-61f585ac-f8e2-4d19-a890-7ebc2726cc72': None} {{(pid=83259) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:639}} Sep 16 15:09:51 devstack cinder-volume[83259]: DEBUG cinder.volume.drivers.quobyte [None req-1361e390-530b-4bc6-9393-1688ed7ec209 tempest-VolumesTransfersV357Test-481525416 None] Available shares ['10.10.41.181/cinder-vol-61f585ac-f8e2-4d19-a890-7ebc2726cc72'] {{(pid=83259) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:669}} Sep 16 15:09:51 devstack cinder-volume[83259]: DEBUG oslo_concurrency.lockutils [None req-1361e390-530b-4bc6-9393-1688ed7ec209 tempest-VolumesTransfersV357Test-481525416 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=83259) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 16 15:09:51 devstack cinder-volume[83259]: DEBUG cinder.volume.drivers.quobyte [None req-1361e390-530b-4bc6-9393-1688ed7ec209 tempest-VolumesTransfersV357Test-481525416 None] Selected 10.10.41.181/cinder-vol-61f585ac-f8e2-4d19-a890-7ebc2726cc72 as target Quobyte volume. {{(pid=83259) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:690}} Sep 16 15:09:51 devstack cinder-volume[83259]: INFO cinder.volume.drivers.remotefs [None req-1361e390-530b-4bc6-9393-1688ed7ec209 tempest-VolumesTransfersV357Test-481525416 None] casted to 10.10.41.181/cinder-vol-61f585ac-f8e2-4d19-a890-7ebc2726cc72 Sep 16 15:09:51 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [None req-1361e390-530b-4bc6-9393-1688ed7ec209 tempest-VolumesTransfersV357Test-481525416 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c/volume-02ba9a3a-2816-41a0-9b1a-73037e545a12 1073741824 {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 15:09:51 devstack quobyte-client[83286]: The server volume:87712ffe-8a69-446d-9ed6-4430c7ee9792@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=87712ffe-8a69-446d-9ed6-4430c7ee9792, inode=94, name=volume-02ba9a3a-2816-41a0-9b1a-73037e545a12, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.206), requestorAccessMask=0 Sep 16 15:09:52 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [None req-1361e390-530b-4bc6-9393-1688ed7ec209 tempest-VolumesTransfersV357Test-481525416 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c/volume-02ba9a3a-2816-41a0-9b1a-73037e545a12 1073741824" returned: 0 in 0.773s {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 15:09:52 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [None req-1361e390-530b-4bc6-9393-1688ed7ec209 tempest-VolumesTransfersV357Test-481525416 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c/volume-02ba9a3a-2816-41a0-9b1a-73037e545a12 {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 15:09:52 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [None req-1361e390-530b-4bc6-9393-1688ed7ec209 tempest-VolumesTransfersV357Test-481525416 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c/volume-02ba9a3a-2816-41a0-9b1a-73037e545a12" returned: 0 in 0.216s {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 15:09:52 devstack cinder-volume[83259]: DEBUG cinder.volume.drivers.quobyte [None req-1361e390-530b-4bc6-9393-1688ed7ec209 tempest-VolumesTransfersV357Test-481525416 None] <== create_volume: return (1103ms) {'provider_location': '10.10.41.181/cinder-vol-61f585ac-f8e2-4d19-a890-7ebc2726cc72'} {{(pid=83259) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Sep 16 15:09:52 devstack cinder-volume[83259]: DEBUG oslo_concurrency.lockutils [None req-1361e390-530b-4bc6-9393-1688ed7ec209 tempest-VolumesTransfersV357Test-481525416 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.118s {{(pid=83259) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 16 15:09:52 devstack cinder-volume[83259]: DEBUG cinder.volume.manager [None req-1361e390-530b-4bc6-9393-1688ed7ec209 tempest-VolumesTransfersV357Test-481525416 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (244ac674-e776-4a0e-a6a4-9bae3bb2557a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-02ba9a3a-2816-41a0-9b1a-73037e545a12', 'volume_size': 1}' {{(pid=83259) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 15:09:53 devstack cinder-volume[83259]: DEBUG cinder.volume.manager [None req-1361e390-530b-4bc6-9393-1688ed7ec209 tempest-VolumesTransfersV357Test-481525416 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (64634392-e0ab-4939-acde-00b0129003b9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83259) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 15:09:53 devstack cinder-volume[83259]: INFO cinder.volume.flows.manager.create_volume [None req-1361e390-530b-4bc6-9393-1688ed7ec209 tempest-VolumesTransfersV357Test-481525416 None] Volume volume-02ba9a3a-2816-41a0-9b1a-73037e545a12 (02ba9a3a-2816-41a0-9b1a-73037e545a12): created successfully Sep 16 15:09:53 devstack cinder-volume[83259]: DEBUG cinder.volume.manager [None req-1361e390-530b-4bc6-9393-1688ed7ec209 tempest-VolumesTransfersV357Test-481525416 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (64634392-e0ab-4939-acde-00b0129003b9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83259) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 15:09:53 devstack cinder-volume[83259]: DEBUG cinder.volume.manager [None req-1361e390-530b-4bc6-9393-1688ed7ec209 tempest-VolumesTransfersV357Test-481525416 None] Flow 'volume_create_manager' (d0e1e2e8-fde4-4fba-b7cb-82811fc64754) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83259) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 16 15:09:53 devstack cinder-volume[83259]: INFO cinder.volume.manager [None req-1361e390-530b-4bc6-9393-1688ed7ec209 tempest-VolumesTransfersV357Test-481525416 None] Created volume successfully. Sep 16 15:09:54 devstack cinder-volume[83259]: WARNING cinder.volume.volume_utils [None req-127f4689-8ab5-4bb3-959b-40233133c3d4 tempest-VolumesTransfersV357Test-1963031565 None] Volume driver (QuobyteDriver 1.2) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 16 15:09:54 devstack cinder-volume[83259]: INFO cinder.volume.manager [None req-127f4689-8ab5-4bb3-959b-40233133c3d4 tempest-VolumesTransfersV357Test-1963031565 None] Transfer volume completed successfully. Sep 16 15:09:56 devstack cinder-volume[83259]: DEBUG cinder.coordination [None req-22cc15cc-6780-4fec-b53f-f13045f95a4b tempest-VolumesTransfersV357Test-1466688312 None] Acquiring lock "cinder-02ba9a3a-2816-41a0-9b1a-73037e545a12-delete_volume" by "delete_volume" {{(pid=83259) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 16 15:09:56 devstack cinder-volume[83259]: DEBUG cinder.coordination [None req-22cc15cc-6780-4fec-b53f-f13045f95a4b tempest-VolumesTransfersV357Test-1466688312 None] Lock "cinder-02ba9a3a-2816-41a0-9b1a-73037e545a12-delete_volume" acquired by "delete_volume" :: waited 0.106s {{(pid=83259) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 16 15:09:56 devstack cinder-volume[83259]: WARNING cinder.volume.volume_utils [None req-22cc15cc-6780-4fec-b53f-f13045f95a4b tempest-VolumesTransfersV357Test-1466688312 None] Volume driver (QuobyteDriver 1.2) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 16 15:09:56 devstack cinder-volume[83259]: DEBUG cinder.coordination [None req-22cc15cc-6780-4fec-b53f-f13045f95a4b tempest-VolumesTransfersV357Test-1466688312 None] Acquiring lock "cinder-quobyte-02ba9a3a-2816-41a0-9b1a-73037e545a12" by "delete_volume" {{(pid=83259) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 16 15:09:56 devstack cinder-volume[83259]: DEBUG cinder.coordination [None req-22cc15cc-6780-4fec-b53f-f13045f95a4b tempest-VolumesTransfersV357Test-1466688312 None] Lock "cinder-quobyte-02ba9a3a-2816-41a0-9b1a-73037e545a12" acquired by "delete_volume" :: waited 0.017s {{(pid=83259) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 16 15:09:56 devstack cinder-volume[83259]: DEBUG oslo.privsep.daemon [-] privsep: reply[d42bba74-bf1f-43e6-bf24-e12fb2b542fe]: (4, 'qcow2') {{(pid=84312) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 16 15:09:56 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [None req-22cc15cc-6780-4fec-b53f-f13045f95a4b tempest-VolumesTransfersV357Test-1466688312 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c/volume-02ba9a3a-2816-41a0-9b1a-73037e545a12 {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 15:09:57 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [None req-22cc15cc-6780-4fec-b53f-f13045f95a4b tempest-VolumesTransfersV357Test-1466688312 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c/volume-02ba9a3a-2816-41a0-9b1a-73037e545a12" returned: 0 in 0.560s {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 15:09:57 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [None req-22cc15cc-6780-4fec-b53f-f13045f95a4b tempest-VolumesTransfersV357Test-1466688312 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c/volume-02ba9a3a-2816-41a0-9b1a-73037e545a12 {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 15:09:57 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [None req-22cc15cc-6780-4fec-b53f-f13045f95a4b tempest-VolumesTransfersV357Test-1466688312 None] CMD "rm -f /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c/volume-02ba9a3a-2816-41a0-9b1a-73037e545a12" returned: 0 in 0.141s {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 15:09:57 devstack cinder-volume[83259]: DEBUG cinder.coordination [None req-22cc15cc-6780-4fec-b53f-f13045f95a4b tempest-VolumesTransfersV357Test-1466688312 None] Lock "cinder-quobyte-02ba9a3a-2816-41a0-9b1a-73037e545a12" released by "delete_volume" :: held 0.943s {{(pid=83259) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 16 15:09:57 devstack cinder-volume[83259]: DEBUG cinder.quota [None req-22cc15cc-6780-4fec-b53f-f13045f95a4b tempest-VolumesTransfersV357Test-1466688312 None] Created reservations ['dd5f3ebe-579a-474a-a242-41b02fa9b01e', '4280d93b-7e84-4ce6-a468-9ea2bb76601c', '5df1bacc-7299-4c88-a1e1-779ca5a3d03d', '2ce01c6b-6a5e-4b98-b58a-2f1859d56981'] {{(pid=83259) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 16 15:09:58 devstack cinder-volume[83259]: DEBUG oslo_concurrency.lockutils [None req-22cc15cc-6780-4fec-b53f-f13045f95a4b tempest-VolumesTransfersV357Test-1466688312 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83259) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 16 15:09:58 devstack cinder-volume[83259]: DEBUG oslo_concurrency.lockutils [None req-22cc15cc-6780-4fec-b53f-f13045f95a4b tempest-VolumesTransfersV357Test-1466688312 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=83259) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 16 15:09:58 devstack cinder-volume[83259]: DEBUG cinder.volume.drivers.quobyte [None req-22cc15cc-6780-4fec-b53f-f13045f95a4b tempest-VolumesTransfersV357Test-1466688312 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-61f585ac-f8e2-4d19-a890-7ebc2726cc72': None} {{(pid=83259) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:639}} Sep 16 15:09:58 devstack cinder-volume[83259]: DEBUG cinder.volume.drivers.quobyte [None req-22cc15cc-6780-4fec-b53f-f13045f95a4b tempest-VolumesTransfersV357Test-1466688312 None] Available shares ['10.10.41.181/cinder-vol-61f585ac-f8e2-4d19-a890-7ebc2726cc72'] {{(pid=83259) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:669}} Sep 16 15:09:58 devstack cinder-volume[83259]: DEBUG oslo_concurrency.lockutils [None req-22cc15cc-6780-4fec-b53f-f13045f95a4b tempest-VolumesTransfersV357Test-1466688312 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=83259) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 16 15:09:58 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [None req-22cc15cc-6780-4fec-b53f-f13045f95a4b tempest-VolumesTransfersV357Test-1466688312 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 15:09:58 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [None req-22cc15cc-6780-4fec-b53f-f13045f95a4b tempest-VolumesTransfersV357Test-1466688312 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c" returned: 0 in 0.136s {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 15:09:58 devstack cinder-volume[83259]: DEBUG cinder.manager [None req-22cc15cc-6780-4fec-b53f-f13045f95a4b tempest-VolumesTransfersV357Test-1466688312 None] Notifying Schedulers of capabilities ... {{(pid=83259) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 16 15:09:58 devstack cinder-volume[83259]: INFO cinder.volume.manager [None req-22cc15cc-6780-4fec-b53f-f13045f95a4b tempest-VolumesTransfersV357Test-1466688312 None] Deleted volume successfully. Sep 16 15:09:58 devstack cinder-volume[83259]: DEBUG cinder.coordination [None req-22cc15cc-6780-4fec-b53f-f13045f95a4b tempest-VolumesTransfersV357Test-1466688312 None] Lock "cinder-02ba9a3a-2816-41a0-9b1a-73037e545a12-delete_volume" released by "delete_volume" :: held 2.181s {{(pid=83259) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 16 15:10:00 devstack cinder-volume[83259]: WARNING cinder.volume.volume_utils [None req-3e76ff0f-e26d-4a66-adda-1a2e48aa08de tempest-VolumesTransfersV357Test-481525416 None] Volume driver (QuobyteDriver 1.2) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 16 15:10:00 devstack cinder-volume[83259]: DEBUG cinder.volume.flows.manager.create_volume [None req-3e76ff0f-e26d-4a66-adda-1a2e48aa08de tempest-VolumesTransfersV357Test-481525416 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#Quobyte'], 'hosts': ['devstack@QuobyteHD#Quobyte']} {{(pid=83259) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1387}} Sep 16 15:10:00 devstack cinder-volume[83259]: DEBUG cinder.volume.manager [None req-3e76ff0f-e26d-4a66-adda-1a2e48aa08de tempest-VolumesTransfersV357Test-481525416 None] Flow 'volume_create_manager' (7d5d96cb-a2cc-405a-92f3-51d44c5b1c52) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83259) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 16 15:10:00 devstack cinder-volume[83259]: DEBUG cinder.volume.manager [None req-3e76ff0f-e26d-4a66-adda-1a2e48aa08de tempest-VolumesTransfersV357Test-481525416 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c975beb4-2f81-4dd0-86c1-5b87a1ba0207) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83259) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 15:10:00 devstack cinder-volume[83259]: DEBUG cinder.volume.manager [None req-3e76ff0f-e26d-4a66-adda-1a2e48aa08de tempest-VolumesTransfersV357Test-481525416 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c975beb4-2f81-4dd0-86c1-5b87a1ba0207) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-16T13:09:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-836115191',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#Quobyte',id=cd5a4bee-8067-4947-8e33-574e2c3ad1df,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0444c383f6d74626a28899e05622c605',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-16T13:10:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-16T13:10:00Z,use_quota=True,user_id='4b90c33874d741a39b30896fa6a5d46d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(485ead50-3df8-4d76-8d34-a4db136c980a),volume_type_id=485ead50-3df8-4d76-8d34-a4db136c980a)' {{(pid=83259) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 15:10:00 devstack cinder-volume[83259]: DEBUG cinder.volume.manager [None req-3e76ff0f-e26d-4a66-adda-1a2e48aa08de tempest-VolumesTransfersV357Test-481525416 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (744a0eef-54a1-48c1-b640-0e4e3e6d7b4f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83259) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 15:10:00 devstack cinder-volume[83259]: DEBUG cinder.volume.manager [None req-3e76ff0f-e26d-4a66-adda-1a2e48aa08de tempest-VolumesTransfersV357Test-481525416 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (744a0eef-54a1-48c1-b640-0e4e3e6d7b4f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83259) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 15:10:00 devstack cinder-volume[83259]: DEBUG cinder.volume.manager [None req-3e76ff0f-e26d-4a66-adda-1a2e48aa08de tempest-VolumesTransfersV357Test-481525416 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1715a64a-a83b-433c-bb7c-e7c528515075) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83259) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 15:10:00 devstack cinder-volume[83259]: DEBUG cinder.volume.manager [None req-3e76ff0f-e26d-4a66-adda-1a2e48aa08de tempest-VolumesTransfersV357Test-481525416 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1715a64a-a83b-433c-bb7c-e7c528515075) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'cd5a4bee-8067-4947-8e33-574e2c3ad1df', 'volume_name': 'volume-cd5a4bee-8067-4947-8e33-574e2c3ad1df', 'volume_size': 1}' {{(pid=83259) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 15:10:00 devstack cinder-volume[83259]: DEBUG cinder.volume.manager [None req-3e76ff0f-e26d-4a66-adda-1a2e48aa08de tempest-VolumesTransfersV357Test-481525416 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e25c45f2-9ce9-4c8e-9411-3c6fee56d90d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83259) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 15:10:00 devstack cinder-volume[83259]: DEBUG cinder.volume.manager [None req-3e76ff0f-e26d-4a66-adda-1a2e48aa08de tempest-VolumesTransfersV357Test-481525416 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e25c45f2-9ce9-4c8e-9411-3c6fee56d90d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83259) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 15:10:00 devstack cinder-volume[83259]: DEBUG cinder.volume.manager [None req-3e76ff0f-e26d-4a66-adda-1a2e48aa08de tempest-VolumesTransfersV357Test-481525416 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a7aded55-1f81-4aa1-b273-9955d609bddd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83259) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 15:10:00 devstack cinder-volume[83259]: INFO cinder.volume.flows.manager.create_volume [None req-3e76ff0f-e26d-4a66-adda-1a2e48aa08de tempest-VolumesTransfersV357Test-481525416 None] Volume cd5a4bee-8067-4947-8e33-574e2c3ad1df: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-cd5a4bee-8067-4947-8e33-574e2c3ad1df', 'volume_size': 1} Sep 16 15:10:00 devstack cinder-volume[83259]: DEBUG oslo_concurrency.lockutils [None req-3e76ff0f-e26d-4a66-adda-1a2e48aa08de tempest-VolumesTransfersV357Test-481525416 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83259) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 16 15:10:00 devstack cinder-volume[83259]: DEBUG oslo_concurrency.lockutils [None req-3e76ff0f-e26d-4a66-adda-1a2e48aa08de tempest-VolumesTransfersV357Test-481525416 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=83259) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 16 15:10:00 devstack cinder-volume[83259]: DEBUG cinder.volume.drivers.quobyte [None req-3e76ff0f-e26d-4a66-adda-1a2e48aa08de tempest-VolumesTransfersV357Test-481525416 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-16T13:09:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-836115191',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#Quobyte',id=cd5a4bee-8067-4947-8e33-574e2c3ad1df,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0444c383f6d74626a28899e05622c605',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-16T13:10:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-16T13:10:00Z,use_quota=True,user_id='4b90c33874d741a39b30896fa6a5d46d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(485ead50-3df8-4d76-8d34-a4db136c980a),volume_type_id=485ead50-3df8-4d76-8d34-a4db136c980a)}" {{(pid=83259) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Sep 16 15:10:00 devstack cinder-volume[83259]: DEBUG cinder.volume.drivers.remotefs [None req-3e76ff0f-e26d-4a66-adda-1a2e48aa08de tempest-VolumesTransfersV357Test-481525416 None] Creating volume cd5a4bee-8067-4947-8e33-574e2c3ad1df {{(pid=83259) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}} Sep 16 15:10:00 devstack cinder-volume[83259]: DEBUG oslo_concurrency.lockutils [None req-3e76ff0f-e26d-4a66-adda-1a2e48aa08de tempest-VolumesTransfersV357Test-481525416 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83259) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 16 15:10:00 devstack cinder-volume[83259]: DEBUG oslo_concurrency.lockutils [None req-3e76ff0f-e26d-4a66-adda-1a2e48aa08de tempest-VolumesTransfersV357Test-481525416 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83259) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 16 15:10:00 devstack cinder-volume[83259]: DEBUG cinder.volume.drivers.quobyte [None req-3e76ff0f-e26d-4a66-adda-1a2e48aa08de tempest-VolumesTransfersV357Test-481525416 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-61f585ac-f8e2-4d19-a890-7ebc2726cc72': None} {{(pid=83259) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:639}} Sep 16 15:10:00 devstack cinder-volume[83259]: DEBUG cinder.volume.drivers.quobyte [None req-3e76ff0f-e26d-4a66-adda-1a2e48aa08de tempest-VolumesTransfersV357Test-481525416 None] Available shares ['10.10.41.181/cinder-vol-61f585ac-f8e2-4d19-a890-7ebc2726cc72'] {{(pid=83259) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:669}} Sep 16 15:10:00 devstack cinder-volume[83259]: DEBUG oslo_concurrency.lockutils [None req-3e76ff0f-e26d-4a66-adda-1a2e48aa08de tempest-VolumesTransfersV357Test-481525416 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=83259) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 16 15:10:00 devstack cinder-volume[83259]: DEBUG cinder.volume.drivers.quobyte [None req-3e76ff0f-e26d-4a66-adda-1a2e48aa08de tempest-VolumesTransfersV357Test-481525416 None] Selected 10.10.41.181/cinder-vol-61f585ac-f8e2-4d19-a890-7ebc2726cc72 as target Quobyte volume. {{(pid=83259) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:690}} Sep 16 15:10:00 devstack cinder-volume[83259]: INFO cinder.volume.drivers.remotefs [None req-3e76ff0f-e26d-4a66-adda-1a2e48aa08de tempest-VolumesTransfersV357Test-481525416 None] casted to 10.10.41.181/cinder-vol-61f585ac-f8e2-4d19-a890-7ebc2726cc72 Sep 16 15:10:00 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [None req-3e76ff0f-e26d-4a66-adda-1a2e48aa08de tempest-VolumesTransfersV357Test-481525416 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c/volume-cd5a4bee-8067-4947-8e33-574e2c3ad1df 1073741824 {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 15:10:00 devstack quobyte-client[83286]: System call of process 94978 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 16 15:10:00 devstack quobyte-client[83286]: The server volume:87712ffe-8a69-446d-9ed6-4430c7ee9792@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=87712ffe-8a69-446d-9ed6-4430c7ee9792, inode=95, name=volume-cd5a4bee-8067-4947-8e33-574e2c3ad1df, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.206), requestorAccessMask=0 Sep 16 15:10:00 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [None req-3e76ff0f-e26d-4a66-adda-1a2e48aa08de tempest-VolumesTransfersV357Test-481525416 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c/volume-cd5a4bee-8067-4947-8e33-574e2c3ad1df 1073741824" returned: 0 in 0.453s {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 15:10:00 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [None req-3e76ff0f-e26d-4a66-adda-1a2e48aa08de tempest-VolumesTransfersV357Test-481525416 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c/volume-cd5a4bee-8067-4947-8e33-574e2c3ad1df {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 15:10:01 devstack cinder-volume[83259]: WARNING cinder.volume.volume_utils [None req-132ecaa9-f5cb-4355-b725-43c54d6f8c51 tempest-AbsoluteLimitsTests-945705968 None] Volume driver (QuobyteDriver 1.2) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 16 15:10:01 devstack cinder-volume[83259]: DEBUG cinder.volume.flows.manager.create_volume [None req-132ecaa9-f5cb-4355-b725-43c54d6f8c51 tempest-AbsoluteLimitsTests-945705968 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#Quobyte'], 'hosts': ['devstack@QuobyteHD#Quobyte']} {{(pid=83259) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1387}} Sep 16 15:10:01 devstack cinder-volume[83259]: DEBUG cinder.volume.manager [None req-132ecaa9-f5cb-4355-b725-43c54d6f8c51 tempest-AbsoluteLimitsTests-945705968 None] Flow 'volume_create_manager' (a6033f81-a93f-4129-bb1b-98070bdfb9fb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83259) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 16 15:10:01 devstack cinder-volume[83259]: DEBUG cinder.volume.manager [None req-132ecaa9-f5cb-4355-b725-43c54d6f8c51 tempest-AbsoluteLimitsTests-945705968 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3a48f859-f831-4074-aba4-94bbf000fd44) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83259) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 15:10:01 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [None req-3e76ff0f-e26d-4a66-adda-1a2e48aa08de tempest-VolumesTransfersV357Test-481525416 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c/volume-cd5a4bee-8067-4947-8e33-574e2c3ad1df" returned: 0 in 0.460s {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 15:10:01 devstack cinder-volume[83259]: DEBUG cinder.volume.manager [None req-132ecaa9-f5cb-4355-b725-43c54d6f8c51 tempest-AbsoluteLimitsTests-945705968 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3a48f859-f831-4074-aba4-94bbf000fd44) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-16T13:10:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AbsoluteLimitsTests-Volume-727404813',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#Quobyte',id=e726bd85-2896-4f12-ac88-5f6602addb18,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ec28c2d5f8ff4e76ad14b86fdd8b4183',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-16T13:10:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-16T13:10:00Z,use_quota=True,user_id='80a81f70b93646d3bdcacc98d99f7d6c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(485ead50-3df8-4d76-8d34-a4db136c980a),volume_type_id=485ead50-3df8-4d76-8d34-a4db136c980a)' {{(pid=83259) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 15:10:01 devstack cinder-volume[83259]: DEBUG cinder.volume.manager [None req-132ecaa9-f5cb-4355-b725-43c54d6f8c51 tempest-AbsoluteLimitsTests-945705968 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (698c0496-707c-435e-bc98-a75ebf6469b0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83259) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 15:10:01 devstack cinder-volume[83259]: DEBUG cinder.volume.manager [None req-132ecaa9-f5cb-4355-b725-43c54d6f8c51 tempest-AbsoluteLimitsTests-945705968 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (698c0496-707c-435e-bc98-a75ebf6469b0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83259) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 15:10:01 devstack cinder-volume[83259]: DEBUG cinder.volume.manager [None req-132ecaa9-f5cb-4355-b725-43c54d6f8c51 tempest-AbsoluteLimitsTests-945705968 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (112de36c-c980-4800-b09b-a55965b83e4c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83259) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 15:10:01 devstack cinder-volume[83259]: DEBUG cinder.volume.manager [None req-132ecaa9-f5cb-4355-b725-43c54d6f8c51 tempest-AbsoluteLimitsTests-945705968 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (112de36c-c980-4800-b09b-a55965b83e4c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e726bd85-2896-4f12-ac88-5f6602addb18', 'volume_name': 'volume-e726bd85-2896-4f12-ac88-5f6602addb18', 'volume_size': 1}' {{(pid=83259) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 15:10:01 devstack cinder-volume[83259]: DEBUG cinder.volume.manager [None req-132ecaa9-f5cb-4355-b725-43c54d6f8c51 tempest-AbsoluteLimitsTests-945705968 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7c84e3aa-7eef-432f-8689-ad870dbdae33) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83259) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 15:10:01 devstack cinder-volume[83259]: DEBUG cinder.volume.manager [None req-132ecaa9-f5cb-4355-b725-43c54d6f8c51 tempest-AbsoluteLimitsTests-945705968 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7c84e3aa-7eef-432f-8689-ad870dbdae33) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83259) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 15:10:01 devstack cinder-volume[83259]: DEBUG cinder.volume.manager [None req-132ecaa9-f5cb-4355-b725-43c54d6f8c51 tempest-AbsoluteLimitsTests-945705968 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (79b7d9ed-fdcd-42ce-96e6-510a838a2d99) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83259) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 15:10:01 devstack cinder-volume[83259]: INFO cinder.volume.flows.manager.create_volume [None req-132ecaa9-f5cb-4355-b725-43c54d6f8c51 tempest-AbsoluteLimitsTests-945705968 None] Volume e726bd85-2896-4f12-ac88-5f6602addb18: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e726bd85-2896-4f12-ac88-5f6602addb18', 'volume_size': 1} Sep 16 15:10:01 devstack cinder-volume[83259]: DEBUG oslo_concurrency.lockutils [None req-132ecaa9-f5cb-4355-b725-43c54d6f8c51 tempest-AbsoluteLimitsTests-945705968 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83259) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 16 15:10:01 devstack cinder-volume[83259]: DEBUG cinder.volume.drivers.quobyte [None req-3e76ff0f-e26d-4a66-adda-1a2e48aa08de tempest-VolumesTransfersV357Test-481525416 None] <== create_volume: return (994ms) {'provider_location': '10.10.41.181/cinder-vol-61f585ac-f8e2-4d19-a890-7ebc2726cc72'} {{(pid=83259) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Sep 16 15:10:01 devstack cinder-volume[83259]: DEBUG oslo_concurrency.lockutils [None req-3e76ff0f-e26d-4a66-adda-1a2e48aa08de tempest-VolumesTransfersV357Test-481525416 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.001s {{(pid=83259) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 16 15:10:01 devstack cinder-volume[83259]: DEBUG oslo_concurrency.lockutils [None req-132ecaa9-f5cb-4355-b725-43c54d6f8c51 tempest-AbsoluteLimitsTests-945705968 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.025s {{(pid=83259) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 16 15:10:01 devstack cinder-volume[83259]: DEBUG cinder.volume.drivers.quobyte [None req-132ecaa9-f5cb-4355-b725-43c54d6f8c51 tempest-AbsoluteLimitsTests-945705968 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-16T13:10:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AbsoluteLimitsTests-Volume-727404813',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#Quobyte',id=e726bd85-2896-4f12-ac88-5f6602addb18,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ec28c2d5f8ff4e76ad14b86fdd8b4183',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-16T13:10:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-16T13:10:00Z,use_quota=True,user_id='80a81f70b93646d3bdcacc98d99f7d6c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(485ead50-3df8-4d76-8d34-a4db136c980a),volume_type_id=485ead50-3df8-4d76-8d34-a4db136c980a)}" {{(pid=83259) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Sep 16 15:10:01 devstack cinder-volume[83259]: DEBUG cinder.volume.drivers.remotefs [None req-132ecaa9-f5cb-4355-b725-43c54d6f8c51 tempest-AbsoluteLimitsTests-945705968 None] Creating volume e726bd85-2896-4f12-ac88-5f6602addb18 {{(pid=83259) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}} Sep 16 15:10:01 devstack cinder-volume[83259]: DEBUG oslo_concurrency.lockutils [None req-132ecaa9-f5cb-4355-b725-43c54d6f8c51 tempest-AbsoluteLimitsTests-945705968 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83259) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 16 15:10:01 devstack cinder-volume[83259]: DEBUG oslo_concurrency.lockutils [None req-132ecaa9-f5cb-4355-b725-43c54d6f8c51 tempest-AbsoluteLimitsTests-945705968 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83259) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 16 15:10:01 devstack cinder-volume[83259]: DEBUG cinder.volume.drivers.quobyte [None req-132ecaa9-f5cb-4355-b725-43c54d6f8c51 tempest-AbsoluteLimitsTests-945705968 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-61f585ac-f8e2-4d19-a890-7ebc2726cc72': None} {{(pid=83259) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:639}} Sep 16 15:10:01 devstack cinder-volume[83259]: DEBUG cinder.volume.drivers.quobyte [None req-132ecaa9-f5cb-4355-b725-43c54d6f8c51 tempest-AbsoluteLimitsTests-945705968 None] Available shares ['10.10.41.181/cinder-vol-61f585ac-f8e2-4d19-a890-7ebc2726cc72'] {{(pid=83259) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:669}} Sep 16 15:10:01 devstack cinder-volume[83259]: DEBUG oslo_concurrency.lockutils [None req-132ecaa9-f5cb-4355-b725-43c54d6f8c51 tempest-AbsoluteLimitsTests-945705968 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=83259) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 16 15:10:01 devstack cinder-volume[83259]: DEBUG cinder.volume.drivers.quobyte [None req-132ecaa9-f5cb-4355-b725-43c54d6f8c51 tempest-AbsoluteLimitsTests-945705968 None] Selected 10.10.41.181/cinder-vol-61f585ac-f8e2-4d19-a890-7ebc2726cc72 as target Quobyte volume. {{(pid=83259) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:690}} Sep 16 15:10:01 devstack cinder-volume[83259]: INFO cinder.volume.drivers.remotefs [None req-132ecaa9-f5cb-4355-b725-43c54d6f8c51 tempest-AbsoluteLimitsTests-945705968 None] casted to 10.10.41.181/cinder-vol-61f585ac-f8e2-4d19-a890-7ebc2726cc72 Sep 16 15:10:01 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [None req-132ecaa9-f5cb-4355-b725-43c54d6f8c51 tempest-AbsoluteLimitsTests-945705968 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c/volume-e726bd85-2896-4f12-ac88-5f6602addb18 1073741824 {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 15:10:01 devstack quobyte-client[83286]: System call of process 94988 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 16 15:10:01 devstack quobyte-client[83286]: The server volume:87712ffe-8a69-446d-9ed6-4430c7ee9792@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=87712ffe-8a69-446d-9ed6-4430c7ee9792, inode=96, name=volume-e726bd85-2896-4f12-ac88-5f6602addb18, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.206), requestorAccessMask=0 Sep 16 15:10:01 devstack cinder-volume[83259]: DEBUG cinder.volume.manager [None req-3e76ff0f-e26d-4a66-adda-1a2e48aa08de tempest-VolumesTransfersV357Test-481525416 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a7aded55-1f81-4aa1-b273-9955d609bddd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-cd5a4bee-8067-4947-8e33-574e2c3ad1df', 'volume_size': 1}' {{(pid=83259) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 15:10:01 devstack cinder-volume[83259]: DEBUG cinder.volume.manager [None req-3e76ff0f-e26d-4a66-adda-1a2e48aa08de tempest-VolumesTransfersV357Test-481525416 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d9810d69-3593-4efd-8d40-d2d4aff704e6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83259) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 15:10:01 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [None req-132ecaa9-f5cb-4355-b725-43c54d6f8c51 tempest-AbsoluteLimitsTests-945705968 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c/volume-e726bd85-2896-4f12-ac88-5f6602addb18 1073741824" returned: 0 in 0.436s {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 15:10:01 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [None req-132ecaa9-f5cb-4355-b725-43c54d6f8c51 tempest-AbsoluteLimitsTests-945705968 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c/volume-e726bd85-2896-4f12-ac88-5f6602addb18 {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 15:10:02 devstack cinder-volume[83259]: INFO cinder.volume.flows.manager.create_volume [None req-3e76ff0f-e26d-4a66-adda-1a2e48aa08de tempest-VolumesTransfersV357Test-481525416 None] Volume volume-cd5a4bee-8067-4947-8e33-574e2c3ad1df (cd5a4bee-8067-4947-8e33-574e2c3ad1df): created successfully Sep 16 15:10:02 devstack cinder-volume[83259]: DEBUG cinder.volume.manager [None req-3e76ff0f-e26d-4a66-adda-1a2e48aa08de tempest-VolumesTransfersV357Test-481525416 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d9810d69-3593-4efd-8d40-d2d4aff704e6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83259) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 15:10:02 devstack cinder-volume[83259]: DEBUG cinder.volume.manager [None req-3e76ff0f-e26d-4a66-adda-1a2e48aa08de tempest-VolumesTransfersV357Test-481525416 None] Flow 'volume_create_manager' (7d5d96cb-a2cc-405a-92f3-51d44c5b1c52) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83259) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 16 15:10:02 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [None req-132ecaa9-f5cb-4355-b725-43c54d6f8c51 tempest-AbsoluteLimitsTests-945705968 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c/volume-e726bd85-2896-4f12-ac88-5f6602addb18" returned: 0 in 0.388s {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 15:10:02 devstack cinder-volume[83259]: DEBUG cinder.volume.drivers.quobyte [None req-132ecaa9-f5cb-4355-b725-43c54d6f8c51 tempest-AbsoluteLimitsTests-945705968 None] <== create_volume: return (844ms) {'provider_location': '10.10.41.181/cinder-vol-61f585ac-f8e2-4d19-a890-7ebc2726cc72'} {{(pid=83259) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Sep 16 15:10:02 devstack cinder-volume[83259]: DEBUG oslo_concurrency.lockutils [None req-132ecaa9-f5cb-4355-b725-43c54d6f8c51 tempest-AbsoluteLimitsTests-945705968 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.853s {{(pid=83259) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 16 15:10:02 devstack cinder-volume[83259]: INFO cinder.volume.manager [None req-3e76ff0f-e26d-4a66-adda-1a2e48aa08de tempest-VolumesTransfersV357Test-481525416 None] Created volume successfully. Sep 16 15:10:02 devstack cinder-volume[83259]: DEBUG cinder.volume.manager [None req-132ecaa9-f5cb-4355-b725-43c54d6f8c51 tempest-AbsoluteLimitsTests-945705968 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (79b7d9ed-fdcd-42ce-96e6-510a838a2d99) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e726bd85-2896-4f12-ac88-5f6602addb18', 'volume_size': 1}' {{(pid=83259) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 15:10:02 devstack cinder-volume[83259]: DEBUG cinder.volume.manager [None req-132ecaa9-f5cb-4355-b725-43c54d6f8c51 tempest-AbsoluteLimitsTests-945705968 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a54f1fe6-460f-4fc1-9b00-d98af8d14967) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83259) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 15:10:02 devstack cinder-volume[83259]: INFO cinder.volume.flows.manager.create_volume [None req-132ecaa9-f5cb-4355-b725-43c54d6f8c51 tempest-AbsoluteLimitsTests-945705968 None] Volume volume-e726bd85-2896-4f12-ac88-5f6602addb18 (e726bd85-2896-4f12-ac88-5f6602addb18): created successfully Sep 16 15:10:02 devstack cinder-volume[83259]: DEBUG cinder.volume.manager [None req-132ecaa9-f5cb-4355-b725-43c54d6f8c51 tempest-AbsoluteLimitsTests-945705968 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a54f1fe6-460f-4fc1-9b00-d98af8d14967) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83259) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 15:10:02 devstack cinder-volume[83259]: DEBUG cinder.volume.manager [None req-132ecaa9-f5cb-4355-b725-43c54d6f8c51 tempest-AbsoluteLimitsTests-945705968 None] Flow 'volume_create_manager' (a6033f81-a93f-4129-bb1b-98070bdfb9fb) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83259) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 16 15:10:02 devstack cinder-volume[83259]: INFO cinder.volume.manager [None req-132ecaa9-f5cb-4355-b725-43c54d6f8c51 tempest-AbsoluteLimitsTests-945705968 None] Created volume successfully. Sep 16 15:10:02 devstack cinder-volume[83259]: DEBUG cinder.coordination [None req-a6f3705b-5cdc-4cec-8237-feb38127c630 tempest-VolumesTransfersV357Test-1466688312 None] Acquiring lock "cinder-cd5a4bee-8067-4947-8e33-574e2c3ad1df-delete_volume" by "delete_volume" {{(pid=83259) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 16 15:10:03 devstack cinder-volume[83259]: DEBUG cinder.coordination [None req-e26efbfe-90fd-4b69-ac43-32255be45c23 tempest-AbsoluteLimitsTests-945705968 None] Acquiring lock "cinder-e726bd85-2896-4f12-ac88-5f6602addb18-delete_volume" by "delete_volume" {{(pid=83259) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 16 15:10:03 devstack cinder-volume[83259]: DEBUG cinder.coordination [None req-a6f3705b-5cdc-4cec-8237-feb38127c630 tempest-VolumesTransfersV357Test-1466688312 None] Lock "cinder-cd5a4bee-8067-4947-8e33-574e2c3ad1df-delete_volume" acquired by "delete_volume" :: waited 0.117s {{(pid=83259) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 16 15:10:03 devstack cinder-volume[83259]: DEBUG cinder.coordination [None req-e26efbfe-90fd-4b69-ac43-32255be45c23 tempest-AbsoluteLimitsTests-945705968 None] Lock "cinder-e726bd85-2896-4f12-ac88-5f6602addb18-delete_volume" acquired by "delete_volume" :: waited 0.078s {{(pid=83259) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 16 15:10:03 devstack cinder-volume[83259]: WARNING cinder.volume.volume_utils [None req-a6f3705b-5cdc-4cec-8237-feb38127c630 tempest-VolumesTransfersV357Test-1466688312 None] Volume driver (QuobyteDriver 1.2) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 16 15:10:03 devstack cinder-volume[83259]: DEBUG cinder.coordination [None req-a6f3705b-5cdc-4cec-8237-feb38127c630 tempest-VolumesTransfersV357Test-1466688312 None] Acquiring lock "cinder-quobyte-cd5a4bee-8067-4947-8e33-574e2c3ad1df" by "delete_volume" {{(pid=83259) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 16 15:10:03 devstack cinder-volume[83259]: WARNING cinder.volume.volume_utils [None req-e26efbfe-90fd-4b69-ac43-32255be45c23 tempest-AbsoluteLimitsTests-945705968 None] Volume driver (QuobyteDriver 1.2) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 16 15:10:03 devstack cinder-volume[83259]: DEBUG cinder.coordination [None req-e26efbfe-90fd-4b69-ac43-32255be45c23 tempest-AbsoluteLimitsTests-945705968 None] Acquiring lock "cinder-quobyte-e726bd85-2896-4f12-ac88-5f6602addb18" by "delete_volume" {{(pid=83259) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 16 15:10:03 devstack cinder-volume[83259]: DEBUG cinder.coordination [None req-a6f3705b-5cdc-4cec-8237-feb38127c630 tempest-VolumesTransfersV357Test-1466688312 None] Lock "cinder-quobyte-cd5a4bee-8067-4947-8e33-574e2c3ad1df" acquired by "delete_volume" :: waited 0.032s {{(pid=83259) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 16 15:10:03 devstack cinder-volume[83259]: DEBUG oslo.privsep.daemon [-] privsep: reply[9319cc29-590f-43ab-af0c-f345834e40cc]: (4, 'qcow2') {{(pid=84312) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 16 15:10:03 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [None req-a6f3705b-5cdc-4cec-8237-feb38127c630 tempest-VolumesTransfersV357Test-1466688312 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c/volume-cd5a4bee-8067-4947-8e33-574e2c3ad1df {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 15:10:03 devstack cinder-volume[83259]: DEBUG cinder.coordination [None req-e26efbfe-90fd-4b69-ac43-32255be45c23 tempest-AbsoluteLimitsTests-945705968 None] Lock "cinder-quobyte-e726bd85-2896-4f12-ac88-5f6602addb18" acquired by "delete_volume" :: waited 0.178s {{(pid=83259) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 16 15:10:03 devstack cinder-volume[83259]: DEBUG oslo.privsep.daemon [-] privsep: reply[14814b3d-8d8a-4394-be9d-928f47442c0a]: (4, 'qcow2') {{(pid=84312) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 16 15:10:03 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [None req-e26efbfe-90fd-4b69-ac43-32255be45c23 tempest-AbsoluteLimitsTests-945705968 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c/volume-e726bd85-2896-4f12-ac88-5f6602addb18 {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 15:10:03 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [None req-a6f3705b-5cdc-4cec-8237-feb38127c630 tempest-VolumesTransfersV357Test-1466688312 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c/volume-cd5a4bee-8067-4947-8e33-574e2c3ad1df" returned: 0 in 0.615s {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 15:10:03 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [None req-a6f3705b-5cdc-4cec-8237-feb38127c630 tempest-VolumesTransfersV357Test-1466688312 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c/volume-cd5a4bee-8067-4947-8e33-574e2c3ad1df {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 15:10:04 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [None req-a6f3705b-5cdc-4cec-8237-feb38127c630 tempest-VolumesTransfersV357Test-1466688312 None] CMD "rm -f /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c/volume-cd5a4bee-8067-4947-8e33-574e2c3ad1df" returned: 0 in 0.180s {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 15:10:04 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [None req-e26efbfe-90fd-4b69-ac43-32255be45c23 tempest-AbsoluteLimitsTests-945705968 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c/volume-e726bd85-2896-4f12-ac88-5f6602addb18" returned: 0 in 0.732s {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 15:10:04 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [None req-e26efbfe-90fd-4b69-ac43-32255be45c23 tempest-AbsoluteLimitsTests-945705968 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c/volume-e726bd85-2896-4f12-ac88-5f6602addb18 {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 15:10:04 devstack cinder-volume[83259]: DEBUG cinder.coordination [None req-a6f3705b-5cdc-4cec-8237-feb38127c630 tempest-VolumesTransfersV357Test-1466688312 None] Lock "cinder-quobyte-cd5a4bee-8067-4947-8e33-574e2c3ad1df" released by "delete_volume" :: held 1.121s {{(pid=83259) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 16 15:10:04 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [None req-e26efbfe-90fd-4b69-ac43-32255be45c23 tempest-AbsoluteLimitsTests-945705968 None] CMD "rm -f /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c/volume-e726bd85-2896-4f12-ac88-5f6602addb18" returned: 0 in 0.340s {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 15:10:04 devstack cinder-volume[83259]: DEBUG cinder.coordination [None req-e26efbfe-90fd-4b69-ac43-32255be45c23 tempest-AbsoluteLimitsTests-945705968 None] Lock "cinder-quobyte-e726bd85-2896-4f12-ac88-5f6602addb18" released by "delete_volume" :: held 1.234s {{(pid=83259) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 16 15:10:04 devstack cinder-volume[83259]: DEBUG cinder.quota [None req-a6f3705b-5cdc-4cec-8237-feb38127c630 tempest-VolumesTransfersV357Test-1466688312 None] Created reservations ['107bcb34-c017-4356-860b-08891f9157d5', 'c2d730b7-164f-44f2-a978-b7ccc187c08a', '75d54f2e-0052-4512-bdac-c7e65ccee0d3', 'c599bc90-bfbb-42fb-97f2-0103bcfef49e'] {{(pid=83259) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 16 15:10:04 devstack cinder-volume[83259]: DEBUG cinder.quota [None req-e26efbfe-90fd-4b69-ac43-32255be45c23 tempest-AbsoluteLimitsTests-945705968 None] Created reservations ['aa9343d2-25ce-4440-bb4d-a0d6ef5c216a', 'da0bda9a-5390-4885-83e8-686389ddd923', 'a4264150-2566-467d-bb2c-8d0315d07380', 'a973a3fd-9fd8-4e93-a285-aa38d83becd2'] {{(pid=83259) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 16 15:10:05 devstack cinder-volume[83259]: DEBUG oslo_concurrency.lockutils [None req-e26efbfe-90fd-4b69-ac43-32255be45c23 tempest-AbsoluteLimitsTests-945705968 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83259) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 16 15:10:05 devstack cinder-volume[83259]: DEBUG oslo_concurrency.lockutils [None req-e26efbfe-90fd-4b69-ac43-32255be45c23 tempest-AbsoluteLimitsTests-945705968 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=83259) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 16 15:10:05 devstack cinder-volume[83259]: DEBUG cinder.volume.drivers.quobyte [None req-e26efbfe-90fd-4b69-ac43-32255be45c23 tempest-AbsoluteLimitsTests-945705968 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-61f585ac-f8e2-4d19-a890-7ebc2726cc72': None} {{(pid=83259) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:639}} Sep 16 15:10:05 devstack cinder-volume[83259]: DEBUG cinder.volume.drivers.quobyte [None req-e26efbfe-90fd-4b69-ac43-32255be45c23 tempest-AbsoluteLimitsTests-945705968 None] Available shares ['10.10.41.181/cinder-vol-61f585ac-f8e2-4d19-a890-7ebc2726cc72'] {{(pid=83259) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:669}} Sep 16 15:10:05 devstack cinder-volume[83259]: DEBUG oslo_concurrency.lockutils [None req-e26efbfe-90fd-4b69-ac43-32255be45c23 tempest-AbsoluteLimitsTests-945705968 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=83259) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 16 15:10:05 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [None req-e26efbfe-90fd-4b69-ac43-32255be45c23 tempest-AbsoluteLimitsTests-945705968 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 15:10:05 devstack cinder-volume[83259]: DEBUG oslo_concurrency.lockutils [None req-a6f3705b-5cdc-4cec-8237-feb38127c630 tempest-VolumesTransfersV357Test-1466688312 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83259) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 16 15:10:05 devstack cinder-volume[83259]: DEBUG oslo_concurrency.lockutils [None req-a6f3705b-5cdc-4cec-8237-feb38127c630 tempest-VolumesTransfersV357Test-1466688312 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.027s {{(pid=83259) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 16 15:10:05 devstack cinder-volume[83259]: DEBUG cinder.volume.drivers.quobyte [None req-a6f3705b-5cdc-4cec-8237-feb38127c630 tempest-VolumesTransfersV357Test-1466688312 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-61f585ac-f8e2-4d19-a890-7ebc2726cc72': None} {{(pid=83259) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:639}} Sep 16 15:10:05 devstack cinder-volume[83259]: DEBUG cinder.volume.drivers.quobyte [None req-a6f3705b-5cdc-4cec-8237-feb38127c630 tempest-VolumesTransfersV357Test-1466688312 None] Available shares ['10.10.41.181/cinder-vol-61f585ac-f8e2-4d19-a890-7ebc2726cc72'] {{(pid=83259) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:669}} Sep 16 15:10:05 devstack cinder-volume[83259]: DEBUG oslo_concurrency.lockutils [None req-a6f3705b-5cdc-4cec-8237-feb38127c630 tempest-VolumesTransfersV357Test-1466688312 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=83259) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 16 15:10:05 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [None req-a6f3705b-5cdc-4cec-8237-feb38127c630 tempest-VolumesTransfersV357Test-1466688312 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 15:10:05 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [None req-e26efbfe-90fd-4b69-ac43-32255be45c23 tempest-AbsoluteLimitsTests-945705968 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c" returned: 0 in 0.759s {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 15:10:05 devstack cinder-volume[83259]: DEBUG cinder.manager [None req-e26efbfe-90fd-4b69-ac43-32255be45c23 tempest-AbsoluteLimitsTests-945705968 None] Notifying Schedulers of capabilities ... {{(pid=83259) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 16 15:10:05 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [None req-a6f3705b-5cdc-4cec-8237-feb38127c630 tempest-VolumesTransfersV357Test-1466688312 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c" returned: 0 in 0.685s {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 15:10:05 devstack cinder-volume[83259]: DEBUG cinder.manager [None req-a6f3705b-5cdc-4cec-8237-feb38127c630 tempest-VolumesTransfersV357Test-1466688312 None] Notifying Schedulers of capabilities ... {{(pid=83259) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 16 15:10:06 devstack cinder-volume[83259]: INFO cinder.volume.manager [None req-e26efbfe-90fd-4b69-ac43-32255be45c23 tempest-AbsoluteLimitsTests-945705968 None] Deleted volume successfully. Sep 16 15:10:06 devstack cinder-volume[83259]: INFO cinder.volume.manager [None req-a6f3705b-5cdc-4cec-8237-feb38127c630 tempest-VolumesTransfersV357Test-1466688312 None] Deleted volume successfully. Sep 16 15:10:06 devstack cinder-volume[83259]: DEBUG cinder.coordination [None req-e26efbfe-90fd-4b69-ac43-32255be45c23 tempest-AbsoluteLimitsTests-945705968 None] Lock "cinder-e726bd85-2896-4f12-ac88-5f6602addb18-delete_volume" released by "delete_volume" :: held 3.276s {{(pid=83259) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 16 15:10:06 devstack cinder-volume[83259]: DEBUG cinder.coordination [None req-a6f3705b-5cdc-4cec-8237-feb38127c630 tempest-VolumesTransfersV357Test-1466688312 None] Lock "cinder-cd5a4bee-8067-4947-8e33-574e2c3ad1df-delete_volume" released by "delete_volume" :: held 3.369s {{(pid=83259) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 16 15:10:12 devstack cinder-volume[83259]: WARNING cinder.volume.volume_utils [None req-3c160439-3f69-4713-8a22-3106eb92986d tempest-VolumesMetadataTest-869046247 None] Volume driver (QuobyteDriver 1.2) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 16 15:10:12 devstack cinder-volume[83259]: DEBUG cinder.volume.flows.manager.create_volume [None req-3c160439-3f69-4713-8a22-3106eb92986d tempest-VolumesMetadataTest-869046247 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#Quobyte'], 'hosts': ['devstack@QuobyteHD#Quobyte']} {{(pid=83259) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1387}} Sep 16 15:10:12 devstack cinder-volume[83259]: DEBUG cinder.volume.manager [None req-3c160439-3f69-4713-8a22-3106eb92986d tempest-VolumesMetadataTest-869046247 None] Flow 'volume_create_manager' (0307902e-7655-4321-a8f5-6b28b832b7cb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83259) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 16 15:10:12 devstack cinder-volume[83259]: DEBUG cinder.volume.manager [None req-3c160439-3f69-4713-8a22-3106eb92986d tempest-VolumesMetadataTest-869046247 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cb392b7a-5ad3-4471-a13a-0e379fe9998c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83259) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 15:10:12 devstack cinder-volume[83259]: DEBUG cinder.volume.manager [None req-3c160439-3f69-4713-8a22-3106eb92986d tempest-VolumesMetadataTest-869046247 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cb392b7a-5ad3-4471-a13a-0e379fe9998c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-16T13:10:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesMetadataTest-Volume-1919099236',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#Quobyte',id=fef3e2d0-1704-473b-a6a7-3b3679063860,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2ad97ed1ccd64597ad7ac98904883af0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-16T13:10:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-16T13:10:12Z,use_quota=True,user_id='f84f426cf5bf41a3a4ae6e5fab3f8991',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(485ead50-3df8-4d76-8d34-a4db136c980a),volume_type_id=485ead50-3df8-4d76-8d34-a4db136c980a)' {{(pid=83259) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 15:10:12 devstack cinder-volume[83259]: DEBUG cinder.volume.manager [None req-3c160439-3f69-4713-8a22-3106eb92986d tempest-VolumesMetadataTest-869046247 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (99e78949-8ac2-4975-8268-51a4bf357532) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83259) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 15:10:12 devstack cinder-volume[83259]: DEBUG cinder.volume.manager [None req-3c160439-3f69-4713-8a22-3106eb92986d tempest-VolumesMetadataTest-869046247 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (99e78949-8ac2-4975-8268-51a4bf357532) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83259) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 15:10:12 devstack cinder-volume[83259]: DEBUG cinder.volume.manager [None req-3c160439-3f69-4713-8a22-3106eb92986d tempest-VolumesMetadataTest-869046247 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (35a2d063-3090-401c-8de2-7e3b4a07b5d1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83259) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 15:10:12 devstack cinder-volume[83259]: DEBUG cinder.volume.manager [None req-3c160439-3f69-4713-8a22-3106eb92986d tempest-VolumesMetadataTest-869046247 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (35a2d063-3090-401c-8de2-7e3b4a07b5d1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'fef3e2d0-1704-473b-a6a7-3b3679063860', 'volume_name': 'volume-fef3e2d0-1704-473b-a6a7-3b3679063860', 'volume_size': 1}' {{(pid=83259) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 15:10:12 devstack cinder-volume[83259]: DEBUG cinder.volume.manager [None req-3c160439-3f69-4713-8a22-3106eb92986d tempest-VolumesMetadataTest-869046247 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e2aca043-00c2-418c-99fc-b1a26d7459f8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83259) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 15:10:12 devstack cinder-volume[83259]: DEBUG cinder.volume.manager [None req-3c160439-3f69-4713-8a22-3106eb92986d tempest-VolumesMetadataTest-869046247 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e2aca043-00c2-418c-99fc-b1a26d7459f8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83259) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 15:10:12 devstack cinder-volume[83259]: DEBUG cinder.volume.manager [None req-3c160439-3f69-4713-8a22-3106eb92986d tempest-VolumesMetadataTest-869046247 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7353045a-90e7-477e-b548-f7e2292550e1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83259) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 15:10:12 devstack cinder-volume[83259]: INFO cinder.volume.flows.manager.create_volume [None req-3c160439-3f69-4713-8a22-3106eb92986d tempest-VolumesMetadataTest-869046247 None] Volume fef3e2d0-1704-473b-a6a7-3b3679063860: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-fef3e2d0-1704-473b-a6a7-3b3679063860', 'volume_size': 1} Sep 16 15:10:12 devstack cinder-volume[83259]: DEBUG oslo_concurrency.lockutils [None req-3c160439-3f69-4713-8a22-3106eb92986d tempest-VolumesMetadataTest-869046247 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83259) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 16 15:10:12 devstack cinder-volume[83259]: DEBUG oslo_concurrency.lockutils [None req-3c160439-3f69-4713-8a22-3106eb92986d tempest-VolumesMetadataTest-869046247 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=83259) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 16 15:10:12 devstack cinder-volume[83259]: DEBUG cinder.volume.drivers.quobyte [None req-3c160439-3f69-4713-8a22-3106eb92986d tempest-VolumesMetadataTest-869046247 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-16T13:10:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesMetadataTest-Volume-1919099236',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#Quobyte',id=fef3e2d0-1704-473b-a6a7-3b3679063860,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2ad97ed1ccd64597ad7ac98904883af0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-16T13:10:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-16T13:10:12Z,use_quota=True,user_id='f84f426cf5bf41a3a4ae6e5fab3f8991',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(485ead50-3df8-4d76-8d34-a4db136c980a),volume_type_id=485ead50-3df8-4d76-8d34-a4db136c980a)}" {{(pid=83259) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Sep 16 15:10:12 devstack cinder-volume[83259]: DEBUG cinder.volume.drivers.remotefs [None req-3c160439-3f69-4713-8a22-3106eb92986d tempest-VolumesMetadataTest-869046247 None] Creating volume fef3e2d0-1704-473b-a6a7-3b3679063860 {{(pid=83259) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}} Sep 16 15:10:12 devstack cinder-volume[83259]: DEBUG oslo_concurrency.lockutils [None req-3c160439-3f69-4713-8a22-3106eb92986d tempest-VolumesMetadataTest-869046247 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83259) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 16 15:10:12 devstack cinder-volume[83259]: DEBUG oslo_concurrency.lockutils [None req-3c160439-3f69-4713-8a22-3106eb92986d tempest-VolumesMetadataTest-869046247 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83259) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 16 15:10:12 devstack cinder-volume[83259]: DEBUG cinder.volume.drivers.quobyte [None req-3c160439-3f69-4713-8a22-3106eb92986d tempest-VolumesMetadataTest-869046247 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-61f585ac-f8e2-4d19-a890-7ebc2726cc72': None} {{(pid=83259) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:639}} Sep 16 15:10:12 devstack cinder-volume[83259]: DEBUG cinder.volume.drivers.quobyte [None req-3c160439-3f69-4713-8a22-3106eb92986d tempest-VolumesMetadataTest-869046247 None] Available shares ['10.10.41.181/cinder-vol-61f585ac-f8e2-4d19-a890-7ebc2726cc72'] {{(pid=83259) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:669}} Sep 16 15:10:12 devstack cinder-volume[83259]: DEBUG oslo_concurrency.lockutils [None req-3c160439-3f69-4713-8a22-3106eb92986d tempest-VolumesMetadataTest-869046247 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=83259) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 16 15:10:12 devstack cinder-volume[83259]: DEBUG cinder.volume.drivers.quobyte [None req-3c160439-3f69-4713-8a22-3106eb92986d tempest-VolumesMetadataTest-869046247 None] Selected 10.10.41.181/cinder-vol-61f585ac-f8e2-4d19-a890-7ebc2726cc72 as target Quobyte volume. {{(pid=83259) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:690}} Sep 16 15:10:12 devstack cinder-volume[83259]: INFO cinder.volume.drivers.remotefs [None req-3c160439-3f69-4713-8a22-3106eb92986d tempest-VolumesMetadataTest-869046247 None] casted to 10.10.41.181/cinder-vol-61f585ac-f8e2-4d19-a890-7ebc2726cc72 Sep 16 15:10:12 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [None req-3c160439-3f69-4713-8a22-3106eb92986d tempest-VolumesMetadataTest-869046247 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c/volume-fef3e2d0-1704-473b-a6a7-3b3679063860 1073741824 {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 15:10:12 devstack quobyte-client[83286]: The server volume:87712ffe-8a69-446d-9ed6-4430c7ee9792@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=87712ffe-8a69-446d-9ed6-4430c7ee9792, inode=97, name=volume-fef3e2d0-1704-473b-a6a7-3b3679063860, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.206), requestorAccessMask=0 Sep 16 15:10:13 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [None req-3c160439-3f69-4713-8a22-3106eb92986d tempest-VolumesMetadataTest-869046247 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c/volume-fef3e2d0-1704-473b-a6a7-3b3679063860 1073741824" returned: 0 in 0.407s {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 15:10:13 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [None req-3c160439-3f69-4713-8a22-3106eb92986d tempest-VolumesMetadataTest-869046247 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c/volume-fef3e2d0-1704-473b-a6a7-3b3679063860 {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 15:10:13 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [None req-3c160439-3f69-4713-8a22-3106eb92986d tempest-VolumesMetadataTest-869046247 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c/volume-fef3e2d0-1704-473b-a6a7-3b3679063860" returned: 0 in 0.124s {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 15:10:13 devstack cinder-volume[83259]: DEBUG cinder.volume.drivers.quobyte [None req-3c160439-3f69-4713-8a22-3106eb92986d tempest-VolumesMetadataTest-869046247 None] <== create_volume: return (611ms) {'provider_location': '10.10.41.181/cinder-vol-61f585ac-f8e2-4d19-a890-7ebc2726cc72'} {{(pid=83259) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Sep 16 15:10:13 devstack cinder-volume[83259]: DEBUG oslo_concurrency.lockutils [None req-3c160439-3f69-4713-8a22-3106eb92986d tempest-VolumesMetadataTest-869046247 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.626s {{(pid=83259) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 16 15:10:13 devstack cinder-volume[83259]: DEBUG cinder.volume.manager [None req-3c160439-3f69-4713-8a22-3106eb92986d tempest-VolumesMetadataTest-869046247 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7353045a-90e7-477e-b548-f7e2292550e1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-fef3e2d0-1704-473b-a6a7-3b3679063860', 'volume_size': 1}' {{(pid=83259) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 15:10:13 devstack cinder-volume[83259]: DEBUG cinder.volume.manager [None req-3c160439-3f69-4713-8a22-3106eb92986d tempest-VolumesMetadataTest-869046247 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (43c106ac-4b03-4453-b5d0-8710127b7095) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83259) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 15:10:13 devstack cinder-volume[83259]: INFO cinder.volume.flows.manager.create_volume [None req-3c160439-3f69-4713-8a22-3106eb92986d tempest-VolumesMetadataTest-869046247 None] Volume volume-fef3e2d0-1704-473b-a6a7-3b3679063860 (fef3e2d0-1704-473b-a6a7-3b3679063860): created successfully Sep 16 15:10:13 devstack cinder-volume[83259]: DEBUG cinder.volume.manager [None req-3c160439-3f69-4713-8a22-3106eb92986d tempest-VolumesMetadataTest-869046247 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (43c106ac-4b03-4453-b5d0-8710127b7095) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83259) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 15:10:13 devstack cinder-volume[83259]: DEBUG cinder.volume.manager [None req-3c160439-3f69-4713-8a22-3106eb92986d tempest-VolumesMetadataTest-869046247 None] Flow 'volume_create_manager' (0307902e-7655-4321-a8f5-6b28b832b7cb) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83259) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 16 15:10:13 devstack cinder-volume[83259]: INFO cinder.volume.manager [None req-3c160439-3f69-4713-8a22-3106eb92986d tempest-VolumesMetadataTest-869046247 None] Created volume successfully. Sep 16 15:10:15 devstack cinder-volume[83259]: DEBUG cinder.coordination [None req-1129cc11-3e1e-4f88-a26a-906600989516 tempest-VolumesMetadataTest-869046247 None] Acquiring lock "cinder-fef3e2d0-1704-473b-a6a7-3b3679063860-delete_volume" by "delete_volume" {{(pid=83259) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 16 15:10:15 devstack cinder-volume[83259]: DEBUG cinder.coordination [None req-1129cc11-3e1e-4f88-a26a-906600989516 tempest-VolumesMetadataTest-869046247 None] Lock "cinder-fef3e2d0-1704-473b-a6a7-3b3679063860-delete_volume" acquired by "delete_volume" :: waited 0.085s {{(pid=83259) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 16 15:10:16 devstack cinder-volume[83259]: WARNING cinder.volume.volume_utils [None req-1129cc11-3e1e-4f88-a26a-906600989516 tempest-VolumesMetadataTest-869046247 None] Volume driver (QuobyteDriver 1.2) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 16 15:10:16 devstack cinder-volume[83259]: DEBUG cinder.coordination [None req-1129cc11-3e1e-4f88-a26a-906600989516 tempest-VolumesMetadataTest-869046247 None] Acquiring lock "cinder-quobyte-fef3e2d0-1704-473b-a6a7-3b3679063860" by "delete_volume" {{(pid=83259) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 16 15:10:16 devstack cinder-volume[83259]: DEBUG cinder.coordination [None req-1129cc11-3e1e-4f88-a26a-906600989516 tempest-VolumesMetadataTest-869046247 None] Lock "cinder-quobyte-fef3e2d0-1704-473b-a6a7-3b3679063860" acquired by "delete_volume" :: waited 0.015s {{(pid=83259) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 16 15:10:16 devstack cinder-volume[83259]: DEBUG oslo.privsep.daemon [-] privsep: reply[d99ea228-5c55-4e1e-be30-05e849684c1a]: (4, 'qcow2') {{(pid=84312) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 16 15:10:16 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [None req-1129cc11-3e1e-4f88-a26a-906600989516 tempest-VolumesMetadataTest-869046247 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c/volume-fef3e2d0-1704-473b-a6a7-3b3679063860 {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 15:10:16 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [None req-1129cc11-3e1e-4f88-a26a-906600989516 tempest-VolumesMetadataTest-869046247 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c/volume-fef3e2d0-1704-473b-a6a7-3b3679063860" returned: 0 in 0.565s {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 15:10:16 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [None req-1129cc11-3e1e-4f88-a26a-906600989516 tempest-VolumesMetadataTest-869046247 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c/volume-fef3e2d0-1704-473b-a6a7-3b3679063860 {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 15:10:16 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [None req-1129cc11-3e1e-4f88-a26a-906600989516 tempest-VolumesMetadataTest-869046247 None] CMD "rm -f /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c/volume-fef3e2d0-1704-473b-a6a7-3b3679063860" returned: 0 in 0.106s {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 15:10:16 devstack cinder-volume[83259]: DEBUG cinder.coordination [None req-1129cc11-3e1e-4f88-a26a-906600989516 tempest-VolumesMetadataTest-869046247 None] Lock "cinder-quobyte-fef3e2d0-1704-473b-a6a7-3b3679063860" released by "delete_volume" :: held 0.889s {{(pid=83259) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 16 15:10:17 devstack cinder-volume[83259]: DEBUG cinder.quota [None req-1129cc11-3e1e-4f88-a26a-906600989516 tempest-VolumesMetadataTest-869046247 None] Created reservations ['31bd470f-c158-49d3-a8df-e1e3d1c63e60', '7db74cf6-0019-434c-b93d-beb68fdd08aa', '58c03334-9797-4584-a053-ed76566bcba6', '36e0b0b2-7e3c-41ff-9487-889ee129bf0c'] {{(pid=83259) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 16 15:10:17 devstack cinder-volume[83259]: DEBUG oslo_concurrency.lockutils [None req-1129cc11-3e1e-4f88-a26a-906600989516 tempest-VolumesMetadataTest-869046247 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83259) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 16 15:10:17 devstack cinder-volume[83259]: DEBUG oslo_concurrency.lockutils [None req-1129cc11-3e1e-4f88-a26a-906600989516 tempest-VolumesMetadataTest-869046247 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=83259) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 16 15:10:17 devstack cinder-volume[83259]: DEBUG cinder.volume.drivers.quobyte [None req-1129cc11-3e1e-4f88-a26a-906600989516 tempest-VolumesMetadataTest-869046247 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-61f585ac-f8e2-4d19-a890-7ebc2726cc72': None} {{(pid=83259) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:639}} Sep 16 15:10:17 devstack cinder-volume[83259]: DEBUG cinder.volume.drivers.quobyte [None req-1129cc11-3e1e-4f88-a26a-906600989516 tempest-VolumesMetadataTest-869046247 None] Available shares ['10.10.41.181/cinder-vol-61f585ac-f8e2-4d19-a890-7ebc2726cc72'] {{(pid=83259) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:669}} Sep 16 15:10:17 devstack cinder-volume[83259]: DEBUG oslo_concurrency.lockutils [None req-1129cc11-3e1e-4f88-a26a-906600989516 tempest-VolumesMetadataTest-869046247 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=83259) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 16 15:10:17 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [None req-1129cc11-3e1e-4f88-a26a-906600989516 tempest-VolumesMetadataTest-869046247 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 15:10:17 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [None req-1129cc11-3e1e-4f88-a26a-906600989516 tempest-VolumesMetadataTest-869046247 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c" returned: 0 in 0.128s {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 15:10:17 devstack cinder-volume[83259]: DEBUG cinder.manager [None req-1129cc11-3e1e-4f88-a26a-906600989516 tempest-VolumesMetadataTest-869046247 None] Notifying Schedulers of capabilities ... {{(pid=83259) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 16 15:10:17 devstack cinder-volume[83259]: INFO cinder.volume.manager [None req-1129cc11-3e1e-4f88-a26a-906600989516 tempest-VolumesMetadataTest-869046247 None] Deleted volume successfully. Sep 16 15:10:17 devstack cinder-volume[83259]: DEBUG cinder.coordination [None req-1129cc11-3e1e-4f88-a26a-906600989516 tempest-VolumesMetadataTest-869046247 None] Lock "cinder-fef3e2d0-1704-473b-a6a7-3b3679063860-delete_volume" released by "delete_volume" :: held 2.065s {{(pid=83259) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 16 15:10:24 devstack cinder-volume[83259]: WARNING cinder.volume.volume_utils [None req-2ab67f62-3745-4417-b54f-74266b70c4ce tempest-VolumesCloneNegativeTest-1358653647 None] Volume driver (QuobyteDriver 1.2) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 16 15:10:24 devstack cinder-volume[83259]: DEBUG cinder.volume.flows.manager.create_volume [None req-2ab67f62-3745-4417-b54f-74266b70c4ce tempest-VolumesCloneNegativeTest-1358653647 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#Quobyte'], 'hosts': ['devstack@QuobyteHD#Quobyte']} {{(pid=83259) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1387}} Sep 16 15:10:24 devstack cinder-volume[83259]: DEBUG cinder.volume.manager [None req-2ab67f62-3745-4417-b54f-74266b70c4ce tempest-VolumesCloneNegativeTest-1358653647 None] Flow 'volume_create_manager' (b9cf1876-1ba8-4771-bae3-31b9f9a7a3a5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83259) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 16 15:10:24 devstack cinder-volume[83259]: DEBUG cinder.volume.manager [None req-2ab67f62-3745-4417-b54f-74266b70c4ce tempest-VolumesCloneNegativeTest-1358653647 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e14d9d4a-ae64-48c3-9eeb-f771dfe0675c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83259) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 15:10:24 devstack cinder-volume[83259]: DEBUG cinder.volume.manager [None req-2ab67f62-3745-4417-b54f-74266b70c4ce tempest-VolumesCloneNegativeTest-1358653647 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e14d9d4a-ae64-48c3-9eeb-f771dfe0675c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-16T13:10:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneNegativeTest-Volume-873179100',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#Quobyte',id=98031ea1-6fe3-4386-9e10-30325136b8ca,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='37cae12cb37848058f1cf48f8df4e606',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-16T13:10:24Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-16T13:10:24Z,use_quota=True,user_id='00c689e12d42466aa36df0c06663842e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(485ead50-3df8-4d76-8d34-a4db136c980a),volume_type_id=485ead50-3df8-4d76-8d34-a4db136c980a)' {{(pid=83259) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 15:10:24 devstack cinder-volume[83259]: DEBUG cinder.volume.manager [None req-2ab67f62-3745-4417-b54f-74266b70c4ce tempest-VolumesCloneNegativeTest-1358653647 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6d511a35-0cd0-42c6-86be-5e59bb5525af) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83259) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 15:10:24 devstack cinder-volume[83259]: DEBUG cinder.volume.manager [None req-2ab67f62-3745-4417-b54f-74266b70c4ce tempest-VolumesCloneNegativeTest-1358653647 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6d511a35-0cd0-42c6-86be-5e59bb5525af) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83259) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 15:10:24 devstack cinder-volume[83259]: DEBUG cinder.volume.manager [None req-2ab67f62-3745-4417-b54f-74266b70c4ce tempest-VolumesCloneNegativeTest-1358653647 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d0001705-a8df-4970-a17a-af8d4d24bd93) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83259) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 15:10:24 devstack cinder-volume[83259]: DEBUG cinder.volume.manager [None req-2ab67f62-3745-4417-b54f-74266b70c4ce tempest-VolumesCloneNegativeTest-1358653647 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d0001705-a8df-4970-a17a-af8d4d24bd93) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '98031ea1-6fe3-4386-9e10-30325136b8ca', 'volume_name': 'volume-98031ea1-6fe3-4386-9e10-30325136b8ca', 'volume_size': 2}' {{(pid=83259) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 15:10:24 devstack cinder-volume[83259]: DEBUG cinder.volume.manager [None req-2ab67f62-3745-4417-b54f-74266b70c4ce tempest-VolumesCloneNegativeTest-1358653647 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a77a7c69-54e4-444d-938d-07a83e799376) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83259) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 15:10:24 devstack cinder-volume[83259]: DEBUG cinder.volume.manager [None req-2ab67f62-3745-4417-b54f-74266b70c4ce tempest-VolumesCloneNegativeTest-1358653647 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a77a7c69-54e4-444d-938d-07a83e799376) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83259) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 15:10:24 devstack cinder-volume[83259]: DEBUG cinder.volume.manager [None req-2ab67f62-3745-4417-b54f-74266b70c4ce tempest-VolumesCloneNegativeTest-1358653647 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ea36e669-c9d8-4c39-9aac-c2cfa13b971c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83259) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 15:10:24 devstack cinder-volume[83259]: INFO cinder.volume.flows.manager.create_volume [None req-2ab67f62-3745-4417-b54f-74266b70c4ce tempest-VolumesCloneNegativeTest-1358653647 None] Volume 98031ea1-6fe3-4386-9e10-30325136b8ca: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-98031ea1-6fe3-4386-9e10-30325136b8ca', 'volume_size': 2} Sep 16 15:10:24 devstack cinder-volume[83259]: DEBUG oslo_concurrency.lockutils [None req-2ab67f62-3745-4417-b54f-74266b70c4ce tempest-VolumesCloneNegativeTest-1358653647 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83259) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 16 15:10:24 devstack cinder-volume[83259]: DEBUG oslo_concurrency.lockutils [None req-2ab67f62-3745-4417-b54f-74266b70c4ce tempest-VolumesCloneNegativeTest-1358653647 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.006s {{(pid=83259) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 16 15:10:24 devstack cinder-volume[83259]: DEBUG cinder.volume.drivers.quobyte [None req-2ab67f62-3745-4417-b54f-74266b70c4ce tempest-VolumesCloneNegativeTest-1358653647 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-16T13:10:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneNegativeTest-Volume-873179100',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#Quobyte',id=98031ea1-6fe3-4386-9e10-30325136b8ca,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='37cae12cb37848058f1cf48f8df4e606',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-16T13:10:24Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-16T13:10:24Z,use_quota=True,user_id='00c689e12d42466aa36df0c06663842e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(485ead50-3df8-4d76-8d34-a4db136c980a),volume_type_id=485ead50-3df8-4d76-8d34-a4db136c980a)}" {{(pid=83259) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Sep 16 15:10:24 devstack cinder-volume[83259]: DEBUG cinder.volume.drivers.remotefs [None req-2ab67f62-3745-4417-b54f-74266b70c4ce tempest-VolumesCloneNegativeTest-1358653647 None] Creating volume 98031ea1-6fe3-4386-9e10-30325136b8ca {{(pid=83259) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}} Sep 16 15:10:24 devstack cinder-volume[83259]: DEBUG oslo_concurrency.lockutils [None req-2ab67f62-3745-4417-b54f-74266b70c4ce tempest-VolumesCloneNegativeTest-1358653647 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83259) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 16 15:10:24 devstack cinder-volume[83259]: DEBUG oslo_concurrency.lockutils [None req-2ab67f62-3745-4417-b54f-74266b70c4ce tempest-VolumesCloneNegativeTest-1358653647 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83259) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 16 15:10:24 devstack cinder-volume[83259]: DEBUG cinder.volume.drivers.quobyte [None req-2ab67f62-3745-4417-b54f-74266b70c4ce tempest-VolumesCloneNegativeTest-1358653647 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-61f585ac-f8e2-4d19-a890-7ebc2726cc72': None} {{(pid=83259) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:639}} Sep 16 15:10:24 devstack cinder-volume[83259]: DEBUG cinder.volume.drivers.quobyte [None req-2ab67f62-3745-4417-b54f-74266b70c4ce tempest-VolumesCloneNegativeTest-1358653647 None] Available shares ['10.10.41.181/cinder-vol-61f585ac-f8e2-4d19-a890-7ebc2726cc72'] {{(pid=83259) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:669}} Sep 16 15:10:24 devstack cinder-volume[83259]: DEBUG oslo_concurrency.lockutils [None req-2ab67f62-3745-4417-b54f-74266b70c4ce tempest-VolumesCloneNegativeTest-1358653647 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.026s {{(pid=83259) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 16 15:10:24 devstack cinder-volume[83259]: DEBUG cinder.volume.drivers.quobyte [None req-2ab67f62-3745-4417-b54f-74266b70c4ce tempest-VolumesCloneNegativeTest-1358653647 None] Selected 10.10.41.181/cinder-vol-61f585ac-f8e2-4d19-a890-7ebc2726cc72 as target Quobyte volume. {{(pid=83259) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:690}} Sep 16 15:10:24 devstack cinder-volume[83259]: INFO cinder.volume.drivers.remotefs [None req-2ab67f62-3745-4417-b54f-74266b70c4ce tempest-VolumesCloneNegativeTest-1358653647 None] casted to 10.10.41.181/cinder-vol-61f585ac-f8e2-4d19-a890-7ebc2726cc72 Sep 16 15:10:24 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [None req-2ab67f62-3745-4417-b54f-74266b70c4ce tempest-VolumesCloneNegativeTest-1358653647 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c/volume-98031ea1-6fe3-4386-9e10-30325136b8ca 2147483648 {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 15:10:25 devstack quobyte-client[83286]: The server volume:87712ffe-8a69-446d-9ed6-4430c7ee9792@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=87712ffe-8a69-446d-9ed6-4430c7ee9792, inode=98, name=volume-98031ea1-6fe3-4386-9e10-30325136b8ca, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.206), requestorAccessMask=0 Sep 16 15:10:25 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [None req-2ab67f62-3745-4417-b54f-74266b70c4ce tempest-VolumesCloneNegativeTest-1358653647 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c/volume-98031ea1-6fe3-4386-9e10-30325136b8ca 2147483648" returned: 0 in 0.953s {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 15:10:26 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [None req-2ab67f62-3745-4417-b54f-74266b70c4ce tempest-VolumesCloneNegativeTest-1358653647 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c/volume-98031ea1-6fe3-4386-9e10-30325136b8ca {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 15:10:26 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [None req-2ab67f62-3745-4417-b54f-74266b70c4ce tempest-VolumesCloneNegativeTest-1358653647 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c/volume-98031ea1-6fe3-4386-9e10-30325136b8ca" returned: 0 in 0.236s {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 15:10:26 devstack cinder-volume[83259]: DEBUG cinder.volume.drivers.quobyte [None req-2ab67f62-3745-4417-b54f-74266b70c4ce tempest-VolumesCloneNegativeTest-1358653647 None] <== create_volume: return (1589ms) {'provider_location': '10.10.41.181/cinder-vol-61f585ac-f8e2-4d19-a890-7ebc2726cc72'} {{(pid=83259) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Sep 16 15:10:26 devstack cinder-volume[83259]: DEBUG oslo_concurrency.lockutils [None req-2ab67f62-3745-4417-b54f-74266b70c4ce tempest-VolumesCloneNegativeTest-1358653647 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.612s {{(pid=83259) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 16 15:10:26 devstack cinder-volume[83259]: DEBUG cinder.volume.manager [None req-2ab67f62-3745-4417-b54f-74266b70c4ce tempest-VolumesCloneNegativeTest-1358653647 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ea36e669-c9d8-4c39-9aac-c2cfa13b971c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-98031ea1-6fe3-4386-9e10-30325136b8ca', 'volume_size': 2}' {{(pid=83259) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 15:10:26 devstack cinder-volume[83259]: DEBUG cinder.volume.manager [None req-2ab67f62-3745-4417-b54f-74266b70c4ce tempest-VolumesCloneNegativeTest-1358653647 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b01d0c11-5639-4a78-8e54-97b99957d104) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83259) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 15:10:26 devstack cinder-volume[83259]: INFO cinder.volume.flows.manager.create_volume [None req-2ab67f62-3745-4417-b54f-74266b70c4ce tempest-VolumesCloneNegativeTest-1358653647 None] Volume volume-98031ea1-6fe3-4386-9e10-30325136b8ca (98031ea1-6fe3-4386-9e10-30325136b8ca): created successfully Sep 16 15:10:26 devstack cinder-volume[83259]: DEBUG cinder.volume.manager [None req-2ab67f62-3745-4417-b54f-74266b70c4ce tempest-VolumesCloneNegativeTest-1358653647 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b01d0c11-5639-4a78-8e54-97b99957d104) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83259) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 15:10:26 devstack cinder-volume[83259]: DEBUG cinder.volume.manager [None req-2ab67f62-3745-4417-b54f-74266b70c4ce tempest-VolumesCloneNegativeTest-1358653647 None] Flow 'volume_create_manager' (b9cf1876-1ba8-4771-bae3-31b9f9a7a3a5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83259) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 16 15:10:26 devstack cinder-volume[83259]: INFO cinder.volume.manager [None req-2ab67f62-3745-4417-b54f-74266b70c4ce tempest-VolumesCloneNegativeTest-1358653647 None] Created volume successfully. Sep 16 15:10:28 devstack cinder-volume[83259]: DEBUG cinder.coordination [None req-24d7566e-7025-4ab4-a5a7-980103e900c4 tempest-VolumesCloneNegativeTest-1358653647 None] Acquiring lock "cinder-98031ea1-6fe3-4386-9e10-30325136b8ca-delete_volume" by "delete_volume" {{(pid=83259) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 16 15:10:28 devstack cinder-volume[83259]: DEBUG cinder.coordination [None req-24d7566e-7025-4ab4-a5a7-980103e900c4 tempest-VolumesCloneNegativeTest-1358653647 None] Lock "cinder-98031ea1-6fe3-4386-9e10-30325136b8ca-delete_volume" acquired by "delete_volume" :: waited 0.123s {{(pid=83259) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 16 15:10:28 devstack cinder-volume[83259]: WARNING cinder.volume.volume_utils [None req-24d7566e-7025-4ab4-a5a7-980103e900c4 tempest-VolumesCloneNegativeTest-1358653647 None] Volume driver (QuobyteDriver 1.2) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 16 15:10:28 devstack cinder-volume[83259]: DEBUG cinder.coordination [None req-24d7566e-7025-4ab4-a5a7-980103e900c4 tempest-VolumesCloneNegativeTest-1358653647 None] Acquiring lock "cinder-quobyte-98031ea1-6fe3-4386-9e10-30325136b8ca" by "delete_volume" {{(pid=83259) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 16 15:10:28 devstack cinder-volume[83259]: DEBUG cinder.coordination [None req-24d7566e-7025-4ab4-a5a7-980103e900c4 tempest-VolumesCloneNegativeTest-1358653647 None] Lock "cinder-quobyte-98031ea1-6fe3-4386-9e10-30325136b8ca" acquired by "delete_volume" :: waited 0.037s {{(pid=83259) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 16 15:10:28 devstack cinder-volume[83259]: DEBUG oslo.privsep.daemon [-] privsep: reply[a10510b0-cef4-4d1d-a4c2-2138958cd718]: (4, 'qcow2') {{(pid=84312) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 16 15:10:28 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [None req-24d7566e-7025-4ab4-a5a7-980103e900c4 tempest-VolumesCloneNegativeTest-1358653647 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c/volume-98031ea1-6fe3-4386-9e10-30325136b8ca {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 15:10:29 devstack cinder-volume[83259]: WARNING cinder.volume.volume_utils [None req-4eb4ca1c-d121-4f7d-80d0-315a8c06a31b tempest-VolumesActionsTest-296669149 None] Volume driver (QuobyteDriver 1.2) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 16 15:10:29 devstack cinder-volume[83259]: DEBUG cinder.volume.flows.manager.create_volume [None req-4eb4ca1c-d121-4f7d-80d0-315a8c06a31b tempest-VolumesActionsTest-296669149 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#Quobyte'], 'hosts': ['devstack@QuobyteHD#Quobyte']} {{(pid=83259) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1387}} Sep 16 15:10:29 devstack cinder-volume[83259]: DEBUG cinder.volume.manager [None req-4eb4ca1c-d121-4f7d-80d0-315a8c06a31b tempest-VolumesActionsTest-296669149 None] Flow 'volume_create_manager' (4d15b495-1127-49d5-924d-217532d475d7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83259) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 16 15:10:29 devstack cinder-volume[83259]: DEBUG cinder.volume.manager [None req-4eb4ca1c-d121-4f7d-80d0-315a8c06a31b tempest-VolumesActionsTest-296669149 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (60ecaead-9946-4ede-8957-f0061939a0dd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83259) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 15:10:29 devstack cinder-volume[83259]: DEBUG cinder.volume.manager [None req-4eb4ca1c-d121-4f7d-80d0-315a8c06a31b tempest-VolumesActionsTest-296669149 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (60ecaead-9946-4ede-8957-f0061939a0dd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-16T13:10:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-884853403',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#Quobyte',id=c07f5ce2-165d-42b6-806a-af27abe6db99,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1a2c87167c4648ea9a76202d5a2ac057',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-16T13:10:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-16T13:10:29Z,use_quota=True,user_id='7ee60e10497d45dc9a98002da339e8bc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(485ead50-3df8-4d76-8d34-a4db136c980a),volume_type_id=485ead50-3df8-4d76-8d34-a4db136c980a)' {{(pid=83259) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 15:10:29 devstack cinder-volume[83259]: DEBUG cinder.volume.manager [None req-4eb4ca1c-d121-4f7d-80d0-315a8c06a31b tempest-VolumesActionsTest-296669149 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1c226424-36b4-426b-a2c4-bfdd19ff5b73) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83259) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 15:10:29 devstack cinder-volume[83259]: DEBUG cinder.volume.manager [None req-4eb4ca1c-d121-4f7d-80d0-315a8c06a31b tempest-VolumesActionsTest-296669149 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1c226424-36b4-426b-a2c4-bfdd19ff5b73) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83259) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 15:10:29 devstack cinder-volume[83259]: DEBUG cinder.volume.manager [None req-4eb4ca1c-d121-4f7d-80d0-315a8c06a31b tempest-VolumesActionsTest-296669149 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7c98f9ec-d568-4114-987c-e71e374528bd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83259) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 15:10:29 devstack cinder-volume[83259]: DEBUG cinder.volume.manager [None req-4eb4ca1c-d121-4f7d-80d0-315a8c06a31b tempest-VolumesActionsTest-296669149 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7c98f9ec-d568-4114-987c-e71e374528bd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c07f5ce2-165d-42b6-806a-af27abe6db99', 'volume_name': 'volume-c07f5ce2-165d-42b6-806a-af27abe6db99', 'volume_size': 1}' {{(pid=83259) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 15:10:29 devstack cinder-volume[83259]: DEBUG cinder.volume.manager [None req-4eb4ca1c-d121-4f7d-80d0-315a8c06a31b tempest-VolumesActionsTest-296669149 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0efb8dd5-df4f-49be-a9fa-3eb08a107116) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83259) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 15:10:29 devstack cinder-volume[83259]: DEBUG cinder.volume.manager [None req-4eb4ca1c-d121-4f7d-80d0-315a8c06a31b tempest-VolumesActionsTest-296669149 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0efb8dd5-df4f-49be-a9fa-3eb08a107116) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83259) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 15:10:29 devstack cinder-volume[83259]: DEBUG cinder.volume.manager [None req-4eb4ca1c-d121-4f7d-80d0-315a8c06a31b tempest-VolumesActionsTest-296669149 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f2765d64-f910-4b20-9bd7-d54db529240c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83259) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 15:10:29 devstack cinder-volume[83259]: INFO cinder.volume.flows.manager.create_volume [None req-4eb4ca1c-d121-4f7d-80d0-315a8c06a31b tempest-VolumesActionsTest-296669149 None] Volume c07f5ce2-165d-42b6-806a-af27abe6db99: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c07f5ce2-165d-42b6-806a-af27abe6db99', 'volume_size': 1} Sep 16 15:10:29 devstack cinder-volume[83259]: DEBUG oslo_concurrency.lockutils [None req-4eb4ca1c-d121-4f7d-80d0-315a8c06a31b tempest-VolumesActionsTest-296669149 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83259) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 16 15:10:29 devstack cinder-volume[83259]: DEBUG oslo_concurrency.lockutils [None req-4eb4ca1c-d121-4f7d-80d0-315a8c06a31b tempest-VolumesActionsTest-296669149 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.004s {{(pid=83259) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 16 15:10:29 devstack cinder-volume[83259]: DEBUG cinder.volume.drivers.quobyte [None req-4eb4ca1c-d121-4f7d-80d0-315a8c06a31b tempest-VolumesActionsTest-296669149 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-16T13:10:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-884853403',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#Quobyte',id=c07f5ce2-165d-42b6-806a-af27abe6db99,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1a2c87167c4648ea9a76202d5a2ac057',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-16T13:10:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-16T13:10:29Z,use_quota=True,user_id='7ee60e10497d45dc9a98002da339e8bc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(485ead50-3df8-4d76-8d34-a4db136c980a),volume_type_id=485ead50-3df8-4d76-8d34-a4db136c980a)}" {{(pid=83259) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Sep 16 15:10:29 devstack cinder-volume[83259]: DEBUG cinder.volume.drivers.remotefs [None req-4eb4ca1c-d121-4f7d-80d0-315a8c06a31b tempest-VolumesActionsTest-296669149 None] Creating volume c07f5ce2-165d-42b6-806a-af27abe6db99 {{(pid=83259) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}} Sep 16 15:10:29 devstack cinder-volume[83259]: DEBUG oslo_concurrency.lockutils [None req-4eb4ca1c-d121-4f7d-80d0-315a8c06a31b tempest-VolumesActionsTest-296669149 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83259) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 16 15:10:29 devstack cinder-volume[83259]: DEBUG oslo_concurrency.lockutils [None req-4eb4ca1c-d121-4f7d-80d0-315a8c06a31b tempest-VolumesActionsTest-296669149 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83259) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 16 15:10:29 devstack cinder-volume[83259]: DEBUG cinder.volume.drivers.quobyte [None req-4eb4ca1c-d121-4f7d-80d0-315a8c06a31b tempest-VolumesActionsTest-296669149 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-61f585ac-f8e2-4d19-a890-7ebc2726cc72': None} {{(pid=83259) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:639}} Sep 16 15:10:29 devstack cinder-volume[83259]: DEBUG cinder.volume.drivers.quobyte [None req-4eb4ca1c-d121-4f7d-80d0-315a8c06a31b tempest-VolumesActionsTest-296669149 None] Available shares ['10.10.41.181/cinder-vol-61f585ac-f8e2-4d19-a890-7ebc2726cc72'] {{(pid=83259) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:669}} Sep 16 15:10:29 devstack cinder-volume[83259]: DEBUG oslo_concurrency.lockutils [None req-4eb4ca1c-d121-4f7d-80d0-315a8c06a31b tempest-VolumesActionsTest-296669149 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=83259) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 16 15:10:29 devstack cinder-volume[83259]: DEBUG cinder.volume.drivers.quobyte [None req-4eb4ca1c-d121-4f7d-80d0-315a8c06a31b tempest-VolumesActionsTest-296669149 None] Selected 10.10.41.181/cinder-vol-61f585ac-f8e2-4d19-a890-7ebc2726cc72 as target Quobyte volume. {{(pid=83259) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:690}} Sep 16 15:10:29 devstack cinder-volume[83259]: INFO cinder.volume.drivers.remotefs [None req-4eb4ca1c-d121-4f7d-80d0-315a8c06a31b tempest-VolumesActionsTest-296669149 None] casted to 10.10.41.181/cinder-vol-61f585ac-f8e2-4d19-a890-7ebc2726cc72 Sep 16 15:10:29 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [None req-4eb4ca1c-d121-4f7d-80d0-315a8c06a31b tempest-VolumesActionsTest-296669149 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c/volume-c07f5ce2-165d-42b6-806a-af27abe6db99 1073741824 {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 15:10:29 devstack quobyte-client[83286]: System call of process 95073 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 16 15:10:29 devstack quobyte-client[83286]: The server volume:87712ffe-8a69-446d-9ed6-4430c7ee9792@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=87712ffe-8a69-446d-9ed6-4430c7ee9792, inode=99, name=volume-c07f5ce2-165d-42b6-806a-af27abe6db99, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.206), requestorAccessMask=0 Sep 16 15:10:30 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [None req-24d7566e-7025-4ab4-a5a7-980103e900c4 tempest-VolumesCloneNegativeTest-1358653647 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c/volume-98031ea1-6fe3-4386-9e10-30325136b8ca" returned: 0 in 1.122s {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 15:10:30 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [None req-24d7566e-7025-4ab4-a5a7-980103e900c4 tempest-VolumesCloneNegativeTest-1358653647 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c/volume-98031ea1-6fe3-4386-9e10-30325136b8ca {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 15:10:30 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [None req-4eb4ca1c-d121-4f7d-80d0-315a8c06a31b tempest-VolumesActionsTest-296669149 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c/volume-c07f5ce2-165d-42b6-806a-af27abe6db99 1073741824" returned: 0 in 0.544s {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 15:10:30 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [None req-4eb4ca1c-d121-4f7d-80d0-315a8c06a31b tempest-VolumesActionsTest-296669149 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c/volume-c07f5ce2-165d-42b6-806a-af27abe6db99 {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 15:10:30 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [None req-24d7566e-7025-4ab4-a5a7-980103e900c4 tempest-VolumesCloneNegativeTest-1358653647 None] CMD "rm -f /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c/volume-98031ea1-6fe3-4386-9e10-30325136b8ca" returned: 0 in 0.407s {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 15:10:30 devstack cinder-volume[83259]: DEBUG cinder.coordination [None req-24d7566e-7025-4ab4-a5a7-980103e900c4 tempest-VolumesCloneNegativeTest-1358653647 None] Lock "cinder-quobyte-98031ea1-6fe3-4386-9e10-30325136b8ca" released by "delete_volume" :: held 1.877s {{(pid=83259) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 16 15:10:31 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [None req-4eb4ca1c-d121-4f7d-80d0-315a8c06a31b tempest-VolumesActionsTest-296669149 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c/volume-c07f5ce2-165d-42b6-806a-af27abe6db99" returned: 0 in 0.667s {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 15:10:31 devstack cinder-volume[83259]: DEBUG cinder.volume.drivers.quobyte [None req-4eb4ca1c-d121-4f7d-80d0-315a8c06a31b tempest-VolumesActionsTest-296669149 None] <== create_volume: return (1349ms) {'provider_location': '10.10.41.181/cinder-vol-61f585ac-f8e2-4d19-a890-7ebc2726cc72'} {{(pid=83259) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Sep 16 15:10:31 devstack cinder-volume[83259]: DEBUG oslo_concurrency.lockutils [None req-4eb4ca1c-d121-4f7d-80d0-315a8c06a31b tempest-VolumesActionsTest-296669149 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.361s {{(pid=83259) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 16 15:10:31 devstack cinder-volume[83259]: DEBUG cinder.volume.manager [None req-4eb4ca1c-d121-4f7d-80d0-315a8c06a31b tempest-VolumesActionsTest-296669149 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f2765d64-f910-4b20-9bd7-d54db529240c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c07f5ce2-165d-42b6-806a-af27abe6db99', 'volume_size': 1}' {{(pid=83259) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 15:10:31 devstack cinder-volume[83259]: DEBUG cinder.volume.manager [None req-4eb4ca1c-d121-4f7d-80d0-315a8c06a31b tempest-VolumesActionsTest-296669149 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (04ab9860-93dd-4313-95a4-13d5e07505ee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83259) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 15:10:31 devstack cinder-volume[83259]: INFO cinder.volume.flows.manager.create_volume [None req-4eb4ca1c-d121-4f7d-80d0-315a8c06a31b tempest-VolumesActionsTest-296669149 None] Volume volume-c07f5ce2-165d-42b6-806a-af27abe6db99 (c07f5ce2-165d-42b6-806a-af27abe6db99): created successfully Sep 16 15:10:31 devstack cinder-volume[83259]: DEBUG cinder.volume.manager [None req-4eb4ca1c-d121-4f7d-80d0-315a8c06a31b tempest-VolumesActionsTest-296669149 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (04ab9860-93dd-4313-95a4-13d5e07505ee) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83259) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 15:10:31 devstack cinder-volume[83259]: DEBUG cinder.volume.manager [None req-4eb4ca1c-d121-4f7d-80d0-315a8c06a31b tempest-VolumesActionsTest-296669149 None] Flow 'volume_create_manager' (4d15b495-1127-49d5-924d-217532d475d7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83259) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 16 15:10:31 devstack cinder-volume[83259]: INFO cinder.volume.manager [None req-4eb4ca1c-d121-4f7d-80d0-315a8c06a31b tempest-VolumesActionsTest-296669149 None] Created volume successfully. Sep 16 15:10:31 devstack cinder-volume[83259]: DEBUG cinder.quota [None req-24d7566e-7025-4ab4-a5a7-980103e900c4 tempest-VolumesCloneNegativeTest-1358653647 None] Created reservations ['2526cef0-e626-47a1-97e7-00042a4be302', '382256fb-d6ea-42e2-a14c-0fe3131a38e2', '5bc841c9-8792-4079-9ec3-65a94f08a56d', '5ba5cd60-9bad-423b-8fb5-f056c1fead04'] {{(pid=83259) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 16 15:10:31 devstack cinder-volume[83259]: DEBUG oslo_concurrency.lockutils [None req-24d7566e-7025-4ab4-a5a7-980103e900c4 tempest-VolumesCloneNegativeTest-1358653647 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83259) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 16 15:10:31 devstack cinder-volume[83259]: DEBUG oslo_concurrency.lockutils [None req-24d7566e-7025-4ab4-a5a7-980103e900c4 tempest-VolumesCloneNegativeTest-1358653647 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=83259) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 16 15:10:31 devstack cinder-volume[83259]: DEBUG cinder.volume.drivers.quobyte [None req-24d7566e-7025-4ab4-a5a7-980103e900c4 tempest-VolumesCloneNegativeTest-1358653647 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-61f585ac-f8e2-4d19-a890-7ebc2726cc72': None} {{(pid=83259) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:639}} Sep 16 15:10:31 devstack cinder-volume[83259]: DEBUG cinder.volume.drivers.quobyte [None req-24d7566e-7025-4ab4-a5a7-980103e900c4 tempest-VolumesCloneNegativeTest-1358653647 None] Available shares ['10.10.41.181/cinder-vol-61f585ac-f8e2-4d19-a890-7ebc2726cc72'] {{(pid=83259) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:669}} Sep 16 15:10:31 devstack cinder-volume[83259]: DEBUG oslo_concurrency.lockutils [None req-24d7566e-7025-4ab4-a5a7-980103e900c4 tempest-VolumesCloneNegativeTest-1358653647 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=83259) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 16 15:10:31 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [None req-24d7566e-7025-4ab4-a5a7-980103e900c4 tempest-VolumesCloneNegativeTest-1358653647 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 15:10:31 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [None req-24d7566e-7025-4ab4-a5a7-980103e900c4 tempest-VolumesCloneNegativeTest-1358653647 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c" returned: 0 in 0.183s {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 15:10:31 devstack cinder-volume[83259]: DEBUG cinder.manager [None req-24d7566e-7025-4ab4-a5a7-980103e900c4 tempest-VolumesCloneNegativeTest-1358653647 None] Notifying Schedulers of capabilities ... {{(pid=83259) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 16 15:10:32 devstack cinder-volume[83259]: INFO cinder.volume.manager [None req-24d7566e-7025-4ab4-a5a7-980103e900c4 tempest-VolumesCloneNegativeTest-1358653647 None] Deleted volume successfully. Sep 16 15:10:32 devstack cinder-volume[83259]: DEBUG cinder.coordination [None req-24d7566e-7025-4ab4-a5a7-980103e900c4 tempest-VolumesCloneNegativeTest-1358653647 None] Lock "cinder-98031ea1-6fe3-4386-9e10-30325136b8ca-delete_volume" released by "delete_volume" :: held 3.975s {{(pid=83259) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 16 15:10:37 devstack cinder-volume[83259]: WARNING cinder.volume.volume_utils [None req-4872dc90-bbb0-4eaf-a7c0-60180f6b5485 tempest-VolumesExtendTest-1864858717 None] Volume driver (QuobyteDriver 1.2) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 16 15:10:37 devstack cinder-volume[83259]: DEBUG cinder.volume.flows.manager.create_volume [None req-4872dc90-bbb0-4eaf-a7c0-60180f6b5485 tempest-VolumesExtendTest-1864858717 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#Quobyte'], 'hosts': ['devstack@QuobyteHD#Quobyte']} {{(pid=83259) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1387}} Sep 16 15:10:37 devstack cinder-volume[83259]: DEBUG cinder.volume.manager [None req-4872dc90-bbb0-4eaf-a7c0-60180f6b5485 tempest-VolumesExtendTest-1864858717 None] Flow 'volume_create_manager' (578b99c9-e64d-4d66-b3d9-38552f72bb51) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83259) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 16 15:10:37 devstack cinder-volume[83259]: DEBUG cinder.volume.manager [None req-4872dc90-bbb0-4eaf-a7c0-60180f6b5485 tempest-VolumesExtendTest-1864858717 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1a72b34c-1473-496e-87a1-a3e95541ba68) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83259) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 15:10:37 devstack cinder-volume[83259]: DEBUG cinder.volume.manager [None req-4872dc90-bbb0-4eaf-a7c0-60180f6b5485 tempest-VolumesExtendTest-1864858717 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1a72b34c-1473-496e-87a1-a3e95541ba68) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-16T13:10:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-651136669',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#Quobyte',id=39df7ba4-0bc1-4769-b02e-f328752e1cb8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='12e7b96bba564d0988df3d254290c4c4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-16T13:10:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-16T13:10:37Z,use_quota=True,user_id='e1829c22ade44df2a224f51e2e1aba33',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(485ead50-3df8-4d76-8d34-a4db136c980a),volume_type_id=485ead50-3df8-4d76-8d34-a4db136c980a)' {{(pid=83259) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 15:10:37 devstack cinder-volume[83259]: DEBUG cinder.volume.manager [None req-4872dc90-bbb0-4eaf-a7c0-60180f6b5485 tempest-VolumesExtendTest-1864858717 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (12d11838-40b6-4dea-bee3-5b0276a02ad7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83259) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 15:10:37 devstack cinder-volume[83259]: DEBUG cinder.volume.manager [None req-4872dc90-bbb0-4eaf-a7c0-60180f6b5485 tempest-VolumesExtendTest-1864858717 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (12d11838-40b6-4dea-bee3-5b0276a02ad7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83259) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 15:10:37 devstack cinder-volume[83259]: DEBUG cinder.volume.manager [None req-4872dc90-bbb0-4eaf-a7c0-60180f6b5485 tempest-VolumesExtendTest-1864858717 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3d08efd6-869a-4b88-94ab-ec41e4f9595e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83259) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 15:10:37 devstack cinder-volume[83259]: DEBUG cinder.image.glance [None req-4872dc90-bbb0-4eaf-a7c0-60180f6b5485 tempest-VolumesExtendTest-1864858717 None] Creating Keystone auth plugin from conf {{(pid=83259) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:128}} Sep 16 15:10:38 devstack cinder-volume[83259]: DEBUG cinder.volume.manager [None req-4872dc90-bbb0-4eaf-a7c0-60180f6b5485 tempest-VolumesExtendTest-1864858717 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3d08efd6-869a-4b88-94ab-ec41e4f9595e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '39df7ba4-0bc1-4769-b02e-f328752e1cb8', 'volume_name': 'volume-39df7ba4-0bc1-4769-b02e-f328752e1cb8', 'volume_size': 1, 'image_id': '7786237f-0aff-46c8-bcd0-3b9486a0637a', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/7786237f-0aff-46c8-bcd0-3b9486a0637a', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '97738b7ffcbe49cbaad0099563a58435', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '7786237f-0aff-46c8-bcd0-3b9486a0637a', 'created_at': datetime.datetime(2025, 9, 16, 12, 35, 41, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2025, 9, 16, 12, 35, 42, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/7786237f-0aff-46c8-bcd0-3b9486a0637a/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=83259) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 15:10:38 devstack cinder-volume[83259]: DEBUG cinder.volume.manager [None req-4872dc90-bbb0-4eaf-a7c0-60180f6b5485 tempest-VolumesExtendTest-1864858717 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e76e0c20-80f2-4a1d-8fdc-567d166df63d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83259) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 15:10:38 devstack cinder-volume[83259]: DEBUG cinder.volume.manager [None req-4872dc90-bbb0-4eaf-a7c0-60180f6b5485 tempest-VolumesExtendTest-1864858717 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e76e0c20-80f2-4a1d-8fdc-567d166df63d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83259) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 15:10:38 devstack cinder-volume[83259]: DEBUG cinder.volume.manager [None req-4872dc90-bbb0-4eaf-a7c0-60180f6b5485 tempest-VolumesExtendTest-1864858717 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (24b15124-4514-4ae3-87d6-0950961a6fdd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83259) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 15:10:38 devstack cinder-volume[83259]: INFO cinder.volume.flows.manager.create_volume [None req-4872dc90-bbb0-4eaf-a7c0-60180f6b5485 tempest-VolumesExtendTest-1864858717 None] Volume 39df7ba4-0bc1-4769-b02e-f328752e1cb8: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-39df7ba4-0bc1-4769-b02e-f328752e1cb8', 'volume_size': 1, 'image_id': '7786237f-0aff-46c8-bcd0-3b9486a0637a', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/7786237f-0aff-46c8-bcd0-3b9486a0637a', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '97738b7ffcbe49cbaad0099563a58435', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '7786237f-0aff-46c8-bcd0-3b9486a0637a', 'created_at': datetime.datetime(2025, 9, 16, 12, 35, 41, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2025, 9, 16, 12, 35, 42, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/7786237f-0aff-46c8-bcd0-3b9486a0637a/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Sep 16 15:10:38 devstack cinder-volume[83259]: DEBUG cinder.volume.flows.manager.create_volume [None req-4872dc90-bbb0-4eaf-a7c0-60180f6b5485 tempest-VolumesExtendTest-1864858717 None] Cloning 39df7ba4-0bc1-4769-b02e-f328752e1cb8 from image 7786237f-0aff-46c8-bcd0-3b9486a0637a at location (None, [{'url': 'file:///opt/stack/data/glance/images/7786237f-0aff-46c8-bcd0-3b9486a0637a', 'metadata': {}}]). {{(pid=83259) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1085}} Sep 16 15:10:38 devstack cinder-volume[83259]: DEBUG cinder.image.image_utils [None req-4872dc90-bbb0-4eaf-a7c0-60180f6b5485 tempest-VolumesExtendTest-1864858717 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_7786237f-0aff-46c8-bcd0-3b9486a0637a_t_s9gbb1devstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=83259) fetch /opt/stack/cinder/cinder/image/image_utils.py:700}} Sep 16 15:10:38 devstack cinder-volume[83259]: INFO cinder.image.image_utils [None req-4872dc90-bbb0-4eaf-a7c0-60180f6b5485 tempest-VolumesExtendTest-1864858717 None] Image download 20.69 MB at 20.69 MB/s Sep 16 15:10:38 devstack cinder-volume[83259]: DEBUG oslo.privsep.daemon [-] privsep: reply[9202be4e-d6e7-4ee5-9386-366508a48715]: (4, 'qcow2') {{(pid=84312) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 16 15:10:38 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [None req-4872dc90-bbb0-4eaf-a7c0-60180f6b5485 tempest-VolumesExtendTest-1864858717 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_7786237f-0aff-46c8-bcd0-3b9486a0637a_t_s9gbb1devstack@QuobyteHD {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 15:10:39 devstack sudo[95089]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_7786237f-0aff-46c8-bcd0-3b9486a0637a_t_s9gbb1devstack@QuobyteHD Sep 16 15:10:39 devstack sudo[95089]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 15:10:42 devstack sudo[95089]: pam_unix(sudo:session): session closed for user root Sep 16 15:10:42 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [None req-4872dc90-bbb0-4eaf-a7c0-60180f6b5485 tempest-VolumesExtendTest-1864858717 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_7786237f-0aff-46c8-bcd0-3b9486a0637a_t_s9gbb1devstack@QuobyteHD" returned: 0 in 3.650s {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 15:10:42 devstack cinder-volume[83259]: DEBUG cinder.image.image_utils [None req-4872dc90-bbb0-4eaf-a7c0-60180f6b5485 tempest-VolumesExtendTest-1864858717 None] Temporary image 7786237f-0aff-46c8-bcd0-3b9486a0637a is fetched for user e1829c22ade44df2a224f51e2e1aba33. {{(pid=83259) fetch /opt/stack/cinder/cinder/image/image_utils.py:1399}} Sep 16 15:10:43 devstack cinder-volume[83259]: DEBUG oslo.privsep.daemon [-] privsep: reply[41db6d97-0f25-4dad-b94e-1d8011484a20]: (4, 'qcow2') {{(pid=84312) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 16 15:10:43 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [None req-4872dc90-bbb0-4eaf-a7c0-60180f6b5485 tempest-VolumesExtendTest-1864858717 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_7786237f-0aff-46c8-bcd0-3b9486a0637a_t_s9gbb1devstack@QuobyteHD {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 15:10:44 devstack sudo[95106]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_7786237f-0aff-46c8-bcd0-3b9486a0637a_t_s9gbb1devstack@QuobyteHD Sep 16 15:10:44 devstack sudo[95106]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 15:10:46 devstack cinder-volume[83259]: DEBUG oslo_service.periodic_task [None req-050ec8a1-6ffd-499d-95ad-d548a84437e2 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=83259) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} Sep 16 15:10:46 devstack cinder-volume[83259]: DEBUG oslo_concurrency.lockutils [None req-050ec8a1-6ffd-499d-95ad-d548a84437e2 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83259) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 16 15:10:46 devstack cinder-volume[83259]: DEBUG oslo_concurrency.lockutils [None req-050ec8a1-6ffd-499d-95ad-d548a84437e2 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.018s {{(pid=83259) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 16 15:10:46 devstack cinder-volume[83259]: DEBUG cinder.volume.drivers.quobyte [None req-050ec8a1-6ffd-499d-95ad-d548a84437e2 None None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-61f585ac-f8e2-4d19-a890-7ebc2726cc72': None} {{(pid=83259) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:639}} Sep 16 15:10:46 devstack cinder-volume[83259]: DEBUG cinder.volume.drivers.quobyte [None req-050ec8a1-6ffd-499d-95ad-d548a84437e2 None None] Available shares ['10.10.41.181/cinder-vol-61f585ac-f8e2-4d19-a890-7ebc2726cc72'] {{(pid=83259) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:669}} Sep 16 15:10:46 devstack cinder-volume[83259]: DEBUG oslo_concurrency.lockutils [None req-050ec8a1-6ffd-499d-95ad-d548a84437e2 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.051s {{(pid=83259) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 16 15:10:46 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [None req-050ec8a1-6ffd-499d-95ad-d548a84437e2 None None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 15:10:46 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [None req-050ec8a1-6ffd-499d-95ad-d548a84437e2 None None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c" returned: 0 in 0.383s {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 15:10:46 devstack cinder-volume[83259]: DEBUG cinder.manager [None req-050ec8a1-6ffd-499d-95ad-d548a84437e2 None None] Notifying Schedulers of capabilities ... {{(pid=83259) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 16 15:10:46 devstack sudo[95106]: pam_unix(sudo:session): session closed for user root Sep 16 15:10:47 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [None req-4872dc90-bbb0-4eaf-a7c0-60180f6b5485 tempest-VolumesExtendTest-1864858717 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_7786237f-0aff-46c8-bcd0-3b9486a0637a_t_s9gbb1devstack@QuobyteHD" returned: 0 in 3.618s {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 15:10:47 devstack cinder-volume[83259]: DEBUG oslo_concurrency.lockutils [None req-4872dc90-bbb0-4eaf-a7c0-60180f6b5485 tempest-VolumesExtendTest-1864858717 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83259) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 16 15:10:47 devstack cinder-volume[83259]: DEBUG oslo_concurrency.lockutils [None req-4872dc90-bbb0-4eaf-a7c0-60180f6b5485 tempest-VolumesExtendTest-1864858717 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.012s {{(pid=83259) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 16 15:10:47 devstack cinder-volume[83259]: DEBUG cinder.volume.drivers.quobyte [None req-4872dc90-bbb0-4eaf-a7c0-60180f6b5485 tempest-VolumesExtendTest-1864858717 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-16T13:10:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-651136669',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#Quobyte',id=39df7ba4-0bc1-4769-b02e-f328752e1cb8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='12e7b96bba564d0988df3d254290c4c4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-16T13:10:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-16T13:10:37Z,use_quota=True,user_id='e1829c22ade44df2a224f51e2e1aba33',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(485ead50-3df8-4d76-8d34-a4db136c980a),volume_type_id=485ead50-3df8-4d76-8d34-a4db136c980a)}" {{(pid=83259) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Sep 16 15:10:47 devstack cinder-volume[83259]: DEBUG cinder.volume.drivers.remotefs [None req-4872dc90-bbb0-4eaf-a7c0-60180f6b5485 tempest-VolumesExtendTest-1864858717 None] Creating volume 39df7ba4-0bc1-4769-b02e-f328752e1cb8 {{(pid=83259) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}} Sep 16 15:10:47 devstack cinder-volume[83259]: DEBUG oslo_concurrency.lockutils [None req-4872dc90-bbb0-4eaf-a7c0-60180f6b5485 tempest-VolumesExtendTest-1864858717 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83259) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 16 15:10:47 devstack cinder-volume[83259]: DEBUG oslo_concurrency.lockutils [None req-4872dc90-bbb0-4eaf-a7c0-60180f6b5485 tempest-VolumesExtendTest-1864858717 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.006s {{(pid=83259) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 16 15:10:47 devstack cinder-volume[83259]: DEBUG cinder.volume.drivers.quobyte [None req-4872dc90-bbb0-4eaf-a7c0-60180f6b5485 tempest-VolumesExtendTest-1864858717 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-61f585ac-f8e2-4d19-a890-7ebc2726cc72': None} {{(pid=83259) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:639}} Sep 16 15:10:47 devstack cinder-volume[83259]: DEBUG cinder.volume.drivers.quobyte [None req-4872dc90-bbb0-4eaf-a7c0-60180f6b5485 tempest-VolumesExtendTest-1864858717 None] Available shares ['10.10.41.181/cinder-vol-61f585ac-f8e2-4d19-a890-7ebc2726cc72'] {{(pid=83259) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:669}} Sep 16 15:10:47 devstack cinder-volume[83259]: DEBUG oslo_concurrency.lockutils [None req-4872dc90-bbb0-4eaf-a7c0-60180f6b5485 tempest-VolumesExtendTest-1864858717 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=83259) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 16 15:10:47 devstack cinder-volume[83259]: DEBUG cinder.volume.drivers.quobyte [None req-4872dc90-bbb0-4eaf-a7c0-60180f6b5485 tempest-VolumesExtendTest-1864858717 None] Selected 10.10.41.181/cinder-vol-61f585ac-f8e2-4d19-a890-7ebc2726cc72 as target Quobyte volume. {{(pid=83259) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:690}} Sep 16 15:10:47 devstack cinder-volume[83259]: INFO cinder.volume.drivers.remotefs [None req-4872dc90-bbb0-4eaf-a7c0-60180f6b5485 tempest-VolumesExtendTest-1864858717 None] casted to 10.10.41.181/cinder-vol-61f585ac-f8e2-4d19-a890-7ebc2726cc72 Sep 16 15:10:47 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [None req-4872dc90-bbb0-4eaf-a7c0-60180f6b5485 tempest-VolumesExtendTest-1864858717 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c/volume-39df7ba4-0bc1-4769-b02e-f328752e1cb8 1073741824 {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 15:10:47 devstack quobyte-client[83286]: System call of process 95132 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 16 15:10:47 devstack quobyte-client[83286]: The server volume:87712ffe-8a69-446d-9ed6-4430c7ee9792@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=87712ffe-8a69-446d-9ed6-4430c7ee9792, inode=100, name=volume-39df7ba4-0bc1-4769-b02e-f328752e1cb8, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.206), requestorAccessMask=0 Sep 16 15:10:47 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [None req-4872dc90-bbb0-4eaf-a7c0-60180f6b5485 tempest-VolumesExtendTest-1864858717 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c/volume-39df7ba4-0bc1-4769-b02e-f328752e1cb8 1073741824" returned: 0 in 0.507s {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 15:10:47 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [None req-4872dc90-bbb0-4eaf-a7c0-60180f6b5485 tempest-VolumesExtendTest-1864858717 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c/volume-39df7ba4-0bc1-4769-b02e-f328752e1cb8 {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 15:10:48 devstack cinder-volume[83259]: DEBUG dbcounter [-] [83259] Writing DB stats cinder:SELECT=36,cinder:UPDATE=36,cinder:INSERT=8,cinder:DELETE=5 {{(pid=83259) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Sep 16 15:10:48 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [None req-4872dc90-bbb0-4eaf-a7c0-60180f6b5485 tempest-VolumesExtendTest-1864858717 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c/volume-39df7ba4-0bc1-4769-b02e-f328752e1cb8" returned: 0 in 0.436s {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 15:10:48 devstack cinder-volume[83259]: DEBUG dbcounter [-] [83259] Writing DB stats cinder:UPDATE=70,cinder:SELECT=34,cinder:DELETE=6,cinder:INSERT=13 {{(pid=83259) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Sep 16 15:10:48 devstack cinder-volume[83259]: DEBUG oslo_concurrency.lockutils [req-68254b4c-48f5-4274-a25b-03f9ff300dad req-50d9753c-90d8-4ed8-a372-5666f4baa55a tempest-TestServerVolumeAttachmentScenario-757686503 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=83259) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 16 15:10:48 devstack cinder-volume[83259]: DEBUG cinder.volume.drivers.quobyte [None req-4872dc90-bbb0-4eaf-a7c0-60180f6b5485 tempest-VolumesExtendTest-1864858717 None] <== create_volume: return (1050ms) {'provider_location': '10.10.41.181/cinder-vol-61f585ac-f8e2-4d19-a890-7ebc2726cc72'} {{(pid=83259) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Sep 16 15:10:48 devstack cinder-volume[83259]: DEBUG oslo_concurrency.lockutils [None req-4872dc90-bbb0-4eaf-a7c0-60180f6b5485 tempest-VolumesExtendTest-1864858717 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.106s {{(pid=83259) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 16 15:10:48 devstack cinder-volume[83259]: DEBUG oslo_concurrency.lockutils [req-68254b4c-48f5-4274-a25b-03f9ff300dad req-50d9753c-90d8-4ed8-a372-5666f4baa55a tempest-TestServerVolumeAttachmentScenario-757686503 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.038s {{(pid=83259) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 16 15:10:48 devstack cinder-volume[83259]: DEBUG oslo.privsep.daemon [-] privsep: reply[1969f291-e854-45f7-9e03-97babfb6564a]: (4, 'qcow2') {{(pid=84312) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 16 15:10:48 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [req-68254b4c-48f5-4274-a25b-03f9ff300dad req-50d9753c-90d8-4ed8-a372-5666f4baa55a tempest-TestServerVolumeAttachmentScenario-757686503 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c/volume-dde63480-6417-458e-9a53-9c562b2718bc {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 15:10:48 devstack cinder-volume[83259]: DEBUG cinder.volume.volume_utils [None req-4872dc90-bbb0-4eaf-a7c0-60180f6b5485 tempest-VolumesExtendTest-1864858717 None] Attempting download of 7786237f-0aff-46c8-bcd0-3b9486a0637a ((None, [{'url': 'file:///opt/stack/data/glance/images/7786237f-0aff-46c8-bcd0-3b9486a0637a', 'metadata': {}}])) to volume 39df7ba4-0bc1-4769-b02e-f328752e1cb8. {{(pid=83259) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1189}} Sep 16 15:10:48 devstack cinder-volume[83259]: DEBUG oslo.privsep.daemon [-] privsep: reply[b69a1f43-6610-47ce-8869-f3db35232b06]: (4, 'raw') {{(pid=84312) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 16 15:10:48 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [None req-4872dc90-bbb0-4eaf-a7c0-60180f6b5485 tempest-VolumesExtendTest-1864858717 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_7786237f-0aff-46c8-bcd0-3b9486a0637a_vf65y8yx {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 15:10:49 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [req-68254b4c-48f5-4274-a25b-03f9ff300dad req-50d9753c-90d8-4ed8-a372-5666f4baa55a tempest-TestServerVolumeAttachmentScenario-757686503 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c/volume-dde63480-6417-458e-9a53-9c562b2718bc" returned: 0 in 0.834s {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 15:10:49 devstack cinder-volume[83259]: DEBUG oslo_concurrency.lockutils [req-68254b4c-48f5-4274-a25b-03f9ff300dad req-50d9753c-90d8-4ed8-a372-5666f4baa55a tempest-TestServerVolumeAttachmentScenario-757686503 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.929s {{(pid=83259) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 16 15:10:49 devstack cinder-volume[83259]: DEBUG cinder.volume.manager [req-68254b4c-48f5-4274-a25b-03f9ff300dad req-50d9753c-90d8-4ed8-a372-5666f4baa55a tempest-TestServerVolumeAttachmentScenario-757686503 None] Connection info returned from driver {'export': '10.10.41.181/cinder-vol-61f585ac-f8e2-4d19-a890-7ebc2726cc72', 'name': 'volume-dde63480-6417-458e-9a53-9c562b2718bc', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '3c2ae944-c0c1-4ee1-8107-b0687ff817fa', 'enforce_multipath': True} {{(pid=83259) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4891}} Sep 16 15:10:49 devstack cinder-volume[83259]: WARNING cinder.volume.volume_utils [req-68254b4c-48f5-4274-a25b-03f9ff300dad req-50d9753c-90d8-4ed8-a372-5666f4baa55a tempest-TestServerVolumeAttachmentScenario-757686503 None] Volume driver (QuobyteDriver 1.2) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 16 15:10:49 devstack sudo[95140]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_7786237f-0aff-46c8-bcd0-3b9486a0637a_vf65y8yx Sep 16 15:10:49 devstack sudo[95140]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 15:10:49 devstack cinder-volume[83259]: INFO cinder.volume.manager [req-68254b4c-48f5-4274-a25b-03f9ff300dad req-50d9753c-90d8-4ed8-a372-5666f4baa55a tempest-TestServerVolumeAttachmentScenario-757686503 None] attachment_update completed successfully. Sep 16 15:10:51 devstack sudo[95140]: pam_unix(sudo:session): session closed for user root Sep 16 15:10:51 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [None req-4872dc90-bbb0-4eaf-a7c0-60180f6b5485 tempest-VolumesExtendTest-1864858717 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_7786237f-0aff-46c8-bcd0-3b9486a0637a_vf65y8yx" returned: 0 in 2.714s {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 15:10:51 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [None req-4872dc90-bbb0-4eaf-a7c0-60180f6b5485 tempest-VolumesExtendTest-1864858717 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_7786237f-0aff-46c8-bcd0-3b9486a0637a_vf65y8yx {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 15:10:52 devstack sudo[95530]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_7786237f-0aff-46c8-bcd0-3b9486a0637a_vf65y8yx Sep 16 15:10:52 devstack sudo[95530]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 15:10:54 devstack sudo[95530]: pam_unix(sudo:session): session closed for user root Sep 16 15:10:54 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [None req-4872dc90-bbb0-4eaf-a7c0-60180f6b5485 tempest-VolumesExtendTest-1864858717 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_7786237f-0aff-46c8-bcd0-3b9486a0637a_vf65y8yx" returned: 1 in 2.824s {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 15:10:54 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [None req-4872dc90-bbb0-4eaf-a7c0-60180f6b5485 tempest-VolumesExtendTest-1864858717 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_7786237f-0aff-46c8-bcd0-3b9486a0637a_vf65y8yx' failed. Not Retrying. {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:423}} Sep 16 15:10:54 devstack cinder-volume[83259]: DEBUG oslo.privsep.daemon [-] privsep: reply[4593b675-ccd8-443e-a59b-a88927278736]: (4, 'qcow2') {{(pid=84312) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 16 15:10:54 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [None req-4872dc90-bbb0-4eaf-a7c0-60180f6b5485 tempest-VolumesExtendTest-1864858717 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_7786237f-0aff-46c8-bcd0-3b9486a0637a_t_s9gbb1devstack@QuobyteHD {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 15:10:55 devstack sudo[95552]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_7786237f-0aff-46c8-bcd0-3b9486a0637a_t_s9gbb1devstack@QuobyteHD Sep 16 15:10:55 devstack sudo[95552]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 15:10:59 devstack cinder-volume[83259]: DEBUG dbcounter [-] [83259] Writing DB stats cinder:UPDATE=4,cinder:SELECT=5 {{(pid=83259) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Sep 16 15:10:59 devstack sudo[95552]: pam_unix(sudo:session): session closed for user root Sep 16 15:10:59 devstack cinder-volume[83259]: DEBUG dbcounter [-] [83259] Writing DB stats cinder:SELECT=4,cinder:UPDATE=1 {{(pid=83259) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Sep 16 15:10:59 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [None req-4872dc90-bbb0-4eaf-a7c0-60180f6b5485 tempest-VolumesExtendTest-1864858717 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_7786237f-0aff-46c8-bcd0-3b9486a0637a_t_s9gbb1devstack@QuobyteHD" returned: 0 in 5.367s {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 15:10:59 devstack cinder-volume[83259]: DEBUG cinder.image.image_utils [None req-4872dc90-bbb0-4eaf-a7c0-60180f6b5485 tempest-VolumesExtendTest-1864858717 None] 7786237f-0aff-46c8-bcd0-3b9486a0637a was qcow2, converting to qcow2 {{(pid=83259) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1088}} Sep 16 15:10:59 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [None req-4872dc90-bbb0-4eaf-a7c0-60180f6b5485 tempest-VolumesExtendTest-1864858717 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_7786237f-0aff-46c8-bcd0-3b9486a0637a_t_s9gbb1devstack@QuobyteHD /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c/volume-39df7ba4-0bc1-4769-b02e-f328752e1cb8 {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 15:11:00 devstack sudo[95611]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_7786237f-0aff-46c8-bcd0-3b9486a0637a_t_s9gbb1devstack@QuobyteHD /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c/volume-39df7ba4-0bc1-4769-b02e-f328752e1cb8 Sep 16 15:11:00 devstack sudo[95611]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 15:11:04 devstack sudo[95611]: pam_unix(sudo:session): session closed for user root Sep 16 15:11:04 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [None req-4872dc90-bbb0-4eaf-a7c0-60180f6b5485 tempest-VolumesExtendTest-1864858717 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_7786237f-0aff-46c8-bcd0-3b9486a0637a_t_s9gbb1devstack@QuobyteHD /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c/volume-39df7ba4-0bc1-4769-b02e-f328752e1cb8" returned: 0 in 4.551s {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 15:11:04 devstack cinder-volume[83259]: DEBUG cinder.image.image_utils [None req-4872dc90-bbb0-4eaf-a7c0-60180f6b5485 tempest-VolumesExtendTest-1864858717 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_7786237f-0aff-46c8-bcd0-3b9486a0637a_t_s9gbb1devstack@QuobyteHD, size 112.00 MB, duration 4.58 sec, destination /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c/volume-39df7ba4-0bc1-4769-b02e-f328752e1cb8 {{(pid=83259) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:501}} Sep 16 15:11:04 devstack cinder-volume[83259]: INFO cinder.image.image_utils [None req-4872dc90-bbb0-4eaf-a7c0-60180f6b5485 tempest-VolumesExtendTest-1864858717 None] Converted 112.00 MB image at 24.44 MB/s Sep 16 15:11:04 devstack cinder-volume[83259]: DEBUG oslo.privsep.daemon [-] privsep: reply[b0fba73b-bf74-4c55-8134-cee25358fcd9]: (4, 'qcow2') {{(pid=84312) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 16 15:11:04 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [None req-4872dc90-bbb0-4eaf-a7c0-60180f6b5485 tempest-VolumesExtendTest-1864858717 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c/volume-39df7ba4-0bc1-4769-b02e-f328752e1cb8 {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 15:11:05 devstack cinder-volume[83259]: DEBUG cinder.coordination [None req-eb5b862a-0f89-4338-86c2-86207fadf48c tempest-VolumesActionsTest-296669149 None] Acquiring lock "cinder-c07f5ce2-165d-42b6-806a-af27abe6db99" by "attach_volume" {{(pid=83259) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 16 15:11:05 devstack cinder-volume[83259]: DEBUG cinder.coordination [None req-eb5b862a-0f89-4338-86c2-86207fadf48c tempest-VolumesActionsTest-296669149 None] Lock "cinder-c07f5ce2-165d-42b6-806a-af27abe6db99" acquired by "attach_volume" :: waited 0.147s {{(pid=83259) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 16 15:11:05 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [None req-4872dc90-bbb0-4eaf-a7c0-60180f6b5485 tempest-VolumesExtendTest-1864858717 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c/volume-39df7ba4-0bc1-4769-b02e-f328752e1cb8" returned: 0 in 0.787s {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 15:11:05 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [None req-4872dc90-bbb0-4eaf-a7c0-60180f6b5485 tempest-VolumesExtendTest-1864858717 None] Running cmd (subprocess): qemu-img resize /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c/volume-39df7ba4-0bc1-4769-b02e-f328752e1cb8 1G {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 15:11:05 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [None req-4872dc90-bbb0-4eaf-a7c0-60180f6b5485 tempest-VolumesExtendTest-1864858717 None] CMD "qemu-img resize /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c/volume-39df7ba4-0bc1-4769-b02e-f328752e1cb8 1G" returned: 0 in 0.603s {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 15:11:05 devstack cinder-volume[83259]: DEBUG cinder.volume.volume_utils [None req-4872dc90-bbb0-4eaf-a7c0-60180f6b5485 tempest-VolumesExtendTest-1864858717 None] Downloaded image 7786237f-0aff-46c8-bcd0-3b9486a0637a ((None, [{'url': 'file:///opt/stack/data/glance/images/7786237f-0aff-46c8-bcd0-3b9486a0637a', 'metadata': {}}])) to volume 39df7ba4-0bc1-4769-b02e-f328752e1cb8 successfully. {{(pid=83259) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1234}} Sep 16 15:11:06 devstack cinder-volume[83259]: DEBUG cinder.image.image_utils [None req-4872dc90-bbb0-4eaf-a7c0-60180f6b5485 tempest-VolumesExtendTest-1864858717 None] Temporary image 7786237f-0aff-46c8-bcd0-3b9486a0637a for user e1829c22ade44df2a224f51e2e1aba33 is deleted. {{(pid=83259) fetch /opt/stack/cinder/cinder/image/image_utils.py:1403}} Sep 16 15:11:06 devstack cinder-volume[83259]: DEBUG cinder.volume.volume_utils [None req-4872dc90-bbb0-4eaf-a7c0-60180f6b5485 tempest-VolumesExtendTest-1864858717 None] Marking volume 39df7ba4-0bc1-4769-b02e-f328752e1cb8 as bootable. {{(pid=83259) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1138}} Sep 16 15:11:06 devstack cinder-volume[83259]: DEBUG cinder.volume.flows.manager.create_volume [None req-4872dc90-bbb0-4eaf-a7c0-60180f6b5485 tempest-VolumesExtendTest-1864858717 None] Copying metadata from image 7786237f-0aff-46c8-bcd0-3b9486a0637a to 39df7ba4-0bc1-4769-b02e-f328752e1cb8. {{(pid=83259) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Sep 16 15:11:06 devstack cinder-volume[83259]: DEBUG cinder.volume.flows.manager.create_volume [None req-4872dc90-bbb0-4eaf-a7c0-60180f6b5485 tempest-VolumesExtendTest-1864858717 None] Creating volume glance metadata for volume 39df7ba4-0bc1-4769-b02e-f328752e1cb8 backed by image 7786237f-0aff-46c8-bcd0-3b9486a0637a with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': '7786237f-0aff-46c8-bcd0-3b9486a0637a', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=83259) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Sep 16 15:11:06 devstack cinder-volume[83259]: WARNING cinder.volume.volume_utils [None req-eb5b862a-0f89-4338-86c2-86207fadf48c tempest-VolumesActionsTest-296669149 None] Volume driver (QuobyteDriver 1.2) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 16 15:11:06 devstack cinder-volume[83259]: INFO cinder.volume.manager [None req-eb5b862a-0f89-4338-86c2-86207fadf48c tempest-VolumesActionsTest-296669149 None] Attaching volume c07f5ce2-165d-42b6-806a-af27abe6db99 to instance 3334a9db-71e4-453c-9f69-d7bbf75df2b3 at mountpoint /dev/vdb on host None. Sep 16 15:11:06 devstack cinder-volume[83259]: INFO cinder.volume.manager [None req-eb5b862a-0f89-4338-86c2-86207fadf48c tempest-VolumesActionsTest-296669149 None] Attach volume completed successfully. Sep 16 15:11:06 devstack cinder-volume[83259]: DEBUG cinder.coordination [None req-eb5b862a-0f89-4338-86c2-86207fadf48c tempest-VolumesActionsTest-296669149 None] Lock "cinder-c07f5ce2-165d-42b6-806a-af27abe6db99" released by "attach_volume" :: held 1.021s {{(pid=83259) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 16 15:11:06 devstack cinder-volume[83259]: DEBUG cinder.volume.manager [None req-4872dc90-bbb0-4eaf-a7c0-60180f6b5485 tempest-VolumesExtendTest-1864858717 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (24b15124-4514-4ae3-87d6-0950961a6fdd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-39df7ba4-0bc1-4769-b02e-f328752e1cb8', 'volume_size': 1, 'image_id': '7786237f-0aff-46c8-bcd0-3b9486a0637a', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/7786237f-0aff-46c8-bcd0-3b9486a0637a', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '97738b7ffcbe49cbaad0099563a58435', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '7786237f-0aff-46c8-bcd0-3b9486a0637a', 'created_at': datetime.datetime(2025, 9, 16, 12, 35, 41, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2025, 9, 16, 12, 35, 42, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/7786237f-0aff-46c8-bcd0-3b9486a0637a/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=83259) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 15:11:06 devstack cinder-volume[83259]: DEBUG cinder.volume.manager [None req-4872dc90-bbb0-4eaf-a7c0-60180f6b5485 tempest-VolumesExtendTest-1864858717 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7430c5c1-6aee-4685-b1c9-8774b084f482) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83259) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 15:11:06 devstack cinder-volume[83259]: INFO cinder.volume.flows.manager.create_volume [None req-4872dc90-bbb0-4eaf-a7c0-60180f6b5485 tempest-VolumesExtendTest-1864858717 None] Volume volume-39df7ba4-0bc1-4769-b02e-f328752e1cb8 (39df7ba4-0bc1-4769-b02e-f328752e1cb8): created successfully Sep 16 15:11:06 devstack cinder-volume[83259]: DEBUG cinder.volume.manager [None req-4872dc90-bbb0-4eaf-a7c0-60180f6b5485 tempest-VolumesExtendTest-1864858717 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7430c5c1-6aee-4685-b1c9-8774b084f482) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83259) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 15:11:06 devstack cinder-volume[83259]: DEBUG cinder.volume.manager [None req-4872dc90-bbb0-4eaf-a7c0-60180f6b5485 tempest-VolumesExtendTest-1864858717 None] Flow 'volume_create_manager' (578b99c9-e64d-4d66-b3d9-38552f72bb51) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83259) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 16 15:11:06 devstack cinder-volume[83259]: INFO cinder.volume.manager [None req-4872dc90-bbb0-4eaf-a7c0-60180f6b5485 tempest-VolumesExtendTest-1864858717 None] Created volume successfully. Sep 16 15:11:06 devstack cinder-volume[83259]: DEBUG cinder.coordination [None req-3874a34c-419d-4d7b-b6a3-e8e706ac348a tempest-VolumesActionsTest-296669149 None] Acquiring lock "cinder-c07f5ce2-165d-42b6-806a-af27abe6db99-detach_volume" by "detach_volume" {{(pid=83259) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 16 15:11:06 devstack cinder-volume[83259]: DEBUG cinder.coordination [None req-3874a34c-419d-4d7b-b6a3-e8e706ac348a tempest-VolumesActionsTest-296669149 None] Lock "cinder-c07f5ce2-165d-42b6-806a-af27abe6db99-detach_volume" acquired by "detach_volume" :: waited 0.031s {{(pid=83259) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 16 15:11:06 devstack cinder-volume[83259]: WARNING cinder.volume.volume_utils [None req-3874a34c-419d-4d7b-b6a3-e8e706ac348a tempest-VolumesActionsTest-296669149 None] Volume driver (QuobyteDriver 1.2) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 16 15:11:06 devstack cinder-volume[83259]: INFO cinder.volume.manager [None req-3874a34c-419d-4d7b-b6a3-e8e706ac348a tempest-VolumesActionsTest-296669149 None] Detaching volume c07f5ce2-165d-42b6-806a-af27abe6db99 from instance 3334a9db-71e4-453c-9f69-d7bbf75df2b3. Sep 16 15:11:06 devstack cinder-volume[83259]: WARNING cinder.volume.volume_utils [None req-3874a34c-419d-4d7b-b6a3-e8e706ac348a tempest-VolumesActionsTest-296669149 None] Volume driver (QuobyteDriver 1.2) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 16 15:11:06 devstack cinder-volume[83259]: INFO cinder.volume.manager [None req-3874a34c-419d-4d7b-b6a3-e8e706ac348a tempest-VolumesActionsTest-296669149 None] Detach volume completed successfully. Sep 16 15:11:06 devstack cinder-volume[83259]: DEBUG cinder.coordination [None req-3874a34c-419d-4d7b-b6a3-e8e706ac348a tempest-VolumesActionsTest-296669149 None] Lock "cinder-c07f5ce2-165d-42b6-806a-af27abe6db99-detach_volume" released by "detach_volume" :: held 0.125s {{(pid=83259) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 16 15:11:06 devstack cinder-volume[83259]: WARNING cinder.volume.volume_utils [None req-f6cdc1ff-d5a6-4d24-886b-ba71b8095df8 tempest-VolumesExtendTest-1864858717 None] Volume driver (QuobyteDriver 1.2) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 16 15:11:06 devstack cinder-volume[83259]: DEBUG oslo_concurrency.lockutils [None req-f6cdc1ff-d5a6-4d24-886b-ba71b8095df8 tempest-VolumesExtendTest-1864858717 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" {{(pid=83259) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 16 15:11:06 devstack cinder-volume[83259]: DEBUG oslo_concurrency.lockutils [None req-f6cdc1ff-d5a6-4d24-886b-ba71b8095df8 tempest-VolumesExtendTest-1864858717 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: waited 0.010s {{(pid=83259) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 16 15:11:06 devstack cinder-volume[83259]: DEBUG oslo.privsep.daemon [-] privsep: reply[46872746-4572-4249-946b-61792c3317fa]: (4, 'qcow2') {{(pid=84312) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 16 15:11:06 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [None req-f6cdc1ff-d5a6-4d24-886b-ba71b8095df8 tempest-VolumesExtendTest-1864858717 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c/volume-39df7ba4-0bc1-4769-b02e-f328752e1cb8 {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 15:11:07 devstack quobyte-client[83286]: System call of process 95648 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 16 15:11:08 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [None req-f6cdc1ff-d5a6-4d24-886b-ba71b8095df8 tempest-VolumesExtendTest-1864858717 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c/volume-39df7ba4-0bc1-4769-b02e-f328752e1cb8" returned: 0 in 1.036s {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 15:11:08 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [None req-f6cdc1ff-d5a6-4d24-886b-ba71b8095df8 tempest-VolumesExtendTest-1864858717 None] Running cmd (subprocess): qemu-img resize /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c/volume-39df7ba4-0bc1-4769-b02e-f328752e1cb8 2G {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 15:11:08 devstack quobyte-client[83286]: System call of process 95652 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 16 15:11:08 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [None req-f6cdc1ff-d5a6-4d24-886b-ba71b8095df8 tempest-VolumesExtendTest-1864858717 None] CMD "qemu-img resize /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c/volume-39df7ba4-0bc1-4769-b02e-f328752e1cb8 2G" returned: 0 in 0.619s {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 15:11:08 devstack cinder-volume[83259]: DEBUG oslo_concurrency.lockutils [None req-f6cdc1ff-d5a6-4d24-886b-ba71b8095df8 tempest-VolumesExtendTest-1864858717 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: held 1.771s {{(pid=83259) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 16 15:11:08 devstack cinder-volume[83259]: DEBUG oslo_concurrency.lockutils [req-7c19bda2-37dd-41a0-8a0d-dfe422a5ff9f req-ca27417d-e5be-4064-8921-86fb4f090d96 tempest-TestServerVolumeAttachmentScenario-757686503 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=83259) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 16 15:11:08 devstack cinder-volume[83259]: DEBUG oslo_concurrency.lockutils [req-7c19bda2-37dd-41a0-8a0d-dfe422a5ff9f req-ca27417d-e5be-4064-8921-86fb4f090d96 tempest-TestServerVolumeAttachmentScenario-757686503 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.003s {{(pid=83259) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 16 15:11:08 devstack cinder-volume[83259]: DEBUG oslo.privsep.daemon [-] privsep: reply[0f06e849-acc9-4d9b-a2ec-1f217a6c83a8]: (4, 'qcow2') {{(pid=84312) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 16 15:11:08 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [req-7c19bda2-37dd-41a0-8a0d-dfe422a5ff9f req-ca27417d-e5be-4064-8921-86fb4f090d96 tempest-TestServerVolumeAttachmentScenario-757686503 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c/volume-89469ddc-4f11-4f5f-9b33-4ff39e729f69 {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 15:11:10 devstack cinder-volume[83259]: INFO cinder.volume.manager [None req-f6cdc1ff-d5a6-4d24-886b-ba71b8095df8 tempest-VolumesExtendTest-1864858717 None] Extend volume completed successfully. Sep 16 15:11:10 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [req-7c19bda2-37dd-41a0-8a0d-dfe422a5ff9f req-ca27417d-e5be-4064-8921-86fb4f090d96 tempest-TestServerVolumeAttachmentScenario-757686503 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c/volume-89469ddc-4f11-4f5f-9b33-4ff39e729f69" returned: 0 in 1.876s {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 15:11:10 devstack cinder-volume[83259]: DEBUG oslo_concurrency.lockutils [req-7c19bda2-37dd-41a0-8a0d-dfe422a5ff9f req-ca27417d-e5be-4064-8921-86fb4f090d96 tempest-TestServerVolumeAttachmentScenario-757686503 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 1.953s {{(pid=83259) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 16 15:11:10 devstack cinder-volume[83259]: DEBUG cinder.volume.manager [req-7c19bda2-37dd-41a0-8a0d-dfe422a5ff9f req-ca27417d-e5be-4064-8921-86fb4f090d96 tempest-TestServerVolumeAttachmentScenario-757686503 None] Connection info returned from driver {'export': '10.10.41.181/cinder-vol-61f585ac-f8e2-4d19-a890-7ebc2726cc72', 'name': 'volume-89469ddc-4f11-4f5f-9b33-4ff39e729f69', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'e2f6b3db-6368-4df5-91b7-1faa52307174', 'enforce_multipath': True} {{(pid=83259) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4891}} Sep 16 15:11:10 devstack cinder-volume[83259]: WARNING cinder.volume.volume_utils [req-7c19bda2-37dd-41a0-8a0d-dfe422a5ff9f req-ca27417d-e5be-4064-8921-86fb4f090d96 tempest-TestServerVolumeAttachmentScenario-757686503 None] Volume driver (QuobyteDriver 1.2) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 16 15:11:10 devstack cinder-volume[83259]: INFO cinder.volume.manager [req-7c19bda2-37dd-41a0-8a0d-dfe422a5ff9f req-ca27417d-e5be-4064-8921-86fb4f090d96 tempest-TestServerVolumeAttachmentScenario-757686503 None] attachment_update completed successfully. Sep 16 15:11:11 devstack cinder-volume[83259]: DEBUG cinder.coordination [None req-049960e1-19a6-48ff-82c5-f17921a52c23 tempest-VolumesExtendTest-1864858717 None] Acquiring lock "cinder-39df7ba4-0bc1-4769-b02e-f328752e1cb8-delete_volume" by "delete_volume" {{(pid=83259) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 16 15:11:11 devstack cinder-volume[83259]: DEBUG cinder.coordination [None req-049960e1-19a6-48ff-82c5-f17921a52c23 tempest-VolumesExtendTest-1864858717 None] Lock "cinder-39df7ba4-0bc1-4769-b02e-f328752e1cb8-delete_volume" acquired by "delete_volume" :: waited 0.071s {{(pid=83259) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 16 15:11:11 devstack cinder-volume[83259]: WARNING cinder.volume.volume_utils [None req-049960e1-19a6-48ff-82c5-f17921a52c23 tempest-VolumesExtendTest-1864858717 None] Volume driver (QuobyteDriver 1.2) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 16 15:11:11 devstack cinder-volume[83259]: DEBUG cinder.coordination [None req-049960e1-19a6-48ff-82c5-f17921a52c23 tempest-VolumesExtendTest-1864858717 None] Acquiring lock "cinder-quobyte-39df7ba4-0bc1-4769-b02e-f328752e1cb8" by "delete_volume" {{(pid=83259) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 16 15:11:11 devstack cinder-volume[83259]: DEBUG cinder.coordination [None req-049960e1-19a6-48ff-82c5-f17921a52c23 tempest-VolumesExtendTest-1864858717 None] Lock "cinder-quobyte-39df7ba4-0bc1-4769-b02e-f328752e1cb8" acquired by "delete_volume" :: waited 0.015s {{(pid=83259) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 16 15:11:11 devstack cinder-volume[83259]: DEBUG oslo.privsep.daemon [-] privsep: reply[afadfb81-8202-4dbd-9645-1a7faa4f8d65]: (4, 'qcow2') {{(pid=84312) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 16 15:11:11 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [None req-049960e1-19a6-48ff-82c5-f17921a52c23 tempest-VolumesExtendTest-1864858717 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c/volume-39df7ba4-0bc1-4769-b02e-f328752e1cb8 {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 15:11:12 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [None req-049960e1-19a6-48ff-82c5-f17921a52c23 tempest-VolumesExtendTest-1864858717 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c/volume-39df7ba4-0bc1-4769-b02e-f328752e1cb8" returned: 0 in 0.611s {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 15:11:12 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [None req-049960e1-19a6-48ff-82c5-f17921a52c23 tempest-VolumesExtendTest-1864858717 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c/volume-39df7ba4-0bc1-4769-b02e-f328752e1cb8 {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 15:11:12 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [None req-049960e1-19a6-48ff-82c5-f17921a52c23 tempest-VolumesExtendTest-1864858717 None] CMD "rm -f /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c/volume-39df7ba4-0bc1-4769-b02e-f328752e1cb8" returned: 0 in 0.186s {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 15:11:12 devstack cinder-volume[83259]: DEBUG cinder.coordination [None req-049960e1-19a6-48ff-82c5-f17921a52c23 tempest-VolumesExtendTest-1864858717 None] Lock "cinder-quobyte-39df7ba4-0bc1-4769-b02e-f328752e1cb8" released by "delete_volume" :: held 1.172s {{(pid=83259) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 16 15:11:13 devstack cinder-volume[83259]: DEBUG cinder.quota [None req-049960e1-19a6-48ff-82c5-f17921a52c23 tempest-VolumesExtendTest-1864858717 None] Created reservations ['2dc797b0-426a-4b98-956d-ee368aea01aa', 'b4fd9002-d7be-42f4-a578-8711ef61d845', '0ce4cf25-6c4a-45e9-8cef-cbb2d8e01ce3', '31101d5a-10c9-4472-9a2a-3acbdfa5a45f'] {{(pid=83259) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 16 15:11:13 devstack cinder-volume[83259]: DEBUG oslo_concurrency.lockutils [None req-049960e1-19a6-48ff-82c5-f17921a52c23 tempest-VolumesExtendTest-1864858717 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83259) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 16 15:11:13 devstack cinder-volume[83259]: DEBUG oslo_concurrency.lockutils [None req-049960e1-19a6-48ff-82c5-f17921a52c23 tempest-VolumesExtendTest-1864858717 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.014s {{(pid=83259) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 16 15:11:13 devstack cinder-volume[83259]: DEBUG cinder.volume.drivers.quobyte [None req-049960e1-19a6-48ff-82c5-f17921a52c23 tempest-VolumesExtendTest-1864858717 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-61f585ac-f8e2-4d19-a890-7ebc2726cc72': None} {{(pid=83259) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:639}} Sep 16 15:11:13 devstack cinder-volume[83259]: DEBUG cinder.volume.drivers.quobyte [None req-049960e1-19a6-48ff-82c5-f17921a52c23 tempest-VolumesExtendTest-1864858717 None] Available shares ['10.10.41.181/cinder-vol-61f585ac-f8e2-4d19-a890-7ebc2726cc72'] {{(pid=83259) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:669}} Sep 16 15:11:13 devstack cinder-volume[83259]: DEBUG oslo_concurrency.lockutils [None req-049960e1-19a6-48ff-82c5-f17921a52c23 tempest-VolumesExtendTest-1864858717 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=83259) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 16 15:11:13 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [None req-049960e1-19a6-48ff-82c5-f17921a52c23 tempest-VolumesExtendTest-1864858717 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 15:11:13 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [None req-049960e1-19a6-48ff-82c5-f17921a52c23 tempest-VolumesExtendTest-1864858717 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c" returned: 0 in 0.164s {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 15:11:13 devstack cinder-volume[83259]: DEBUG cinder.manager [None req-049960e1-19a6-48ff-82c5-f17921a52c23 tempest-VolumesExtendTest-1864858717 None] Notifying Schedulers of capabilities ... {{(pid=83259) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 16 15:11:13 devstack cinder-volume[83259]: INFO cinder.volume.manager [None req-049960e1-19a6-48ff-82c5-f17921a52c23 tempest-VolumesExtendTest-1864858717 None] Deleted volume successfully. Sep 16 15:11:14 devstack cinder-volume[83259]: DEBUG cinder.coordination [None req-049960e1-19a6-48ff-82c5-f17921a52c23 tempest-VolumesExtendTest-1864858717 None] Lock "cinder-39df7ba4-0bc1-4769-b02e-f328752e1cb8-delete_volume" released by "delete_volume" :: held 2.779s {{(pid=83259) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 16 15:11:14 devstack cinder-volume[83259]: WARNING cinder.volume.volume_utils [None req-4f7e1e3f-c1f8-4736-9c41-ad6b0345aca8 tempest-VolumesExtendTest-1864858717 None] Volume driver (QuobyteDriver 1.2) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 16 15:11:14 devstack cinder-volume[83259]: DEBUG cinder.volume.flows.manager.create_volume [None req-4f7e1e3f-c1f8-4736-9c41-ad6b0345aca8 tempest-VolumesExtendTest-1864858717 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#Quobyte'], 'hosts': ['devstack@QuobyteHD#Quobyte']} {{(pid=83259) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1387}} Sep 16 15:11:14 devstack cinder-volume[83259]: DEBUG cinder.volume.manager [None req-4f7e1e3f-c1f8-4736-9c41-ad6b0345aca8 tempest-VolumesExtendTest-1864858717 None] Flow 'volume_create_manager' (2a960aa3-b5f6-4c6c-b037-40136816c6bb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83259) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 16 15:11:14 devstack cinder-volume[83259]: DEBUG cinder.volume.manager [None req-4f7e1e3f-c1f8-4736-9c41-ad6b0345aca8 tempest-VolumesExtendTest-1864858717 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d30aa1bf-b376-42cd-b92c-a2e016460820) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83259) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 15:11:14 devstack cinder-volume[83259]: DEBUG cinder.volume.manager [None req-4f7e1e3f-c1f8-4736-9c41-ad6b0345aca8 tempest-VolumesExtendTest-1864858717 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d30aa1bf-b376-42cd-b92c-a2e016460820) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-16T13:11:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-59127297',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#Quobyte',id=7f7a28bd-43d8-4acb-b2e4-602440e420cc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='12e7b96bba564d0988df3d254290c4c4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-16T13:11:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-16T13:11:14Z,use_quota=True,user_id='e1829c22ade44df2a224f51e2e1aba33',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(485ead50-3df8-4d76-8d34-a4db136c980a),volume_type_id=485ead50-3df8-4d76-8d34-a4db136c980a)' {{(pid=83259) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 15:11:14 devstack cinder-volume[83259]: DEBUG cinder.volume.manager [None req-4f7e1e3f-c1f8-4736-9c41-ad6b0345aca8 tempest-VolumesExtendTest-1864858717 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e6a88ed2-5c87-40be-9277-7075c77b629f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83259) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 15:11:14 devstack cinder-volume[83259]: DEBUG cinder.volume.manager [None req-4f7e1e3f-c1f8-4736-9c41-ad6b0345aca8 tempest-VolumesExtendTest-1864858717 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e6a88ed2-5c87-40be-9277-7075c77b629f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83259) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 15:11:14 devstack cinder-volume[83259]: DEBUG cinder.volume.manager [None req-4f7e1e3f-c1f8-4736-9c41-ad6b0345aca8 tempest-VolumesExtendTest-1864858717 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (67a21ac3-12f7-4267-8911-bdc6efc6a377) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83259) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 15:11:14 devstack cinder-volume[83259]: DEBUG cinder.volume.manager [None req-4f7e1e3f-c1f8-4736-9c41-ad6b0345aca8 tempest-VolumesExtendTest-1864858717 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (67a21ac3-12f7-4267-8911-bdc6efc6a377) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7f7a28bd-43d8-4acb-b2e4-602440e420cc', 'volume_name': 'volume-7f7a28bd-43d8-4acb-b2e4-602440e420cc', 'volume_size': 1}' {{(pid=83259) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 15:11:14 devstack cinder-volume[83259]: DEBUG cinder.volume.manager [None req-4f7e1e3f-c1f8-4736-9c41-ad6b0345aca8 tempest-VolumesExtendTest-1864858717 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4fd73d17-cea9-45a5-919c-5503efc55237) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83259) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 15:11:14 devstack cinder-volume[83259]: DEBUG cinder.volume.manager [None req-4f7e1e3f-c1f8-4736-9c41-ad6b0345aca8 tempest-VolumesExtendTest-1864858717 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4fd73d17-cea9-45a5-919c-5503efc55237) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83259) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 15:11:14 devstack cinder-volume[83259]: DEBUG cinder.volume.manager [None req-4f7e1e3f-c1f8-4736-9c41-ad6b0345aca8 tempest-VolumesExtendTest-1864858717 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b546e32b-fffc-4b2b-ac41-bdb21d70aae8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83259) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 15:11:14 devstack cinder-volume[83259]: INFO cinder.volume.flows.manager.create_volume [None req-4f7e1e3f-c1f8-4736-9c41-ad6b0345aca8 tempest-VolumesExtendTest-1864858717 None] Volume 7f7a28bd-43d8-4acb-b2e4-602440e420cc: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7f7a28bd-43d8-4acb-b2e4-602440e420cc', 'volume_size': 1} Sep 16 15:11:14 devstack cinder-volume[83259]: DEBUG oslo_concurrency.lockutils [None req-4f7e1e3f-c1f8-4736-9c41-ad6b0345aca8 tempest-VolumesExtendTest-1864858717 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83259) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 16 15:11:14 devstack cinder-volume[83259]: DEBUG oslo_concurrency.lockutils [None req-4f7e1e3f-c1f8-4736-9c41-ad6b0345aca8 tempest-VolumesExtendTest-1864858717 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=83259) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 16 15:11:14 devstack cinder-volume[83259]: DEBUG cinder.volume.drivers.quobyte [None req-4f7e1e3f-c1f8-4736-9c41-ad6b0345aca8 tempest-VolumesExtendTest-1864858717 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-16T13:11:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-59127297',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#Quobyte',id=7f7a28bd-43d8-4acb-b2e4-602440e420cc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='12e7b96bba564d0988df3d254290c4c4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-16T13:11:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-16T13:11:14Z,use_quota=True,user_id='e1829c22ade44df2a224f51e2e1aba33',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(485ead50-3df8-4d76-8d34-a4db136c980a),volume_type_id=485ead50-3df8-4d76-8d34-a4db136c980a)}" {{(pid=83259) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Sep 16 15:11:14 devstack cinder-volume[83259]: DEBUG cinder.volume.drivers.remotefs [None req-4f7e1e3f-c1f8-4736-9c41-ad6b0345aca8 tempest-VolumesExtendTest-1864858717 None] Creating volume 7f7a28bd-43d8-4acb-b2e4-602440e420cc {{(pid=83259) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}} Sep 16 15:11:14 devstack cinder-volume[83259]: DEBUG oslo_concurrency.lockutils [None req-4f7e1e3f-c1f8-4736-9c41-ad6b0345aca8 tempest-VolumesExtendTest-1864858717 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83259) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 16 15:11:14 devstack cinder-volume[83259]: DEBUG oslo_concurrency.lockutils [None req-4f7e1e3f-c1f8-4736-9c41-ad6b0345aca8 tempest-VolumesExtendTest-1864858717 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83259) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 16 15:11:14 devstack cinder-volume[83259]: DEBUG cinder.volume.drivers.quobyte [None req-4f7e1e3f-c1f8-4736-9c41-ad6b0345aca8 tempest-VolumesExtendTest-1864858717 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-61f585ac-f8e2-4d19-a890-7ebc2726cc72': None} {{(pid=83259) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:639}} Sep 16 15:11:14 devstack cinder-volume[83259]: DEBUG cinder.volume.drivers.quobyte [None req-4f7e1e3f-c1f8-4736-9c41-ad6b0345aca8 tempest-VolumesExtendTest-1864858717 None] Available shares ['10.10.41.181/cinder-vol-61f585ac-f8e2-4d19-a890-7ebc2726cc72'] {{(pid=83259) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:669}} Sep 16 15:11:14 devstack cinder-volume[83259]: DEBUG oslo_concurrency.lockutils [None req-4f7e1e3f-c1f8-4736-9c41-ad6b0345aca8 tempest-VolumesExtendTest-1864858717 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=83259) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 16 15:11:14 devstack cinder-volume[83259]: DEBUG cinder.volume.drivers.quobyte [None req-4f7e1e3f-c1f8-4736-9c41-ad6b0345aca8 tempest-VolumesExtendTest-1864858717 None] Selected 10.10.41.181/cinder-vol-61f585ac-f8e2-4d19-a890-7ebc2726cc72 as target Quobyte volume. {{(pid=83259) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:690}} Sep 16 15:11:14 devstack cinder-volume[83259]: INFO cinder.volume.drivers.remotefs [None req-4f7e1e3f-c1f8-4736-9c41-ad6b0345aca8 tempest-VolumesExtendTest-1864858717 None] casted to 10.10.41.181/cinder-vol-61f585ac-f8e2-4d19-a890-7ebc2726cc72 Sep 16 15:11:14 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [None req-4f7e1e3f-c1f8-4736-9c41-ad6b0345aca8 tempest-VolumesExtendTest-1864858717 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c/volume-7f7a28bd-43d8-4acb-b2e4-602440e420cc 1073741824 {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 15:11:14 devstack quobyte-client[83286]: The server volume:87712ffe-8a69-446d-9ed6-4430c7ee9792@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=87712ffe-8a69-446d-9ed6-4430c7ee9792, inode=101, name=volume-7f7a28bd-43d8-4acb-b2e4-602440e420cc, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.206), requestorAccessMask=0 Sep 16 15:11:15 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [None req-4f7e1e3f-c1f8-4736-9c41-ad6b0345aca8 tempest-VolumesExtendTest-1864858717 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c/volume-7f7a28bd-43d8-4acb-b2e4-602440e420cc 1073741824" returned: 0 in 0.335s {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 15:11:15 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [None req-4f7e1e3f-c1f8-4736-9c41-ad6b0345aca8 tempest-VolumesExtendTest-1864858717 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c/volume-7f7a28bd-43d8-4acb-b2e4-602440e420cc {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 15:11:15 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [None req-4f7e1e3f-c1f8-4736-9c41-ad6b0345aca8 tempest-VolumesExtendTest-1864858717 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c/volume-7f7a28bd-43d8-4acb-b2e4-602440e420cc" returned: 0 in 0.087s {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 15:11:15 devstack cinder-volume[83259]: DEBUG cinder.volume.drivers.quobyte [None req-4f7e1e3f-c1f8-4736-9c41-ad6b0345aca8 tempest-VolumesExtendTest-1864858717 None] <== create_volume: return (541ms) {'provider_location': '10.10.41.181/cinder-vol-61f585ac-f8e2-4d19-a890-7ebc2726cc72'} {{(pid=83259) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Sep 16 15:11:15 devstack cinder-volume[83259]: DEBUG oslo_concurrency.lockutils [None req-4f7e1e3f-c1f8-4736-9c41-ad6b0345aca8 tempest-VolumesExtendTest-1864858717 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.557s {{(pid=83259) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 16 15:11:15 devstack cinder-volume[83259]: DEBUG cinder.volume.manager [None req-4f7e1e3f-c1f8-4736-9c41-ad6b0345aca8 tempest-VolumesExtendTest-1864858717 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b546e32b-fffc-4b2b-ac41-bdb21d70aae8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7f7a28bd-43d8-4acb-b2e4-602440e420cc', 'volume_size': 1}' {{(pid=83259) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 15:11:15 devstack cinder-volume[83259]: DEBUG cinder.volume.manager [None req-4f7e1e3f-c1f8-4736-9c41-ad6b0345aca8 tempest-VolumesExtendTest-1864858717 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (467ff338-fb02-4061-8f36-a6025da00d69) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83259) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 15:11:15 devstack cinder-volume[83259]: INFO cinder.volume.flows.manager.create_volume [None req-4f7e1e3f-c1f8-4736-9c41-ad6b0345aca8 tempest-VolumesExtendTest-1864858717 None] Volume volume-7f7a28bd-43d8-4acb-b2e4-602440e420cc (7f7a28bd-43d8-4acb-b2e4-602440e420cc): created successfully Sep 16 15:11:15 devstack cinder-volume[83259]: DEBUG cinder.volume.manager [None req-4f7e1e3f-c1f8-4736-9c41-ad6b0345aca8 tempest-VolumesExtendTest-1864858717 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (467ff338-fb02-4061-8f36-a6025da00d69) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83259) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 15:11:15 devstack cinder-volume[83259]: DEBUG cinder.volume.manager [None req-4f7e1e3f-c1f8-4736-9c41-ad6b0345aca8 tempest-VolumesExtendTest-1864858717 None] Flow 'volume_create_manager' (2a960aa3-b5f6-4c6c-b037-40136816c6bb) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83259) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 16 15:11:15 devstack cinder-volume[83259]: INFO cinder.volume.manager [None req-4f7e1e3f-c1f8-4736-9c41-ad6b0345aca8 tempest-VolumesExtendTest-1864858717 None] Created volume successfully. Sep 16 15:11:16 devstack cinder-volume[83259]: WARNING cinder.volume.volume_utils [None req-14138085-749b-4beb-b3cb-7dc4da617ae8 tempest-VolumesExtendTest-1864858717 None] Volume driver (QuobyteDriver 1.2) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 16 15:11:16 devstack cinder-volume[83259]: DEBUG oslo_concurrency.lockutils [None req-14138085-749b-4beb-b3cb-7dc4da617ae8 tempest-VolumesExtendTest-1864858717 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=83259) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 16 15:11:16 devstack cinder-volume[83259]: DEBUG oslo_concurrency.lockutils [None req-14138085-749b-4beb-b3cb-7dc4da617ae8 tempest-VolumesExtendTest-1864858717 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.003s {{(pid=83259) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 16 15:11:17 devstack cinder-volume[83259]: DEBUG cinder.volume.drivers.remotefs [None req-14138085-749b-4beb-b3cb-7dc4da617ae8 tempest-VolumesExtendTest-1864858717 None] Creating offline snapshot a0db00bc-a8d4-4c1b-9eb5-fe35530ba653 of volume 7f7a28bd-43d8-4acb-b2e4-602440e420cc {{(pid=83259) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1694}} Sep 16 15:11:17 devstack cinder-volume[83259]: DEBUG oslo.privsep.daemon [-] privsep: reply[981ed281-9d19-4c52-b344-b2dcd027e72b]: (4, 'qcow2') {{(pid=84312) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 16 15:11:17 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [None req-14138085-749b-4beb-b3cb-7dc4da617ae8 tempest-VolumesExtendTest-1864858717 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c/volume-7f7a28bd-43d8-4acb-b2e4-602440e420cc {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 15:11:17 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [None req-14138085-749b-4beb-b3cb-7dc4da617ae8 tempest-VolumesExtendTest-1864858717 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c/volume-7f7a28bd-43d8-4acb-b2e4-602440e420cc" returned: 0 in 0.446s {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 15:11:17 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [None req-14138085-749b-4beb-b3cb-7dc4da617ae8 tempest-VolumesExtendTest-1864858717 None] Running cmd (subprocess): qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c/volume-7f7a28bd-43d8-4acb-b2e4-602440e420cc,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c/volume-7f7a28bd-43d8-4acb-b2e4-602440e420cc.a0db00bc-a8d4-4c1b-9eb5-fe35530ba653 1G {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 15:11:17 devstack quobyte-client[83286]: The server volume:87712ffe-8a69-446d-9ed6-4430c7ee9792@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=87712ffe-8a69-446d-9ed6-4430c7ee9792, inode=102, name=volume-7f7a28bd-43d8-4acb-b2e4-602440e420cc.a0db00bc-a8d4-4c1b-9eb5-fe35530ba653, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.206), requestorAccessMask=0 Sep 16 15:11:17 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [None req-14138085-749b-4beb-b3cb-7dc4da617ae8 tempest-VolumesExtendTest-1864858717 None] CMD "qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c/volume-7f7a28bd-43d8-4acb-b2e4-602440e420cc,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c/volume-7f7a28bd-43d8-4acb-b2e4-602440e420cc.a0db00bc-a8d4-4c1b-9eb5-fe35530ba653 1G" returned: 0 in 0.238s {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 15:11:17 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [None req-14138085-749b-4beb-b3cb-7dc4da617ae8 tempest-VolumesExtendTest-1864858717 None] Running cmd (subprocess): qemu-img rebase -u -b volume-7f7a28bd-43d8-4acb-b2e4-602440e420cc -F qcow2 /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c/volume-7f7a28bd-43d8-4acb-b2e4-602440e420cc.a0db00bc-a8d4-4c1b-9eb5-fe35530ba653 {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 15:11:17 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [None req-14138085-749b-4beb-b3cb-7dc4da617ae8 tempest-VolumesExtendTest-1864858717 None] CMD "qemu-img rebase -u -b volume-7f7a28bd-43d8-4acb-b2e4-602440e420cc -F qcow2 /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c/volume-7f7a28bd-43d8-4acb-b2e4-602440e420cc.a0db00bc-a8d4-4c1b-9eb5-fe35530ba653" returned: 0 in 0.138s {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 15:11:17 devstack cinder-volume[83259]: DEBUG cinder.volume.drivers.remotefs [None req-14138085-749b-4beb-b3cb-7dc4da617ae8 tempest-VolumesExtendTest-1864858717 None] File path /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c/volume-7f7a28bd-43d8-4acb-b2e4-602440e420cc.a0db00bc-a8d4-4c1b-9eb5-fe35530ba653 is being set with permissions: 660 {{(pid=83259) _set_rw_permissions /opt/stack/cinder/cinder/volume/drivers/remotefs.py:492}} Sep 16 15:11:17 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [None req-14138085-749b-4beb-b3cb-7dc4da617ae8 tempest-VolumesExtendTest-1864858717 None] Running cmd (subprocess): chmod 660 /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c/volume-7f7a28bd-43d8-4acb-b2e4-602440e420cc.a0db00bc-a8d4-4c1b-9eb5-fe35530ba653 {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 15:11:18 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [None req-14138085-749b-4beb-b3cb-7dc4da617ae8 tempest-VolumesExtendTest-1864858717 None] CMD "chmod 660 /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c/volume-7f7a28bd-43d8-4acb-b2e4-602440e420cc.a0db00bc-a8d4-4c1b-9eb5-fe35530ba653" returned: 0 in 0.189s {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 15:11:18 devstack cinder-volume[83259]: DEBUG cinder.volume.drivers.remotefs [None req-14138085-749b-4beb-b3cb-7dc4da617ae8 tempest-VolumesExtendTest-1864858717 None] Setting permissions: /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c/volume-7f7a28bd-43d8-4acb-b2e4-602440e420cc -> 1000:1000 {{(pid=83259) _do_create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1584}} Sep 16 15:11:18 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [None req-14138085-749b-4beb-b3cb-7dc4da617ae8 tempest-VolumesExtendTest-1864858717 None] Running cmd (subprocess): chown --reference=/opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c/volume-7f7a28bd-43d8-4acb-b2e4-602440e420cc /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c/volume-7f7a28bd-43d8-4acb-b2e4-602440e420cc.a0db00bc-a8d4-4c1b-9eb5-fe35530ba653 {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 15:11:18 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [None req-14138085-749b-4beb-b3cb-7dc4da617ae8 tempest-VolumesExtendTest-1864858717 None] CMD "chown --reference=/opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c/volume-7f7a28bd-43d8-4acb-b2e4-602440e420cc /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c/volume-7f7a28bd-43d8-4acb-b2e4-602440e420cc.a0db00bc-a8d4-4c1b-9eb5-fe35530ba653" returned: 0 in 0.238s {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 15:11:18 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [None req-14138085-749b-4beb-b3cb-7dc4da617ae8 tempest-VolumesExtendTest-1864858717 None] Running cmd (subprocess): truncate -s0 /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c/volume-7f7a28bd-43d8-4acb-b2e4-602440e420cc.info {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 15:11:18 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [None req-14138085-749b-4beb-b3cb-7dc4da617ae8 tempest-VolumesExtendTest-1864858717 None] CMD "truncate -s0 /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c/volume-7f7a28bd-43d8-4acb-b2e4-602440e420cc.info" returned: 0 in 0.140s {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 15:11:18 devstack cinder-volume[83259]: DEBUG cinder.volume.drivers.remotefs [None req-14138085-749b-4beb-b3cb-7dc4da617ae8 tempest-VolumesExtendTest-1864858717 None] File path /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c/volume-7f7a28bd-43d8-4acb-b2e4-602440e420cc.info is being set with permissions: 660 {{(pid=83259) _set_rw_permissions /opt/stack/cinder/cinder/volume/drivers/remotefs.py:492}} Sep 16 15:11:18 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [None req-14138085-749b-4beb-b3cb-7dc4da617ae8 tempest-VolumesExtendTest-1864858717 None] Running cmd (subprocess): chmod 660 /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c/volume-7f7a28bd-43d8-4acb-b2e4-602440e420cc.info {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 15:11:18 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [None req-14138085-749b-4beb-b3cb-7dc4da617ae8 tempest-VolumesExtendTest-1864858717 None] CMD "chmod 660 /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c/volume-7f7a28bd-43d8-4acb-b2e4-602440e420cc.info" returned: 0 in 0.121s {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 15:11:18 devstack cinder-volume[83259]: DEBUG oslo_concurrency.lockutils [None req-14138085-749b-4beb-b3cb-7dc4da617ae8 tempest-VolumesExtendTest-1864858717 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.904s {{(pid=83259) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 16 15:11:19 devstack cinder-volume[83259]: INFO cinder.volume.manager [None req-14138085-749b-4beb-b3cb-7dc4da617ae8 tempest-VolumesExtendTest-1864858717 None] Create snapshot completed successfully Sep 16 15:11:20 devstack cinder-volume[83259]: WARNING cinder.volume.volume_utils [None req-30a5a877-435f-4955-8854-85bb14b85c22 tempest-VolumesExtendTest-1864858717 None] Volume driver (QuobyteDriver 1.2) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 16 15:11:20 devstack cinder-volume[83259]: DEBUG oslo_concurrency.lockutils [None req-30a5a877-435f-4955-8854-85bb14b85c22 tempest-VolumesExtendTest-1864858717 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" {{(pid=83259) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 16 15:11:20 devstack cinder-volume[83259]: DEBUG oslo_concurrency.lockutils [None req-30a5a877-435f-4955-8854-85bb14b85c22 tempest-VolumesExtendTest-1864858717 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: waited 0.005s {{(pid=83259) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 16 15:11:20 devstack cinder-volume[83259]: DEBUG oslo.privsep.daemon [-] privsep: reply[8ff8315f-085a-43b2-8063-abe69c7d7066]: (4, 'qcow2') {{(pid=84312) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 16 15:11:20 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [None req-30a5a877-435f-4955-8854-85bb14b85c22 tempest-VolumesExtendTest-1864858717 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c/volume-7f7a28bd-43d8-4acb-b2e4-602440e420cc {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 15:11:21 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [None req-30a5a877-435f-4955-8854-85bb14b85c22 tempest-VolumesExtendTest-1864858717 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c/volume-7f7a28bd-43d8-4acb-b2e4-602440e420cc" returned: 0 in 0.646s {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 15:11:21 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [None req-30a5a877-435f-4955-8854-85bb14b85c22 tempest-VolumesExtendTest-1864858717 None] Running cmd (subprocess): qemu-img resize /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c/volume-7f7a28bd-43d8-4acb-b2e4-602440e420cc.a0db00bc-a8d4-4c1b-9eb5-fe35530ba653 2G {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 15:11:21 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [None req-30a5a877-435f-4955-8854-85bb14b85c22 tempest-VolumesExtendTest-1864858717 None] CMD "qemu-img resize /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c/volume-7f7a28bd-43d8-4acb-b2e4-602440e420cc.a0db00bc-a8d4-4c1b-9eb5-fe35530ba653 2G" returned: 0 in 0.214s {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 15:11:21 devstack cinder-volume[83259]: DEBUG oslo_concurrency.lockutils [None req-30a5a877-435f-4955-8854-85bb14b85c22 tempest-VolumesExtendTest-1864858717 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: held 0.958s {{(pid=83259) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 16 15:11:21 devstack cinder-volume[83259]: INFO cinder.volume.manager [None req-30a5a877-435f-4955-8854-85bb14b85c22 tempest-VolumesExtendTest-1864858717 None] Extend volume completed successfully. Sep 16 15:11:22 devstack cinder-volume[83259]: DEBUG cinder.coordination [None req-32278c56-8a68-45a4-a956-8db7d06a6cb4 tempest-VolumesExtendTest-1864858717 None] Acquiring lock "cinder-a0db00bc-a8d4-4c1b-9eb5-fe35530ba653-delete_snapshot" by "delete_snapshot" {{(pid=83259) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 16 15:11:22 devstack cinder-volume[83259]: DEBUG cinder.coordination [None req-32278c56-8a68-45a4-a956-8db7d06a6cb4 tempest-VolumesExtendTest-1864858717 None] Lock "cinder-a0db00bc-a8d4-4c1b-9eb5-fe35530ba653-delete_snapshot" acquired by "delete_snapshot" :: waited 0.058s {{(pid=83259) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 16 15:11:22 devstack cinder-volume[83259]: WARNING cinder.volume.volume_utils [None req-32278c56-8a68-45a4-a956-8db7d06a6cb4 tempest-VolumesExtendTest-1864858717 None] Volume driver (QuobyteDriver 1.2) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 16 15:11:22 devstack cinder-volume[83259]: DEBUG cinder.coordination [None req-32278c56-8a68-45a4-a956-8db7d06a6cb4 tempest-VolumesExtendTest-1864858717 None] Acquiring lock "cinder-quobyte-7f7a28bd-43d8-4acb-b2e4-602440e420cc" by "delete_snapshot" {{(pid=83259) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 16 15:11:23 devstack cinder-volume[83259]: DEBUG cinder.coordination [None req-32278c56-8a68-45a4-a956-8db7d06a6cb4 tempest-VolumesExtendTest-1864858717 None] Lock "cinder-quobyte-7f7a28bd-43d8-4acb-b2e4-602440e420cc" acquired by "delete_snapshot" :: waited 0.290s {{(pid=83259) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 16 15:11:23 devstack cinder-volume[83259]: DEBUG cinder.coordination [None req-32278c56-8a68-45a4-a956-8db7d06a6cb4 tempest-VolumesExtendTest-1864858717 None] Acquiring lock "cinder-quobyte-a0db00bc-a8d4-4c1b-9eb5-fe35530ba653" by "_delete_snapshot" {{(pid=83259) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 16 15:11:23 devstack cinder-volume[83259]: DEBUG cinder.coordination [None req-32278c56-8a68-45a4-a956-8db7d06a6cb4 tempest-VolumesExtendTest-1864858717 None] Lock "cinder-quobyte-a0db00bc-a8d4-4c1b-9eb5-fe35530ba653" acquired by "_delete_snapshot" :: waited 0.015s {{(pid=83259) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 16 15:11:23 devstack cinder-volume[83259]: DEBUG cinder.volume.drivers.remotefs [None req-32278c56-8a68-45a4-a956-8db7d06a6cb4 tempest-VolumesExtendTest-1864858717 None] Deleting offline snapshot a0db00bc-a8d4-4c1b-9eb5-fe35530ba653 of volume 7f7a28bd-43d8-4acb-b2e4-602440e420cc {{(pid=83259) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1278}} Sep 16 15:11:23 devstack cinder-volume[83259]: DEBUG cinder.volume.drivers.remotefs [None req-32278c56-8a68-45a4-a956-8db7d06a6cb4 tempest-VolumesExtendTest-1864858717 None] snapshot_file for this snap is: volume-7f7a28bd-43d8-4acb-b2e4-602440e420cc.a0db00bc-a8d4-4c1b-9eb5-fe35530ba653 {{(pid=83259) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1307}} Sep 16 15:11:23 devstack cinder-volume[83259]: DEBUG oslo.privsep.daemon [-] privsep: reply[adbcf778-848b-4306-9107-7911bb53ff72]: (4, 'qcow2') {{(pid=84312) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 16 15:11:23 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [None req-32278c56-8a68-45a4-a956-8db7d06a6cb4 tempest-VolumesExtendTest-1864858717 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c/volume-7f7a28bd-43d8-4acb-b2e4-602440e420cc.a0db00bc-a8d4-4c1b-9eb5-fe35530ba653 {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 15:11:23 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [None req-32278c56-8a68-45a4-a956-8db7d06a6cb4 tempest-VolumesExtendTest-1864858717 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c/volume-7f7a28bd-43d8-4acb-b2e4-602440e420cc.a0db00bc-a8d4-4c1b-9eb5-fe35530ba653" returned: 0 in 0.400s {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 15:11:23 devstack cinder-volume[83259]: DEBUG cinder.volume.drivers.remotefs [None req-32278c56-8a68-45a4-a956-8db7d06a6cb4 tempest-VolumesExtendTest-1864858717 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-7f7a28bd-43d8-4acb-b2e4-602440e420cc(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83259) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:886}} Sep 16 15:11:23 devstack cinder-volume[83259]: DEBUG oslo.privsep.daemon [-] privsep: reply[baa093d1-594b-4557-9fe6-1927a40dd8e8]: (4, 'qcow2') {{(pid=84312) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 16 15:11:23 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [None req-32278c56-8a68-45a4-a956-8db7d06a6cb4 tempest-VolumesExtendTest-1864858717 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c/volume-7f7a28bd-43d8-4acb-b2e4-602440e420cc {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 15:11:24 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [None req-32278c56-8a68-45a4-a956-8db7d06a6cb4 tempest-VolumesExtendTest-1864858717 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c/volume-7f7a28bd-43d8-4acb-b2e4-602440e420cc" returned: 0 in 0.439s {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 15:11:24 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [None req-32278c56-8a68-45a4-a956-8db7d06a6cb4 tempest-VolumesExtendTest-1864858717 None] Running cmd (subprocess): qemu-img commit -d /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c/volume-7f7a28bd-43d8-4acb-b2e4-602440e420cc.a0db00bc-a8d4-4c1b-9eb5-fe35530ba653 {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 15:11:24 devstack quobyte-client[83286]: System call of process 95807 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 16 15:11:24 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [None req-32278c56-8a68-45a4-a956-8db7d06a6cb4 tempest-VolumesExtendTest-1864858717 None] CMD "qemu-img commit -d /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c/volume-7f7a28bd-43d8-4acb-b2e4-602440e420cc.a0db00bc-a8d4-4c1b-9eb5-fe35530ba653" returned: 0 in 0.273s {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 15:11:24 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [None req-32278c56-8a68-45a4-a956-8db7d06a6cb4 tempest-VolumesExtendTest-1864858717 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c/volume-7f7a28bd-43d8-4acb-b2e4-602440e420cc.a0db00bc-a8d4-4c1b-9eb5-fe35530ba653 {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 15:11:24 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [None req-32278c56-8a68-45a4-a956-8db7d06a6cb4 tempest-VolumesExtendTest-1864858717 None] CMD "rm -f /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c/volume-7f7a28bd-43d8-4acb-b2e4-602440e420cc.a0db00bc-a8d4-4c1b-9eb5-fe35530ba653" returned: 0 in 0.114s {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 15:11:24 devstack cinder-volume[83259]: DEBUG cinder.coordination [None req-32278c56-8a68-45a4-a956-8db7d06a6cb4 tempest-VolumesExtendTest-1864858717 None] Lock "cinder-quobyte-a0db00bc-a8d4-4c1b-9eb5-fe35530ba653" released by "_delete_snapshot" :: held 1.576s {{(pid=83259) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 16 15:11:24 devstack cinder-volume[83259]: DEBUG cinder.coordination [None req-32278c56-8a68-45a4-a956-8db7d06a6cb4 tempest-VolumesExtendTest-1864858717 None] Lock "cinder-quobyte-7f7a28bd-43d8-4acb-b2e4-602440e420cc" released by "delete_snapshot" :: held 1.606s {{(pid=83259) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 16 15:11:25 devstack cinder-volume[83259]: DEBUG cinder.quota [None req-32278c56-8a68-45a4-a956-8db7d06a6cb4 tempest-VolumesExtendTest-1864858717 None] Created reservations ['d5d3c273-e1eb-44de-962f-830df10a9f45', '3c998787-89b2-480a-9095-32ad5813effd', 'b237a0d8-7f1b-4273-a0fa-690509c540d2', '7c415b18-5c7f-41d8-9728-438547dfa4ad'] {{(pid=83259) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 16 15:11:25 devstack cinder-volume[83259]: INFO cinder.volume.manager [None req-32278c56-8a68-45a4-a956-8db7d06a6cb4 tempest-VolumesExtendTest-1864858717 None] Delete snapshot completed successfully. Sep 16 15:11:25 devstack cinder-volume[83259]: DEBUG cinder.coordination [None req-32278c56-8a68-45a4-a956-8db7d06a6cb4 tempest-VolumesExtendTest-1864858717 None] Lock "cinder-a0db00bc-a8d4-4c1b-9eb5-fe35530ba653-delete_snapshot" released by "delete_snapshot" :: held 2.405s {{(pid=83259) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 16 15:11:26 devstack cinder-volume[83259]: DEBUG cinder.coordination [None req-c39105ad-86db-4360-8003-856775bbbca4 tempest-VolumesExtendTest-1864858717 None] Acquiring lock "cinder-7f7a28bd-43d8-4acb-b2e4-602440e420cc-delete_volume" by "delete_volume" {{(pid=83259) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 16 15:11:26 devstack cinder-volume[83259]: DEBUG cinder.coordination [None req-c39105ad-86db-4360-8003-856775bbbca4 tempest-VolumesExtendTest-1864858717 None] Lock "cinder-7f7a28bd-43d8-4acb-b2e4-602440e420cc-delete_volume" acquired by "delete_volume" :: waited 0.038s {{(pid=83259) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 16 15:11:26 devstack cinder-volume[83259]: WARNING cinder.volume.volume_utils [None req-c39105ad-86db-4360-8003-856775bbbca4 tempest-VolumesExtendTest-1864858717 None] Volume driver (QuobyteDriver 1.2) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 16 15:11:26 devstack cinder-volume[83259]: DEBUG cinder.coordination [None req-c39105ad-86db-4360-8003-856775bbbca4 tempest-VolumesExtendTest-1864858717 None] Acquiring lock "cinder-quobyte-7f7a28bd-43d8-4acb-b2e4-602440e420cc" by "delete_volume" {{(pid=83259) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 16 15:11:26 devstack cinder-volume[83259]: DEBUG cinder.coordination [None req-c39105ad-86db-4360-8003-856775bbbca4 tempest-VolumesExtendTest-1864858717 None] Lock "cinder-quobyte-7f7a28bd-43d8-4acb-b2e4-602440e420cc" acquired by "delete_volume" :: waited 0.019s {{(pid=83259) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 16 15:11:26 devstack cinder-volume[83259]: DEBUG oslo.privsep.daemon [-] privsep: reply[0897932c-af32-4eff-9d8c-59624730c11e]: (4, 'qcow2') {{(pid=84312) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 16 15:11:26 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [None req-c39105ad-86db-4360-8003-856775bbbca4 tempest-VolumesExtendTest-1864858717 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c/volume-7f7a28bd-43d8-4acb-b2e4-602440e420cc {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 15:11:26 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [None req-c39105ad-86db-4360-8003-856775bbbca4 tempest-VolumesExtendTest-1864858717 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c/volume-7f7a28bd-43d8-4acb-b2e4-602440e420cc" returned: 0 in 0.600s {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 15:11:26 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [None req-c39105ad-86db-4360-8003-856775bbbca4 tempest-VolumesExtendTest-1864858717 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c/volume-7f7a28bd-43d8-4acb-b2e4-602440e420cc {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 15:11:27 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [None req-c39105ad-86db-4360-8003-856775bbbca4 tempest-VolumesExtendTest-1864858717 None] CMD "rm -f /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c/volume-7f7a28bd-43d8-4acb-b2e4-602440e420cc" returned: 0 in 0.153s {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 15:11:27 devstack cinder-volume[83259]: DEBUG cinder.coordination [None req-c39105ad-86db-4360-8003-856775bbbca4 tempest-VolumesExtendTest-1864858717 None] Lock "cinder-quobyte-7f7a28bd-43d8-4acb-b2e4-602440e420cc" released by "delete_volume" :: held 1.002s {{(pid=83259) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 16 15:11:27 devstack cinder-volume[83259]: DEBUG cinder.quota [None req-c39105ad-86db-4360-8003-856775bbbca4 tempest-VolumesExtendTest-1864858717 None] Created reservations ['f0774478-d9e8-4577-815b-e09db549046e', '0af67d90-fa88-45e8-a32b-b69ca43525a4', '7c496c8d-14bf-40c3-8eba-f3f949394afb', 'f665680a-6b44-4def-8bbe-852606e27316'] {{(pid=83259) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 16 15:11:27 devstack cinder-volume[83259]: DEBUG oslo_concurrency.lockutils [None req-c39105ad-86db-4360-8003-856775bbbca4 tempest-VolumesExtendTest-1864858717 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83259) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 16 15:11:28 devstack cinder-volume[83259]: DEBUG oslo_concurrency.lockutils [None req-c39105ad-86db-4360-8003-856775bbbca4 tempest-VolumesExtendTest-1864858717 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.009s {{(pid=83259) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 16 15:11:28 devstack cinder-volume[83259]: DEBUG cinder.volume.drivers.quobyte [None req-c39105ad-86db-4360-8003-856775bbbca4 tempest-VolumesExtendTest-1864858717 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-61f585ac-f8e2-4d19-a890-7ebc2726cc72': None} {{(pid=83259) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:639}} Sep 16 15:11:28 devstack cinder-volume[83259]: DEBUG cinder.volume.drivers.quobyte [None req-c39105ad-86db-4360-8003-856775bbbca4 tempest-VolumesExtendTest-1864858717 None] Available shares ['10.10.41.181/cinder-vol-61f585ac-f8e2-4d19-a890-7ebc2726cc72'] {{(pid=83259) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:669}} Sep 16 15:11:28 devstack cinder-volume[83259]: DEBUG oslo_concurrency.lockutils [None req-c39105ad-86db-4360-8003-856775bbbca4 tempest-VolumesExtendTest-1864858717 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.022s {{(pid=83259) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 16 15:11:28 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [None req-c39105ad-86db-4360-8003-856775bbbca4 tempest-VolumesExtendTest-1864858717 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 15:11:28 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [None req-c39105ad-86db-4360-8003-856775bbbca4 tempest-VolumesExtendTest-1864858717 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c" returned: 0 in 0.128s {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 15:11:28 devstack cinder-volume[83259]: DEBUG cinder.manager [None req-c39105ad-86db-4360-8003-856775bbbca4 tempest-VolumesExtendTest-1864858717 None] Notifying Schedulers of capabilities ... {{(pid=83259) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 16 15:11:28 devstack cinder-volume[83259]: INFO cinder.volume.manager [None req-c39105ad-86db-4360-8003-856775bbbca4 tempest-VolumesExtendTest-1864858717 None] Deleted volume successfully. Sep 16 15:11:28 devstack cinder-volume[83259]: DEBUG cinder.coordination [None req-c39105ad-86db-4360-8003-856775bbbca4 tempest-VolumesExtendTest-1864858717 None] Lock "cinder-7f7a28bd-43d8-4acb-b2e4-602440e420cc-delete_volume" released by "delete_volume" :: held 2.815s {{(pid=83259) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 16 15:11:36 devstack cinder-volume[83259]: WARNING cinder.volume.volume_utils [None req-ee2b6b38-c2e7-43e4-906a-808ebbf246e3 tempest-VolumesNegativeTest-1640808438 None] Volume driver (QuobyteDriver 1.2) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 16 15:11:36 devstack cinder-volume[83259]: DEBUG cinder.volume.flows.manager.create_volume [None req-ee2b6b38-c2e7-43e4-906a-808ebbf246e3 tempest-VolumesNegativeTest-1640808438 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#Quobyte'], 'hosts': ['devstack@QuobyteHD#Quobyte']} {{(pid=83259) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1387}} Sep 16 15:11:36 devstack cinder-volume[83259]: DEBUG cinder.volume.manager [None req-ee2b6b38-c2e7-43e4-906a-808ebbf246e3 tempest-VolumesNegativeTest-1640808438 None] Flow 'volume_create_manager' (c2503775-004b-4887-8754-9566be0f9c27) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83259) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 16 15:11:36 devstack cinder-volume[83259]: DEBUG cinder.volume.manager [None req-ee2b6b38-c2e7-43e4-906a-808ebbf246e3 tempest-VolumesNegativeTest-1640808438 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (42d4fe1b-3bb4-467f-a7c3-0e7324d068b5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83259) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 15:11:36 devstack cinder-volume[83259]: DEBUG cinder.volume.manager [None req-ee2b6b38-c2e7-43e4-906a-808ebbf246e3 tempest-VolumesNegativeTest-1640808438 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (42d4fe1b-3bb4-467f-a7c3-0e7324d068b5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-16T13:11:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesNegativeTest-Volume-1788615490',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#Quobyte',id=c9ca23b9-c1ff-41de-8dae-6889e09f4934,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='35565ad43d2d44839c2532d537643646',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-16T13:11:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-16T13:11:36Z,use_quota=True,user_id='e1931df9002847baaa90c19007b942dc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(485ead50-3df8-4d76-8d34-a4db136c980a),volume_type_id=485ead50-3df8-4d76-8d34-a4db136c980a)' {{(pid=83259) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 15:11:36 devstack cinder-volume[83259]: DEBUG cinder.volume.manager [None req-ee2b6b38-c2e7-43e4-906a-808ebbf246e3 tempest-VolumesNegativeTest-1640808438 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (619d946f-eff3-4cd1-9234-a30b10b0571e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83259) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 15:11:36 devstack cinder-volume[83259]: DEBUG cinder.volume.manager [None req-ee2b6b38-c2e7-43e4-906a-808ebbf246e3 tempest-VolumesNegativeTest-1640808438 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (619d946f-eff3-4cd1-9234-a30b10b0571e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83259) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 15:11:36 devstack cinder-volume[83259]: DEBUG cinder.volume.manager [None req-ee2b6b38-c2e7-43e4-906a-808ebbf246e3 tempest-VolumesNegativeTest-1640808438 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (67bc762c-def3-41d7-a299-a51838e9cf69) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83259) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 15:11:36 devstack cinder-volume[83259]: DEBUG cinder.volume.manager [None req-ee2b6b38-c2e7-43e4-906a-808ebbf246e3 tempest-VolumesNegativeTest-1640808438 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (67bc762c-def3-41d7-a299-a51838e9cf69) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c9ca23b9-c1ff-41de-8dae-6889e09f4934', 'volume_name': 'volume-c9ca23b9-c1ff-41de-8dae-6889e09f4934', 'volume_size': 1}' {{(pid=83259) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 15:11:36 devstack cinder-volume[83259]: DEBUG cinder.volume.manager [None req-ee2b6b38-c2e7-43e4-906a-808ebbf246e3 tempest-VolumesNegativeTest-1640808438 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c3146b11-850d-40dd-8ca2-515996629b91) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83259) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 15:11:36 devstack cinder-volume[83259]: DEBUG cinder.volume.manager [None req-ee2b6b38-c2e7-43e4-906a-808ebbf246e3 tempest-VolumesNegativeTest-1640808438 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c3146b11-850d-40dd-8ca2-515996629b91) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83259) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 15:11:36 devstack cinder-volume[83259]: DEBUG cinder.volume.manager [None req-ee2b6b38-c2e7-43e4-906a-808ebbf246e3 tempest-VolumesNegativeTest-1640808438 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c304a2da-cb79-45ce-a911-fbcbc076368b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83259) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 15:11:36 devstack cinder-volume[83259]: INFO cinder.volume.flows.manager.create_volume [None req-ee2b6b38-c2e7-43e4-906a-808ebbf246e3 tempest-VolumesNegativeTest-1640808438 None] Volume c9ca23b9-c1ff-41de-8dae-6889e09f4934: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c9ca23b9-c1ff-41de-8dae-6889e09f4934', 'volume_size': 1} Sep 16 15:11:36 devstack cinder-volume[83259]: DEBUG oslo_concurrency.lockutils [None req-ee2b6b38-c2e7-43e4-906a-808ebbf246e3 tempest-VolumesNegativeTest-1640808438 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83259) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 16 15:11:36 devstack cinder-volume[83259]: DEBUG oslo_concurrency.lockutils [None req-ee2b6b38-c2e7-43e4-906a-808ebbf246e3 tempest-VolumesNegativeTest-1640808438 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=83259) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 16 15:11:36 devstack cinder-volume[83259]: DEBUG cinder.volume.drivers.quobyte [None req-ee2b6b38-c2e7-43e4-906a-808ebbf246e3 tempest-VolumesNegativeTest-1640808438 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-16T13:11:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesNegativeTest-Volume-1788615490',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#Quobyte',id=c9ca23b9-c1ff-41de-8dae-6889e09f4934,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='35565ad43d2d44839c2532d537643646',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-16T13:11:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-16T13:11:36Z,use_quota=True,user_id='e1931df9002847baaa90c19007b942dc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(485ead50-3df8-4d76-8d34-a4db136c980a),volume_type_id=485ead50-3df8-4d76-8d34-a4db136c980a)}" {{(pid=83259) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Sep 16 15:11:36 devstack cinder-volume[83259]: DEBUG cinder.volume.drivers.remotefs [None req-ee2b6b38-c2e7-43e4-906a-808ebbf246e3 tempest-VolumesNegativeTest-1640808438 None] Creating volume c9ca23b9-c1ff-41de-8dae-6889e09f4934 {{(pid=83259) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}} Sep 16 15:11:36 devstack cinder-volume[83259]: DEBUG oslo_concurrency.lockutils [None req-ee2b6b38-c2e7-43e4-906a-808ebbf246e3 tempest-VolumesNegativeTest-1640808438 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83259) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 16 15:11:36 devstack cinder-volume[83259]: DEBUG oslo_concurrency.lockutils [None req-ee2b6b38-c2e7-43e4-906a-808ebbf246e3 tempest-VolumesNegativeTest-1640808438 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83259) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 16 15:11:36 devstack cinder-volume[83259]: DEBUG cinder.volume.drivers.quobyte [None req-ee2b6b38-c2e7-43e4-906a-808ebbf246e3 tempest-VolumesNegativeTest-1640808438 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-61f585ac-f8e2-4d19-a890-7ebc2726cc72': None} {{(pid=83259) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:639}} Sep 16 15:11:36 devstack cinder-volume[83259]: DEBUG cinder.volume.drivers.quobyte [None req-ee2b6b38-c2e7-43e4-906a-808ebbf246e3 tempest-VolumesNegativeTest-1640808438 None] Available shares ['10.10.41.181/cinder-vol-61f585ac-f8e2-4d19-a890-7ebc2726cc72'] {{(pid=83259) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:669}} Sep 16 15:11:36 devstack cinder-volume[83259]: DEBUG oslo_concurrency.lockutils [None req-ee2b6b38-c2e7-43e4-906a-808ebbf246e3 tempest-VolumesNegativeTest-1640808438 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=83259) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 16 15:11:36 devstack cinder-volume[83259]: DEBUG cinder.volume.drivers.quobyte [None req-ee2b6b38-c2e7-43e4-906a-808ebbf246e3 tempest-VolumesNegativeTest-1640808438 None] Selected 10.10.41.181/cinder-vol-61f585ac-f8e2-4d19-a890-7ebc2726cc72 as target Quobyte volume. {{(pid=83259) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:690}} Sep 16 15:11:36 devstack cinder-volume[83259]: INFO cinder.volume.drivers.remotefs [None req-ee2b6b38-c2e7-43e4-906a-808ebbf246e3 tempest-VolumesNegativeTest-1640808438 None] casted to 10.10.41.181/cinder-vol-61f585ac-f8e2-4d19-a890-7ebc2726cc72 Sep 16 15:11:36 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [None req-ee2b6b38-c2e7-43e4-906a-808ebbf246e3 tempest-VolumesNegativeTest-1640808438 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c/volume-c9ca23b9-c1ff-41de-8dae-6889e09f4934 1073741824 {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 15:11:36 devstack quobyte-client[83286]: System call of process 95849 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 16 15:11:36 devstack quobyte-client[83286]: The server volume:87712ffe-8a69-446d-9ed6-4430c7ee9792@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=87712ffe-8a69-446d-9ed6-4430c7ee9792, inode=104, name=volume-c9ca23b9-c1ff-41de-8dae-6889e09f4934, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.206), requestorAccessMask=0 Sep 16 15:11:36 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [None req-ee2b6b38-c2e7-43e4-906a-808ebbf246e3 tempest-VolumesNegativeTest-1640808438 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c/volume-c9ca23b9-c1ff-41de-8dae-6889e09f4934 1073741824" returned: 0 in 0.458s {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 15:11:36 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [None req-ee2b6b38-c2e7-43e4-906a-808ebbf246e3 tempest-VolumesNegativeTest-1640808438 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c/volume-c9ca23b9-c1ff-41de-8dae-6889e09f4934 {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 15:11:36 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [None req-ee2b6b38-c2e7-43e4-906a-808ebbf246e3 tempest-VolumesNegativeTest-1640808438 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c/volume-c9ca23b9-c1ff-41de-8dae-6889e09f4934" returned: 0 in 0.189s {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 15:11:36 devstack cinder-volume[83259]: DEBUG cinder.volume.drivers.quobyte [None req-ee2b6b38-c2e7-43e4-906a-808ebbf246e3 tempest-VolumesNegativeTest-1640808438 None] <== create_volume: return (747ms) {'provider_location': '10.10.41.181/cinder-vol-61f585ac-f8e2-4d19-a890-7ebc2726cc72'} {{(pid=83259) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Sep 16 15:11:36 devstack cinder-volume[83259]: DEBUG oslo_concurrency.lockutils [None req-ee2b6b38-c2e7-43e4-906a-808ebbf246e3 tempest-VolumesNegativeTest-1640808438 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.760s {{(pid=83259) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 16 15:11:37 devstack cinder-volume[83259]: DEBUG cinder.volume.manager [None req-ee2b6b38-c2e7-43e4-906a-808ebbf246e3 tempest-VolumesNegativeTest-1640808438 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c304a2da-cb79-45ce-a911-fbcbc076368b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c9ca23b9-c1ff-41de-8dae-6889e09f4934', 'volume_size': 1}' {{(pid=83259) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 15:11:37 devstack cinder-volume[83259]: DEBUG cinder.volume.manager [None req-ee2b6b38-c2e7-43e4-906a-808ebbf246e3 tempest-VolumesNegativeTest-1640808438 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ca0ebcb0-5630-472a-b5a8-8b1573409237) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83259) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 15:11:37 devstack cinder-volume[83259]: INFO cinder.volume.flows.manager.create_volume [None req-ee2b6b38-c2e7-43e4-906a-808ebbf246e3 tempest-VolumesNegativeTest-1640808438 None] Volume volume-c9ca23b9-c1ff-41de-8dae-6889e09f4934 (c9ca23b9-c1ff-41de-8dae-6889e09f4934): created successfully Sep 16 15:11:37 devstack cinder-volume[83259]: DEBUG cinder.volume.manager [None req-ee2b6b38-c2e7-43e4-906a-808ebbf246e3 tempest-VolumesNegativeTest-1640808438 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ca0ebcb0-5630-472a-b5a8-8b1573409237) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83259) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 15:11:37 devstack cinder-volume[83259]: DEBUG cinder.volume.manager [None req-ee2b6b38-c2e7-43e4-906a-808ebbf246e3 tempest-VolumesNegativeTest-1640808438 None] Flow 'volume_create_manager' (c2503775-004b-4887-8754-9566be0f9c27) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83259) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 16 15:11:37 devstack cinder-volume[83259]: INFO cinder.volume.manager [None req-ee2b6b38-c2e7-43e4-906a-808ebbf246e3 tempest-VolumesNegativeTest-1640808438 None] Created volume successfully. Sep 16 15:11:40 devstack cinder-volume[83259]: WARNING cinder.volume.volume_utils [req-39bb2e8d-3b84-414f-878e-f7c1d43477d5 req-2c43bac8-b96e-4178-8b88-d84762404c24 tempest-TestServerVolumeAttachmentScenario-757686503 None] Volume driver (QuobyteDriver 1.2) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 16 15:11:40 devstack cinder-volume[83259]: WARNING cinder.volume.volume_utils [req-39bb2e8d-3b84-414f-878e-f7c1d43477d5 req-2c43bac8-b96e-4178-8b88-d84762404c24 tempest-TestServerVolumeAttachmentScenario-757686503 None] Volume driver (QuobyteDriver 1.2) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 16 15:11:40 devstack cinder-volume[83259]: INFO cinder.volume.manager [req-39bb2e8d-3b84-414f-878e-f7c1d43477d5 req-2c43bac8-b96e-4178-8b88-d84762404c24 tempest-TestServerVolumeAttachmentScenario-757686503 None] Terminate volume connection completed successfully. Sep 16 15:11:40 devstack cinder-volume[83259]: DEBUG cinder.volume.manager [req-39bb2e8d-3b84-414f-878e-f7c1d43477d5 req-2c43bac8-b96e-4178-8b88-d84762404c24 tempest-TestServerVolumeAttachmentScenario-757686503 None] Deleting attachment e2f6b3db-6368-4df5-91b7-1faa52307174. {{(pid=83259) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5022}} Sep 16 15:11:45 devstack cinder-volume[83259]: DEBUG oslo_service.periodic_task [None req-050ec8a1-6ffd-499d-95ad-d548a84437e2 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=83259) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} Sep 16 15:11:45 devstack cinder-volume[83259]: DEBUG oslo_concurrency.lockutils [None req-050ec8a1-6ffd-499d-95ad-d548a84437e2 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83259) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 16 15:11:45 devstack cinder-volume[83259]: DEBUG oslo_concurrency.lockutils [None req-050ec8a1-6ffd-499d-95ad-d548a84437e2 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.005s {{(pid=83259) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 16 15:11:45 devstack cinder-volume[83259]: DEBUG cinder.volume.drivers.quobyte [None req-050ec8a1-6ffd-499d-95ad-d548a84437e2 None None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-61f585ac-f8e2-4d19-a890-7ebc2726cc72': None} {{(pid=83259) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:639}} Sep 16 15:11:45 devstack cinder-volume[83259]: DEBUG cinder.volume.drivers.quobyte [None req-050ec8a1-6ffd-499d-95ad-d548a84437e2 None None] Available shares ['10.10.41.181/cinder-vol-61f585ac-f8e2-4d19-a890-7ebc2726cc72'] {{(pid=83259) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:669}} Sep 16 15:11:45 devstack cinder-volume[83259]: DEBUG oslo_concurrency.lockutils [None req-050ec8a1-6ffd-499d-95ad-d548a84437e2 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.033s {{(pid=83259) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 16 15:11:45 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [None req-050ec8a1-6ffd-499d-95ad-d548a84437e2 None None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 15:11:46 devstack cinder-volume[83259]: DEBUG cinder.coordination [None req-2487206e-52f9-48f0-8527-da7528525828 tempest-VolumesActionsTest-296669149 None] Acquiring lock "cinder-c07f5ce2-165d-42b6-806a-af27abe6db99" by "attach_volume" {{(pid=83259) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 16 15:11:46 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [None req-050ec8a1-6ffd-499d-95ad-d548a84437e2 None None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c" returned: 0 in 0.432s {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 15:11:46 devstack cinder-volume[83259]: DEBUG cinder.manager [None req-050ec8a1-6ffd-499d-95ad-d548a84437e2 None None] Notifying Schedulers of capabilities ... {{(pid=83259) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 16 15:11:46 devstack cinder-volume[83259]: DEBUG cinder.coordination [None req-2487206e-52f9-48f0-8527-da7528525828 tempest-VolumesActionsTest-296669149 None] Lock "cinder-c07f5ce2-165d-42b6-806a-af27abe6db99" acquired by "attach_volume" :: waited 0.221s {{(pid=83259) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 16 15:11:46 devstack cinder-volume[83259]: WARNING cinder.volume.volume_utils [None req-2487206e-52f9-48f0-8527-da7528525828 tempest-VolumesActionsTest-296669149 None] Volume driver (QuobyteDriver 1.2) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 16 15:11:46 devstack cinder-volume[83259]: INFO cinder.volume.manager [None req-2487206e-52f9-48f0-8527-da7528525828 tempest-VolumesActionsTest-296669149 None] Attaching volume c07f5ce2-165d-42b6-806a-af27abe6db99 to instance ca6c3641-f6eb-4b64-aa16-16c463604f48 at mountpoint /dev/vdb on host None. Sep 16 15:11:46 devstack cinder-volume[83259]: INFO cinder.volume.manager [None req-2487206e-52f9-48f0-8527-da7528525828 tempest-VolumesActionsTest-296669149 None] Attach volume completed successfully. Sep 16 15:11:46 devstack cinder-volume[83259]: DEBUG cinder.coordination [None req-2487206e-52f9-48f0-8527-da7528525828 tempest-VolumesActionsTest-296669149 None] Lock "cinder-c07f5ce2-165d-42b6-806a-af27abe6db99" released by "attach_volume" :: held 0.464s {{(pid=83259) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 16 15:11:47 devstack cinder-volume[83259]: DEBUG cinder.coordination [None req-d3486cd5-2cb3-4213-8401-abfa8c25c734 tempest-VolumesActionsTest-296669149 None] Acquiring lock "cinder-c07f5ce2-165d-42b6-806a-af27abe6db99-detach_volume" by "detach_volume" {{(pid=83259) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 16 15:11:47 devstack cinder-volume[83259]: DEBUG cinder.coordination [None req-d3486cd5-2cb3-4213-8401-abfa8c25c734 tempest-VolumesActionsTest-296669149 None] Lock "cinder-c07f5ce2-165d-42b6-806a-af27abe6db99-detach_volume" acquired by "detach_volume" :: waited 0.020s {{(pid=83259) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 16 15:11:47 devstack cinder-volume[83259]: WARNING cinder.volume.volume_utils [None req-d3486cd5-2cb3-4213-8401-abfa8c25c734 tempest-VolumesActionsTest-296669149 None] Volume driver (QuobyteDriver 1.2) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 16 15:11:47 devstack cinder-volume[83259]: INFO cinder.volume.manager [None req-d3486cd5-2cb3-4213-8401-abfa8c25c734 tempest-VolumesActionsTest-296669149 None] Detaching volume c07f5ce2-165d-42b6-806a-af27abe6db99 from instance ca6c3641-f6eb-4b64-aa16-16c463604f48. Sep 16 15:11:47 devstack cinder-volume[83259]: WARNING cinder.volume.volume_utils [None req-d3486cd5-2cb3-4213-8401-abfa8c25c734 tempest-VolumesActionsTest-296669149 None] Volume driver (QuobyteDriver 1.2) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 16 15:11:47 devstack cinder-volume[83259]: INFO cinder.volume.manager [None req-d3486cd5-2cb3-4213-8401-abfa8c25c734 tempest-VolumesActionsTest-296669149 None] Detach volume completed successfully. Sep 16 15:11:47 devstack cinder-volume[83259]: DEBUG cinder.coordination [None req-d3486cd5-2cb3-4213-8401-abfa8c25c734 tempest-VolumesActionsTest-296669149 None] Lock "cinder-c07f5ce2-165d-42b6-806a-af27abe6db99-detach_volume" released by "detach_volume" :: held 0.132s {{(pid=83259) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 16 15:11:57 devstack cinder-volume[83259]: DEBUG dbcounter [-] [83259] Writing DB stats cinder:SELECT=46,cinder:UPDATE=50,cinder:INSERT=12,cinder:DELETE=3 {{(pid=83259) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Sep 16 15:11:57 devstack cinder-volume[83259]: DEBUG dbcounter [-] [83259] Writing DB stats cinder:INSERT=16,cinder:SELECT=48,cinder:UPDATE=32,cinder:DELETE=3 {{(pid=83259) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Sep 16 15:12:02 devstack cinder-volume[83259]: WARNING cinder.volume.volume_utils [None req-458cb9dd-4410-4ecd-9405-d6c4051b94e7 tempest-VolumesActionsTest-296669149 None] Volume driver (QuobyteDriver 1.2) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 16 15:12:02 devstack cinder-volume[83259]: DEBUG oslo_concurrency.lockutils [None req-458cb9dd-4410-4ecd-9405-d6c4051b94e7 tempest-VolumesActionsTest-296669149 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" {{(pid=83259) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 16 15:12:02 devstack cinder-volume[83259]: DEBUG oslo_concurrency.lockutils [None req-458cb9dd-4410-4ecd-9405-d6c4051b94e7 tempest-VolumesActionsTest-296669149 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: waited 0.012s {{(pid=83259) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 16 15:12:02 devstack cinder-volume[83259]: DEBUG oslo.privsep.daemon [-] privsep: reply[fa222553-fc46-4ff1-a577-53c04cae641e]: (4, 'qcow2') {{(pid=84312) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 16 15:12:02 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [None req-458cb9dd-4410-4ecd-9405-d6c4051b94e7 tempest-VolumesActionsTest-296669149 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c/volume-c07f5ce2-165d-42b6-806a-af27abe6db99 {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 15:12:03 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [None req-458cb9dd-4410-4ecd-9405-d6c4051b94e7 tempest-VolumesActionsTest-296669149 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c/volume-c07f5ce2-165d-42b6-806a-af27abe6db99" returned: 0 in 0.611s {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 15:12:03 devstack cinder-volume[83259]: DEBUG oslo.privsep.daemon [-] privsep: reply[9e63b578-3978-418e-9739-ae35a267d615]: (4, 'qcow2') {{(pid=84312) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 16 15:12:03 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [None req-458cb9dd-4410-4ecd-9405-d6c4051b94e7 tempest-VolumesActionsTest-296669149 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c/volume-c07f5ce2-165d-42b6-806a-af27abe6db99 {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 15:12:04 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [None req-458cb9dd-4410-4ecd-9405-d6c4051b94e7 tempest-VolumesActionsTest-296669149 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c/volume-c07f5ce2-165d-42b6-806a-af27abe6db99" returned: 0 in 0.670s {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 15:12:04 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [None req-458cb9dd-4410-4ecd-9405-d6c4051b94e7 tempest-VolumesActionsTest-296669149 None] Running cmd (subprocess): qemu-img convert -O raw /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c/volume-c07f5ce2-165d-42b6-806a-af27abe6db99 /opt/stack/data/cinder/conversion/c07f5ce2-165d-42b6-806a-af27abe6db99.temp_image.006c1627-c0c0-438d-8230-12fb41053ff0_3b6x64w.img {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 15:12:07 devstack cinder-volume[83259]: WARNING cinder.volume.volume_utils [req-8953ad49-7d8b-4003-a8d9-9da91c7db147 req-a3d55c10-d058-4041-b608-174371471ed0 tempest-TestServerVolumeAttachmentScenario-757686503 None] Volume driver (QuobyteDriver 1.2) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 16 15:12:08 devstack cinder-volume[83259]: WARNING cinder.volume.volume_utils [req-8953ad49-7d8b-4003-a8d9-9da91c7db147 req-a3d55c10-d058-4041-b608-174371471ed0 tempest-TestServerVolumeAttachmentScenario-757686503 None] Volume driver (QuobyteDriver 1.2) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 16 15:12:08 devstack cinder-volume[83259]: INFO cinder.volume.manager [req-8953ad49-7d8b-4003-a8d9-9da91c7db147 req-a3d55c10-d058-4041-b608-174371471ed0 tempest-TestServerVolumeAttachmentScenario-757686503 None] Terminate volume connection completed successfully. Sep 16 15:12:08 devstack cinder-volume[83259]: DEBUG cinder.volume.manager [req-8953ad49-7d8b-4003-a8d9-9da91c7db147 req-a3d55c10-d058-4041-b608-174371471ed0 tempest-TestServerVolumeAttachmentScenario-757686503 None] Deleting attachment 3c2ae944-c0c1-4ee1-8107-b0687ff817fa. {{(pid=83259) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5022}} Sep 16 15:12:12 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [None req-458cb9dd-4410-4ecd-9405-d6c4051b94e7 tempest-VolumesActionsTest-296669149 None] CMD "qemu-img convert -O raw /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c/volume-c07f5ce2-165d-42b6-806a-af27abe6db99 /opt/stack/data/cinder/conversion/c07f5ce2-165d-42b6-806a-af27abe6db99.temp_image.006c1627-c0c0-438d-8230-12fb41053ff0_3b6x64w.img" returned: 0 in 8.041s {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 15:12:12 devstack cinder-volume[83259]: DEBUG oslo.privsep.daemon [-] privsep: reply[fc373efb-cb85-4771-a25e-5cf5dcab544d]: (4, 'qcow2') {{(pid=84312) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 16 15:12:12 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [None req-458cb9dd-4410-4ecd-9405-d6c4051b94e7 tempest-VolumesActionsTest-296669149 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c/volume-c07f5ce2-165d-42b6-806a-af27abe6db99 {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 15:12:13 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [None req-458cb9dd-4410-4ecd-9405-d6c4051b94e7 tempest-VolumesActionsTest-296669149 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c/volume-c07f5ce2-165d-42b6-806a-af27abe6db99" returned: 0 in 1.296s {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 15:12:13 devstack cinder-volume[83259]: DEBUG cinder.image.image_utils [None req-458cb9dd-4410-4ecd-9405-d6c4051b94e7 tempest-VolumesActionsTest-296669149 None] Image conversion details: src /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c/volume-c07f5ce2-165d-42b6-806a-af27abe6db99, size 1024.00 MB, duration 8.05 sec, destination /opt/stack/data/cinder/conversion/c07f5ce2-165d-42b6-806a-af27abe6db99.temp_image.006c1627-c0c0-438d-8230-12fb41053ff0_3b6x64w.img {{(pid=83259) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:501}} Sep 16 15:12:13 devstack cinder-volume[83259]: INFO cinder.image.image_utils [None req-458cb9dd-4410-4ecd-9405-d6c4051b94e7 tempest-VolumesActionsTest-296669149 None] Converted 1024.00 MB image at 127.25 MB/s Sep 16 15:12:14 devstack cinder-volume[83259]: DEBUG cinder.image.image_utils [None req-458cb9dd-4410-4ecd-9405-d6c4051b94e7 tempest-VolumesActionsTest-296669149 None] 006c1627-c0c0-438d-8230-12fb41053ff0 was raw, no need to convert to raw {{(pid=83259) upload_volume /opt/stack/cinder/cinder/image/image_utils.py:1127}} Sep 16 15:12:24 devstack cinder-volume[83259]: DEBUG dbcounter [-] [83259] Writing DB stats cinder:SELECT=3,cinder:UPDATE=1 {{(pid=83259) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Sep 16 15:12:24 devstack cinder-volume[83259]: DEBUG dbcounter [-] [83259] Writing DB stats cinder:SELECT=3 {{(pid=83259) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Sep 16 15:12:31 devstack cinder-volume[83259]: DEBUG cinder.coordination [None req-547b6f65-ef41-4d32-9771-a2a98e2ac6b3 tempest-TestServerVolumeAttachmentScenario-757686503 None] Acquiring lock "cinder-89469ddc-4f11-4f5f-9b33-4ff39e729f69-delete_volume" by "delete_volume" {{(pid=83259) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 16 15:12:31 devstack cinder-volume[83259]: DEBUG cinder.coordination [None req-547b6f65-ef41-4d32-9771-a2a98e2ac6b3 tempest-TestServerVolumeAttachmentScenario-757686503 None] Lock "cinder-89469ddc-4f11-4f5f-9b33-4ff39e729f69-delete_volume" acquired by "delete_volume" :: waited 0.176s {{(pid=83259) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 16 15:12:31 devstack cinder-volume[83259]: WARNING cinder.volume.volume_utils [None req-547b6f65-ef41-4d32-9771-a2a98e2ac6b3 tempest-TestServerVolumeAttachmentScenario-757686503 None] Volume driver (QuobyteDriver 1.2) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 16 15:12:31 devstack cinder-volume[83259]: DEBUG cinder.coordination [None req-547b6f65-ef41-4d32-9771-a2a98e2ac6b3 tempest-TestServerVolumeAttachmentScenario-757686503 None] Acquiring lock "cinder-quobyte-89469ddc-4f11-4f5f-9b33-4ff39e729f69" by "delete_volume" {{(pid=83259) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 16 15:12:31 devstack cinder-volume[83259]: DEBUG cinder.coordination [None req-547b6f65-ef41-4d32-9771-a2a98e2ac6b3 tempest-TestServerVolumeAttachmentScenario-757686503 None] Lock "cinder-quobyte-89469ddc-4f11-4f5f-9b33-4ff39e729f69" acquired by "delete_volume" :: waited 0.049s {{(pid=83259) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 16 15:12:31 devstack cinder-volume[83259]: DEBUG oslo.privsep.daemon [-] privsep: reply[0219c29f-9346-4550-8913-ed8b77cb0ebc]: (4, 'qcow2') {{(pid=84312) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 16 15:12:31 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [None req-547b6f65-ef41-4d32-9771-a2a98e2ac6b3 tempest-TestServerVolumeAttachmentScenario-757686503 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c/volume-89469ddc-4f11-4f5f-9b33-4ff39e729f69 {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 15:12:32 devstack quobyte-client[83286]: System call of process 96304 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 16 15:12:32 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [None req-547b6f65-ef41-4d32-9771-a2a98e2ac6b3 tempest-TestServerVolumeAttachmentScenario-757686503 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c/volume-89469ddc-4f11-4f5f-9b33-4ff39e729f69" returned: 0 in 0.668s {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 15:12:32 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [None req-547b6f65-ef41-4d32-9771-a2a98e2ac6b3 tempest-TestServerVolumeAttachmentScenario-757686503 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c/volume-89469ddc-4f11-4f5f-9b33-4ff39e729f69 {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 15:12:32 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [None req-547b6f65-ef41-4d32-9771-a2a98e2ac6b3 tempest-TestServerVolumeAttachmentScenario-757686503 None] CMD "rm -f /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c/volume-89469ddc-4f11-4f5f-9b33-4ff39e729f69" returned: 0 in 0.205s {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 15:12:32 devstack cinder-volume[83259]: DEBUG cinder.coordination [None req-547b6f65-ef41-4d32-9771-a2a98e2ac6b3 tempest-TestServerVolumeAttachmentScenario-757686503 None] Lock "cinder-quobyte-89469ddc-4f11-4f5f-9b33-4ff39e729f69" released by "delete_volume" :: held 1.150s {{(pid=83259) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 16 15:12:33 devstack cinder-volume[83259]: DEBUG cinder.quota [None req-547b6f65-ef41-4d32-9771-a2a98e2ac6b3 tempest-TestServerVolumeAttachmentScenario-757686503 None] Created reservations ['21952d78-1421-469f-a55f-eb228d711559', '698a3181-da56-43e8-9270-3d25b4e9371b', 'fd072c74-d9a4-42a2-8964-b48d1a38be12', '31fbdd39-e185-4b37-9fc1-d75c75e4ed59'] {{(pid=83259) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 16 15:12:33 devstack cinder-volume[83259]: DEBUG oslo_concurrency.lockutils [None req-547b6f65-ef41-4d32-9771-a2a98e2ac6b3 tempest-TestServerVolumeAttachmentScenario-757686503 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83259) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 16 15:12:33 devstack cinder-volume[83259]: DEBUG oslo_concurrency.lockutils [None req-547b6f65-ef41-4d32-9771-a2a98e2ac6b3 tempest-TestServerVolumeAttachmentScenario-757686503 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.008s {{(pid=83259) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 16 15:12:33 devstack cinder-volume[83259]: DEBUG cinder.volume.drivers.quobyte [None req-547b6f65-ef41-4d32-9771-a2a98e2ac6b3 tempest-TestServerVolumeAttachmentScenario-757686503 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-61f585ac-f8e2-4d19-a890-7ebc2726cc72': None} {{(pid=83259) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:639}} Sep 16 15:12:33 devstack cinder-volume[83259]: DEBUG cinder.volume.drivers.quobyte [None req-547b6f65-ef41-4d32-9771-a2a98e2ac6b3 tempest-TestServerVolumeAttachmentScenario-757686503 None] Available shares ['10.10.41.181/cinder-vol-61f585ac-f8e2-4d19-a890-7ebc2726cc72'] {{(pid=83259) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:669}} Sep 16 15:12:33 devstack cinder-volume[83259]: DEBUG oslo_concurrency.lockutils [None req-547b6f65-ef41-4d32-9771-a2a98e2ac6b3 tempest-TestServerVolumeAttachmentScenario-757686503 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=83259) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 16 15:12:33 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [None req-547b6f65-ef41-4d32-9771-a2a98e2ac6b3 tempest-TestServerVolumeAttachmentScenario-757686503 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 15:12:34 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [None req-547b6f65-ef41-4d32-9771-a2a98e2ac6b3 tempest-TestServerVolumeAttachmentScenario-757686503 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c" returned: 0 in 0.497s {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 15:12:34 devstack cinder-volume[83259]: DEBUG cinder.manager [None req-547b6f65-ef41-4d32-9771-a2a98e2ac6b3 tempest-TestServerVolumeAttachmentScenario-757686503 None] Notifying Schedulers of capabilities ... {{(pid=83259) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 16 15:12:34 devstack cinder-volume[83259]: INFO cinder.volume.manager [None req-547b6f65-ef41-4d32-9771-a2a98e2ac6b3 tempest-TestServerVolumeAttachmentScenario-757686503 None] Deleted volume successfully. Sep 16 15:12:34 devstack cinder-volume[83259]: DEBUG cinder.coordination [None req-8116e2a5-6b46-4c88-9f02-87fa4360d0ec tempest-TestServerVolumeAttachmentScenario-757686503 None] Acquiring lock "cinder-dde63480-6417-458e-9a53-9c562b2718bc-delete_volume" by "delete_volume" {{(pid=83259) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 16 15:12:35 devstack cinder-volume[83259]: DEBUG cinder.coordination [None req-547b6f65-ef41-4d32-9771-a2a98e2ac6b3 tempest-TestServerVolumeAttachmentScenario-757686503 None] Lock "cinder-89469ddc-4f11-4f5f-9b33-4ff39e729f69-delete_volume" released by "delete_volume" :: held 3.810s {{(pid=83259) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 16 15:12:35 devstack cinder-volume[83259]: DEBUG cinder.coordination [None req-8116e2a5-6b46-4c88-9f02-87fa4360d0ec tempest-TestServerVolumeAttachmentScenario-757686503 None] Lock "cinder-dde63480-6417-458e-9a53-9c562b2718bc-delete_volume" acquired by "delete_volume" :: waited 0.183s {{(pid=83259) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 16 15:12:35 devstack cinder-volume[83259]: WARNING cinder.volume.volume_utils [None req-8116e2a5-6b46-4c88-9f02-87fa4360d0ec tempest-TestServerVolumeAttachmentScenario-757686503 None] Volume driver (QuobyteDriver 1.2) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 16 15:12:35 devstack cinder-volume[83259]: DEBUG cinder.coordination [None req-8116e2a5-6b46-4c88-9f02-87fa4360d0ec tempest-TestServerVolumeAttachmentScenario-757686503 None] Acquiring lock "cinder-quobyte-dde63480-6417-458e-9a53-9c562b2718bc" by "delete_volume" {{(pid=83259) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 16 15:12:35 devstack cinder-volume[83259]: DEBUG cinder.coordination [None req-8116e2a5-6b46-4c88-9f02-87fa4360d0ec tempest-TestServerVolumeAttachmentScenario-757686503 None] Lock "cinder-quobyte-dde63480-6417-458e-9a53-9c562b2718bc" acquired by "delete_volume" :: waited 0.053s {{(pid=83259) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 16 15:12:35 devstack cinder-volume[83259]: DEBUG oslo.privsep.daemon [-] privsep: reply[7b800053-d04d-4d13-b790-84da78d2d50c]: (4, 'qcow2') {{(pid=84312) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 16 15:12:35 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [None req-8116e2a5-6b46-4c88-9f02-87fa4360d0ec tempest-TestServerVolumeAttachmentScenario-757686503 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c/volume-dde63480-6417-458e-9a53-9c562b2718bc {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 15:12:36 devstack cinder-volume[83259]: DEBUG cinder.coordination [None req-5f0069cf-3868-4c43-ba5b-c0f53be20eaf tempest-VolumesNegativeTest-1640808438 None] Acquiring lock "cinder-c9ca23b9-c1ff-41de-8dae-6889e09f4934-delete_volume" by "delete_volume" {{(pid=83259) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 16 15:12:36 devstack cinder-volume[83259]: DEBUG cinder.coordination [None req-5f0069cf-3868-4c43-ba5b-c0f53be20eaf tempest-VolumesNegativeTest-1640808438 None] Lock "cinder-c9ca23b9-c1ff-41de-8dae-6889e09f4934-delete_volume" acquired by "delete_volume" :: waited 0.130s {{(pid=83259) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 16 15:12:36 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [None req-8116e2a5-6b46-4c88-9f02-87fa4360d0ec tempest-TestServerVolumeAttachmentScenario-757686503 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c/volume-dde63480-6417-458e-9a53-9c562b2718bc" returned: 0 in 1.142s {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 15:12:36 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [None req-8116e2a5-6b46-4c88-9f02-87fa4360d0ec tempest-TestServerVolumeAttachmentScenario-757686503 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c/volume-dde63480-6417-458e-9a53-9c562b2718bc {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 15:12:37 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [None req-8116e2a5-6b46-4c88-9f02-87fa4360d0ec tempest-TestServerVolumeAttachmentScenario-757686503 None] CMD "rm -f /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c/volume-dde63480-6417-458e-9a53-9c562b2718bc" returned: 0 in 0.424s {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 15:12:37 devstack cinder-volume[83259]: DEBUG cinder.coordination [None req-8116e2a5-6b46-4c88-9f02-87fa4360d0ec tempest-TestServerVolumeAttachmentScenario-757686503 None] Lock "cinder-quobyte-dde63480-6417-458e-9a53-9c562b2718bc" released by "delete_volume" :: held 1.861s {{(pid=83259) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 16 15:12:37 devstack cinder-volume[83259]: WARNING cinder.volume.volume_utils [None req-5f0069cf-3868-4c43-ba5b-c0f53be20eaf tempest-VolumesNegativeTest-1640808438 None] Volume driver (QuobyteDriver 1.2) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 16 15:12:37 devstack cinder-volume[83259]: DEBUG cinder.coordination [None req-5f0069cf-3868-4c43-ba5b-c0f53be20eaf tempest-VolumesNegativeTest-1640808438 None] Acquiring lock "cinder-quobyte-c9ca23b9-c1ff-41de-8dae-6889e09f4934" by "delete_volume" {{(pid=83259) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 16 15:12:37 devstack cinder-volume[83259]: DEBUG cinder.coordination [None req-5f0069cf-3868-4c43-ba5b-c0f53be20eaf tempest-VolumesNegativeTest-1640808438 None] Lock "cinder-quobyte-c9ca23b9-c1ff-41de-8dae-6889e09f4934" acquired by "delete_volume" :: waited 0.198s {{(pid=83259) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 16 15:12:37 devstack cinder-volume[83259]: DEBUG oslo.privsep.daemon [-] privsep: reply[a9dc391e-af93-427f-9b7a-df685e67cc7d]: (4, 'qcow2') {{(pid=84312) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 16 15:12:37 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [None req-5f0069cf-3868-4c43-ba5b-c0f53be20eaf tempest-VolumesNegativeTest-1640808438 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c/volume-c9ca23b9-c1ff-41de-8dae-6889e09f4934 {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 15:12:38 devstack cinder-volume[83259]: DEBUG cinder.quota [None req-8116e2a5-6b46-4c88-9f02-87fa4360d0ec tempest-TestServerVolumeAttachmentScenario-757686503 None] Created reservations ['cc912d33-48fd-4c10-8b24-3302a813bd1c', 'b98641a2-8886-4a0d-8df8-9d1d5ab9e3df', '295ea1eb-24cc-4aaf-826c-99ef78b73451', 'fca2e589-2ad0-4984-9b9b-8937d434cee6'] {{(pid=83259) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 16 15:12:38 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [None req-5f0069cf-3868-4c43-ba5b-c0f53be20eaf tempest-VolumesNegativeTest-1640808438 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c/volume-c9ca23b9-c1ff-41de-8dae-6889e09f4934" returned: 0 in 0.734s {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 15:12:38 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [None req-5f0069cf-3868-4c43-ba5b-c0f53be20eaf tempest-VolumesNegativeTest-1640808438 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c/volume-c9ca23b9-c1ff-41de-8dae-6889e09f4934 {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 15:12:38 devstack cinder-volume[83259]: DEBUG oslo_concurrency.lockutils [None req-8116e2a5-6b46-4c88-9f02-87fa4360d0ec tempest-TestServerVolumeAttachmentScenario-757686503 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83259) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 16 15:12:38 devstack cinder-volume[83259]: DEBUG oslo_concurrency.lockutils [None req-8116e2a5-6b46-4c88-9f02-87fa4360d0ec tempest-TestServerVolumeAttachmentScenario-757686503 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.021s {{(pid=83259) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 16 15:12:38 devstack cinder-volume[83259]: DEBUG cinder.volume.drivers.quobyte [None req-8116e2a5-6b46-4c88-9f02-87fa4360d0ec tempest-TestServerVolumeAttachmentScenario-757686503 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-61f585ac-f8e2-4d19-a890-7ebc2726cc72': None} {{(pid=83259) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:639}} Sep 16 15:12:38 devstack cinder-volume[83259]: DEBUG cinder.volume.drivers.quobyte [None req-8116e2a5-6b46-4c88-9f02-87fa4360d0ec tempest-TestServerVolumeAttachmentScenario-757686503 None] Available shares ['10.10.41.181/cinder-vol-61f585ac-f8e2-4d19-a890-7ebc2726cc72'] {{(pid=83259) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:669}} Sep 16 15:12:38 devstack cinder-volume[83259]: DEBUG oslo_concurrency.lockutils [None req-8116e2a5-6b46-4c88-9f02-87fa4360d0ec tempest-TestServerVolumeAttachmentScenario-757686503 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=83259) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 16 15:12:38 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [None req-8116e2a5-6b46-4c88-9f02-87fa4360d0ec tempest-TestServerVolumeAttachmentScenario-757686503 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 15:12:38 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [None req-5f0069cf-3868-4c43-ba5b-c0f53be20eaf tempest-VolumesNegativeTest-1640808438 None] CMD "rm -f /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c/volume-c9ca23b9-c1ff-41de-8dae-6889e09f4934" returned: 0 in 0.341s {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 15:12:39 devstack cinder-volume[83259]: DEBUG cinder.coordination [None req-5f0069cf-3868-4c43-ba5b-c0f53be20eaf tempest-VolumesNegativeTest-1640808438 None] Lock "cinder-quobyte-c9ca23b9-c1ff-41de-8dae-6889e09f4934" released by "delete_volume" :: held 1.294s {{(pid=83259) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 16 15:12:39 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [None req-8116e2a5-6b46-4c88-9f02-87fa4360d0ec tempest-TestServerVolumeAttachmentScenario-757686503 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c" returned: 0 in 0.397s {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 15:12:39 devstack cinder-volume[83259]: DEBUG cinder.manager [None req-8116e2a5-6b46-4c88-9f02-87fa4360d0ec tempest-TestServerVolumeAttachmentScenario-757686503 None] Notifying Schedulers of capabilities ... {{(pid=83259) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 16 15:12:39 devstack cinder-volume[83259]: INFO cinder.volume.manager [None req-8116e2a5-6b46-4c88-9f02-87fa4360d0ec tempest-TestServerVolumeAttachmentScenario-757686503 None] Deleted volume successfully. Sep 16 15:12:39 devstack cinder-volume[83259]: DEBUG cinder.coordination [None req-8116e2a5-6b46-4c88-9f02-87fa4360d0ec tempest-TestServerVolumeAttachmentScenario-757686503 None] Lock "cinder-dde63480-6417-458e-9a53-9c562b2718bc-delete_volume" released by "delete_volume" :: held 4.460s {{(pid=83259) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 16 15:12:40 devstack cinder-volume[83259]: DEBUG cinder.quota [None req-5f0069cf-3868-4c43-ba5b-c0f53be20eaf tempest-VolumesNegativeTest-1640808438 None] Created reservations ['c82ff485-0b87-42d8-bb0a-5e6ebd7c7045', '2a4b7a4e-3cd6-4b5d-9738-8bcf7680772d', '79ee5105-8c76-432c-a3d7-e55f142e2f99', '5bf5258a-d465-454e-8c68-25dc7f93fc16'] {{(pid=83259) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 16 15:12:40 devstack cinder-volume[83259]: DEBUG oslo_concurrency.lockutils [None req-5f0069cf-3868-4c43-ba5b-c0f53be20eaf tempest-VolumesNegativeTest-1640808438 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83259) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 16 15:12:40 devstack cinder-volume[83259]: DEBUG oslo_concurrency.lockutils [None req-5f0069cf-3868-4c43-ba5b-c0f53be20eaf tempest-VolumesNegativeTest-1640808438 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=83259) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 16 15:12:40 devstack cinder-volume[83259]: DEBUG cinder.volume.drivers.quobyte [None req-5f0069cf-3868-4c43-ba5b-c0f53be20eaf tempest-VolumesNegativeTest-1640808438 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-61f585ac-f8e2-4d19-a890-7ebc2726cc72': None} {{(pid=83259) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:639}} Sep 16 15:12:40 devstack cinder-volume[83259]: DEBUG cinder.volume.drivers.quobyte [None req-5f0069cf-3868-4c43-ba5b-c0f53be20eaf tempest-VolumesNegativeTest-1640808438 None] Available shares ['10.10.41.181/cinder-vol-61f585ac-f8e2-4d19-a890-7ebc2726cc72'] {{(pid=83259) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:669}} Sep 16 15:12:40 devstack cinder-volume[83259]: DEBUG oslo_concurrency.lockutils [None req-5f0069cf-3868-4c43-ba5b-c0f53be20eaf tempest-VolumesNegativeTest-1640808438 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=83259) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 16 15:12:40 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [None req-5f0069cf-3868-4c43-ba5b-c0f53be20eaf tempest-VolumesNegativeTest-1640808438 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 15:12:41 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [None req-5f0069cf-3868-4c43-ba5b-c0f53be20eaf tempest-VolumesNegativeTest-1640808438 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c" returned: 0 in 0.322s {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 15:12:41 devstack cinder-volume[83259]: DEBUG cinder.manager [None req-5f0069cf-3868-4c43-ba5b-c0f53be20eaf tempest-VolumesNegativeTest-1640808438 None] Notifying Schedulers of capabilities ... {{(pid=83259) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 16 15:12:41 devstack cinder-volume[83259]: INFO cinder.volume.manager [None req-5f0069cf-3868-4c43-ba5b-c0f53be20eaf tempest-VolumesNegativeTest-1640808438 None] Deleted volume successfully. Sep 16 15:12:41 devstack cinder-volume[83259]: DEBUG cinder.coordination [None req-5f0069cf-3868-4c43-ba5b-c0f53be20eaf tempest-VolumesNegativeTest-1640808438 None] Lock "cinder-c9ca23b9-c1ff-41de-8dae-6889e09f4934-delete_volume" released by "delete_volume" :: held 4.783s {{(pid=83259) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 16 15:12:45 devstack cinder-volume[83259]: DEBUG oslo_service.periodic_task [None req-050ec8a1-6ffd-499d-95ad-d548a84437e2 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=83259) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} Sep 16 15:12:45 devstack cinder-volume[83259]: DEBUG oslo_concurrency.lockutils [None req-050ec8a1-6ffd-499d-95ad-d548a84437e2 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83259) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 16 15:12:45 devstack cinder-volume[83259]: DEBUG oslo_concurrency.lockutils [None req-050ec8a1-6ffd-499d-95ad-d548a84437e2 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.009s {{(pid=83259) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 16 15:12:45 devstack cinder-volume[83259]: DEBUG cinder.volume.drivers.quobyte [None req-050ec8a1-6ffd-499d-95ad-d548a84437e2 None None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-61f585ac-f8e2-4d19-a890-7ebc2726cc72': None} {{(pid=83259) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:639}} Sep 16 15:12:45 devstack cinder-volume[83259]: DEBUG cinder.volume.drivers.quobyte [None req-050ec8a1-6ffd-499d-95ad-d548a84437e2 None None] Available shares ['10.10.41.181/cinder-vol-61f585ac-f8e2-4d19-a890-7ebc2726cc72'] {{(pid=83259) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:669}} Sep 16 15:12:45 devstack cinder-volume[83259]: DEBUG oslo_concurrency.lockutils [None req-050ec8a1-6ffd-499d-95ad-d548a84437e2 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=83259) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 16 15:12:45 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [None req-050ec8a1-6ffd-499d-95ad-d548a84437e2 None None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 15:12:46 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [None req-050ec8a1-6ffd-499d-95ad-d548a84437e2 None None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c" returned: 0 in 0.218s {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 15:12:46 devstack cinder-volume[83259]: DEBUG cinder.manager [None req-050ec8a1-6ffd-499d-95ad-d548a84437e2 None None] Notifying Schedulers of capabilities ... {{(pid=83259) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 16 15:12:47 devstack cinder-volume[83259]: WARNING cinder.volume.volume_utils [None req-77661b87-723a-4dd8-b72a-dc7ac9b2024f tempest-VolumesSnapshotListTestJSON-248203627 None] Volume driver (QuobyteDriver 1.2) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 16 15:12:47 devstack cinder-volume[83259]: DEBUG cinder.volume.flows.manager.create_volume [None req-77661b87-723a-4dd8-b72a-dc7ac9b2024f tempest-VolumesSnapshotListTestJSON-248203627 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#Quobyte'], 'hosts': ['devstack@QuobyteHD#Quobyte']} {{(pid=83259) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1387}} Sep 16 15:12:47 devstack cinder-volume[83259]: DEBUG cinder.volume.manager [None req-77661b87-723a-4dd8-b72a-dc7ac9b2024f tempest-VolumesSnapshotListTestJSON-248203627 None] Flow 'volume_create_manager' (c5461ef0-8191-44b7-87d3-4cb99fe7d43e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83259) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 16 15:12:47 devstack cinder-volume[83259]: DEBUG cinder.volume.manager [None req-77661b87-723a-4dd8-b72a-dc7ac9b2024f tempest-VolumesSnapshotListTestJSON-248203627 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e8361545-2b63-4040-be02-a74e11064a43) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83259) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 15:12:47 devstack cinder-volume[83259]: DEBUG cinder.volume.manager [None req-77661b87-723a-4dd8-b72a-dc7ac9b2024f tempest-VolumesSnapshotListTestJSON-248203627 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e8361545-2b63-4040-be02-a74e11064a43) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-16T13:12:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotListTestJSON-Volume-303931304',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#Quobyte',id=68324198-e4bf-4e89-934a-b125055ec9ed,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dfd5df44b18c488888fac7271c0e8e39',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-16T13:12:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-16T13:12:47Z,use_quota=True,user_id='0ca305637f4c4b608692d8343e4dcd1d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(485ead50-3df8-4d76-8d34-a4db136c980a),volume_type_id=485ead50-3df8-4d76-8d34-a4db136c980a)' {{(pid=83259) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 15:12:47 devstack cinder-volume[83259]: DEBUG cinder.volume.manager [None req-77661b87-723a-4dd8-b72a-dc7ac9b2024f tempest-VolumesSnapshotListTestJSON-248203627 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ebab86a3-b373-4d16-bcea-333e58087f6c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83259) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 15:12:47 devstack cinder-volume[83259]: DEBUG cinder.volume.manager [None req-77661b87-723a-4dd8-b72a-dc7ac9b2024f tempest-VolumesSnapshotListTestJSON-248203627 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ebab86a3-b373-4d16-bcea-333e58087f6c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83259) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 15:12:47 devstack cinder-volume[83259]: DEBUG cinder.volume.manager [None req-77661b87-723a-4dd8-b72a-dc7ac9b2024f tempest-VolumesSnapshotListTestJSON-248203627 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4d80b1a8-6522-4927-9acb-cf2dcdfe6883) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83259) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 15:12:47 devstack cinder-volume[83259]: DEBUG cinder.volume.manager [None req-77661b87-723a-4dd8-b72a-dc7ac9b2024f tempest-VolumesSnapshotListTestJSON-248203627 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4d80b1a8-6522-4927-9acb-cf2dcdfe6883) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '68324198-e4bf-4e89-934a-b125055ec9ed', 'volume_name': 'volume-68324198-e4bf-4e89-934a-b125055ec9ed', 'volume_size': 1}' {{(pid=83259) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 15:12:47 devstack cinder-volume[83259]: DEBUG cinder.volume.manager [None req-77661b87-723a-4dd8-b72a-dc7ac9b2024f tempest-VolumesSnapshotListTestJSON-248203627 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6146e8d6-bdc9-4479-80d6-4f766eaf0ecd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83259) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 15:12:47 devstack cinder-volume[83259]: DEBUG cinder.volume.manager [None req-77661b87-723a-4dd8-b72a-dc7ac9b2024f tempest-VolumesSnapshotListTestJSON-248203627 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6146e8d6-bdc9-4479-80d6-4f766eaf0ecd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83259) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 15:12:47 devstack cinder-volume[83259]: DEBUG cinder.volume.manager [None req-77661b87-723a-4dd8-b72a-dc7ac9b2024f tempest-VolumesSnapshotListTestJSON-248203627 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e11ea1f7-b8e2-40e0-aad9-44767610aa5a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83259) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 15:12:47 devstack cinder-volume[83259]: INFO cinder.volume.flows.manager.create_volume [None req-77661b87-723a-4dd8-b72a-dc7ac9b2024f tempest-VolumesSnapshotListTestJSON-248203627 None] Volume 68324198-e4bf-4e89-934a-b125055ec9ed: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-68324198-e4bf-4e89-934a-b125055ec9ed', 'volume_size': 1} Sep 16 15:12:47 devstack cinder-volume[83259]: DEBUG oslo_concurrency.lockutils [None req-77661b87-723a-4dd8-b72a-dc7ac9b2024f tempest-VolumesSnapshotListTestJSON-248203627 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83259) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 16 15:12:57 devstack cinder-volume[83259]: DEBUG dbcounter [-] [83259] Writing DB stats cinder:SELECT=17,cinder:INSERT=4,cinder:UPDATE=26,cinder:DELETE=2 {{(pid=83259) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Sep 16 15:12:57 devstack cinder-volume[83259]: DEBUG dbcounter [-] [83259] Writing DB stats cinder:SELECT=15,cinder:UPDATE=23,cinder:INSERT=8,cinder:DELETE=1 {{(pid=83259) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Sep 16 15:13:03 devstack cinder-volume[83259]: WARNING cinder.volume.volume_utils [None req-0ce3fe9c-8e96-48f1-85a2-1fb4eb5f42d2 tempest-CreateVolumesFromImageTest-1245864730 None] Volume driver (QuobyteDriver 1.2) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 16 15:13:03 devstack cinder-volume[83259]: DEBUG cinder.volume.flows.manager.create_volume [None req-0ce3fe9c-8e96-48f1-85a2-1fb4eb5f42d2 tempest-CreateVolumesFromImageTest-1245864730 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#Quobyte'], 'hosts': ['devstack@QuobyteHD#Quobyte']} {{(pid=83259) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1387}} Sep 16 15:13:03 devstack cinder-volume[83259]: DEBUG cinder.volume.manager [None req-0ce3fe9c-8e96-48f1-85a2-1fb4eb5f42d2 tempest-CreateVolumesFromImageTest-1245864730 None] Flow 'volume_create_manager' (6db01f6d-5509-43d8-a929-f31dac09a828) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83259) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 16 15:13:03 devstack cinder-volume[83259]: DEBUG cinder.volume.manager [None req-0ce3fe9c-8e96-48f1-85a2-1fb4eb5f42d2 tempest-CreateVolumesFromImageTest-1245864730 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6b0b7ed9-96c0-4d3a-b698-6ace317d3871) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83259) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 15:13:03 devstack cinder-volume[83259]: DEBUG cinder.volume.manager [None req-0ce3fe9c-8e96-48f1-85a2-1fb4eb5f42d2 tempest-CreateVolumesFromImageTest-1245864730 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6b0b7ed9-96c0-4d3a-b698-6ace317d3871) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-16T13:13:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-922844823',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#Quobyte',id=9c82ccf0-7efe-42a9-a8c8-549b64230bda,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='57100306065e40139c791ae050253ee5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-16T13:13:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-16T13:13:03Z,use_quota=True,user_id='49ec8541dd7241408704bc80d3eced0e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(485ead50-3df8-4d76-8d34-a4db136c980a),volume_type_id=485ead50-3df8-4d76-8d34-a4db136c980a)' {{(pid=83259) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 15:13:03 devstack cinder-volume[83259]: DEBUG cinder.volume.manager [None req-0ce3fe9c-8e96-48f1-85a2-1fb4eb5f42d2 tempest-CreateVolumesFromImageTest-1245864730 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ae24727d-6ec9-4c3c-933a-cbb92cbd4c2e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83259) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 15:13:03 devstack cinder-volume[83259]: DEBUG cinder.volume.manager [None req-0ce3fe9c-8e96-48f1-85a2-1fb4eb5f42d2 tempest-CreateVolumesFromImageTest-1245864730 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ae24727d-6ec9-4c3c-933a-cbb92cbd4c2e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83259) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 15:13:03 devstack cinder-volume[83259]: DEBUG cinder.volume.manager [None req-0ce3fe9c-8e96-48f1-85a2-1fb4eb5f42d2 tempest-CreateVolumesFromImageTest-1245864730 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ed588d49-b20f-4332-aee0-e14c77f45746) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83259) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 15:13:03 devstack cinder-volume[83259]: DEBUG cinder.volume.manager [None req-0ce3fe9c-8e96-48f1-85a2-1fb4eb5f42d2 tempest-CreateVolumesFromImageTest-1245864730 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ed588d49-b20f-4332-aee0-e14c77f45746) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9c82ccf0-7efe-42a9-a8c8-549b64230bda', 'volume_name': 'volume-9c82ccf0-7efe-42a9-a8c8-549b64230bda', 'volume_size': 1}' {{(pid=83259) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 15:13:03 devstack cinder-volume[83259]: DEBUG cinder.volume.manager [None req-0ce3fe9c-8e96-48f1-85a2-1fb4eb5f42d2 tempest-CreateVolumesFromImageTest-1245864730 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e3de489b-8e65-4547-95b8-36dc155db2df) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83259) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 15:13:03 devstack cinder-volume[83259]: DEBUG cinder.volume.manager [None req-0ce3fe9c-8e96-48f1-85a2-1fb4eb5f42d2 tempest-CreateVolumesFromImageTest-1245864730 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e3de489b-8e65-4547-95b8-36dc155db2df) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83259) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 15:13:03 devstack cinder-volume[83259]: DEBUG cinder.volume.manager [None req-0ce3fe9c-8e96-48f1-85a2-1fb4eb5f42d2 tempest-CreateVolumesFromImageTest-1245864730 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0399cfa9-d346-478a-b5a9-1988e4ed5eac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83259) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 15:13:03 devstack cinder-volume[83259]: INFO cinder.volume.flows.manager.create_volume [None req-0ce3fe9c-8e96-48f1-85a2-1fb4eb5f42d2 tempest-CreateVolumesFromImageTest-1245864730 None] Volume 9c82ccf0-7efe-42a9-a8c8-549b64230bda: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9c82ccf0-7efe-42a9-a8c8-549b64230bda', 'volume_size': 1} Sep 16 15:13:03 devstack cinder-volume[83259]: DEBUG oslo_concurrency.lockutils [None req-0ce3fe9c-8e96-48f1-85a2-1fb4eb5f42d2 tempest-CreateVolumesFromImageTest-1245864730 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83259) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 16 15:13:03 devstack cinder-volume[83259]: WARNING cinder.volume.volume_utils [None req-e12670df-1ed9-4951-9413-ff123415f748 tempest-CreateVolumesFromImageTest-1245864730 None] Volume driver (QuobyteDriver 1.2) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 16 15:13:03 devstack cinder-volume[83259]: DEBUG cinder.volume.flows.manager.create_volume [None req-e12670df-1ed9-4951-9413-ff123415f748 tempest-CreateVolumesFromImageTest-1245864730 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#Quobyte'], 'hosts': ['devstack@QuobyteHD#Quobyte']} {{(pid=83259) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1387}} Sep 16 15:13:03 devstack cinder-volume[83259]: DEBUG cinder.volume.manager [None req-e12670df-1ed9-4951-9413-ff123415f748 tempest-CreateVolumesFromImageTest-1245864730 None] Flow 'volume_create_manager' (1df60c6e-cdbf-4f6b-bd37-cd3a55227dc0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83259) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 16 15:13:03 devstack cinder-volume[83259]: DEBUG cinder.volume.manager [None req-e12670df-1ed9-4951-9413-ff123415f748 tempest-CreateVolumesFromImageTest-1245864730 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c18d9fa2-68c5-47ac-b3f2-d5cb08d51a82) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83259) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 15:13:03 devstack cinder-volume[83259]: DEBUG cinder.volume.manager [None req-e12670df-1ed9-4951-9413-ff123415f748 tempest-CreateVolumesFromImageTest-1245864730 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c18d9fa2-68c5-47ac-b3f2-d5cb08d51a82) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-16T13:13:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-292571825',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#Quobyte',id=9d18bf7e-2e8a-413d-b930-926000cd0930,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='57100306065e40139c791ae050253ee5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-16T13:13:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-16T13:13:03Z,use_quota=True,user_id='49ec8541dd7241408704bc80d3eced0e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(485ead50-3df8-4d76-8d34-a4db136c980a),volume_type_id=485ead50-3df8-4d76-8d34-a4db136c980a)' {{(pid=83259) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 15:13:03 devstack cinder-volume[83259]: DEBUG cinder.volume.manager [None req-e12670df-1ed9-4951-9413-ff123415f748 tempest-CreateVolumesFromImageTest-1245864730 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (31f4376b-49fe-419a-af92-48b8a693448d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83259) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 15:13:03 devstack cinder-volume[83259]: DEBUG cinder.volume.manager [None req-e12670df-1ed9-4951-9413-ff123415f748 tempest-CreateVolumesFromImageTest-1245864730 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (31f4376b-49fe-419a-af92-48b8a693448d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83259) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 15:13:03 devstack cinder-volume[83259]: DEBUG cinder.volume.manager [None req-e12670df-1ed9-4951-9413-ff123415f748 tempest-CreateVolumesFromImageTest-1245864730 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ee247234-7e8e-45b1-85f6-2137ec840631) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83259) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 15:13:03 devstack cinder-volume[83259]: DEBUG cinder.volume.manager [None req-e12670df-1ed9-4951-9413-ff123415f748 tempest-CreateVolumesFromImageTest-1245864730 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ee247234-7e8e-45b1-85f6-2137ec840631) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9d18bf7e-2e8a-413d-b930-926000cd0930', 'volume_name': 'volume-9d18bf7e-2e8a-413d-b930-926000cd0930', 'volume_size': 1}' {{(pid=83259) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 15:13:03 devstack cinder-volume[83259]: DEBUG cinder.volume.manager [None req-e12670df-1ed9-4951-9413-ff123415f748 tempest-CreateVolumesFromImageTest-1245864730 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (98027a6d-2b04-48a1-943c-d900e0bd0b02) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83259) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 15:13:03 devstack cinder-volume[83259]: DEBUG cinder.volume.manager [None req-e12670df-1ed9-4951-9413-ff123415f748 tempest-CreateVolumesFromImageTest-1245864730 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (98027a6d-2b04-48a1-943c-d900e0bd0b02) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83259) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 15:13:03 devstack cinder-volume[83259]: DEBUG cinder.volume.manager [None req-e12670df-1ed9-4951-9413-ff123415f748 tempest-CreateVolumesFromImageTest-1245864730 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ba0b318e-81a6-4990-b87c-bb9008ce4a9a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83259) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 15:13:03 devstack cinder-volume[83259]: INFO cinder.volume.flows.manager.create_volume [None req-e12670df-1ed9-4951-9413-ff123415f748 tempest-CreateVolumesFromImageTest-1245864730 None] Volume 9d18bf7e-2e8a-413d-b930-926000cd0930: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9d18bf7e-2e8a-413d-b930-926000cd0930', 'volume_size': 1} Sep 16 15:13:03 devstack cinder-volume[83259]: DEBUG oslo_concurrency.lockutils [None req-e12670df-1ed9-4951-9413-ff123415f748 tempest-CreateVolumesFromImageTest-1245864730 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83259) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 16 15:13:04 devstack cinder-volume[83259]: WARNING cinder.volume.volume_utils [None req-0b38a1a2-e65d-42bb-a6dd-531e35f60d7e tempest-CreateVolumesFromImageTest-1245864730 None] Volume driver (QuobyteDriver 1.2) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 16 15:13:04 devstack cinder-volume[83259]: DEBUG cinder.volume.flows.manager.create_volume [None req-0b38a1a2-e65d-42bb-a6dd-531e35f60d7e tempest-CreateVolumesFromImageTest-1245864730 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#Quobyte'], 'hosts': ['devstack@QuobyteHD#Quobyte']} {{(pid=83259) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1387}} Sep 16 15:13:04 devstack cinder-volume[83259]: DEBUG cinder.volume.manager [None req-0b38a1a2-e65d-42bb-a6dd-531e35f60d7e tempest-CreateVolumesFromImageTest-1245864730 None] Flow 'volume_create_manager' (641a3ffa-7a05-4629-8ba6-8b936a0edbe7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83259) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 16 15:13:04 devstack cinder-volume[83259]: DEBUG cinder.volume.manager [None req-0b38a1a2-e65d-42bb-a6dd-531e35f60d7e tempest-CreateVolumesFromImageTest-1245864730 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9796ffda-d497-4d21-b39f-f1e69d93b49e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83259) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 15:13:04 devstack cinder-volume[83259]: DEBUG cinder.volume.manager [None req-0b38a1a2-e65d-42bb-a6dd-531e35f60d7e tempest-CreateVolumesFromImageTest-1245864730 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9796ffda-d497-4d21-b39f-f1e69d93b49e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-16T13:13:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-79662501',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#Quobyte',id=a1861ecb-7997-445c-932d-b787ca98585e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='57100306065e40139c791ae050253ee5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-16T13:13:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-16T13:13:04Z,use_quota=True,user_id='49ec8541dd7241408704bc80d3eced0e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(485ead50-3df8-4d76-8d34-a4db136c980a),volume_type_id=485ead50-3df8-4d76-8d34-a4db136c980a)' {{(pid=83259) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 15:13:04 devstack cinder-volume[83259]: DEBUG cinder.volume.manager [None req-0b38a1a2-e65d-42bb-a6dd-531e35f60d7e tempest-CreateVolumesFromImageTest-1245864730 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d359294a-1bd1-4e76-a2b2-321bc24dd48f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83259) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 15:13:04 devstack cinder-volume[83259]: DEBUG cinder.volume.manager [None req-0b38a1a2-e65d-42bb-a6dd-531e35f60d7e tempest-CreateVolumesFromImageTest-1245864730 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d359294a-1bd1-4e76-a2b2-321bc24dd48f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83259) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 15:13:04 devstack cinder-volume[83259]: DEBUG cinder.volume.manager [None req-0b38a1a2-e65d-42bb-a6dd-531e35f60d7e tempest-CreateVolumesFromImageTest-1245864730 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b2d38e15-961f-4244-8f03-ec4cc9ba3289) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83259) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 15:13:04 devstack cinder-volume[83259]: DEBUG cinder.volume.manager [None req-0b38a1a2-e65d-42bb-a6dd-531e35f60d7e tempest-CreateVolumesFromImageTest-1245864730 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b2d38e15-961f-4244-8f03-ec4cc9ba3289) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a1861ecb-7997-445c-932d-b787ca98585e', 'volume_name': 'volume-a1861ecb-7997-445c-932d-b787ca98585e', 'volume_size': 1}' {{(pid=83259) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 15:13:04 devstack cinder-volume[83259]: DEBUG cinder.volume.manager [None req-0b38a1a2-e65d-42bb-a6dd-531e35f60d7e tempest-CreateVolumesFromImageTest-1245864730 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (03278a43-41e2-4ff4-b2a5-0f64a825906a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83259) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 15:13:04 devstack cinder-volume[83259]: DEBUG cinder.volume.manager [None req-0b38a1a2-e65d-42bb-a6dd-531e35f60d7e tempest-CreateVolumesFromImageTest-1245864730 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (03278a43-41e2-4ff4-b2a5-0f64a825906a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83259) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 15:13:04 devstack cinder-volume[83259]: DEBUG cinder.volume.manager [None req-0b38a1a2-e65d-42bb-a6dd-531e35f60d7e tempest-CreateVolumesFromImageTest-1245864730 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5855c3bc-e0d8-442b-8df6-5509c17f7a17) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83259) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 15:13:04 devstack cinder-volume[83259]: INFO cinder.volume.flows.manager.create_volume [None req-0b38a1a2-e65d-42bb-a6dd-531e35f60d7e tempest-CreateVolumesFromImageTest-1245864730 None] Volume a1861ecb-7997-445c-932d-b787ca98585e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a1861ecb-7997-445c-932d-b787ca98585e', 'volume_size': 1} Sep 16 15:13:04 devstack cinder-volume[83259]: DEBUG oslo_concurrency.lockutils [None req-0b38a1a2-e65d-42bb-a6dd-531e35f60d7e tempest-CreateVolumesFromImageTest-1245864730 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83259) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 16 15:13:04 devstack cinder-volume[83259]: WARNING cinder.volume.volume_utils [None req-502f01cb-c748-4291-9b9e-fc7849b15de4 tempest-CreateVolumesFromImageTest-1245864730 None] Volume driver (QuobyteDriver 1.2) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 16 15:13:04 devstack cinder-volume[83259]: DEBUG cinder.volume.flows.manager.create_volume [None req-502f01cb-c748-4291-9b9e-fc7849b15de4 tempest-CreateVolumesFromImageTest-1245864730 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#Quobyte'], 'hosts': ['devstack@QuobyteHD#Quobyte']} {{(pid=83259) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1387}} Sep 16 15:13:04 devstack cinder-volume[83259]: DEBUG cinder.volume.manager [None req-502f01cb-c748-4291-9b9e-fc7849b15de4 tempest-CreateVolumesFromImageTest-1245864730 None] Flow 'volume_create_manager' (044f78b1-f11f-477a-8485-ad4f4bc0f98a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83259) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 16 15:13:04 devstack cinder-volume[83259]: DEBUG cinder.volume.manager [None req-502f01cb-c748-4291-9b9e-fc7849b15de4 tempest-CreateVolumesFromImageTest-1245864730 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d376cc1c-6c3e-4bf4-bdda-11b32e2fd939) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83259) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 15:13:04 devstack cinder-volume[83259]: DEBUG cinder.volume.manager [None req-502f01cb-c748-4291-9b9e-fc7849b15de4 tempest-CreateVolumesFromImageTest-1245864730 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d376cc1c-6c3e-4bf4-bdda-11b32e2fd939) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-16T13:13:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1883002886',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#Quobyte',id=371375cf-34a2-44da-940b-a1a3927ebcc0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='57100306065e40139c791ae050253ee5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-16T13:13:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-16T13:13:04Z,use_quota=True,user_id='49ec8541dd7241408704bc80d3eced0e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(485ead50-3df8-4d76-8d34-a4db136c980a),volume_type_id=485ead50-3df8-4d76-8d34-a4db136c980a)' {{(pid=83259) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 15:13:04 devstack cinder-volume[83259]: DEBUG cinder.volume.manager [None req-502f01cb-c748-4291-9b9e-fc7849b15de4 tempest-CreateVolumesFromImageTest-1245864730 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2d107634-314c-49ea-a415-219de20ff166) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83259) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 15:13:04 devstack cinder-volume[83259]: DEBUG cinder.volume.manager [None req-502f01cb-c748-4291-9b9e-fc7849b15de4 tempest-CreateVolumesFromImageTest-1245864730 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2d107634-314c-49ea-a415-219de20ff166) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83259) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 15:13:04 devstack cinder-volume[83259]: DEBUG cinder.volume.manager [None req-502f01cb-c748-4291-9b9e-fc7849b15de4 tempest-CreateVolumesFromImageTest-1245864730 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2c5bb4f0-9408-4f87-afd9-2a8a7b48948a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83259) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 15:13:04 devstack cinder-volume[83259]: DEBUG cinder.volume.manager [None req-502f01cb-c748-4291-9b9e-fc7849b15de4 tempest-CreateVolumesFromImageTest-1245864730 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2c5bb4f0-9408-4f87-afd9-2a8a7b48948a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '371375cf-34a2-44da-940b-a1a3927ebcc0', 'volume_name': 'volume-371375cf-34a2-44da-940b-a1a3927ebcc0', 'volume_size': 1}' {{(pid=83259) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 15:13:04 devstack cinder-volume[83259]: DEBUG cinder.volume.manager [None req-502f01cb-c748-4291-9b9e-fc7849b15de4 tempest-CreateVolumesFromImageTest-1245864730 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ceae4a2d-f4de-4fc6-a5e3-e4d86d7a3da1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83259) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 15:13:04 devstack cinder-volume[83259]: DEBUG cinder.volume.manager [None req-502f01cb-c748-4291-9b9e-fc7849b15de4 tempest-CreateVolumesFromImageTest-1245864730 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ceae4a2d-f4de-4fc6-a5e3-e4d86d7a3da1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83259) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 15:13:04 devstack cinder-volume[83259]: DEBUG cinder.volume.manager [None req-502f01cb-c748-4291-9b9e-fc7849b15de4 tempest-CreateVolumesFromImageTest-1245864730 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9892f324-3581-487b-8a0b-29e925f15b08) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83259) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 15:13:04 devstack cinder-volume[83259]: INFO cinder.volume.flows.manager.create_volume [None req-502f01cb-c748-4291-9b9e-fc7849b15de4 tempest-CreateVolumesFromImageTest-1245864730 None] Volume 371375cf-34a2-44da-940b-a1a3927ebcc0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-371375cf-34a2-44da-940b-a1a3927ebcc0', 'volume_size': 1} Sep 16 15:13:04 devstack cinder-volume[83259]: DEBUG oslo_concurrency.lockutils [None req-502f01cb-c748-4291-9b9e-fc7849b15de4 tempest-CreateVolumesFromImageTest-1245864730 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83259) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 16 15:13:04 devstack cinder-volume[83259]: WARNING cinder.volume.volume_utils [None req-310fa066-b341-487b-b783-bfe960a65a42 tempest-CreateVolumesFromImageTest-1245864730 None] Volume driver (QuobyteDriver 1.2) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 16 15:13:04 devstack cinder-volume[83259]: DEBUG cinder.volume.flows.manager.create_volume [None req-310fa066-b341-487b-b783-bfe960a65a42 tempest-CreateVolumesFromImageTest-1245864730 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#Quobyte'], 'hosts': ['devstack@QuobyteHD#Quobyte']} {{(pid=83259) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1387}} Sep 16 15:13:04 devstack cinder-volume[83259]: DEBUG cinder.volume.manager [None req-310fa066-b341-487b-b783-bfe960a65a42 tempest-CreateVolumesFromImageTest-1245864730 None] Flow 'volume_create_manager' (039d5d12-88ec-49a2-b87a-d3cf0b9b1ea6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83259) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 16 15:13:04 devstack cinder-volume[83259]: DEBUG cinder.volume.manager [None req-310fa066-b341-487b-b783-bfe960a65a42 tempest-CreateVolumesFromImageTest-1245864730 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (51e8dc64-f031-44b4-8a62-749cb96286f0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83259) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 15:13:04 devstack cinder-volume[83259]: DEBUG cinder.volume.manager [None req-310fa066-b341-487b-b783-bfe960a65a42 tempest-CreateVolumesFromImageTest-1245864730 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (51e8dc64-f031-44b4-8a62-749cb96286f0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-16T13:13:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-338268229',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#Quobyte',id=aa963c50-0bac-4ebd-89a7-09b1c1f4b3c6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='57100306065e40139c791ae050253ee5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-16T13:13:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-16T13:13:05Z,use_quota=True,user_id='49ec8541dd7241408704bc80d3eced0e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(485ead50-3df8-4d76-8d34-a4db136c980a),volume_type_id=485ead50-3df8-4d76-8d34-a4db136c980a)' {{(pid=83259) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 15:13:04 devstack cinder-volume[83259]: DEBUG cinder.volume.manager [None req-310fa066-b341-487b-b783-bfe960a65a42 tempest-CreateVolumesFromImageTest-1245864730 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4d308d3f-92ca-4731-ab22-ddaad41194d4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83259) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 15:13:04 devstack cinder-volume[83259]: DEBUG cinder.volume.manager [None req-310fa066-b341-487b-b783-bfe960a65a42 tempest-CreateVolumesFromImageTest-1245864730 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4d308d3f-92ca-4731-ab22-ddaad41194d4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83259) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 15:13:04 devstack cinder-volume[83259]: DEBUG cinder.volume.manager [None req-310fa066-b341-487b-b783-bfe960a65a42 tempest-CreateVolumesFromImageTest-1245864730 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (467d5262-85ab-4adb-aa55-263b62ee02dd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83259) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 15:13:04 devstack cinder-volume[83259]: DEBUG cinder.volume.manager [None req-310fa066-b341-487b-b783-bfe960a65a42 tempest-CreateVolumesFromImageTest-1245864730 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (467d5262-85ab-4adb-aa55-263b62ee02dd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'aa963c50-0bac-4ebd-89a7-09b1c1f4b3c6', 'volume_name': 'volume-aa963c50-0bac-4ebd-89a7-09b1c1f4b3c6', 'volume_size': 1}' {{(pid=83259) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 15:13:04 devstack cinder-volume[83259]: DEBUG cinder.volume.manager [None req-310fa066-b341-487b-b783-bfe960a65a42 tempest-CreateVolumesFromImageTest-1245864730 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0bf6d0cb-527f-4cc1-9acf-12a04bdc9cd5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83259) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 15:13:04 devstack cinder-volume[83259]: DEBUG cinder.volume.manager [None req-310fa066-b341-487b-b783-bfe960a65a42 tempest-CreateVolumesFromImageTest-1245864730 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0bf6d0cb-527f-4cc1-9acf-12a04bdc9cd5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83259) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 15:13:04 devstack cinder-volume[83259]: DEBUG cinder.volume.manager [None req-310fa066-b341-487b-b783-bfe960a65a42 tempest-CreateVolumesFromImageTest-1245864730 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cf0a06b6-e69e-4abc-b03f-deaaad04afeb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83259) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 15:13:04 devstack cinder-volume[83259]: INFO cinder.volume.flows.manager.create_volume [None req-310fa066-b341-487b-b783-bfe960a65a42 tempest-CreateVolumesFromImageTest-1245864730 None] Volume aa963c50-0bac-4ebd-89a7-09b1c1f4b3c6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-aa963c50-0bac-4ebd-89a7-09b1c1f4b3c6', 'volume_size': 1} Sep 16 15:13:04 devstack cinder-volume[83259]: DEBUG oslo_concurrency.lockutils [None req-310fa066-b341-487b-b783-bfe960a65a42 tempest-CreateVolumesFromImageTest-1245864730 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83259) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 16 15:13:14 devstack cinder-volume[83259]: DEBUG dbcounter [-] [83259] Writing DB stats cinder:UPDATE=5,cinder:SELECT=2 {{(pid=83259) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Sep 16 15:13:14 devstack cinder-volume[83259]: DEBUG dbcounter [-] [83259] Writing DB stats cinder:SELECT=8 {{(pid=83259) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Sep 16 15:13:17 devstack cinder-volume[83259]: DEBUG oslo_concurrency.lockutils [None req-458cb9dd-4410-4ecd-9405-d6c4051b94e7 tempest-VolumesActionsTest-296669149 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: held 74.537s {{(pid=83259) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 16 15:13:17 devstack cinder-volume[83259]: DEBUG cinder.volume.manager [None req-458cb9dd-4410-4ecd-9405-d6c4051b94e7 tempest-VolumesActionsTest-296669149 None] Uploaded volume to glance image-id: 006c1627-c0c0-438d-8230-12fb41053ff0. {{(pid=83259) copy_volume_to_image /opt/stack/cinder/cinder/volume/manager.py:1780}} Sep 16 15:13:17 devstack cinder-volume[83259]: DEBUG oslo_concurrency.lockutils [None req-77661b87-723a-4dd8-b72a-dc7ac9b2024f tempest-VolumesSnapshotListTestJSON-248203627 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 29.788s {{(pid=83259) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 16 15:13:17 devstack cinder-volume[83259]: DEBUG cinder.volume.drivers.quobyte [None req-77661b87-723a-4dd8-b72a-dc7ac9b2024f tempest-VolumesSnapshotListTestJSON-248203627 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-16T13:12:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotListTestJSON-Volume-303931304',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#Quobyte',id=68324198-e4bf-4e89-934a-b125055ec9ed,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dfd5df44b18c488888fac7271c0e8e39',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-16T13:12:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-16T13:12:47Z,use_quota=True,user_id='0ca305637f4c4b608692d8343e4dcd1d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(485ead50-3df8-4d76-8d34-a4db136c980a),volume_type_id=485ead50-3df8-4d76-8d34-a4db136c980a)}" {{(pid=83259) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Sep 16 15:13:17 devstack cinder-volume[83259]: DEBUG cinder.volume.drivers.remotefs [None req-77661b87-723a-4dd8-b72a-dc7ac9b2024f tempest-VolumesSnapshotListTestJSON-248203627 None] Creating volume 68324198-e4bf-4e89-934a-b125055ec9ed {{(pid=83259) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}} Sep 16 15:13:17 devstack cinder-volume[83259]: DEBUG oslo_concurrency.lockutils [None req-77661b87-723a-4dd8-b72a-dc7ac9b2024f tempest-VolumesSnapshotListTestJSON-248203627 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83259) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 16 15:13:17 devstack cinder-volume[83259]: DEBUG oslo_concurrency.lockutils [None req-77661b87-723a-4dd8-b72a-dc7ac9b2024f tempest-VolumesSnapshotListTestJSON-248203627 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83259) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 16 15:13:17 devstack cinder-volume[83259]: DEBUG cinder.volume.drivers.quobyte [None req-77661b87-723a-4dd8-b72a-dc7ac9b2024f tempest-VolumesSnapshotListTestJSON-248203627 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-61f585ac-f8e2-4d19-a890-7ebc2726cc72': None} {{(pid=83259) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:639}} Sep 16 15:13:17 devstack cinder-volume[83259]: DEBUG cinder.volume.drivers.quobyte [None req-77661b87-723a-4dd8-b72a-dc7ac9b2024f tempest-VolumesSnapshotListTestJSON-248203627 None] Available shares ['10.10.41.181/cinder-vol-61f585ac-f8e2-4d19-a890-7ebc2726cc72'] {{(pid=83259) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:669}} Sep 16 15:13:17 devstack cinder-volume[83259]: DEBUG oslo_concurrency.lockutils [None req-77661b87-723a-4dd8-b72a-dc7ac9b2024f tempest-VolumesSnapshotListTestJSON-248203627 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=83259) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 16 15:13:17 devstack cinder-volume[83259]: DEBUG cinder.volume.drivers.quobyte [None req-77661b87-723a-4dd8-b72a-dc7ac9b2024f tempest-VolumesSnapshotListTestJSON-248203627 None] Selected 10.10.41.181/cinder-vol-61f585ac-f8e2-4d19-a890-7ebc2726cc72 as target Quobyte volume. {{(pid=83259) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:690}} Sep 16 15:13:17 devstack cinder-volume[83259]: INFO cinder.volume.drivers.remotefs [None req-77661b87-723a-4dd8-b72a-dc7ac9b2024f tempest-VolumesSnapshotListTestJSON-248203627 None] casted to 10.10.41.181/cinder-vol-61f585ac-f8e2-4d19-a890-7ebc2726cc72 Sep 16 15:13:17 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [None req-77661b87-723a-4dd8-b72a-dc7ac9b2024f tempest-VolumesSnapshotListTestJSON-248203627 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c/volume-68324198-e4bf-4e89-934a-b125055ec9ed 1073741824 {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 15:13:17 devstack quobyte-client[83286]: The server volume:87712ffe-8a69-446d-9ed6-4430c7ee9792@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=87712ffe-8a69-446d-9ed6-4430c7ee9792, inode=105, name=volume-68324198-e4bf-4e89-934a-b125055ec9ed, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.206), requestorAccessMask=0 Sep 16 15:13:17 devstack cinder-volume[83259]: INFO cinder.volume.manager [None req-458cb9dd-4410-4ecd-9405-d6c4051b94e7 tempest-VolumesActionsTest-296669149 None] Copy volume to image completed successfully. Sep 16 15:13:17 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [None req-77661b87-723a-4dd8-b72a-dc7ac9b2024f tempest-VolumesSnapshotListTestJSON-248203627 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c/volume-68324198-e4bf-4e89-934a-b125055ec9ed 1073741824" returned: 0 in 0.440s {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 15:13:17 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [None req-77661b87-723a-4dd8-b72a-dc7ac9b2024f tempest-VolumesSnapshotListTestJSON-248203627 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c/volume-68324198-e4bf-4e89-934a-b125055ec9ed {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 15:13:17 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [None req-77661b87-723a-4dd8-b72a-dc7ac9b2024f tempest-VolumesSnapshotListTestJSON-248203627 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c/volume-68324198-e4bf-4e89-934a-b125055ec9ed" returned: 0 in 0.094s {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 15:13:17 devstack cinder-volume[83259]: DEBUG cinder.volume.drivers.quobyte [None req-77661b87-723a-4dd8-b72a-dc7ac9b2024f tempest-VolumesSnapshotListTestJSON-248203627 None] <== create_volume: return (591ms) {'provider_location': '10.10.41.181/cinder-vol-61f585ac-f8e2-4d19-a890-7ebc2726cc72'} {{(pid=83259) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Sep 16 15:13:17 devstack cinder-volume[83259]: DEBUG oslo_concurrency.lockutils [None req-77661b87-723a-4dd8-b72a-dc7ac9b2024f tempest-VolumesSnapshotListTestJSON-248203627 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.605s {{(pid=83259) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 16 15:13:18 devstack cinder-volume[83259]: DEBUG oslo_concurrency.lockutils [None req-0ce3fe9c-8e96-48f1-85a2-1fb4eb5f42d2 tempest-CreateVolumesFromImageTest-1245864730 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 14.569s {{(pid=83259) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 16 15:13:18 devstack cinder-volume[83259]: DEBUG cinder.volume.drivers.quobyte [None req-0ce3fe9c-8e96-48f1-85a2-1fb4eb5f42d2 tempest-CreateVolumesFromImageTest-1245864730 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-16T13:13:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-922844823',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#Quobyte',id=9c82ccf0-7efe-42a9-a8c8-549b64230bda,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='57100306065e40139c791ae050253ee5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-16T13:13:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-16T13:13:03Z,use_quota=True,user_id='49ec8541dd7241408704bc80d3eced0e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(485ead50-3df8-4d76-8d34-a4db136c980a),volume_type_id=485ead50-3df8-4d76-8d34-a4db136c980a)}" {{(pid=83259) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Sep 16 15:13:18 devstack cinder-volume[83259]: DEBUG cinder.volume.drivers.remotefs [None req-0ce3fe9c-8e96-48f1-85a2-1fb4eb5f42d2 tempest-CreateVolumesFromImageTest-1245864730 None] Creating volume 9c82ccf0-7efe-42a9-a8c8-549b64230bda {{(pid=83259) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}} Sep 16 15:13:18 devstack cinder-volume[83259]: DEBUG oslo_concurrency.lockutils [None req-0ce3fe9c-8e96-48f1-85a2-1fb4eb5f42d2 tempest-CreateVolumesFromImageTest-1245864730 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83259) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 16 15:13:18 devstack cinder-volume[83259]: DEBUG oslo_concurrency.lockutils [None req-0ce3fe9c-8e96-48f1-85a2-1fb4eb5f42d2 tempest-CreateVolumesFromImageTest-1245864730 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=83259) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 16 15:13:18 devstack cinder-volume[83259]: DEBUG cinder.volume.drivers.quobyte [None req-0ce3fe9c-8e96-48f1-85a2-1fb4eb5f42d2 tempest-CreateVolumesFromImageTest-1245864730 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-61f585ac-f8e2-4d19-a890-7ebc2726cc72': None} {{(pid=83259) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:639}} Sep 16 15:13:18 devstack cinder-volume[83259]: DEBUG cinder.volume.drivers.quobyte [None req-0ce3fe9c-8e96-48f1-85a2-1fb4eb5f42d2 tempest-CreateVolumesFromImageTest-1245864730 None] Available shares ['10.10.41.181/cinder-vol-61f585ac-f8e2-4d19-a890-7ebc2726cc72'] {{(pid=83259) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:669}} Sep 16 15:13:18 devstack cinder-volume[83259]: DEBUG oslo_concurrency.lockutils [None req-0ce3fe9c-8e96-48f1-85a2-1fb4eb5f42d2 tempest-CreateVolumesFromImageTest-1245864730 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=83259) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 16 15:13:18 devstack cinder-volume[83259]: DEBUG cinder.volume.drivers.quobyte [None req-0ce3fe9c-8e96-48f1-85a2-1fb4eb5f42d2 tempest-CreateVolumesFromImageTest-1245864730 None] Selected 10.10.41.181/cinder-vol-61f585ac-f8e2-4d19-a890-7ebc2726cc72 as target Quobyte volume. {{(pid=83259) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:690}} Sep 16 15:13:18 devstack cinder-volume[83259]: INFO cinder.volume.drivers.remotefs [None req-0ce3fe9c-8e96-48f1-85a2-1fb4eb5f42d2 tempest-CreateVolumesFromImageTest-1245864730 None] casted to 10.10.41.181/cinder-vol-61f585ac-f8e2-4d19-a890-7ebc2726cc72 Sep 16 15:13:18 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [None req-0ce3fe9c-8e96-48f1-85a2-1fb4eb5f42d2 tempest-CreateVolumesFromImageTest-1245864730 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c/volume-9c82ccf0-7efe-42a9-a8c8-549b64230bda 1073741824 {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 15:13:18 devstack quobyte-client[83286]: The server volume:87712ffe-8a69-446d-9ed6-4430c7ee9792@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=87712ffe-8a69-446d-9ed6-4430c7ee9792, inode=106, name=volume-9c82ccf0-7efe-42a9-a8c8-549b64230bda, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.206), requestorAccessMask=0 Sep 16 15:13:18 devstack cinder-volume[83259]: DEBUG cinder.volume.manager [None req-77661b87-723a-4dd8-b72a-dc7ac9b2024f tempest-VolumesSnapshotListTestJSON-248203627 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e11ea1f7-b8e2-40e0-aad9-44767610aa5a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-68324198-e4bf-4e89-934a-b125055ec9ed', 'volume_size': 1}' {{(pid=83259) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 15:13:18 devstack cinder-volume[83259]: DEBUG cinder.volume.manager [None req-77661b87-723a-4dd8-b72a-dc7ac9b2024f tempest-VolumesSnapshotListTestJSON-248203627 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d1a59694-2320-403d-bb95-0b8dbdc24885) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83259) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 15:13:18 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [None req-0ce3fe9c-8e96-48f1-85a2-1fb4eb5f42d2 tempest-CreateVolumesFromImageTest-1245864730 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c/volume-9c82ccf0-7efe-42a9-a8c8-549b64230bda 1073741824" returned: 0 in 0.387s {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 15:13:18 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [None req-0ce3fe9c-8e96-48f1-85a2-1fb4eb5f42d2 tempest-CreateVolumesFromImageTest-1245864730 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c/volume-9c82ccf0-7efe-42a9-a8c8-549b64230bda {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 15:13:18 devstack cinder-volume[83259]: INFO cinder.volume.flows.manager.create_volume [None req-77661b87-723a-4dd8-b72a-dc7ac9b2024f tempest-VolumesSnapshotListTestJSON-248203627 None] Volume volume-68324198-e4bf-4e89-934a-b125055ec9ed (68324198-e4bf-4e89-934a-b125055ec9ed): created successfully Sep 16 15:13:18 devstack cinder-volume[83259]: DEBUG cinder.volume.manager [None req-77661b87-723a-4dd8-b72a-dc7ac9b2024f tempest-VolumesSnapshotListTestJSON-248203627 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d1a59694-2320-403d-bb95-0b8dbdc24885) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83259) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 15:13:18 devstack cinder-volume[83259]: DEBUG cinder.volume.manager [None req-77661b87-723a-4dd8-b72a-dc7ac9b2024f tempest-VolumesSnapshotListTestJSON-248203627 None] Flow 'volume_create_manager' (c5461ef0-8191-44b7-87d3-4cb99fe7d43e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83259) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 16 15:13:18 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [None req-0ce3fe9c-8e96-48f1-85a2-1fb4eb5f42d2 tempest-CreateVolumesFromImageTest-1245864730 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c/volume-9c82ccf0-7efe-42a9-a8c8-549b64230bda" returned: 0 in 0.350s {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 15:13:18 devstack cinder-volume[83259]: DEBUG cinder.volume.drivers.quobyte [None req-0ce3fe9c-8e96-48f1-85a2-1fb4eb5f42d2 tempest-CreateVolumesFromImageTest-1245864730 None] <== create_volume: return (766ms) {'provider_location': '10.10.41.181/cinder-vol-61f585ac-f8e2-4d19-a890-7ebc2726cc72'} {{(pid=83259) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Sep 16 15:13:18 devstack cinder-volume[83259]: DEBUG oslo_concurrency.lockutils [None req-0ce3fe9c-8e96-48f1-85a2-1fb4eb5f42d2 tempest-CreateVolumesFromImageTest-1245864730 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.789s {{(pid=83259) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 16 15:13:18 devstack cinder-volume[83259]: DEBUG oslo_concurrency.lockutils [None req-e12670df-1ed9-4951-9413-ff123415f748 tempest-CreateVolumesFromImageTest-1245864730 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 15.084s {{(pid=83259) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 16 15:13:18 devstack cinder-volume[83259]: DEBUG cinder.volume.drivers.quobyte [None req-e12670df-1ed9-4951-9413-ff123415f748 tempest-CreateVolumesFromImageTest-1245864730 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-16T13:13:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-292571825',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#Quobyte',id=9d18bf7e-2e8a-413d-b930-926000cd0930,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='57100306065e40139c791ae050253ee5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-16T13:13:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-16T13:13:03Z,use_quota=True,user_id='49ec8541dd7241408704bc80d3eced0e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(485ead50-3df8-4d76-8d34-a4db136c980a),volume_type_id=485ead50-3df8-4d76-8d34-a4db136c980a)}" {{(pid=83259) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Sep 16 15:13:18 devstack cinder-volume[83259]: DEBUG cinder.volume.drivers.remotefs [None req-e12670df-1ed9-4951-9413-ff123415f748 tempest-CreateVolumesFromImageTest-1245864730 None] Creating volume 9d18bf7e-2e8a-413d-b930-926000cd0930 {{(pid=83259) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}} Sep 16 15:13:18 devstack cinder-volume[83259]: DEBUG oslo_concurrency.lockutils [None req-e12670df-1ed9-4951-9413-ff123415f748 tempest-CreateVolumesFromImageTest-1245864730 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83259) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 16 15:13:18 devstack cinder-volume[83259]: DEBUG oslo_concurrency.lockutils [None req-e12670df-1ed9-4951-9413-ff123415f748 tempest-CreateVolumesFromImageTest-1245864730 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=83259) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 16 15:13:18 devstack cinder-volume[83259]: DEBUG cinder.volume.drivers.quobyte [None req-e12670df-1ed9-4951-9413-ff123415f748 tempest-CreateVolumesFromImageTest-1245864730 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-61f585ac-f8e2-4d19-a890-7ebc2726cc72': None} {{(pid=83259) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:639}} Sep 16 15:13:18 devstack cinder-volume[83259]: DEBUG cinder.volume.drivers.quobyte [None req-e12670df-1ed9-4951-9413-ff123415f748 tempest-CreateVolumesFromImageTest-1245864730 None] Available shares ['10.10.41.181/cinder-vol-61f585ac-f8e2-4d19-a890-7ebc2726cc72'] {{(pid=83259) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:669}} Sep 16 15:13:18 devstack cinder-volume[83259]: DEBUG oslo_concurrency.lockutils [None req-e12670df-1ed9-4951-9413-ff123415f748 tempest-CreateVolumesFromImageTest-1245864730 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=83259) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 16 15:13:18 devstack cinder-volume[83259]: DEBUG cinder.volume.drivers.quobyte [None req-e12670df-1ed9-4951-9413-ff123415f748 tempest-CreateVolumesFromImageTest-1245864730 None] Selected 10.10.41.181/cinder-vol-61f585ac-f8e2-4d19-a890-7ebc2726cc72 as target Quobyte volume. {{(pid=83259) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:690}} Sep 16 15:13:18 devstack cinder-volume[83259]: INFO cinder.volume.drivers.remotefs [None req-e12670df-1ed9-4951-9413-ff123415f748 tempest-CreateVolumesFromImageTest-1245864730 None] casted to 10.10.41.181/cinder-vol-61f585ac-f8e2-4d19-a890-7ebc2726cc72 Sep 16 15:13:18 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [None req-e12670df-1ed9-4951-9413-ff123415f748 tempest-CreateVolumesFromImageTest-1245864730 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c/volume-9d18bf7e-2e8a-413d-b930-926000cd0930 1073741824 {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 15:13:19 devstack quobyte-client[83286]: System call of process 96349 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 16 15:13:19 devstack cinder-volume[83259]: INFO cinder.volume.manager [None req-77661b87-723a-4dd8-b72a-dc7ac9b2024f tempest-VolumesSnapshotListTestJSON-248203627 None] Created volume successfully. Sep 16 15:13:19 devstack quobyte-client[83286]: The server volume:87712ffe-8a69-446d-9ed6-4430c7ee9792@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=87712ffe-8a69-446d-9ed6-4430c7ee9792, inode=107, name=volume-9d18bf7e-2e8a-413d-b930-926000cd0930, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.206), requestorAccessMask=0 Sep 16 15:13:19 devstack cinder-volume[83259]: DEBUG cinder.volume.manager [None req-0ce3fe9c-8e96-48f1-85a2-1fb4eb5f42d2 tempest-CreateVolumesFromImageTest-1245864730 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0399cfa9-d346-478a-b5a9-1988e4ed5eac) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9c82ccf0-7efe-42a9-a8c8-549b64230bda', 'volume_size': 1}' {{(pid=83259) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 15:13:19 devstack cinder-volume[83259]: DEBUG cinder.volume.manager [None req-0ce3fe9c-8e96-48f1-85a2-1fb4eb5f42d2 tempest-CreateVolumesFromImageTest-1245864730 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (72336b0e-6e34-44fb-8569-540bc43256ed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83259) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 15:13:19 devstack cinder-volume[83259]: INFO cinder.volume.flows.manager.create_volume [None req-0ce3fe9c-8e96-48f1-85a2-1fb4eb5f42d2 tempest-CreateVolumesFromImageTest-1245864730 None] Volume volume-9c82ccf0-7efe-42a9-a8c8-549b64230bda (9c82ccf0-7efe-42a9-a8c8-549b64230bda): created successfully Sep 16 15:13:19 devstack cinder-volume[83259]: DEBUG cinder.volume.manager [None req-0ce3fe9c-8e96-48f1-85a2-1fb4eb5f42d2 tempest-CreateVolumesFromImageTest-1245864730 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (72336b0e-6e34-44fb-8569-540bc43256ed) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83259) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 15:13:19 devstack cinder-volume[83259]: DEBUG cinder.volume.manager [None req-0ce3fe9c-8e96-48f1-85a2-1fb4eb5f42d2 tempest-CreateVolumesFromImageTest-1245864730 None] Flow 'volume_create_manager' (6db01f6d-5509-43d8-a929-f31dac09a828) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83259) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 16 15:13:19 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [None req-e12670df-1ed9-4951-9413-ff123415f748 tempest-CreateVolumesFromImageTest-1245864730 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c/volume-9d18bf7e-2e8a-413d-b930-926000cd0930 1073741824" returned: 0 in 0.561s {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 15:13:19 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [None req-e12670df-1ed9-4951-9413-ff123415f748 tempest-CreateVolumesFromImageTest-1245864730 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c/volume-9d18bf7e-2e8a-413d-b930-926000cd0930 {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 15:13:19 devstack cinder-volume[83259]: INFO cinder.volume.manager [None req-0ce3fe9c-8e96-48f1-85a2-1fb4eb5f42d2 tempest-CreateVolumesFromImageTest-1245864730 None] Created volume successfully. Sep 16 15:13:19 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [None req-e12670df-1ed9-4951-9413-ff123415f748 tempest-CreateVolumesFromImageTest-1245864730 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c/volume-9d18bf7e-2e8a-413d-b930-926000cd0930" returned: 0 in 0.336s {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 15:13:19 devstack cinder-volume[83259]: DEBUG cinder.volume.drivers.quobyte [None req-e12670df-1ed9-4951-9413-ff123415f748 tempest-CreateVolumesFromImageTest-1245864730 None] <== create_volume: return (926ms) {'provider_location': '10.10.41.181/cinder-vol-61f585ac-f8e2-4d19-a890-7ebc2726cc72'} {{(pid=83259) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Sep 16 15:13:19 devstack cinder-volume[83259]: DEBUG oslo_concurrency.lockutils [None req-e12670df-1ed9-4951-9413-ff123415f748 tempest-CreateVolumesFromImageTest-1245864730 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.947s {{(pid=83259) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 16 15:13:19 devstack cinder-volume[83259]: DEBUG oslo_concurrency.lockutils [None req-0b38a1a2-e65d-42bb-a6dd-531e35f60d7e tempest-CreateVolumesFromImageTest-1245864730 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 15.718s {{(pid=83259) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 16 15:13:19 devstack cinder-volume[83259]: DEBUG cinder.volume.drivers.quobyte [None req-0b38a1a2-e65d-42bb-a6dd-531e35f60d7e tempest-CreateVolumesFromImageTest-1245864730 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-16T13:13:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-79662501',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#Quobyte',id=a1861ecb-7997-445c-932d-b787ca98585e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='57100306065e40139c791ae050253ee5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-16T13:13:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-16T13:13:04Z,use_quota=True,user_id='49ec8541dd7241408704bc80d3eced0e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(485ead50-3df8-4d76-8d34-a4db136c980a),volume_type_id=485ead50-3df8-4d76-8d34-a4db136c980a)}" {{(pid=83259) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Sep 16 15:13:19 devstack cinder-volume[83259]: DEBUG cinder.volume.drivers.remotefs [None req-0b38a1a2-e65d-42bb-a6dd-531e35f60d7e tempest-CreateVolumesFromImageTest-1245864730 None] Creating volume a1861ecb-7997-445c-932d-b787ca98585e {{(pid=83259) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}} Sep 16 15:13:19 devstack cinder-volume[83259]: DEBUG oslo_concurrency.lockutils [None req-0b38a1a2-e65d-42bb-a6dd-531e35f60d7e tempest-CreateVolumesFromImageTest-1245864730 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83259) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 16 15:13:19 devstack cinder-volume[83259]: DEBUG oslo_concurrency.lockutils [None req-0b38a1a2-e65d-42bb-a6dd-531e35f60d7e tempest-CreateVolumesFromImageTest-1245864730 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.013s {{(pid=83259) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 16 15:13:19 devstack cinder-volume[83259]: DEBUG cinder.volume.drivers.quobyte [None req-0b38a1a2-e65d-42bb-a6dd-531e35f60d7e tempest-CreateVolumesFromImageTest-1245864730 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-61f585ac-f8e2-4d19-a890-7ebc2726cc72': None} {{(pid=83259) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:639}} Sep 16 15:13:19 devstack cinder-volume[83259]: DEBUG cinder.volume.drivers.quobyte [None req-0b38a1a2-e65d-42bb-a6dd-531e35f60d7e tempest-CreateVolumesFromImageTest-1245864730 None] Available shares ['10.10.41.181/cinder-vol-61f585ac-f8e2-4d19-a890-7ebc2726cc72'] {{(pid=83259) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:669}} Sep 16 15:13:19 devstack cinder-volume[83259]: DEBUG oslo_concurrency.lockutils [None req-0b38a1a2-e65d-42bb-a6dd-531e35f60d7e tempest-CreateVolumesFromImageTest-1245864730 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.031s {{(pid=83259) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 16 15:13:19 devstack cinder-volume[83259]: DEBUG cinder.volume.drivers.quobyte [None req-0b38a1a2-e65d-42bb-a6dd-531e35f60d7e tempest-CreateVolumesFromImageTest-1245864730 None] Selected 10.10.41.181/cinder-vol-61f585ac-f8e2-4d19-a890-7ebc2726cc72 as target Quobyte volume. {{(pid=83259) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:690}} Sep 16 15:13:19 devstack cinder-volume[83259]: INFO cinder.volume.drivers.remotefs [None req-0b38a1a2-e65d-42bb-a6dd-531e35f60d7e tempest-CreateVolumesFromImageTest-1245864730 None] casted to 10.10.41.181/cinder-vol-61f585ac-f8e2-4d19-a890-7ebc2726cc72 Sep 16 15:13:19 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [None req-0b38a1a2-e65d-42bb-a6dd-531e35f60d7e tempest-CreateVolumesFromImageTest-1245864730 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c/volume-a1861ecb-7997-445c-932d-b787ca98585e 1073741824 {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 15:13:20 devstack quobyte-client[83286]: The server volume:87712ffe-8a69-446d-9ed6-4430c7ee9792@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=87712ffe-8a69-446d-9ed6-4430c7ee9792, inode=108, name=volume-a1861ecb-7997-445c-932d-b787ca98585e, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.206), requestorAccessMask=0 Sep 16 15:13:20 devstack cinder-volume[83259]: DEBUG cinder.volume.manager [None req-e12670df-1ed9-4951-9413-ff123415f748 tempest-CreateVolumesFromImageTest-1245864730 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ba0b318e-81a6-4990-b87c-bb9008ce4a9a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9d18bf7e-2e8a-413d-b930-926000cd0930', 'volume_size': 1}' {{(pid=83259) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 15:13:20 devstack cinder-volume[83259]: DEBUG cinder.volume.manager [None req-e12670df-1ed9-4951-9413-ff123415f748 tempest-CreateVolumesFromImageTest-1245864730 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cb32b43a-07b7-40a3-898b-6f5c5f38a2ba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83259) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 15:13:20 devstack cinder-volume[83259]: WARNING cinder.volume.volume_utils [None req-26366c8a-5eeb-4c0f-95d4-3a4807f007db tempest-VolumesActionsTest-296669149 None] Volume driver (QuobyteDriver 1.2) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 16 15:13:20 devstack cinder-volume[83259]: DEBUG oslo_concurrency.lockutils [None req-26366c8a-5eeb-4c0f-95d4-3a4807f007db tempest-VolumesActionsTest-296669149 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" {{(pid=83259) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 16 15:13:20 devstack cinder-volume[83259]: WARNING cinder.volume.volume_utils [None req-56f13465-4088-4334-bd02-fe8178f5fa15 tempest-VolumesSnapshotListTestJSON-248203627 None] Volume driver (QuobyteDriver 1.2) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 16 15:13:20 devstack cinder-volume[83259]: DEBUG oslo_concurrency.lockutils [None req-56f13465-4088-4334-bd02-fe8178f5fa15 tempest-VolumesSnapshotListTestJSON-248203627 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=83259) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 16 15:13:20 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [None req-0b38a1a2-e65d-42bb-a6dd-531e35f60d7e tempest-CreateVolumesFromImageTest-1245864730 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c/volume-a1861ecb-7997-445c-932d-b787ca98585e 1073741824" returned: 0 in 0.588s {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 15:13:20 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [None req-0b38a1a2-e65d-42bb-a6dd-531e35f60d7e tempest-CreateVolumesFromImageTest-1245864730 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c/volume-a1861ecb-7997-445c-932d-b787ca98585e {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 15:13:20 devstack cinder-volume[83259]: INFO cinder.volume.flows.manager.create_volume [None req-e12670df-1ed9-4951-9413-ff123415f748 tempest-CreateVolumesFromImageTest-1245864730 None] Volume volume-9d18bf7e-2e8a-413d-b930-926000cd0930 (9d18bf7e-2e8a-413d-b930-926000cd0930): created successfully Sep 16 15:13:20 devstack cinder-volume[83259]: DEBUG cinder.volume.manager [None req-e12670df-1ed9-4951-9413-ff123415f748 tempest-CreateVolumesFromImageTest-1245864730 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cb32b43a-07b7-40a3-898b-6f5c5f38a2ba) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83259) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 15:13:20 devstack cinder-volume[83259]: DEBUG cinder.volume.manager [None req-e12670df-1ed9-4951-9413-ff123415f748 tempest-CreateVolumesFromImageTest-1245864730 None] Flow 'volume_create_manager' (1df60c6e-cdbf-4f6b-bd37-cd3a55227dc0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83259) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 16 15:13:20 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [None req-0b38a1a2-e65d-42bb-a6dd-531e35f60d7e tempest-CreateVolumesFromImageTest-1245864730 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c/volume-a1861ecb-7997-445c-932d-b787ca98585e" returned: 0 in 0.309s {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 15:13:20 devstack cinder-volume[83259]: DEBUG cinder.volume.drivers.quobyte [None req-0b38a1a2-e65d-42bb-a6dd-531e35f60d7e tempest-CreateVolumesFromImageTest-1245864730 None] <== create_volume: return (953ms) {'provider_location': '10.10.41.181/cinder-vol-61f585ac-f8e2-4d19-a890-7ebc2726cc72'} {{(pid=83259) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Sep 16 15:13:20 devstack cinder-volume[83259]: DEBUG oslo_concurrency.lockutils [None req-0b38a1a2-e65d-42bb-a6dd-531e35f60d7e tempest-CreateVolumesFromImageTest-1245864730 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.977s {{(pid=83259) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 16 15:13:20 devstack cinder-volume[83259]: DEBUG oslo_concurrency.lockutils [None req-502f01cb-c748-4291-9b9e-fc7849b15de4 tempest-CreateVolumesFromImageTest-1245864730 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 16.426s {{(pid=83259) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 16 15:13:20 devstack cinder-volume[83259]: DEBUG cinder.volume.drivers.quobyte [None req-502f01cb-c748-4291-9b9e-fc7849b15de4 tempest-CreateVolumesFromImageTest-1245864730 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-16T13:13:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1883002886',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#Quobyte',id=371375cf-34a2-44da-940b-a1a3927ebcc0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='57100306065e40139c791ae050253ee5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-16T13:13:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-16T13:13:04Z,use_quota=True,user_id='49ec8541dd7241408704bc80d3eced0e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(485ead50-3df8-4d76-8d34-a4db136c980a),volume_type_id=485ead50-3df8-4d76-8d34-a4db136c980a)}" {{(pid=83259) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Sep 16 15:13:20 devstack cinder-volume[83259]: DEBUG cinder.volume.drivers.remotefs [None req-502f01cb-c748-4291-9b9e-fc7849b15de4 tempest-CreateVolumesFromImageTest-1245864730 None] Creating volume 371375cf-34a2-44da-940b-a1a3927ebcc0 {{(pid=83259) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}} Sep 16 15:13:20 devstack cinder-volume[83259]: DEBUG oslo_concurrency.lockutils [None req-502f01cb-c748-4291-9b9e-fc7849b15de4 tempest-CreateVolumesFromImageTest-1245864730 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83259) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 16 15:13:20 devstack cinder-volume[83259]: DEBUG oslo_concurrency.lockutils [None req-502f01cb-c748-4291-9b9e-fc7849b15de4 tempest-CreateVolumesFromImageTest-1245864730 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=83259) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 16 15:13:20 devstack cinder-volume[83259]: DEBUG cinder.volume.drivers.quobyte [None req-502f01cb-c748-4291-9b9e-fc7849b15de4 tempest-CreateVolumesFromImageTest-1245864730 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-61f585ac-f8e2-4d19-a890-7ebc2726cc72': None} {{(pid=83259) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:639}} Sep 16 15:13:20 devstack cinder-volume[83259]: DEBUG cinder.volume.drivers.quobyte [None req-502f01cb-c748-4291-9b9e-fc7849b15de4 tempest-CreateVolumesFromImageTest-1245864730 None] Available shares ['10.10.41.181/cinder-vol-61f585ac-f8e2-4d19-a890-7ebc2726cc72'] {{(pid=83259) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:669}} Sep 16 15:13:20 devstack cinder-volume[83259]: DEBUG oslo_concurrency.lockutils [None req-502f01cb-c748-4291-9b9e-fc7849b15de4 tempest-CreateVolumesFromImageTest-1245864730 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=83259) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 16 15:13:20 devstack cinder-volume[83259]: DEBUG cinder.volume.drivers.quobyte [None req-502f01cb-c748-4291-9b9e-fc7849b15de4 tempest-CreateVolumesFromImageTest-1245864730 None] Selected 10.10.41.181/cinder-vol-61f585ac-f8e2-4d19-a890-7ebc2726cc72 as target Quobyte volume. {{(pid=83259) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:690}} Sep 16 15:13:20 devstack cinder-volume[83259]: INFO cinder.volume.drivers.remotefs [None req-502f01cb-c748-4291-9b9e-fc7849b15de4 tempest-CreateVolumesFromImageTest-1245864730 None] casted to 10.10.41.181/cinder-vol-61f585ac-f8e2-4d19-a890-7ebc2726cc72 Sep 16 15:13:20 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [None req-502f01cb-c748-4291-9b9e-fc7849b15de4 tempest-CreateVolumesFromImageTest-1245864730 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c/volume-371375cf-34a2-44da-940b-a1a3927ebcc0 1073741824 {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 15:13:21 devstack cinder-volume[83259]: INFO cinder.volume.manager [None req-e12670df-1ed9-4951-9413-ff123415f748 tempest-CreateVolumesFromImageTest-1245864730 None] Created volume successfully. Sep 16 15:13:21 devstack quobyte-client[83286]: System call of process 96357 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 16 15:13:21 devstack quobyte-client[83286]: The server volume:87712ffe-8a69-446d-9ed6-4430c7ee9792@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=87712ffe-8a69-446d-9ed6-4430c7ee9792, inode=109, name=volume-371375cf-34a2-44da-940b-a1a3927ebcc0, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.206), requestorAccessMask=0 Sep 16 15:13:21 devstack cinder-volume[83259]: DEBUG cinder.volume.manager [None req-0b38a1a2-e65d-42bb-a6dd-531e35f60d7e tempest-CreateVolumesFromImageTest-1245864730 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5855c3bc-e0d8-442b-8df6-5509c17f7a17) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a1861ecb-7997-445c-932d-b787ca98585e', 'volume_size': 1}' {{(pid=83259) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 15:13:21 devstack cinder-volume[83259]: DEBUG cinder.volume.manager [None req-0b38a1a2-e65d-42bb-a6dd-531e35f60d7e tempest-CreateVolumesFromImageTest-1245864730 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (21742d6e-eea2-4818-869a-90b27c6b4f9e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83259) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 15:13:21 devstack cinder-volume[83259]: INFO cinder.volume.flows.manager.create_volume [None req-0b38a1a2-e65d-42bb-a6dd-531e35f60d7e tempest-CreateVolumesFromImageTest-1245864730 None] Volume volume-a1861ecb-7997-445c-932d-b787ca98585e (a1861ecb-7997-445c-932d-b787ca98585e): created successfully Sep 16 15:13:21 devstack cinder-volume[83259]: DEBUG cinder.volume.manager [None req-0b38a1a2-e65d-42bb-a6dd-531e35f60d7e tempest-CreateVolumesFromImageTest-1245864730 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (21742d6e-eea2-4818-869a-90b27c6b4f9e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83259) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 15:13:21 devstack cinder-volume[83259]: DEBUG cinder.volume.manager [None req-0b38a1a2-e65d-42bb-a6dd-531e35f60d7e tempest-CreateVolumesFromImageTest-1245864730 None] Flow 'volume_create_manager' (641a3ffa-7a05-4629-8ba6-8b936a0edbe7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83259) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 16 15:13:21 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [None req-502f01cb-c748-4291-9b9e-fc7849b15de4 tempest-CreateVolumesFromImageTest-1245864730 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c/volume-371375cf-34a2-44da-940b-a1a3927ebcc0 1073741824" returned: 0 in 0.515s {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 15:13:21 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [None req-502f01cb-c748-4291-9b9e-fc7849b15de4 tempest-CreateVolumesFromImageTest-1245864730 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c/volume-371375cf-34a2-44da-940b-a1a3927ebcc0 {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 15:13:21 devstack cinder-volume[83259]: INFO cinder.volume.manager [None req-0b38a1a2-e65d-42bb-a6dd-531e35f60d7e tempest-CreateVolumesFromImageTest-1245864730 None] Created volume successfully. Sep 16 15:13:21 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [None req-502f01cb-c748-4291-9b9e-fc7849b15de4 tempest-CreateVolumesFromImageTest-1245864730 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c/volume-371375cf-34a2-44da-940b-a1a3927ebcc0" returned: 0 in 0.276s {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 15:13:21 devstack cinder-volume[83259]: DEBUG cinder.volume.drivers.quobyte [None req-502f01cb-c748-4291-9b9e-fc7849b15de4 tempest-CreateVolumesFromImageTest-1245864730 None] <== create_volume: return (819ms) {'provider_location': '10.10.41.181/cinder-vol-61f585ac-f8e2-4d19-a890-7ebc2726cc72'} {{(pid=83259) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Sep 16 15:13:21 devstack cinder-volume[83259]: DEBUG oslo_concurrency.lockutils [None req-502f01cb-c748-4291-9b9e-fc7849b15de4 tempest-CreateVolumesFromImageTest-1245864730 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.835s {{(pid=83259) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 16 15:13:21 devstack cinder-volume[83259]: DEBUG oslo_concurrency.lockutils [None req-310fa066-b341-487b-b783-bfe960a65a42 tempest-CreateVolumesFromImageTest-1245864730 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 16.790s {{(pid=83259) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 16 15:13:21 devstack cinder-volume[83259]: DEBUG cinder.volume.drivers.quobyte [None req-310fa066-b341-487b-b783-bfe960a65a42 tempest-CreateVolumesFromImageTest-1245864730 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-16T13:13:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-338268229',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#Quobyte',id=aa963c50-0bac-4ebd-89a7-09b1c1f4b3c6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='57100306065e40139c791ae050253ee5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-16T13:13:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-16T13:13:05Z,use_quota=True,user_id='49ec8541dd7241408704bc80d3eced0e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(485ead50-3df8-4d76-8d34-a4db136c980a),volume_type_id=485ead50-3df8-4d76-8d34-a4db136c980a)}" {{(pid=83259) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Sep 16 15:13:21 devstack cinder-volume[83259]: DEBUG cinder.volume.drivers.remotefs [None req-310fa066-b341-487b-b783-bfe960a65a42 tempest-CreateVolumesFromImageTest-1245864730 None] Creating volume aa963c50-0bac-4ebd-89a7-09b1c1f4b3c6 {{(pid=83259) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}} Sep 16 15:13:21 devstack cinder-volume[83259]: DEBUG oslo_concurrency.lockutils [None req-310fa066-b341-487b-b783-bfe960a65a42 tempest-CreateVolumesFromImageTest-1245864730 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83259) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 16 15:13:21 devstack cinder-volume[83259]: DEBUG oslo_concurrency.lockutils [None req-310fa066-b341-487b-b783-bfe960a65a42 tempest-CreateVolumesFromImageTest-1245864730 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=83259) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 16 15:13:21 devstack cinder-volume[83259]: DEBUG cinder.volume.drivers.quobyte [None req-310fa066-b341-487b-b783-bfe960a65a42 tempest-CreateVolumesFromImageTest-1245864730 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-61f585ac-f8e2-4d19-a890-7ebc2726cc72': None} {{(pid=83259) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:639}} Sep 16 15:13:21 devstack cinder-volume[83259]: DEBUG cinder.volume.drivers.quobyte [None req-310fa066-b341-487b-b783-bfe960a65a42 tempest-CreateVolumesFromImageTest-1245864730 None] Available shares ['10.10.41.181/cinder-vol-61f585ac-f8e2-4d19-a890-7ebc2726cc72'] {{(pid=83259) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:669}} Sep 16 15:13:21 devstack cinder-volume[83259]: DEBUG oslo_concurrency.lockutils [None req-310fa066-b341-487b-b783-bfe960a65a42 tempest-CreateVolumesFromImageTest-1245864730 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=83259) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 16 15:13:21 devstack cinder-volume[83259]: DEBUG cinder.volume.drivers.quobyte [None req-310fa066-b341-487b-b783-bfe960a65a42 tempest-CreateVolumesFromImageTest-1245864730 None] Selected 10.10.41.181/cinder-vol-61f585ac-f8e2-4d19-a890-7ebc2726cc72 as target Quobyte volume. {{(pid=83259) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:690}} Sep 16 15:13:21 devstack cinder-volume[83259]: INFO cinder.volume.drivers.remotefs [None req-310fa066-b341-487b-b783-bfe960a65a42 tempest-CreateVolumesFromImageTest-1245864730 None] casted to 10.10.41.181/cinder-vol-61f585ac-f8e2-4d19-a890-7ebc2726cc72 Sep 16 15:13:21 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [None req-310fa066-b341-487b-b783-bfe960a65a42 tempest-CreateVolumesFromImageTest-1245864730 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c/volume-aa963c50-0bac-4ebd-89a7-09b1c1f4b3c6 1073741824 {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 15:13:21 devstack quobyte-client[83286]: The server volume:87712ffe-8a69-446d-9ed6-4430c7ee9792@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=87712ffe-8a69-446d-9ed6-4430c7ee9792, inode=110, name=volume-aa963c50-0bac-4ebd-89a7-09b1c1f4b3c6, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.206), requestorAccessMask=0 Sep 16 15:13:22 devstack cinder-volume[83259]: DEBUG cinder.volume.manager [None req-502f01cb-c748-4291-9b9e-fc7849b15de4 tempest-CreateVolumesFromImageTest-1245864730 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9892f324-3581-487b-8a0b-29e925f15b08) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-371375cf-34a2-44da-940b-a1a3927ebcc0', 'volume_size': 1}' {{(pid=83259) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 15:13:22 devstack cinder-volume[83259]: DEBUG cinder.volume.manager [None req-502f01cb-c748-4291-9b9e-fc7849b15de4 tempest-CreateVolumesFromImageTest-1245864730 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9375f244-8114-4177-a17b-07cf3f0aac14) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83259) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 15:13:22 devstack cinder-volume[83259]: INFO cinder.volume.flows.manager.create_volume [None req-502f01cb-c748-4291-9b9e-fc7849b15de4 tempest-CreateVolumesFromImageTest-1245864730 None] Volume volume-371375cf-34a2-44da-940b-a1a3927ebcc0 (371375cf-34a2-44da-940b-a1a3927ebcc0): created successfully Sep 16 15:13:22 devstack cinder-volume[83259]: DEBUG cinder.volume.manager [None req-502f01cb-c748-4291-9b9e-fc7849b15de4 tempest-CreateVolumesFromImageTest-1245864730 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9375f244-8114-4177-a17b-07cf3f0aac14) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83259) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 15:13:22 devstack cinder-volume[83259]: DEBUG cinder.volume.manager [None req-502f01cb-c748-4291-9b9e-fc7849b15de4 tempest-CreateVolumesFromImageTest-1245864730 None] Flow 'volume_create_manager' (044f78b1-f11f-477a-8485-ad4f4bc0f98a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83259) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 16 15:13:22 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [None req-310fa066-b341-487b-b783-bfe960a65a42 tempest-CreateVolumesFromImageTest-1245864730 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c/volume-aa963c50-0bac-4ebd-89a7-09b1c1f4b3c6 1073741824" returned: 0 in 0.446s {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 15:13:22 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [None req-310fa066-b341-487b-b783-bfe960a65a42 tempest-CreateVolumesFromImageTest-1245864730 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c/volume-aa963c50-0bac-4ebd-89a7-09b1c1f4b3c6 {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 15:13:22 devstack cinder-volume[83259]: INFO cinder.volume.manager [None req-502f01cb-c748-4291-9b9e-fc7849b15de4 tempest-CreateVolumesFromImageTest-1245864730 None] Created volume successfully. Sep 16 15:13:22 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [None req-310fa066-b341-487b-b783-bfe960a65a42 tempest-CreateVolumesFromImageTest-1245864730 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c/volume-aa963c50-0bac-4ebd-89a7-09b1c1f4b3c6" returned: 0 in 0.248s {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 15:13:22 devstack cinder-volume[83259]: DEBUG cinder.volume.drivers.quobyte [None req-310fa066-b341-487b-b783-bfe960a65a42 tempest-CreateVolumesFromImageTest-1245864730 None] <== create_volume: return (720ms) {'provider_location': '10.10.41.181/cinder-vol-61f585ac-f8e2-4d19-a890-7ebc2726cc72'} {{(pid=83259) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Sep 16 15:13:22 devstack cinder-volume[83259]: DEBUG oslo_concurrency.lockutils [None req-310fa066-b341-487b-b783-bfe960a65a42 tempest-CreateVolumesFromImageTest-1245864730 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.740s {{(pid=83259) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 16 15:13:22 devstack cinder-volume[83259]: DEBUG oslo_concurrency.lockutils [None req-26366c8a-5eeb-4c0f-95d4-3a4807f007db tempest-VolumesActionsTest-296669149 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: waited 1.980s {{(pid=83259) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 16 15:13:22 devstack cinder-volume[83259]: DEBUG cinder.volume.manager [None req-310fa066-b341-487b-b783-bfe960a65a42 tempest-CreateVolumesFromImageTest-1245864730 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cf0a06b6-e69e-4abc-b03f-deaaad04afeb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-aa963c50-0bac-4ebd-89a7-09b1c1f4b3c6', 'volume_size': 1}' {{(pid=83259) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 15:13:22 devstack cinder-volume[83259]: DEBUG cinder.volume.manager [None req-310fa066-b341-487b-b783-bfe960a65a42 tempest-CreateVolumesFromImageTest-1245864730 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d1d2138e-8a89-45f1-b738-cdf9193342b8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83259) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 15:13:22 devstack cinder-volume[83259]: DEBUG oslo.privsep.daemon [-] privsep: reply[733be6fa-e077-4f0f-bafa-30c31cc6aa0b]: (4, 'qcow2') {{(pid=84312) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 16 15:13:22 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [None req-26366c8a-5eeb-4c0f-95d4-3a4807f007db tempest-VolumesActionsTest-296669149 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c/volume-c07f5ce2-165d-42b6-806a-af27abe6db99 {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 15:13:22 devstack cinder-volume[83259]: INFO cinder.volume.flows.manager.create_volume [None req-310fa066-b341-487b-b783-bfe960a65a42 tempest-CreateVolumesFromImageTest-1245864730 None] Volume volume-aa963c50-0bac-4ebd-89a7-09b1c1f4b3c6 (aa963c50-0bac-4ebd-89a7-09b1c1f4b3c6): created successfully Sep 16 15:13:23 devstack cinder-volume[83259]: DEBUG cinder.volume.manager [None req-310fa066-b341-487b-b783-bfe960a65a42 tempest-CreateVolumesFromImageTest-1245864730 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d1d2138e-8a89-45f1-b738-cdf9193342b8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83259) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 15:13:23 devstack cinder-volume[83259]: DEBUG cinder.volume.manager [None req-310fa066-b341-487b-b783-bfe960a65a42 tempest-CreateVolumesFromImageTest-1245864730 None] Flow 'volume_create_manager' (039d5d12-88ec-49a2-b87a-d3cf0b9b1ea6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83259) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 16 15:13:23 devstack cinder-volume[83259]: INFO cinder.volume.manager [None req-310fa066-b341-487b-b783-bfe960a65a42 tempest-CreateVolumesFromImageTest-1245864730 None] Created volume successfully. Sep 16 15:13:23 devstack quobyte-client[83286]: System call of process 96375 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 16 15:13:23 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [None req-26366c8a-5eeb-4c0f-95d4-3a4807f007db tempest-VolumesActionsTest-296669149 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c/volume-c07f5ce2-165d-42b6-806a-af27abe6db99" returned: 0 in 0.735s {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 15:13:23 devstack cinder-volume[83259]: DEBUG oslo.privsep.daemon [-] privsep: reply[72ab0813-d13e-4cbc-b1f0-e4fe38a06f24]: (4, 'qcow2') {{(pid=84312) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 16 15:13:23 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [None req-26366c8a-5eeb-4c0f-95d4-3a4807f007db tempest-VolumesActionsTest-296669149 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c/volume-c07f5ce2-165d-42b6-806a-af27abe6db99 {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 15:13:23 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [None req-26366c8a-5eeb-4c0f-95d4-3a4807f007db tempest-VolumesActionsTest-296669149 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c/volume-c07f5ce2-165d-42b6-806a-af27abe6db99" returned: 0 in 0.448s {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 15:13:24 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [None req-26366c8a-5eeb-4c0f-95d4-3a4807f007db tempest-VolumesActionsTest-296669149 None] Running cmd (subprocess): qemu-img convert -O raw /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c/volume-c07f5ce2-165d-42b6-806a-af27abe6db99 /opt/stack/data/cinder/conversion/c07f5ce2-165d-42b6-806a-af27abe6db99.temp_image.dd8ddf40-b09f-4563-8e34-d52693c8d948srf6xv83.img {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 15:13:24 devstack quobyte-client[83286]: System call of process 96403 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 16 15:13:24 devstack cinder-volume[83259]: DEBUG cinder.coordination [None req-4f65803b-6c07-43e3-93ef-baa3456ac8eb tempest-CreateVolumesFromImageTest-1245864730 None] Acquiring lock "cinder-aa963c50-0bac-4ebd-89a7-09b1c1f4b3c6-delete_volume" by "delete_volume" {{(pid=83259) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 16 15:13:24 devstack cinder-volume[83259]: DEBUG cinder.coordination [None req-4f65803b-6c07-43e3-93ef-baa3456ac8eb tempest-CreateVolumesFromImageTest-1245864730 None] Lock "cinder-aa963c50-0bac-4ebd-89a7-09b1c1f4b3c6-delete_volume" acquired by "delete_volume" :: waited 0.137s {{(pid=83259) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 16 15:13:25 devstack cinder-volume[83259]: WARNING cinder.volume.volume_utils [None req-4f65803b-6c07-43e3-93ef-baa3456ac8eb tempest-CreateVolumesFromImageTest-1245864730 None] Volume driver (QuobyteDriver 1.2) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 16 15:13:25 devstack cinder-volume[83259]: DEBUG cinder.coordination [None req-4f65803b-6c07-43e3-93ef-baa3456ac8eb tempest-CreateVolumesFromImageTest-1245864730 None] Acquiring lock "cinder-quobyte-aa963c50-0bac-4ebd-89a7-09b1c1f4b3c6" by "delete_volume" {{(pid=83259) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 16 15:13:25 devstack cinder-volume[83259]: DEBUG cinder.coordination [None req-4f65803b-6c07-43e3-93ef-baa3456ac8eb tempest-CreateVolumesFromImageTest-1245864730 None] Lock "cinder-quobyte-aa963c50-0bac-4ebd-89a7-09b1c1f4b3c6" acquired by "delete_volume" :: waited 0.061s {{(pid=83259) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 16 15:13:25 devstack cinder-volume[83259]: DEBUG oslo.privsep.daemon [-] privsep: reply[feeac77a-e000-4f9b-9b40-6adfce7a2c74]: (4, 'qcow2') {{(pid=84312) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 16 15:13:25 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [None req-4f65803b-6c07-43e3-93ef-baa3456ac8eb tempest-CreateVolumesFromImageTest-1245864730 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c/volume-aa963c50-0bac-4ebd-89a7-09b1c1f4b3c6 {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 15:13:26 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [None req-4f65803b-6c07-43e3-93ef-baa3456ac8eb tempest-CreateVolumesFromImageTest-1245864730 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c/volume-aa963c50-0bac-4ebd-89a7-09b1c1f4b3c6" returned: 0 in 1.195s {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 15:13:26 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [None req-4f65803b-6c07-43e3-93ef-baa3456ac8eb tempest-CreateVolumesFromImageTest-1245864730 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c/volume-aa963c50-0bac-4ebd-89a7-09b1c1f4b3c6 {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 15:13:27 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [None req-4f65803b-6c07-43e3-93ef-baa3456ac8eb tempest-CreateVolumesFromImageTest-1245864730 None] CMD "rm -f /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c/volume-aa963c50-0bac-4ebd-89a7-09b1c1f4b3c6" returned: 0 in 0.381s {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 15:13:27 devstack cinder-volume[83259]: DEBUG cinder.coordination [None req-4f65803b-6c07-43e3-93ef-baa3456ac8eb tempest-CreateVolumesFromImageTest-1245864730 None] Lock "cinder-quobyte-aa963c50-0bac-4ebd-89a7-09b1c1f4b3c6" released by "delete_volume" :: held 2.040s {{(pid=83259) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 16 15:13:28 devstack cinder-volume[83259]: DEBUG cinder.quota [None req-4f65803b-6c07-43e3-93ef-baa3456ac8eb tempest-CreateVolumesFromImageTest-1245864730 None] Created reservations ['02322273-952c-4109-b437-812033512b2d', '4876841e-8c8e-4de5-9e8f-f002536791b3', 'b9290af9-e67e-4af4-9b5d-e189e1d0a74b', '878dc7d5-d9aa-4c53-a013-4673e43253a9'] {{(pid=83259) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 16 15:13:29 devstack cinder-volume[83259]: DEBUG oslo_concurrency.lockutils [None req-4f65803b-6c07-43e3-93ef-baa3456ac8eb tempest-CreateVolumesFromImageTest-1245864730 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83259) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 16 15:13:29 devstack cinder-volume[83259]: DEBUG oslo_concurrency.lockutils [None req-4f65803b-6c07-43e3-93ef-baa3456ac8eb tempest-CreateVolumesFromImageTest-1245864730 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.006s {{(pid=83259) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 16 15:13:29 devstack cinder-volume[83259]: DEBUG cinder.volume.drivers.quobyte [None req-4f65803b-6c07-43e3-93ef-baa3456ac8eb tempest-CreateVolumesFromImageTest-1245864730 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-61f585ac-f8e2-4d19-a890-7ebc2726cc72': None} {{(pid=83259) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:639}} Sep 16 15:13:29 devstack cinder-volume[83259]: DEBUG cinder.volume.drivers.quobyte [None req-4f65803b-6c07-43e3-93ef-baa3456ac8eb tempest-CreateVolumesFromImageTest-1245864730 None] Available shares ['10.10.41.181/cinder-vol-61f585ac-f8e2-4d19-a890-7ebc2726cc72'] {{(pid=83259) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:669}} Sep 16 15:13:29 devstack cinder-volume[83259]: DEBUG oslo_concurrency.lockutils [None req-4f65803b-6c07-43e3-93ef-baa3456ac8eb tempest-CreateVolumesFromImageTest-1245864730 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=83259) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 16 15:13:29 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [None req-4f65803b-6c07-43e3-93ef-baa3456ac8eb tempest-CreateVolumesFromImageTest-1245864730 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 15:13:29 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [None req-4f65803b-6c07-43e3-93ef-baa3456ac8eb tempest-CreateVolumesFromImageTest-1245864730 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c" returned: 0 in 0.324s {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 15:13:29 devstack cinder-volume[83259]: DEBUG cinder.manager [None req-4f65803b-6c07-43e3-93ef-baa3456ac8eb tempest-CreateVolumesFromImageTest-1245864730 None] Notifying Schedulers of capabilities ... {{(pid=83259) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 16 15:13:29 devstack cinder-volume[83259]: INFO cinder.volume.manager [None req-4f65803b-6c07-43e3-93ef-baa3456ac8eb tempest-CreateVolumesFromImageTest-1245864730 None] Deleted volume successfully. Sep 16 15:13:30 devstack cinder-volume[83259]: DEBUG cinder.coordination [None req-f9ce8d55-c0aa-46ac-8a17-9d8c884420c7 tempest-CreateVolumesFromImageTest-1245864730 None] Acquiring lock "cinder-371375cf-34a2-44da-940b-a1a3927ebcc0-delete_volume" by "delete_volume" {{(pid=83259) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 16 15:13:30 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [None req-26366c8a-5eeb-4c0f-95d4-3a4807f007db tempest-VolumesActionsTest-296669149 None] CMD "qemu-img convert -O raw /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c/volume-c07f5ce2-165d-42b6-806a-af27abe6db99 /opt/stack/data/cinder/conversion/c07f5ce2-165d-42b6-806a-af27abe6db99.temp_image.dd8ddf40-b09f-4563-8e34-d52693c8d948srf6xv83.img" returned: 0 in 6.250s {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 15:13:30 devstack cinder-volume[83259]: DEBUG cinder.coordination [None req-4f65803b-6c07-43e3-93ef-baa3456ac8eb tempest-CreateVolumesFromImageTest-1245864730 None] Lock "cinder-aa963c50-0bac-4ebd-89a7-09b1c1f4b3c6-delete_volume" released by "delete_volume" :: held 5.786s {{(pid=83259) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 16 15:13:30 devstack cinder-volume[83259]: DEBUG oslo.privsep.daemon [-] privsep: reply[230440db-f320-40a1-95a2-762a00235328]: (4, 'qcow2') {{(pid=84312) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 16 15:13:30 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [None req-26366c8a-5eeb-4c0f-95d4-3a4807f007db tempest-VolumesActionsTest-296669149 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c/volume-c07f5ce2-165d-42b6-806a-af27abe6db99 {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 15:13:30 devstack cinder-volume[83259]: DEBUG cinder.coordination [None req-f9ce8d55-c0aa-46ac-8a17-9d8c884420c7 tempest-CreateVolumesFromImageTest-1245864730 None] Lock "cinder-371375cf-34a2-44da-940b-a1a3927ebcc0-delete_volume" acquired by "delete_volume" :: waited 0.287s {{(pid=83259) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 16 15:13:30 devstack cinder-volume[83259]: WARNING cinder.volume.volume_utils [None req-f9ce8d55-c0aa-46ac-8a17-9d8c884420c7 tempest-CreateVolumesFromImageTest-1245864730 None] Volume driver (QuobyteDriver 1.2) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 16 15:13:30 devstack cinder-volume[83259]: DEBUG cinder.coordination [None req-f9ce8d55-c0aa-46ac-8a17-9d8c884420c7 tempest-CreateVolumesFromImageTest-1245864730 None] Acquiring lock "cinder-quobyte-371375cf-34a2-44da-940b-a1a3927ebcc0" by "delete_volume" {{(pid=83259) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 16 15:13:31 devstack cinder-volume[83259]: DEBUG cinder.coordination [None req-f9ce8d55-c0aa-46ac-8a17-9d8c884420c7 tempest-CreateVolumesFromImageTest-1245864730 None] Lock "cinder-quobyte-371375cf-34a2-44da-940b-a1a3927ebcc0" acquired by "delete_volume" :: waited 0.093s {{(pid=83259) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 16 15:13:31 devstack cinder-volume[83259]: DEBUG oslo.privsep.daemon [-] privsep: reply[e0be0325-df00-4d4b-a487-afde7ca7db16]: (4, 'qcow2') {{(pid=84312) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 16 15:13:31 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [None req-f9ce8d55-c0aa-46ac-8a17-9d8c884420c7 tempest-CreateVolumesFromImageTest-1245864730 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c/volume-371375cf-34a2-44da-940b-a1a3927ebcc0 {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 15:13:31 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [None req-26366c8a-5eeb-4c0f-95d4-3a4807f007db tempest-VolumesActionsTest-296669149 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c/volume-c07f5ce2-165d-42b6-806a-af27abe6db99" returned: 0 in 1.051s {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 15:13:31 devstack cinder-volume[83259]: DEBUG cinder.image.image_utils [None req-26366c8a-5eeb-4c0f-95d4-3a4807f007db tempest-VolumesActionsTest-296669149 None] Image conversion details: src /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c/volume-c07f5ce2-165d-42b6-806a-af27abe6db99, size 1024.00 MB, duration 6.29 sec, destination /opt/stack/data/cinder/conversion/c07f5ce2-165d-42b6-806a-af27abe6db99.temp_image.dd8ddf40-b09f-4563-8e34-d52693c8d948srf6xv83.img {{(pid=83259) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:501}} Sep 16 15:13:31 devstack cinder-volume[83259]: INFO cinder.image.image_utils [None req-26366c8a-5eeb-4c0f-95d4-3a4807f007db tempest-VolumesActionsTest-296669149 None] Converted 1024.00 MB image at 162.73 MB/s Sep 16 15:13:31 devstack cinder-volume[83259]: DEBUG cinder.image.image_utils [None req-26366c8a-5eeb-4c0f-95d4-3a4807f007db tempest-VolumesActionsTest-296669149 None] dd8ddf40-b09f-4563-8e34-d52693c8d948 was raw, converting to qcow2 {{(pid=83259) upload_volume /opt/stack/cinder/cinder/image/image_utils.py:1144}} Sep 16 15:13:31 devstack cinder-volume[83259]: DEBUG oslo.privsep.daemon [-] privsep: reply[024a06ce-5692-47ba-81f0-9bda9a02b5d1]: (4, 'raw') {{(pid=84312) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 16 15:13:31 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [None req-26366c8a-5eeb-4c0f-95d4-3a4807f007db tempest-VolumesActionsTest-296669149 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/c07f5ce2-165d-42b6-806a-af27abe6db99.temp_image.dd8ddf40-b09f-4563-8e34-d52693c8d948srf6xv83.img {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 15:13:31 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [None req-f9ce8d55-c0aa-46ac-8a17-9d8c884420c7 tempest-CreateVolumesFromImageTest-1245864730 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c/volume-371375cf-34a2-44da-940b-a1a3927ebcc0" returned: 0 in 0.662s {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 15:13:31 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [None req-f9ce8d55-c0aa-46ac-8a17-9d8c884420c7 tempest-CreateVolumesFromImageTest-1245864730 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c/volume-371375cf-34a2-44da-940b-a1a3927ebcc0 {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 15:13:31 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [None req-f9ce8d55-c0aa-46ac-8a17-9d8c884420c7 tempest-CreateVolumesFromImageTest-1245864730 None] CMD "rm -f /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c/volume-371375cf-34a2-44da-940b-a1a3927ebcc0" returned: 0 in 0.127s {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 15:13:32 devstack cinder-volume[83259]: DEBUG cinder.coordination [None req-f9ce8d55-c0aa-46ac-8a17-9d8c884420c7 tempest-CreateVolumesFromImageTest-1245864730 None] Lock "cinder-quobyte-371375cf-34a2-44da-940b-a1a3927ebcc0" released by "delete_volume" :: held 1.003s {{(pid=83259) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 16 15:13:32 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [None req-26366c8a-5eeb-4c0f-95d4-3a4807f007db tempest-VolumesActionsTest-296669149 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/c07f5ce2-165d-42b6-806a-af27abe6db99.temp_image.dd8ddf40-b09f-4563-8e34-d52693c8d948srf6xv83.img" returned: 0 in 0.657s {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 15:13:32 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [None req-26366c8a-5eeb-4c0f-95d4-3a4807f007db tempest-VolumesActionsTest-296669149 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/c07f5ce2-165d-42b6-806a-af27abe6db99.temp_image.dd8ddf40-b09f-4563-8e34-d52693c8d948srf6xv83.img {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 15:13:32 devstack cinder-volume[83259]: DEBUG cinder.quota [None req-f9ce8d55-c0aa-46ac-8a17-9d8c884420c7 tempest-CreateVolumesFromImageTest-1245864730 None] Created reservations ['75c21e78-e76f-4133-8871-cf0147d19c92', '01b86ecb-c779-4857-b589-efd17e8f06f0', '150cb524-68ae-45e3-b0e0-a7b7d8195d56', '6305b1d3-daa8-406d-8aa6-0a6cc12dce68'] {{(pid=83259) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 16 15:13:32 devstack cinder-volume[83259]: DEBUG oslo_concurrency.lockutils [None req-f9ce8d55-c0aa-46ac-8a17-9d8c884420c7 tempest-CreateVolumesFromImageTest-1245864730 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83259) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 16 15:13:32 devstack cinder-volume[83259]: DEBUG oslo_concurrency.lockutils [None req-f9ce8d55-c0aa-46ac-8a17-9d8c884420c7 tempest-CreateVolumesFromImageTest-1245864730 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.005s {{(pid=83259) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 16 15:13:32 devstack cinder-volume[83259]: DEBUG cinder.volume.drivers.quobyte [None req-f9ce8d55-c0aa-46ac-8a17-9d8c884420c7 tempest-CreateVolumesFromImageTest-1245864730 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-61f585ac-f8e2-4d19-a890-7ebc2726cc72': None} {{(pid=83259) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:639}} Sep 16 15:13:32 devstack cinder-volume[83259]: DEBUG cinder.volume.drivers.quobyte [None req-f9ce8d55-c0aa-46ac-8a17-9d8c884420c7 tempest-CreateVolumesFromImageTest-1245864730 None] Available shares ['10.10.41.181/cinder-vol-61f585ac-f8e2-4d19-a890-7ebc2726cc72'] {{(pid=83259) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:669}} Sep 16 15:13:32 devstack cinder-volume[83259]: DEBUG oslo_concurrency.lockutils [None req-f9ce8d55-c0aa-46ac-8a17-9d8c884420c7 tempest-CreateVolumesFromImageTest-1245864730 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=83259) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 16 15:13:32 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [None req-f9ce8d55-c0aa-46ac-8a17-9d8c884420c7 tempest-CreateVolumesFromImageTest-1245864730 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 15:13:32 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [None req-26366c8a-5eeb-4c0f-95d4-3a4807f007db tempest-VolumesActionsTest-296669149 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/c07f5ce2-165d-42b6-806a-af27abe6db99.temp_image.dd8ddf40-b09f-4563-8e34-d52693c8d948srf6xv83.img" returned: 1 in 0.624s {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 15:13:32 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [None req-26366c8a-5eeb-4c0f-95d4-3a4807f007db tempest-VolumesActionsTest-296669149 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/c07f5ce2-165d-42b6-806a-af27abe6db99.temp_image.dd8ddf40-b09f-4563-8e34-d52693c8d948srf6xv83.img' failed. Not Retrying. {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:423}} Sep 16 15:13:33 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [None req-26366c8a-5eeb-4c0f-95d4-3a4807f007db tempest-VolumesActionsTest-296669149 None] Running cmd (subprocess): qemu-img convert -O qcow2 -c /opt/stack/data/cinder/conversion/c07f5ce2-165d-42b6-806a-af27abe6db99.temp_image.dd8ddf40-b09f-4563-8e34-d52693c8d948srf6xv83.img /opt/stack/data/cinder/conversion/vol_upload_bwopwh0u {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 15:13:33 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [None req-f9ce8d55-c0aa-46ac-8a17-9d8c884420c7 tempest-CreateVolumesFromImageTest-1245864730 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c" returned: 0 in 0.291s {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 15:13:33 devstack cinder-volume[83259]: DEBUG cinder.manager [None req-f9ce8d55-c0aa-46ac-8a17-9d8c884420c7 tempest-CreateVolumesFromImageTest-1245864730 None] Notifying Schedulers of capabilities ... {{(pid=83259) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 16 15:13:33 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [None req-26366c8a-5eeb-4c0f-95d4-3a4807f007db tempest-VolumesActionsTest-296669149 None] CMD "qemu-img convert -O qcow2 -c /opt/stack/data/cinder/conversion/c07f5ce2-165d-42b6-806a-af27abe6db99.temp_image.dd8ddf40-b09f-4563-8e34-d52693c8d948srf6xv83.img /opt/stack/data/cinder/conversion/vol_upload_bwopwh0u" returned: 0 in 0.256s {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 15:13:33 devstack cinder-volume[83259]: DEBUG cinder.image.image_utils [None req-26366c8a-5eeb-4c0f-95d4-3a4807f007db tempest-VolumesActionsTest-296669149 None] Image conversion details: src /opt/stack/data/cinder/conversion/c07f5ce2-165d-42b6-806a-af27abe6db99.temp_image.dd8ddf40-b09f-4563-8e34-d52693c8d948srf6xv83.img, size 1024.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/conversion/vol_upload_bwopwh0u {{(pid=83259) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:501}} Sep 16 15:13:33 devstack cinder-volume[83259]: INFO cinder.image.image_utils [None req-26366c8a-5eeb-4c0f-95d4-3a4807f007db tempest-VolumesActionsTest-296669149 None] Converted 1024.00 MB image at 1024.00 MB/s Sep 16 15:13:33 devstack cinder-volume[83259]: INFO cinder.volume.manager [None req-f9ce8d55-c0aa-46ac-8a17-9d8c884420c7 tempest-CreateVolumesFromImageTest-1245864730 None] Deleted volume successfully. Sep 16 15:13:33 devstack cinder-volume[83259]: DEBUG oslo.privsep.daemon [-] privsep: reply[751f921f-9761-4342-800f-aa52e7a10800]: (4, 'qcow2') {{(pid=84312) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 16 15:13:33 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [None req-26366c8a-5eeb-4c0f-95d4-3a4807f007db tempest-VolumesActionsTest-296669149 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/vol_upload_bwopwh0u {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 15:13:33 devstack cinder-volume[83259]: DEBUG cinder.coordination [None req-38420661-5d3f-41f1-8241-40b52aae69d5 tempest-CreateVolumesFromImageTest-1245864730 None] Acquiring lock "cinder-a1861ecb-7997-445c-932d-b787ca98585e-delete_volume" by "delete_volume" {{(pid=83259) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 16 15:13:33 devstack cinder-volume[83259]: DEBUG cinder.coordination [None req-f9ce8d55-c0aa-46ac-8a17-9d8c884420c7 tempest-CreateVolumesFromImageTest-1245864730 None] Lock "cinder-371375cf-34a2-44da-940b-a1a3927ebcc0-delete_volume" released by "delete_volume" :: held 3.369s {{(pid=83259) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 16 15:13:33 devstack cinder-volume[83259]: DEBUG cinder.coordination [None req-38420661-5d3f-41f1-8241-40b52aae69d5 tempest-CreateVolumesFromImageTest-1245864730 None] Lock "cinder-a1861ecb-7997-445c-932d-b787ca98585e-delete_volume" acquired by "delete_volume" :: waited 0.173s {{(pid=83259) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 16 15:13:34 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [None req-26366c8a-5eeb-4c0f-95d4-3a4807f007db tempest-VolumesActionsTest-296669149 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/vol_upload_bwopwh0u" returned: 0 in 0.593s {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 15:13:34 devstack cinder-volume[83259]: WARNING cinder.volume.volume_utils [None req-38420661-5d3f-41f1-8241-40b52aae69d5 tempest-CreateVolumesFromImageTest-1245864730 None] Volume driver (QuobyteDriver 1.2) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 16 15:13:34 devstack cinder-volume[83259]: DEBUG cinder.coordination [None req-38420661-5d3f-41f1-8241-40b52aae69d5 tempest-CreateVolumesFromImageTest-1245864730 None] Acquiring lock "cinder-quobyte-a1861ecb-7997-445c-932d-b787ca98585e" by "delete_volume" {{(pid=83259) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 16 15:13:34 devstack cinder-volume[83259]: DEBUG cinder.coordination [None req-38420661-5d3f-41f1-8241-40b52aae69d5 tempest-CreateVolumesFromImageTest-1245864730 None] Lock "cinder-quobyte-a1861ecb-7997-445c-932d-b787ca98585e" acquired by "delete_volume" :: waited 0.018s {{(pid=83259) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 16 15:13:34 devstack cinder-volume[83259]: DEBUG oslo.privsep.daemon [-] privsep: reply[8d5354c6-b685-468b-b864-1efca3a45821]: (4, 'qcow2') {{(pid=84312) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 16 15:13:34 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [None req-38420661-5d3f-41f1-8241-40b52aae69d5 tempest-CreateVolumesFromImageTest-1245864730 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c/volume-a1861ecb-7997-445c-932d-b787ca98585e {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 15:13:34 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [None req-38420661-5d3f-41f1-8241-40b52aae69d5 tempest-CreateVolumesFromImageTest-1245864730 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c/volume-a1861ecb-7997-445c-932d-b787ca98585e" returned: 0 in 0.508s {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 15:13:34 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [None req-38420661-5d3f-41f1-8241-40b52aae69d5 tempest-CreateVolumesFromImageTest-1245864730 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c/volume-a1861ecb-7997-445c-932d-b787ca98585e {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 15:13:34 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [None req-38420661-5d3f-41f1-8241-40b52aae69d5 tempest-CreateVolumesFromImageTest-1245864730 None] CMD "rm -f /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c/volume-a1861ecb-7997-445c-932d-b787ca98585e" returned: 0 in 0.106s {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 15:13:34 devstack cinder-volume[83259]: DEBUG cinder.coordination [None req-38420661-5d3f-41f1-8241-40b52aae69d5 tempest-CreateVolumesFromImageTest-1245864730 None] Lock "cinder-quobyte-a1861ecb-7997-445c-932d-b787ca98585e" released by "delete_volume" :: held 0.802s {{(pid=83259) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 16 15:13:35 devstack cinder-volume[83259]: DEBUG cinder.quota [None req-38420661-5d3f-41f1-8241-40b52aae69d5 tempest-CreateVolumesFromImageTest-1245864730 None] Created reservations ['393da296-0d39-42b2-9656-c9ef385de5dc', 'ec301016-a914-4328-9e26-2477bdfb323c', '684a15af-f545-4c8f-a1fa-ef6d40092b18', '71c37f4c-c31a-4b5f-a8aa-ce992a9837d7'] {{(pid=83259) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 16 15:13:35 devstack cinder-volume[83259]: DEBUG oslo_concurrency.lockutils [None req-38420661-5d3f-41f1-8241-40b52aae69d5 tempest-CreateVolumesFromImageTest-1245864730 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83259) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 16 15:13:35 devstack cinder-volume[83259]: DEBUG oslo_concurrency.lockutils [None req-38420661-5d3f-41f1-8241-40b52aae69d5 tempest-CreateVolumesFromImageTest-1245864730 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=83259) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 16 15:13:35 devstack cinder-volume[83259]: DEBUG cinder.volume.drivers.quobyte [None req-38420661-5d3f-41f1-8241-40b52aae69d5 tempest-CreateVolumesFromImageTest-1245864730 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-61f585ac-f8e2-4d19-a890-7ebc2726cc72': None} {{(pid=83259) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:639}} Sep 16 15:13:35 devstack cinder-volume[83259]: DEBUG cinder.volume.drivers.quobyte [None req-38420661-5d3f-41f1-8241-40b52aae69d5 tempest-CreateVolumesFromImageTest-1245864730 None] Available shares ['10.10.41.181/cinder-vol-61f585ac-f8e2-4d19-a890-7ebc2726cc72'] {{(pid=83259) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:669}} Sep 16 15:13:35 devstack cinder-volume[83259]: DEBUG oslo_concurrency.lockutils [None req-38420661-5d3f-41f1-8241-40b52aae69d5 tempest-CreateVolumesFromImageTest-1245864730 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=83259) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 16 15:13:35 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [None req-38420661-5d3f-41f1-8241-40b52aae69d5 tempest-CreateVolumesFromImageTest-1245864730 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 15:13:35 devstack cinder-volume[83259]: DEBUG oslo_concurrency.lockutils [None req-26366c8a-5eeb-4c0f-95d4-3a4807f007db tempest-VolumesActionsTest-296669149 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: held 13.419s {{(pid=83259) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 16 15:13:36 devstack cinder-volume[83259]: DEBUG cinder.volume.manager [None req-26366c8a-5eeb-4c0f-95d4-3a4807f007db tempest-VolumesActionsTest-296669149 None] Uploaded volume to glance image-id: dd8ddf40-b09f-4563-8e34-d52693c8d948. {{(pid=83259) copy_volume_to_image /opt/stack/cinder/cinder/volume/manager.py:1780}} Sep 16 15:13:36 devstack cinder-volume[83259]: DEBUG oslo_concurrency.lockutils [None req-56f13465-4088-4334-bd02-fe8178f5fa15 tempest-VolumesSnapshotListTestJSON-248203627 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 15.621s {{(pid=83259) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 16 15:13:36 devstack cinder-volume[83259]: INFO cinder.volume.manager [None req-26366c8a-5eeb-4c0f-95d4-3a4807f007db tempest-VolumesActionsTest-296669149 None] Copy volume to image completed successfully. Sep 16 15:13:36 devstack cinder-volume[83259]: DEBUG cinder.volume.drivers.remotefs [None req-56f13465-4088-4334-bd02-fe8178f5fa15 tempest-VolumesSnapshotListTestJSON-248203627 None] Creating offline snapshot 0372b193-39a5-4cc5-b188-e72fdea25759 of volume 68324198-e4bf-4e89-934a-b125055ec9ed {{(pid=83259) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1694}} Sep 16 15:13:36 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [None req-38420661-5d3f-41f1-8241-40b52aae69d5 tempest-CreateVolumesFromImageTest-1245864730 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c" returned: 0 in 0.478s {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 15:13:36 devstack cinder-volume[83259]: DEBUG cinder.manager [None req-38420661-5d3f-41f1-8241-40b52aae69d5 tempest-CreateVolumesFromImageTest-1245864730 None] Notifying Schedulers of capabilities ... {{(pid=83259) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 16 15:13:36 devstack cinder-volume[83259]: INFO cinder.volume.manager [None req-38420661-5d3f-41f1-8241-40b52aae69d5 tempest-CreateVolumesFromImageTest-1245864730 None] Deleted volume successfully. Sep 16 15:13:36 devstack cinder-volume[83259]: DEBUG oslo.privsep.daemon [-] privsep: reply[fa8b1644-00bc-4e55-9684-fa04b8771636]: (4, 'qcow2') {{(pid=84312) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 16 15:13:36 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [None req-56f13465-4088-4334-bd02-fe8178f5fa15 tempest-VolumesSnapshotListTestJSON-248203627 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c/volume-68324198-e4bf-4e89-934a-b125055ec9ed {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 15:13:36 devstack cinder-volume[83259]: DEBUG cinder.coordination [None req-38420661-5d3f-41f1-8241-40b52aae69d5 tempest-CreateVolumesFromImageTest-1245864730 None] Lock "cinder-a1861ecb-7997-445c-932d-b787ca98585e-delete_volume" released by "delete_volume" :: held 2.780s {{(pid=83259) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 16 15:13:36 devstack cinder-volume[83259]: DEBUG cinder.coordination [None req-6c28953f-5a4b-4a42-8bc6-868be6ef27b9 tempest-CreateVolumesFromImageTest-1245864730 None] Acquiring lock "cinder-9d18bf7e-2e8a-413d-b930-926000cd0930-delete_volume" by "delete_volume" {{(pid=83259) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 16 15:13:37 devstack cinder-volume[83259]: DEBUG cinder.coordination [None req-6c28953f-5a4b-4a42-8bc6-868be6ef27b9 tempest-CreateVolumesFromImageTest-1245864730 None] Lock "cinder-9d18bf7e-2e8a-413d-b930-926000cd0930-delete_volume" acquired by "delete_volume" :: waited 0.068s {{(pid=83259) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 16 15:13:37 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [None req-56f13465-4088-4334-bd02-fe8178f5fa15 tempest-VolumesSnapshotListTestJSON-248203627 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c/volume-68324198-e4bf-4e89-934a-b125055ec9ed" returned: 0 in 0.766s {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 15:13:37 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [None req-56f13465-4088-4334-bd02-fe8178f5fa15 tempest-VolumesSnapshotListTestJSON-248203627 None] Running cmd (subprocess): qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c/volume-68324198-e4bf-4e89-934a-b125055ec9ed,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c/volume-68324198-e4bf-4e89-934a-b125055ec9ed.0372b193-39a5-4cc5-b188-e72fdea25759 1G {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 15:13:37 devstack quobyte-client[83286]: System call of process 96451 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 16 15:13:37 devstack quobyte-client[83286]: The server volume:87712ffe-8a69-446d-9ed6-4430c7ee9792@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=87712ffe-8a69-446d-9ed6-4430c7ee9792, inode=111, name=volume-68324198-e4bf-4e89-934a-b125055ec9ed.0372b193-39a5-4cc5-b188-e72fdea25759, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.206), requestorAccessMask=0 Sep 16 15:13:37 devstack cinder-volume[83259]: DEBUG cinder.coordination [None req-14c98242-6fa2-4b9b-a09c-693a103ed428 tempest-VolumesActionsTest-296669149 None] Acquiring lock "cinder-c07f5ce2-165d-42b6-806a-af27abe6db99-delete_volume" by "delete_volume" {{(pid=83259) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 16 15:13:37 devstack cinder-volume[83259]: WARNING cinder.volume.volume_utils [None req-6c28953f-5a4b-4a42-8bc6-868be6ef27b9 tempest-CreateVolumesFromImageTest-1245864730 None] Volume driver (QuobyteDriver 1.2) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 16 15:13:37 devstack cinder-volume[83259]: DEBUG cinder.coordination [None req-6c28953f-5a4b-4a42-8bc6-868be6ef27b9 tempest-CreateVolumesFromImageTest-1245864730 None] Acquiring lock "cinder-quobyte-9d18bf7e-2e8a-413d-b930-926000cd0930" by "delete_volume" {{(pid=83259) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 16 15:13:37 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [None req-56f13465-4088-4334-bd02-fe8178f5fa15 tempest-VolumesSnapshotListTestJSON-248203627 None] CMD "qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c/volume-68324198-e4bf-4e89-934a-b125055ec9ed,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c/volume-68324198-e4bf-4e89-934a-b125055ec9ed.0372b193-39a5-4cc5-b188-e72fdea25759 1G" returned: 0 in 0.639s {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 15:13:37 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [None req-56f13465-4088-4334-bd02-fe8178f5fa15 tempest-VolumesSnapshotListTestJSON-248203627 None] Running cmd (subprocess): qemu-img rebase -u -b volume-68324198-e4bf-4e89-934a-b125055ec9ed -F qcow2 /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c/volume-68324198-e4bf-4e89-934a-b125055ec9ed.0372b193-39a5-4cc5-b188-e72fdea25759 {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 15:13:37 devstack cinder-volume[83259]: DEBUG cinder.coordination [None req-14c98242-6fa2-4b9b-a09c-693a103ed428 tempest-VolumesActionsTest-296669149 None] Lock "cinder-c07f5ce2-165d-42b6-806a-af27abe6db99-delete_volume" acquired by "delete_volume" :: waited 0.291s {{(pid=83259) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 16 15:13:38 devstack cinder-volume[83259]: DEBUG cinder.coordination [None req-6c28953f-5a4b-4a42-8bc6-868be6ef27b9 tempest-CreateVolumesFromImageTest-1245864730 None] Lock "cinder-quobyte-9d18bf7e-2e8a-413d-b930-926000cd0930" acquired by "delete_volume" :: waited 0.367s {{(pid=83259) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 16 15:13:38 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [None req-56f13465-4088-4334-bd02-fe8178f5fa15 tempest-VolumesSnapshotListTestJSON-248203627 None] CMD "qemu-img rebase -u -b volume-68324198-e4bf-4e89-934a-b125055ec9ed -F qcow2 /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c/volume-68324198-e4bf-4e89-934a-b125055ec9ed.0372b193-39a5-4cc5-b188-e72fdea25759" returned: 0 in 0.400s {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 15:13:38 devstack cinder-volume[83259]: DEBUG oslo.privsep.daemon [-] privsep: reply[71a54fa2-d56a-4ad1-a48c-f865c9eca362]: (4, 'qcow2') {{(pid=84312) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 16 15:13:38 devstack cinder-volume[83259]: DEBUG cinder.volume.drivers.remotefs [None req-56f13465-4088-4334-bd02-fe8178f5fa15 tempest-VolumesSnapshotListTestJSON-248203627 None] File path /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c/volume-68324198-e4bf-4e89-934a-b125055ec9ed.0372b193-39a5-4cc5-b188-e72fdea25759 is being set with permissions: 660 {{(pid=83259) _set_rw_permissions /opt/stack/cinder/cinder/volume/drivers/remotefs.py:492}} Sep 16 15:13:38 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [None req-56f13465-4088-4334-bd02-fe8178f5fa15 tempest-VolumesSnapshotListTestJSON-248203627 None] Running cmd (subprocess): chmod 660 /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c/volume-68324198-e4bf-4e89-934a-b125055ec9ed.0372b193-39a5-4cc5-b188-e72fdea25759 {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 15:13:38 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [None req-6c28953f-5a4b-4a42-8bc6-868be6ef27b9 tempest-CreateVolumesFromImageTest-1245864730 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c/volume-9d18bf7e-2e8a-413d-b930-926000cd0930 {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 15:13:38 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [None req-56f13465-4088-4334-bd02-fe8178f5fa15 tempest-VolumesSnapshotListTestJSON-248203627 None] CMD "chmod 660 /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c/volume-68324198-e4bf-4e89-934a-b125055ec9ed.0372b193-39a5-4cc5-b188-e72fdea25759" returned: 0 in 0.481s {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 15:13:38 devstack cinder-volume[83259]: WARNING cinder.volume.volume_utils [None req-14c98242-6fa2-4b9b-a09c-693a103ed428 tempest-VolumesActionsTest-296669149 None] Volume driver (QuobyteDriver 1.2) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 16 15:13:38 devstack cinder-volume[83259]: DEBUG cinder.coordination [None req-14c98242-6fa2-4b9b-a09c-693a103ed428 tempest-VolumesActionsTest-296669149 None] Acquiring lock "cinder-quobyte-c07f5ce2-165d-42b6-806a-af27abe6db99" by "delete_volume" {{(pid=83259) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 16 15:13:38 devstack cinder-volume[83259]: DEBUG cinder.volume.drivers.remotefs [None req-56f13465-4088-4334-bd02-fe8178f5fa15 tempest-VolumesSnapshotListTestJSON-248203627 None] Setting permissions: /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c/volume-68324198-e4bf-4e89-934a-b125055ec9ed -> 1000:1000 {{(pid=83259) _do_create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1584}} Sep 16 15:13:38 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [None req-56f13465-4088-4334-bd02-fe8178f5fa15 tempest-VolumesSnapshotListTestJSON-248203627 None] Running cmd (subprocess): chown --reference=/opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c/volume-68324198-e4bf-4e89-934a-b125055ec9ed /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c/volume-68324198-e4bf-4e89-934a-b125055ec9ed.0372b193-39a5-4cc5-b188-e72fdea25759 {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 15:13:39 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [None req-56f13465-4088-4334-bd02-fe8178f5fa15 tempest-VolumesSnapshotListTestJSON-248203627 None] CMD "chown --reference=/opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c/volume-68324198-e4bf-4e89-934a-b125055ec9ed /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c/volume-68324198-e4bf-4e89-934a-b125055ec9ed.0372b193-39a5-4cc5-b188-e72fdea25759" returned: 0 in 0.245s {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 15:13:39 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [None req-56f13465-4088-4334-bd02-fe8178f5fa15 tempest-VolumesSnapshotListTestJSON-248203627 None] Running cmd (subprocess): truncate -s0 /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c/volume-68324198-e4bf-4e89-934a-b125055ec9ed.info {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 15:13:39 devstack cinder-volume[83259]: DEBUG cinder.coordination [None req-14c98242-6fa2-4b9b-a09c-693a103ed428 tempest-VolumesActionsTest-296669149 None] Lock "cinder-quobyte-c07f5ce2-165d-42b6-806a-af27abe6db99" acquired by "delete_volume" :: waited 0.421s {{(pid=83259) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 16 15:13:39 devstack cinder-volume[83259]: DEBUG oslo.privsep.daemon [-] privsep: reply[819ab669-9173-4a58-b2d5-74cc36fd4d20]: (4, 'qcow2') {{(pid=84312) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 16 15:13:39 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [None req-6c28953f-5a4b-4a42-8bc6-868be6ef27b9 tempest-CreateVolumesFromImageTest-1245864730 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c/volume-9d18bf7e-2e8a-413d-b930-926000cd0930" returned: 0 in 0.952s {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 15:13:39 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [None req-14c98242-6fa2-4b9b-a09c-693a103ed428 tempest-VolumesActionsTest-296669149 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c/volume-c07f5ce2-165d-42b6-806a-af27abe6db99 {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 15:13:39 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [None req-6c28953f-5a4b-4a42-8bc6-868be6ef27b9 tempest-CreateVolumesFromImageTest-1245864730 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c/volume-9d18bf7e-2e8a-413d-b930-926000cd0930 {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 15:13:39 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [None req-56f13465-4088-4334-bd02-fe8178f5fa15 tempest-VolumesSnapshotListTestJSON-248203627 None] CMD "truncate -s0 /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c/volume-68324198-e4bf-4e89-934a-b125055ec9ed.info" returned: 0 in 0.377s {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 15:13:39 devstack cinder-volume[83259]: DEBUG cinder.volume.drivers.remotefs [None req-56f13465-4088-4334-bd02-fe8178f5fa15 tempest-VolumesSnapshotListTestJSON-248203627 None] File path /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c/volume-68324198-e4bf-4e89-934a-b125055ec9ed.info is being set with permissions: 660 {{(pid=83259) _set_rw_permissions /opt/stack/cinder/cinder/volume/drivers/remotefs.py:492}} Sep 16 15:13:39 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [None req-56f13465-4088-4334-bd02-fe8178f5fa15 tempest-VolumesSnapshotListTestJSON-248203627 None] Running cmd (subprocess): chmod 660 /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c/volume-68324198-e4bf-4e89-934a-b125055ec9ed.info {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 15:13:39 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [None req-6c28953f-5a4b-4a42-8bc6-868be6ef27b9 tempest-CreateVolumesFromImageTest-1245864730 None] CMD "rm -f /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c/volume-9d18bf7e-2e8a-413d-b930-926000cd0930" returned: 0 in 0.281s {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 15:13:39 devstack cinder-volume[83259]: DEBUG cinder.coordination [None req-6c28953f-5a4b-4a42-8bc6-868be6ef27b9 tempest-CreateVolumesFromImageTest-1245864730 None] Lock "cinder-quobyte-9d18bf7e-2e8a-413d-b930-926000cd0930" released by "delete_volume" :: held 1.583s {{(pid=83259) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 16 15:13:39 devstack quobyte-client[83286]: System call of process 96464 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 16 15:13:39 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [None req-56f13465-4088-4334-bd02-fe8178f5fa15 tempest-VolumesSnapshotListTestJSON-248203627 None] CMD "chmod 660 /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c/volume-68324198-e4bf-4e89-934a-b125055ec9ed.info" returned: 0 in 0.470s {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 15:13:40 devstack cinder-volume[83259]: DEBUG oslo_concurrency.lockutils [None req-56f13465-4088-4334-bd02-fe8178f5fa15 tempest-VolumesSnapshotListTestJSON-248203627 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.805s {{(pid=83259) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 16 15:13:40 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [None req-14c98242-6fa2-4b9b-a09c-693a103ed428 tempest-VolumesActionsTest-296669149 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c/volume-c07f5ce2-165d-42b6-806a-af27abe6db99" returned: 0 in 0.792s {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 15:13:40 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [None req-14c98242-6fa2-4b9b-a09c-693a103ed428 tempest-VolumesActionsTest-296669149 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c/volume-c07f5ce2-165d-42b6-806a-af27abe6db99 {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 15:13:40 devstack cinder-volume[83259]: INFO cinder.volume.manager [None req-56f13465-4088-4334-bd02-fe8178f5fa15 tempest-VolumesSnapshotListTestJSON-248203627 None] Create snapshot completed successfully Sep 16 15:13:40 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [None req-14c98242-6fa2-4b9b-a09c-693a103ed428 tempest-VolumesActionsTest-296669149 None] CMD "rm -f /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c/volume-c07f5ce2-165d-42b6-806a-af27abe6db99" returned: 0 in 0.406s {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 15:13:40 devstack cinder-volume[83259]: DEBUG cinder.coordination [None req-14c98242-6fa2-4b9b-a09c-693a103ed428 tempest-VolumesActionsTest-296669149 None] Lock "cinder-quobyte-c07f5ce2-165d-42b6-806a-af27abe6db99" released by "delete_volume" :: held 1.402s {{(pid=83259) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 16 15:13:40 devstack cinder-volume[83259]: DEBUG cinder.quota [None req-6c28953f-5a4b-4a42-8bc6-868be6ef27b9 tempest-CreateVolumesFromImageTest-1245864730 None] Created reservations ['55b73a32-a80c-4d30-b159-bc31536fb9ca', 'bb03de7b-3be6-4785-a0ef-ec94518df8c7', 'aeadbe02-9313-4881-9bb5-8d5eac0d0fe6', 'fcc8c84f-7539-4476-94ed-f9040d05386e'] {{(pid=83259) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 16 15:13:40 devstack cinder-volume[83259]: DEBUG cinder.quota [None req-14c98242-6fa2-4b9b-a09c-693a103ed428 tempest-VolumesActionsTest-296669149 None] Created reservations ['d84e340a-38e3-47e6-b80a-818e14199f93', 'b93a5c54-9b1f-4df9-923b-a5cf1c96cda7', '1eb079a3-e7d9-4e88-9613-706e12ba4cb4', '9a41bf32-9660-4ed9-9c8f-8b41eb41b52c'] {{(pid=83259) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 16 15:13:40 devstack cinder-volume[83259]: DEBUG oslo_concurrency.lockutils [None req-6c28953f-5a4b-4a42-8bc6-868be6ef27b9 tempest-CreateVolumesFromImageTest-1245864730 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83259) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 16 15:13:40 devstack cinder-volume[83259]: DEBUG oslo_concurrency.lockutils [None req-6c28953f-5a4b-4a42-8bc6-868be6ef27b9 tempest-CreateVolumesFromImageTest-1245864730 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=83259) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 16 15:13:40 devstack cinder-volume[83259]: DEBUG cinder.volume.drivers.quobyte [None req-6c28953f-5a4b-4a42-8bc6-868be6ef27b9 tempest-CreateVolumesFromImageTest-1245864730 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-61f585ac-f8e2-4d19-a890-7ebc2726cc72': None} {{(pid=83259) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:639}} Sep 16 15:13:40 devstack cinder-volume[83259]: DEBUG cinder.volume.drivers.quobyte [None req-6c28953f-5a4b-4a42-8bc6-868be6ef27b9 tempest-CreateVolumesFromImageTest-1245864730 None] Available shares ['10.10.41.181/cinder-vol-61f585ac-f8e2-4d19-a890-7ebc2726cc72'] {{(pid=83259) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:669}} Sep 16 15:13:40 devstack cinder-volume[83259]: DEBUG oslo_concurrency.lockutils [None req-6c28953f-5a4b-4a42-8bc6-868be6ef27b9 tempest-CreateVolumesFromImageTest-1245864730 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=83259) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 16 15:13:40 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [None req-6c28953f-5a4b-4a42-8bc6-868be6ef27b9 tempest-CreateVolumesFromImageTest-1245864730 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 15:13:41 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [None req-6c28953f-5a4b-4a42-8bc6-868be6ef27b9 tempest-CreateVolumesFromImageTest-1245864730 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c" returned: 0 in 0.418s {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 15:13:41 devstack cinder-volume[83259]: DEBUG cinder.manager [None req-6c28953f-5a4b-4a42-8bc6-868be6ef27b9 tempest-CreateVolumesFromImageTest-1245864730 None] Notifying Schedulers of capabilities ... {{(pid=83259) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 16 15:13:41 devstack cinder-volume[83259]: INFO cinder.volume.manager [None req-6c28953f-5a4b-4a42-8bc6-868be6ef27b9 tempest-CreateVolumesFromImageTest-1245864730 None] Deleted volume successfully. Sep 16 15:13:41 devstack cinder-volume[83259]: WARNING cinder.volume.volume_utils [None req-286948a9-dd5c-4516-8a65-01845a1933f6 tempest-VolumesSnapshotListTestJSON-248203627 None] Volume driver (QuobyteDriver 1.2) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 16 15:13:41 devstack cinder-volume[83259]: DEBUG oslo_concurrency.lockutils [None req-286948a9-dd5c-4516-8a65-01845a1933f6 tempest-VolumesSnapshotListTestJSON-248203627 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=83259) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 16 15:13:41 devstack cinder-volume[83259]: DEBUG oslo_concurrency.lockutils [None req-286948a9-dd5c-4516-8a65-01845a1933f6 tempest-VolumesSnapshotListTestJSON-248203627 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.003s {{(pid=83259) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 16 15:13:41 devstack cinder-volume[83259]: DEBUG cinder.volume.drivers.remotefs [None req-286948a9-dd5c-4516-8a65-01845a1933f6 tempest-VolumesSnapshotListTestJSON-248203627 None] Creating offline snapshot d3fb3e12-9afe-44d7-8d93-0d1a88315aa4 of volume 68324198-e4bf-4e89-934a-b125055ec9ed {{(pid=83259) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1694}} Sep 16 15:13:41 devstack cinder-volume[83259]: DEBUG cinder.coordination [None req-71e187a1-7cb2-431a-ab4f-24bd70a50b81 tempest-CreateVolumesFromImageTest-1245864730 None] Acquiring lock "cinder-9c82ccf0-7efe-42a9-a8c8-549b64230bda-delete_volume" by "delete_volume" {{(pid=83259) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 16 15:13:41 devstack cinder-volume[83259]: DEBUG cinder.coordination [None req-6c28953f-5a4b-4a42-8bc6-868be6ef27b9 tempest-CreateVolumesFromImageTest-1245864730 None] Lock "cinder-9d18bf7e-2e8a-413d-b930-926000cd0930-delete_volume" released by "delete_volume" :: held 4.442s {{(pid=83259) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 16 15:13:41 devstack cinder-volume[83259]: DEBUG oslo.privsep.daemon [-] privsep: reply[ef11936c-a54c-48c2-9e06-bc1cc530d132]: (4, 'qcow2') {{(pid=84312) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 16 15:13:41 devstack cinder-volume[83259]: DEBUG oslo_concurrency.lockutils [None req-14c98242-6fa2-4b9b-a09c-693a103ed428 tempest-VolumesActionsTest-296669149 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83259) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 16 15:13:41 devstack cinder-volume[83259]: DEBUG oslo_concurrency.lockutils [None req-14c98242-6fa2-4b9b-a09c-693a103ed428 tempest-VolumesActionsTest-296669149 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83259) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 16 15:13:41 devstack cinder-volume[83259]: DEBUG cinder.volume.drivers.quobyte [None req-14c98242-6fa2-4b9b-a09c-693a103ed428 tempest-VolumesActionsTest-296669149 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-61f585ac-f8e2-4d19-a890-7ebc2726cc72': None} {{(pid=83259) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:639}} Sep 16 15:13:41 devstack cinder-volume[83259]: DEBUG cinder.volume.drivers.quobyte [None req-14c98242-6fa2-4b9b-a09c-693a103ed428 tempest-VolumesActionsTest-296669149 None] Available shares ['10.10.41.181/cinder-vol-61f585ac-f8e2-4d19-a890-7ebc2726cc72'] {{(pid=83259) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:669}} Sep 16 15:13:41 devstack cinder-volume[83259]: DEBUG oslo_concurrency.lockutils [None req-14c98242-6fa2-4b9b-a09c-693a103ed428 tempest-VolumesActionsTest-296669149 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=83259) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 16 15:13:41 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [None req-14c98242-6fa2-4b9b-a09c-693a103ed428 tempest-VolumesActionsTest-296669149 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 15:13:41 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [None req-286948a9-dd5c-4516-8a65-01845a1933f6 tempest-VolumesSnapshotListTestJSON-248203627 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c/volume-68324198-e4bf-4e89-934a-b125055ec9ed.0372b193-39a5-4cc5-b188-e72fdea25759 {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 15:13:41 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [None req-14c98242-6fa2-4b9b-a09c-693a103ed428 tempest-VolumesActionsTest-296669149 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c" returned: 0 in 0.295s {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 15:13:41 devstack cinder-volume[83259]: DEBUG cinder.manager [None req-14c98242-6fa2-4b9b-a09c-693a103ed428 tempest-VolumesActionsTest-296669149 None] Notifying Schedulers of capabilities ... {{(pid=83259) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 16 15:13:41 devstack cinder-volume[83259]: DEBUG cinder.coordination [None req-71e187a1-7cb2-431a-ab4f-24bd70a50b81 tempest-CreateVolumesFromImageTest-1245864730 None] Lock "cinder-9c82ccf0-7efe-42a9-a8c8-549b64230bda-delete_volume" acquired by "delete_volume" :: waited 0.447s {{(pid=83259) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 16 15:13:42 devstack cinder-volume[83259]: INFO cinder.volume.manager [None req-14c98242-6fa2-4b9b-a09c-693a103ed428 tempest-VolumesActionsTest-296669149 None] Deleted volume successfully. Sep 16 15:13:42 devstack cinder-volume[83259]: DEBUG cinder.coordination [None req-14c98242-6fa2-4b9b-a09c-693a103ed428 tempest-VolumesActionsTest-296669149 None] Lock "cinder-c07f5ce2-165d-42b6-806a-af27abe6db99-delete_volume" released by "delete_volume" :: held 4.218s {{(pid=83259) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 16 15:13:42 devstack cinder-volume[83259]: WARNING cinder.volume.volume_utils [None req-71e187a1-7cb2-431a-ab4f-24bd70a50b81 tempest-CreateVolumesFromImageTest-1245864730 None] Volume driver (QuobyteDriver 1.2) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 16 15:13:42 devstack cinder-volume[83259]: DEBUG cinder.coordination [None req-71e187a1-7cb2-431a-ab4f-24bd70a50b81 tempest-CreateVolumesFromImageTest-1245864730 None] Acquiring lock "cinder-quobyte-9c82ccf0-7efe-42a9-a8c8-549b64230bda" by "delete_volume" {{(pid=83259) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 16 15:13:42 devstack cinder-volume[83259]: DEBUG cinder.coordination [None req-71e187a1-7cb2-431a-ab4f-24bd70a50b81 tempest-CreateVolumesFromImageTest-1245864730 None] Lock "cinder-quobyte-9c82ccf0-7efe-42a9-a8c8-549b64230bda" acquired by "delete_volume" :: waited 0.019s {{(pid=83259) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 16 15:13:42 devstack quobyte-client[83286]: System call of process 96478 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 16 15:13:42 devstack cinder-volume[83259]: DEBUG oslo.privsep.daemon [-] privsep: reply[989b5098-114b-4b77-8cdd-9e9e773af20b]: (4, 'qcow2') {{(pid=84312) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 16 15:13:42 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [None req-71e187a1-7cb2-431a-ab4f-24bd70a50b81 tempest-CreateVolumesFromImageTest-1245864730 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c/volume-9c82ccf0-7efe-42a9-a8c8-549b64230bda {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 15:13:42 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [None req-286948a9-dd5c-4516-8a65-01845a1933f6 tempest-VolumesSnapshotListTestJSON-248203627 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c/volume-68324198-e4bf-4e89-934a-b125055ec9ed.0372b193-39a5-4cc5-b188-e72fdea25759" returned: 0 in 0.850s {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 15:13:42 devstack cinder-volume[83259]: DEBUG cinder.volume.drivers.remotefs [None req-286948a9-dd5c-4516-8a65-01845a1933f6 tempest-VolumesSnapshotListTestJSON-248203627 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-68324198-e4bf-4e89-934a-b125055ec9ed(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83259) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:886}} Sep 16 15:13:42 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [None req-286948a9-dd5c-4516-8a65-01845a1933f6 tempest-VolumesSnapshotListTestJSON-248203627 None] Running cmd (subprocess): qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c/volume-68324198-e4bf-4e89-934a-b125055ec9ed.0372b193-39a5-4cc5-b188-e72fdea25759,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c/volume-68324198-e4bf-4e89-934a-b125055ec9ed.d3fb3e12-9afe-44d7-8d93-0d1a88315aa4 1G {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 15:13:42 devstack quobyte-client[83286]: The server volume:87712ffe-8a69-446d-9ed6-4430c7ee9792@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=87712ffe-8a69-446d-9ed6-4430c7ee9792, inode=113, name=volume-68324198-e4bf-4e89-934a-b125055ec9ed.d3fb3e12-9afe-44d7-8d93-0d1a88315aa4, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.206), requestorAccessMask=0 Sep 16 15:13:43 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [None req-286948a9-dd5c-4516-8a65-01845a1933f6 tempest-VolumesSnapshotListTestJSON-248203627 None] CMD "qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c/volume-68324198-e4bf-4e89-934a-b125055ec9ed.0372b193-39a5-4cc5-b188-e72fdea25759,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c/volume-68324198-e4bf-4e89-934a-b125055ec9ed.d3fb3e12-9afe-44d7-8d93-0d1a88315aa4 1G" returned: 0 in 0.421s {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 15:13:43 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [None req-286948a9-dd5c-4516-8a65-01845a1933f6 tempest-VolumesSnapshotListTestJSON-248203627 None] Running cmd (subprocess): qemu-img rebase -u -b volume-68324198-e4bf-4e89-934a-b125055ec9ed.0372b193-39a5-4cc5-b188-e72fdea25759 -F qcow2 /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c/volume-68324198-e4bf-4e89-934a-b125055ec9ed.d3fb3e12-9afe-44d7-8d93-0d1a88315aa4 {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 15:13:43 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [None req-71e187a1-7cb2-431a-ab4f-24bd70a50b81 tempest-CreateVolumesFromImageTest-1245864730 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c/volume-9c82ccf0-7efe-42a9-a8c8-549b64230bda" returned: 0 in 0.782s {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 15:13:43 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [None req-71e187a1-7cb2-431a-ab4f-24bd70a50b81 tempest-CreateVolumesFromImageTest-1245864730 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c/volume-9c82ccf0-7efe-42a9-a8c8-549b64230bda {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 15:13:43 devstack quobyte-client[83286]: System call of process 96487 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 16 15:13:43 devstack quobyte-client[83286]: System call of process 96487 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 16 15:13:43 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [None req-286948a9-dd5c-4516-8a65-01845a1933f6 tempest-VolumesSnapshotListTestJSON-248203627 None] CMD "qemu-img rebase -u -b volume-68324198-e4bf-4e89-934a-b125055ec9ed.0372b193-39a5-4cc5-b188-e72fdea25759 -F qcow2 /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c/volume-68324198-e4bf-4e89-934a-b125055ec9ed.d3fb3e12-9afe-44d7-8d93-0d1a88315aa4" returned: 0 in 0.329s {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 15:13:43 devstack cinder-volume[83259]: DEBUG cinder.volume.drivers.remotefs [None req-286948a9-dd5c-4516-8a65-01845a1933f6 tempest-VolumesSnapshotListTestJSON-248203627 None] File path /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c/volume-68324198-e4bf-4e89-934a-b125055ec9ed.d3fb3e12-9afe-44d7-8d93-0d1a88315aa4 is being set with permissions: 660 {{(pid=83259) _set_rw_permissions /opt/stack/cinder/cinder/volume/drivers/remotefs.py:492}} Sep 16 15:13:43 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [None req-286948a9-dd5c-4516-8a65-01845a1933f6 tempest-VolumesSnapshotListTestJSON-248203627 None] Running cmd (subprocess): chmod 660 /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c/volume-68324198-e4bf-4e89-934a-b125055ec9ed.d3fb3e12-9afe-44d7-8d93-0d1a88315aa4 {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 15:13:43 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [None req-71e187a1-7cb2-431a-ab4f-24bd70a50b81 tempest-CreateVolumesFromImageTest-1245864730 None] CMD "rm -f /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c/volume-9c82ccf0-7efe-42a9-a8c8-549b64230bda" returned: 0 in 0.270s {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 15:13:43 devstack cinder-volume[83259]: DEBUG cinder.coordination [None req-71e187a1-7cb2-431a-ab4f-24bd70a50b81 tempest-CreateVolumesFromImageTest-1245864730 None] Lock "cinder-quobyte-9c82ccf0-7efe-42a9-a8c8-549b64230bda" released by "delete_volume" :: held 1.414s {{(pid=83259) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 16 15:13:43 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [None req-286948a9-dd5c-4516-8a65-01845a1933f6 tempest-VolumesSnapshotListTestJSON-248203627 None] CMD "chmod 660 /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c/volume-68324198-e4bf-4e89-934a-b125055ec9ed.d3fb3e12-9afe-44d7-8d93-0d1a88315aa4" returned: 0 in 0.512s {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 15:13:43 devstack cinder-volume[83259]: DEBUG cinder.volume.drivers.remotefs [None req-286948a9-dd5c-4516-8a65-01845a1933f6 tempest-VolumesSnapshotListTestJSON-248203627 None] Setting permissions: /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c/volume-68324198-e4bf-4e89-934a-b125055ec9ed.0372b193-39a5-4cc5-b188-e72fdea25759 -> 1000:1000 {{(pid=83259) _do_create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1584}} Sep 16 15:13:43 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [None req-286948a9-dd5c-4516-8a65-01845a1933f6 tempest-VolumesSnapshotListTestJSON-248203627 None] Running cmd (subprocess): chown --reference=/opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c/volume-68324198-e4bf-4e89-934a-b125055ec9ed.0372b193-39a5-4cc5-b188-e72fdea25759 /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c/volume-68324198-e4bf-4e89-934a-b125055ec9ed.d3fb3e12-9afe-44d7-8d93-0d1a88315aa4 {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 15:13:44 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [None req-286948a9-dd5c-4516-8a65-01845a1933f6 tempest-VolumesSnapshotListTestJSON-248203627 None] CMD "chown --reference=/opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c/volume-68324198-e4bf-4e89-934a-b125055ec9ed.0372b193-39a5-4cc5-b188-e72fdea25759 /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c/volume-68324198-e4bf-4e89-934a-b125055ec9ed.d3fb3e12-9afe-44d7-8d93-0d1a88315aa4" returned: 0 in 0.317s {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 15:13:44 devstack cinder-volume[83259]: DEBUG oslo_concurrency.lockutils [None req-286948a9-dd5c-4516-8a65-01845a1933f6 tempest-VolumesSnapshotListTestJSON-248203627 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.964s {{(pid=83259) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 16 15:13:44 devstack cinder-volume[83259]: DEBUG cinder.quota [None req-71e187a1-7cb2-431a-ab4f-24bd70a50b81 tempest-CreateVolumesFromImageTest-1245864730 None] Created reservations ['de12e87a-55fb-4609-8d58-f6f9b7799c2f', '0e13cb2e-64a4-4589-8b23-3d38dcc2e8ee', 'ecfbae5e-0b9a-4ba8-a6f8-647084906f97', 'da5a3a60-5d16-441b-9c35-e1aa7c2137cd'] {{(pid=83259) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 16 15:13:44 devstack cinder-volume[83259]: INFO cinder.volume.manager [None req-286948a9-dd5c-4516-8a65-01845a1933f6 tempest-VolumesSnapshotListTestJSON-248203627 None] Create snapshot completed successfully Sep 16 15:13:44 devstack cinder-volume[83259]: DEBUG oslo_concurrency.lockutils [None req-71e187a1-7cb2-431a-ab4f-24bd70a50b81 tempest-CreateVolumesFromImageTest-1245864730 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83259) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 16 15:13:44 devstack cinder-volume[83259]: DEBUG oslo_concurrency.lockutils [None req-71e187a1-7cb2-431a-ab4f-24bd70a50b81 tempest-CreateVolumesFromImageTest-1245864730 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=83259) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 16 15:13:44 devstack cinder-volume[83259]: DEBUG cinder.volume.drivers.quobyte [None req-71e187a1-7cb2-431a-ab4f-24bd70a50b81 tempest-CreateVolumesFromImageTest-1245864730 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-61f585ac-f8e2-4d19-a890-7ebc2726cc72': None} {{(pid=83259) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:639}} Sep 16 15:13:44 devstack cinder-volume[83259]: DEBUG cinder.volume.drivers.quobyte [None req-71e187a1-7cb2-431a-ab4f-24bd70a50b81 tempest-CreateVolumesFromImageTest-1245864730 None] Available shares ['10.10.41.181/cinder-vol-61f585ac-f8e2-4d19-a890-7ebc2726cc72'] {{(pid=83259) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:669}} Sep 16 15:13:44 devstack cinder-volume[83259]: DEBUG oslo_concurrency.lockutils [None req-71e187a1-7cb2-431a-ab4f-24bd70a50b81 tempest-CreateVolumesFromImageTest-1245864730 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=83259) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 16 15:13:44 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [None req-71e187a1-7cb2-431a-ab4f-24bd70a50b81 tempest-CreateVolumesFromImageTest-1245864730 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 15:13:44 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [None req-71e187a1-7cb2-431a-ab4f-24bd70a50b81 tempest-CreateVolumesFromImageTest-1245864730 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c" returned: 0 in 0.124s {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 15:13:44 devstack cinder-volume[83259]: DEBUG cinder.manager [None req-71e187a1-7cb2-431a-ab4f-24bd70a50b81 tempest-CreateVolumesFromImageTest-1245864730 None] Notifying Schedulers of capabilities ... {{(pid=83259) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 16 15:13:44 devstack cinder-volume[83259]: INFO cinder.volume.manager [None req-71e187a1-7cb2-431a-ab4f-24bd70a50b81 tempest-CreateVolumesFromImageTest-1245864730 None] Deleted volume successfully. Sep 16 15:13:45 devstack cinder-volume[83259]: DEBUG cinder.coordination [None req-71e187a1-7cb2-431a-ab4f-24bd70a50b81 tempest-CreateVolumesFromImageTest-1245864730 None] Lock "cinder-9c82ccf0-7efe-42a9-a8c8-549b64230bda-delete_volume" released by "delete_volume" :: held 3.437s {{(pid=83259) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 16 15:13:45 devstack cinder-volume[83259]: DEBUG oslo_service.periodic_task [None req-050ec8a1-6ffd-499d-95ad-d548a84437e2 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=83259) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} Sep 16 15:13:45 devstack cinder-volume[83259]: DEBUG oslo_concurrency.lockutils [None req-050ec8a1-6ffd-499d-95ad-d548a84437e2 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83259) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 16 15:13:45 devstack cinder-volume[83259]: DEBUG oslo_concurrency.lockutils [None req-050ec8a1-6ffd-499d-95ad-d548a84437e2 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83259) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 16 15:13:45 devstack cinder-volume[83259]: DEBUG cinder.volume.drivers.quobyte [None req-050ec8a1-6ffd-499d-95ad-d548a84437e2 None None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-61f585ac-f8e2-4d19-a890-7ebc2726cc72': None} {{(pid=83259) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:639}} Sep 16 15:13:46 devstack cinder-volume[83259]: DEBUG cinder.volume.drivers.quobyte [None req-050ec8a1-6ffd-499d-95ad-d548a84437e2 None None] Available shares ['10.10.41.181/cinder-vol-61f585ac-f8e2-4d19-a890-7ebc2726cc72'] {{(pid=83259) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:669}} Sep 16 15:13:46 devstack cinder-volume[83259]: DEBUG oslo_concurrency.lockutils [None req-050ec8a1-6ffd-499d-95ad-d548a84437e2 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=83259) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 16 15:13:46 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [None req-050ec8a1-6ffd-499d-95ad-d548a84437e2 None None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 15:13:46 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [None req-050ec8a1-6ffd-499d-95ad-d548a84437e2 None None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c" returned: 0 in 0.720s {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 15:13:46 devstack cinder-volume[83259]: DEBUG cinder.manager [None req-050ec8a1-6ffd-499d-95ad-d548a84437e2 None None] Notifying Schedulers of capabilities ... {{(pid=83259) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 16 15:13:46 devstack cinder-volume[83259]: WARNING cinder.volume.volume_utils [None req-56e7d205-2ac2-4f3d-a181-1293d86afd4b tempest-VolumesSnapshotListTestJSON-248203627 None] Volume driver (QuobyteDriver 1.2) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 16 15:13:46 devstack cinder-volume[83259]: DEBUG oslo_concurrency.lockutils [None req-56e7d205-2ac2-4f3d-a181-1293d86afd4b tempest-VolumesSnapshotListTestJSON-248203627 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=83259) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 16 15:13:46 devstack cinder-volume[83259]: DEBUG oslo_concurrency.lockutils [None req-56e7d205-2ac2-4f3d-a181-1293d86afd4b tempest-VolumesSnapshotListTestJSON-248203627 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.005s {{(pid=83259) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 16 15:13:46 devstack cinder-volume[83259]: DEBUG cinder.volume.drivers.remotefs [None req-56e7d205-2ac2-4f3d-a181-1293d86afd4b tempest-VolumesSnapshotListTestJSON-248203627 None] Creating offline snapshot 1ef934d5-3f4b-4d5c-bece-7453d803d338 of volume 68324198-e4bf-4e89-934a-b125055ec9ed {{(pid=83259) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1694}} Sep 16 15:13:46 devstack cinder-volume[83259]: DEBUG oslo.privsep.daemon [-] privsep: reply[f9ec821a-ec71-4150-8b6d-e8df69e71127]: (4, 'qcow2') {{(pid=84312) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 16 15:13:47 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [None req-56e7d205-2ac2-4f3d-a181-1293d86afd4b tempest-VolumesSnapshotListTestJSON-248203627 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c/volume-68324198-e4bf-4e89-934a-b125055ec9ed.d3fb3e12-9afe-44d7-8d93-0d1a88315aa4 {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 15:13:47 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [None req-56e7d205-2ac2-4f3d-a181-1293d86afd4b tempest-VolumesSnapshotListTestJSON-248203627 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c/volume-68324198-e4bf-4e89-934a-b125055ec9ed.d3fb3e12-9afe-44d7-8d93-0d1a88315aa4" returned: 0 in 0.708s {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 15:13:47 devstack cinder-volume[83259]: DEBUG cinder.volume.drivers.remotefs [None req-56e7d205-2ac2-4f3d-a181-1293d86afd4b tempest-VolumesSnapshotListTestJSON-248203627 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-68324198-e4bf-4e89-934a-b125055ec9ed(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83259) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:886}} Sep 16 15:13:47 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [None req-56e7d205-2ac2-4f3d-a181-1293d86afd4b tempest-VolumesSnapshotListTestJSON-248203627 None] Running cmd (subprocess): qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c/volume-68324198-e4bf-4e89-934a-b125055ec9ed.d3fb3e12-9afe-44d7-8d93-0d1a88315aa4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c/volume-68324198-e4bf-4e89-934a-b125055ec9ed.1ef934d5-3f4b-4d5c-bece-7453d803d338 1G {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 15:13:48 devstack quobyte-client[83286]: The server volume:87712ffe-8a69-446d-9ed6-4430c7ee9792@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=87712ffe-8a69-446d-9ed6-4430c7ee9792, inode=114, name=volume-68324198-e4bf-4e89-934a-b125055ec9ed.1ef934d5-3f4b-4d5c-bece-7453d803d338, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.206), requestorAccessMask=0 Sep 16 15:13:48 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [None req-56e7d205-2ac2-4f3d-a181-1293d86afd4b tempest-VolumesSnapshotListTestJSON-248203627 None] CMD "qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c/volume-68324198-e4bf-4e89-934a-b125055ec9ed.d3fb3e12-9afe-44d7-8d93-0d1a88315aa4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c/volume-68324198-e4bf-4e89-934a-b125055ec9ed.1ef934d5-3f4b-4d5c-bece-7453d803d338 1G" returned: 0 in 0.465s {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 15:13:48 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [None req-56e7d205-2ac2-4f3d-a181-1293d86afd4b tempest-VolumesSnapshotListTestJSON-248203627 None] Running cmd (subprocess): qemu-img rebase -u -b volume-68324198-e4bf-4e89-934a-b125055ec9ed.d3fb3e12-9afe-44d7-8d93-0d1a88315aa4 -F qcow2 /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c/volume-68324198-e4bf-4e89-934a-b125055ec9ed.1ef934d5-3f4b-4d5c-bece-7453d803d338 {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 15:13:48 devstack quobyte-client[83286]: System call of process 96504 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 16 15:13:48 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [None req-56e7d205-2ac2-4f3d-a181-1293d86afd4b tempest-VolumesSnapshotListTestJSON-248203627 None] CMD "qemu-img rebase -u -b volume-68324198-e4bf-4e89-934a-b125055ec9ed.d3fb3e12-9afe-44d7-8d93-0d1a88315aa4 -F qcow2 /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c/volume-68324198-e4bf-4e89-934a-b125055ec9ed.1ef934d5-3f4b-4d5c-bece-7453d803d338" returned: 0 in 0.255s {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 15:13:48 devstack cinder-volume[83259]: DEBUG cinder.volume.drivers.remotefs [None req-56e7d205-2ac2-4f3d-a181-1293d86afd4b tempest-VolumesSnapshotListTestJSON-248203627 None] File path /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c/volume-68324198-e4bf-4e89-934a-b125055ec9ed.1ef934d5-3f4b-4d5c-bece-7453d803d338 is being set with permissions: 660 {{(pid=83259) _set_rw_permissions /opt/stack/cinder/cinder/volume/drivers/remotefs.py:492}} Sep 16 15:13:48 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [None req-56e7d205-2ac2-4f3d-a181-1293d86afd4b tempest-VolumesSnapshotListTestJSON-248203627 None] Running cmd (subprocess): chmod 660 /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c/volume-68324198-e4bf-4e89-934a-b125055ec9ed.1ef934d5-3f4b-4d5c-bece-7453d803d338 {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 15:13:48 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [None req-56e7d205-2ac2-4f3d-a181-1293d86afd4b tempest-VolumesSnapshotListTestJSON-248203627 None] CMD "chmod 660 /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c/volume-68324198-e4bf-4e89-934a-b125055ec9ed.1ef934d5-3f4b-4d5c-bece-7453d803d338" returned: 0 in 0.127s {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 15:13:48 devstack cinder-volume[83259]: DEBUG cinder.volume.drivers.remotefs [None req-56e7d205-2ac2-4f3d-a181-1293d86afd4b tempest-VolumesSnapshotListTestJSON-248203627 None] Setting permissions: /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c/volume-68324198-e4bf-4e89-934a-b125055ec9ed.d3fb3e12-9afe-44d7-8d93-0d1a88315aa4 -> 1000:1000 {{(pid=83259) _do_create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1584}} Sep 16 15:13:48 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [None req-56e7d205-2ac2-4f3d-a181-1293d86afd4b tempest-VolumesSnapshotListTestJSON-248203627 None] Running cmd (subprocess): chown --reference=/opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c/volume-68324198-e4bf-4e89-934a-b125055ec9ed.d3fb3e12-9afe-44d7-8d93-0d1a88315aa4 /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c/volume-68324198-e4bf-4e89-934a-b125055ec9ed.1ef934d5-3f4b-4d5c-bece-7453d803d338 {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 15:13:48 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [None req-56e7d205-2ac2-4f3d-a181-1293d86afd4b tempest-VolumesSnapshotListTestJSON-248203627 None] CMD "chown --reference=/opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c/volume-68324198-e4bf-4e89-934a-b125055ec9ed.d3fb3e12-9afe-44d7-8d93-0d1a88315aa4 /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c/volume-68324198-e4bf-4e89-934a-b125055ec9ed.1ef934d5-3f4b-4d5c-bece-7453d803d338" returned: 0 in 0.164s {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 15:13:49 devstack cinder-volume[83259]: DEBUG oslo_concurrency.lockutils [None req-56e7d205-2ac2-4f3d-a181-1293d86afd4b tempest-VolumesSnapshotListTestJSON-248203627 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.179s {{(pid=83259) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 16 15:13:49 devstack cinder-volume[83259]: INFO cinder.volume.manager [None req-56e7d205-2ac2-4f3d-a181-1293d86afd4b tempest-VolumesSnapshotListTestJSON-248203627 None] Create snapshot completed successfully Sep 16 15:13:50 devstack cinder-volume[83259]: WARNING cinder.volume.volume_utils [None req-a8166bb3-f868-4745-bc53-a22b8fe12c2c tempest-CreateVolumesFromSnapshotTest-388118498 None] Volume driver (QuobyteDriver 1.2) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 16 15:13:50 devstack cinder-volume[83259]: DEBUG cinder.volume.flows.manager.create_volume [None req-a8166bb3-f868-4745-bc53-a22b8fe12c2c tempest-CreateVolumesFromSnapshotTest-388118498 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#Quobyte'], 'hosts': ['devstack@QuobyteHD#Quobyte']} {{(pid=83259) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1387}} Sep 16 15:13:50 devstack cinder-volume[83259]: DEBUG cinder.volume.manager [None req-a8166bb3-f868-4745-bc53-a22b8fe12c2c tempest-CreateVolumesFromSnapshotTest-388118498 None] Flow 'volume_create_manager' (a8c53658-6cd5-4180-bb5b-bf196dd5fdaa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83259) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 16 15:13:50 devstack cinder-volume[83259]: DEBUG cinder.volume.manager [None req-a8166bb3-f868-4745-bc53-a22b8fe12c2c tempest-CreateVolumesFromSnapshotTest-388118498 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7ec5c56f-5a06-4329-acea-b8f0de1abb21) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83259) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 15:13:50 devstack cinder-volume[83259]: DEBUG cinder.volume.manager [None req-a8166bb3-f868-4745-bc53-a22b8fe12c2c tempest-CreateVolumesFromSnapshotTest-388118498 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7ec5c56f-5a06-4329-acea-b8f0de1abb21) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-16T13:13:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-686870306',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#Quobyte',id=100279a7-ee41-49d2-8532-176d3ce3291e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8468a91973714863896d263c8f21babb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-16T13:13:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-16T13:13:50Z,use_quota=True,user_id='b8e110a8439d457b8c0f8cec54bb1b14',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(485ead50-3df8-4d76-8d34-a4db136c980a),volume_type_id=485ead50-3df8-4d76-8d34-a4db136c980a)' {{(pid=83259) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 15:13:50 devstack cinder-volume[83259]: DEBUG cinder.volume.manager [None req-a8166bb3-f868-4745-bc53-a22b8fe12c2c tempest-CreateVolumesFromSnapshotTest-388118498 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f386079e-f02f-4905-bc8b-3c9752328b7a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83259) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 15:13:50 devstack cinder-volume[83259]: DEBUG cinder.volume.manager [None req-a8166bb3-f868-4745-bc53-a22b8fe12c2c tempest-CreateVolumesFromSnapshotTest-388118498 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f386079e-f02f-4905-bc8b-3c9752328b7a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83259) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 15:13:50 devstack cinder-volume[83259]: DEBUG cinder.volume.manager [None req-a8166bb3-f868-4745-bc53-a22b8fe12c2c tempest-CreateVolumesFromSnapshotTest-388118498 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5eb9c521-a3ff-4d9d-a64b-954c84e0c062) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83259) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 15:13:50 devstack cinder-volume[83259]: DEBUG cinder.volume.manager [None req-a8166bb3-f868-4745-bc53-a22b8fe12c2c tempest-CreateVolumesFromSnapshotTest-388118498 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5eb9c521-a3ff-4d9d-a64b-954c84e0c062) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '100279a7-ee41-49d2-8532-176d3ce3291e', 'volume_name': 'volume-100279a7-ee41-49d2-8532-176d3ce3291e', 'volume_size': 1}' {{(pid=83259) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 15:13:50 devstack cinder-volume[83259]: DEBUG cinder.volume.manager [None req-a8166bb3-f868-4745-bc53-a22b8fe12c2c tempest-CreateVolumesFromSnapshotTest-388118498 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f2ab7671-3aef-439e-a121-b456f2d91dca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83259) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 15:13:50 devstack cinder-volume[83259]: DEBUG cinder.volume.manager [None req-a8166bb3-f868-4745-bc53-a22b8fe12c2c tempest-CreateVolumesFromSnapshotTest-388118498 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f2ab7671-3aef-439e-a121-b456f2d91dca) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83259) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 15:13:50 devstack cinder-volume[83259]: DEBUG cinder.volume.manager [None req-a8166bb3-f868-4745-bc53-a22b8fe12c2c tempest-CreateVolumesFromSnapshotTest-388118498 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ea540d73-291e-4781-b835-940febb949ee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83259) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 15:13:50 devstack cinder-volume[83259]: INFO cinder.volume.flows.manager.create_volume [None req-a8166bb3-f868-4745-bc53-a22b8fe12c2c tempest-CreateVolumesFromSnapshotTest-388118498 None] Volume 100279a7-ee41-49d2-8532-176d3ce3291e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-100279a7-ee41-49d2-8532-176d3ce3291e', 'volume_size': 1} Sep 16 15:13:50 devstack cinder-volume[83259]: DEBUG oslo_concurrency.lockutils [None req-a8166bb3-f868-4745-bc53-a22b8fe12c2c tempest-CreateVolumesFromSnapshotTest-388118498 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83259) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 16 15:13:50 devstack cinder-volume[83259]: DEBUG oslo_concurrency.lockutils [None req-a8166bb3-f868-4745-bc53-a22b8fe12c2c tempest-CreateVolumesFromSnapshotTest-388118498 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.003s {{(pid=83259) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 16 15:13:50 devstack cinder-volume[83259]: DEBUG cinder.volume.drivers.quobyte [None req-a8166bb3-f868-4745-bc53-a22b8fe12c2c tempest-CreateVolumesFromSnapshotTest-388118498 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-16T13:13:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-686870306',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#Quobyte',id=100279a7-ee41-49d2-8532-176d3ce3291e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8468a91973714863896d263c8f21babb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-16T13:13:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-16T13:13:50Z,use_quota=True,user_id='b8e110a8439d457b8c0f8cec54bb1b14',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(485ead50-3df8-4d76-8d34-a4db136c980a),volume_type_id=485ead50-3df8-4d76-8d34-a4db136c980a)}" {{(pid=83259) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Sep 16 15:13:50 devstack cinder-volume[83259]: DEBUG cinder.volume.drivers.remotefs [None req-a8166bb3-f868-4745-bc53-a22b8fe12c2c tempest-CreateVolumesFromSnapshotTest-388118498 None] Creating volume 100279a7-ee41-49d2-8532-176d3ce3291e {{(pid=83259) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}} Sep 16 15:13:50 devstack cinder-volume[83259]: DEBUG oslo_concurrency.lockutils [None req-a8166bb3-f868-4745-bc53-a22b8fe12c2c tempest-CreateVolumesFromSnapshotTest-388118498 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83259) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 16 15:13:50 devstack cinder-volume[83259]: DEBUG oslo_concurrency.lockutils [None req-a8166bb3-f868-4745-bc53-a22b8fe12c2c tempest-CreateVolumesFromSnapshotTest-388118498 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83259) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 16 15:13:50 devstack cinder-volume[83259]: DEBUG cinder.volume.drivers.quobyte [None req-a8166bb3-f868-4745-bc53-a22b8fe12c2c tempest-CreateVolumesFromSnapshotTest-388118498 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-61f585ac-f8e2-4d19-a890-7ebc2726cc72': None} {{(pid=83259) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:639}} Sep 16 15:13:50 devstack cinder-volume[83259]: DEBUG cinder.volume.drivers.quobyte [None req-a8166bb3-f868-4745-bc53-a22b8fe12c2c tempest-CreateVolumesFromSnapshotTest-388118498 None] Available shares ['10.10.41.181/cinder-vol-61f585ac-f8e2-4d19-a890-7ebc2726cc72'] {{(pid=83259) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:669}} Sep 16 15:13:50 devstack cinder-volume[83259]: DEBUG oslo_concurrency.lockutils [None req-a8166bb3-f868-4745-bc53-a22b8fe12c2c tempest-CreateVolumesFromSnapshotTest-388118498 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=83259) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 16 15:13:50 devstack cinder-volume[83259]: DEBUG cinder.volume.drivers.quobyte [None req-a8166bb3-f868-4745-bc53-a22b8fe12c2c tempest-CreateVolumesFromSnapshotTest-388118498 None] Selected 10.10.41.181/cinder-vol-61f585ac-f8e2-4d19-a890-7ebc2726cc72 as target Quobyte volume. {{(pid=83259) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:690}} Sep 16 15:13:50 devstack cinder-volume[83259]: INFO cinder.volume.drivers.remotefs [None req-a8166bb3-f868-4745-bc53-a22b8fe12c2c tempest-CreateVolumesFromSnapshotTest-388118498 None] casted to 10.10.41.181/cinder-vol-61f585ac-f8e2-4d19-a890-7ebc2726cc72 Sep 16 15:13:50 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [None req-a8166bb3-f868-4745-bc53-a22b8fe12c2c tempest-CreateVolumesFromSnapshotTest-388118498 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c/volume-100279a7-ee41-49d2-8532-176d3ce3291e 1073741824 {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 15:13:50 devstack quobyte-client[83286]: The server volume:87712ffe-8a69-446d-9ed6-4430c7ee9792@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=87712ffe-8a69-446d-9ed6-4430c7ee9792, inode=115, name=volume-100279a7-ee41-49d2-8532-176d3ce3291e, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.206), requestorAccessMask=0 Sep 16 15:13:51 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [None req-a8166bb3-f868-4745-bc53-a22b8fe12c2c tempest-CreateVolumesFromSnapshotTest-388118498 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c/volume-100279a7-ee41-49d2-8532-176d3ce3291e 1073741824" returned: 0 in 0.892s {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 15:13:51 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [None req-a8166bb3-f868-4745-bc53-a22b8fe12c2c tempest-CreateVolumesFromSnapshotTest-388118498 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c/volume-100279a7-ee41-49d2-8532-176d3ce3291e {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 15:13:51 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [None req-a8166bb3-f868-4745-bc53-a22b8fe12c2c tempest-CreateVolumesFromSnapshotTest-388118498 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c/volume-100279a7-ee41-49d2-8532-176d3ce3291e" returned: 0 in 0.146s {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 15:13:51 devstack cinder-volume[83259]: DEBUG cinder.volume.drivers.quobyte [None req-a8166bb3-f868-4745-bc53-a22b8fe12c2c tempest-CreateVolumesFromSnapshotTest-388118498 None] <== create_volume: return (1199ms) {'provider_location': '10.10.41.181/cinder-vol-61f585ac-f8e2-4d19-a890-7ebc2726cc72'} {{(pid=83259) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Sep 16 15:13:51 devstack cinder-volume[83259]: DEBUG oslo_concurrency.lockutils [None req-a8166bb3-f868-4745-bc53-a22b8fe12c2c tempest-CreateVolumesFromSnapshotTest-388118498 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.220s {{(pid=83259) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 16 15:13:52 devstack cinder-volume[83259]: DEBUG cinder.volume.manager [None req-a8166bb3-f868-4745-bc53-a22b8fe12c2c tempest-CreateVolumesFromSnapshotTest-388118498 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ea540d73-291e-4781-b835-940febb949ee) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-100279a7-ee41-49d2-8532-176d3ce3291e', 'volume_size': 1}' {{(pid=83259) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 15:13:52 devstack cinder-volume[83259]: DEBUG cinder.volume.manager [None req-a8166bb3-f868-4745-bc53-a22b8fe12c2c tempest-CreateVolumesFromSnapshotTest-388118498 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f20d2431-ba21-4d48-b46f-7a657ce535fd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83259) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 15:13:52 devstack cinder-volume[83259]: INFO cinder.volume.flows.manager.create_volume [None req-a8166bb3-f868-4745-bc53-a22b8fe12c2c tempest-CreateVolumesFromSnapshotTest-388118498 None] Volume volume-100279a7-ee41-49d2-8532-176d3ce3291e (100279a7-ee41-49d2-8532-176d3ce3291e): created successfully Sep 16 15:13:52 devstack cinder-volume[83259]: DEBUG cinder.volume.manager [None req-a8166bb3-f868-4745-bc53-a22b8fe12c2c tempest-CreateVolumesFromSnapshotTest-388118498 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f20d2431-ba21-4d48-b46f-7a657ce535fd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83259) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 15:13:52 devstack cinder-volume[83259]: DEBUG cinder.volume.manager [None req-a8166bb3-f868-4745-bc53-a22b8fe12c2c tempest-CreateVolumesFromSnapshotTest-388118498 None] Flow 'volume_create_manager' (a8c53658-6cd5-4180-bb5b-bf196dd5fdaa) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83259) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 16 15:13:52 devstack cinder-volume[83259]: INFO cinder.volume.manager [None req-a8166bb3-f868-4745-bc53-a22b8fe12c2c tempest-CreateVolumesFromSnapshotTest-388118498 None] Created volume successfully. Sep 16 15:13:52 devstack cinder-volume[83259]: DEBUG cinder.coordination [None req-c8f63872-d941-4053-bd04-0fc9ab6773f2 tempest-VolumesSnapshotListTestJSON-248203627 None] Acquiring lock "cinder-1ef934d5-3f4b-4d5c-bece-7453d803d338-delete_snapshot" by "delete_snapshot" {{(pid=83259) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 16 15:13:52 devstack cinder-volume[83259]: DEBUG cinder.coordination [None req-c8f63872-d941-4053-bd04-0fc9ab6773f2 tempest-VolumesSnapshotListTestJSON-248203627 None] Lock "cinder-1ef934d5-3f4b-4d5c-bece-7453d803d338-delete_snapshot" acquired by "delete_snapshot" :: waited 0.058s {{(pid=83259) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 16 15:13:52 devstack cinder-volume[83259]: WARNING cinder.volume.volume_utils [None req-c8f63872-d941-4053-bd04-0fc9ab6773f2 tempest-VolumesSnapshotListTestJSON-248203627 None] Volume driver (QuobyteDriver 1.2) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 16 15:13:52 devstack cinder-volume[83259]: DEBUG cinder.coordination [None req-c8f63872-d941-4053-bd04-0fc9ab6773f2 tempest-VolumesSnapshotListTestJSON-248203627 None] Acquiring lock "cinder-quobyte-68324198-e4bf-4e89-934a-b125055ec9ed" by "delete_snapshot" {{(pid=83259) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 16 15:13:53 devstack cinder-volume[83259]: DEBUG cinder.coordination [None req-c8f63872-d941-4053-bd04-0fc9ab6773f2 tempest-VolumesSnapshotListTestJSON-248203627 None] Lock "cinder-quobyte-68324198-e4bf-4e89-934a-b125055ec9ed" acquired by "delete_snapshot" :: waited 0.025s {{(pid=83259) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 16 15:13:53 devstack cinder-volume[83259]: DEBUG cinder.coordination [None req-c8f63872-d941-4053-bd04-0fc9ab6773f2 tempest-VolumesSnapshotListTestJSON-248203627 None] Acquiring lock "cinder-quobyte-1ef934d5-3f4b-4d5c-bece-7453d803d338" by "_delete_snapshot" {{(pid=83259) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 16 15:13:53 devstack cinder-volume[83259]: DEBUG cinder.coordination [None req-c8f63872-d941-4053-bd04-0fc9ab6773f2 tempest-VolumesSnapshotListTestJSON-248203627 None] Lock "cinder-quobyte-1ef934d5-3f4b-4d5c-bece-7453d803d338" acquired by "_delete_snapshot" :: waited 0.012s {{(pid=83259) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 16 15:13:53 devstack cinder-volume[83259]: DEBUG cinder.volume.drivers.remotefs [None req-c8f63872-d941-4053-bd04-0fc9ab6773f2 tempest-VolumesSnapshotListTestJSON-248203627 None] Deleting offline snapshot 1ef934d5-3f4b-4d5c-bece-7453d803d338 of volume 68324198-e4bf-4e89-934a-b125055ec9ed {{(pid=83259) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1278}} Sep 16 15:13:53 devstack cinder-volume[83259]: DEBUG cinder.volume.drivers.remotefs [None req-c8f63872-d941-4053-bd04-0fc9ab6773f2 tempest-VolumesSnapshotListTestJSON-248203627 None] snapshot_file for this snap is: volume-68324198-e4bf-4e89-934a-b125055ec9ed.1ef934d5-3f4b-4d5c-bece-7453d803d338 {{(pid=83259) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1307}} Sep 16 15:13:53 devstack cinder-volume[83259]: WARNING cinder.volume.volume_utils [None req-4f68ff0e-ce7f-4546-aa4e-4c2a7ce16d41 tempest-CreateVolumesFromSnapshotTest-388118498 None] Volume driver (QuobyteDriver 1.2) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 16 15:13:53 devstack cinder-volume[83259]: DEBUG oslo_concurrency.lockutils [None req-4f68ff0e-ce7f-4546-aa4e-4c2a7ce16d41 tempest-CreateVolumesFromSnapshotTest-388118498 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=83259) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 16 15:13:53 devstack cinder-volume[83259]: DEBUG oslo_concurrency.lockutils [None req-4f68ff0e-ce7f-4546-aa4e-4c2a7ce16d41 tempest-CreateVolumesFromSnapshotTest-388118498 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.003s {{(pid=83259) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 16 15:13:53 devstack cinder-volume[83259]: DEBUG oslo.privsep.daemon [-] privsep: reply[bd6d1a3f-cd67-4d26-b3ca-c4e1703303b6]: (4, 'qcow2') {{(pid=84312) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 16 15:13:53 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [None req-c8f63872-d941-4053-bd04-0fc9ab6773f2 tempest-VolumesSnapshotListTestJSON-248203627 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c/volume-68324198-e4bf-4e89-934a-b125055ec9ed.1ef934d5-3f4b-4d5c-bece-7453d803d338 {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 15:13:53 devstack cinder-volume[83259]: DEBUG cinder.volume.drivers.remotefs [None req-4f68ff0e-ce7f-4546-aa4e-4c2a7ce16d41 tempest-CreateVolumesFromSnapshotTest-388118498 None] Creating offline snapshot 1036e60b-7d2b-4612-a05d-de598608f23b of volume 100279a7-ee41-49d2-8532-176d3ce3291e {{(pid=83259) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1694}} Sep 16 15:13:53 devstack cinder-volume[83259]: DEBUG oslo.privsep.daemon [-] privsep: reply[a5079c12-04d7-4f6f-b7e1-683a4c25898a]: (4, 'qcow2') {{(pid=84312) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 16 15:13:53 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [None req-4f68ff0e-ce7f-4546-aa4e-4c2a7ce16d41 tempest-CreateVolumesFromSnapshotTest-388118498 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c/volume-100279a7-ee41-49d2-8532-176d3ce3291e {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 15:13:53 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [None req-c8f63872-d941-4053-bd04-0fc9ab6773f2 tempest-VolumesSnapshotListTestJSON-248203627 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c/volume-68324198-e4bf-4e89-934a-b125055ec9ed.1ef934d5-3f4b-4d5c-bece-7453d803d338" returned: 0 in 0.651s {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 15:13:53 devstack cinder-volume[83259]: DEBUG cinder.volume.drivers.remotefs [None req-c8f63872-d941-4053-bd04-0fc9ab6773f2 tempest-VolumesSnapshotListTestJSON-248203627 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-68324198-e4bf-4e89-934a-b125055ec9ed(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83259) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:886}} Sep 16 15:13:53 devstack cinder-volume[83259]: DEBUG oslo.privsep.daemon [-] privsep: reply[899125fd-bbf5-414c-88ef-a5a1a29f9185]: (4, 'qcow2') {{(pid=84312) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 16 15:13:53 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [None req-c8f63872-d941-4053-bd04-0fc9ab6773f2 tempest-VolumesSnapshotListTestJSON-248203627 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c/volume-68324198-e4bf-4e89-934a-b125055ec9ed.d3fb3e12-9afe-44d7-8d93-0d1a88315aa4 {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 15:13:54 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [None req-4f68ff0e-ce7f-4546-aa4e-4c2a7ce16d41 tempest-CreateVolumesFromSnapshotTest-388118498 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c/volume-100279a7-ee41-49d2-8532-176d3ce3291e" returned: 0 in 0.698s {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 15:13:54 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [None req-4f68ff0e-ce7f-4546-aa4e-4c2a7ce16d41 tempest-CreateVolumesFromSnapshotTest-388118498 None] Running cmd (subprocess): qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c/volume-100279a7-ee41-49d2-8532-176d3ce3291e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c/volume-100279a7-ee41-49d2-8532-176d3ce3291e.1036e60b-7d2b-4612-a05d-de598608f23b 1G {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 15:13:54 devstack quobyte-client[83286]: System call of process 96518 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 16 15:13:54 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [None req-c8f63872-d941-4053-bd04-0fc9ab6773f2 tempest-VolumesSnapshotListTestJSON-248203627 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c/volume-68324198-e4bf-4e89-934a-b125055ec9ed.d3fb3e12-9afe-44d7-8d93-0d1a88315aa4" returned: 0 in 0.581s {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 15:13:54 devstack quobyte-client[83286]: The server volume:87712ffe-8a69-446d-9ed6-4430c7ee9792@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=87712ffe-8a69-446d-9ed6-4430c7ee9792, inode=116, name=volume-100279a7-ee41-49d2-8532-176d3ce3291e.1036e60b-7d2b-4612-a05d-de598608f23b, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.206), requestorAccessMask=0 Sep 16 15:13:54 devstack cinder-volume[83259]: DEBUG cinder.volume.drivers.remotefs [None req-c8f63872-d941-4053-bd04-0fc9ab6773f2 tempest-VolumesSnapshotListTestJSON-248203627 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-68324198-e4bf-4e89-934a-b125055ec9ed(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83259) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:886}} Sep 16 15:13:54 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [None req-c8f63872-d941-4053-bd04-0fc9ab6773f2 tempest-VolumesSnapshotListTestJSON-248203627 None] Running cmd (subprocess): qemu-img commit -d /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c/volume-68324198-e4bf-4e89-934a-b125055ec9ed.1ef934d5-3f4b-4d5c-bece-7453d803d338 {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 15:13:54 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [None req-4f68ff0e-ce7f-4546-aa4e-4c2a7ce16d41 tempest-CreateVolumesFromSnapshotTest-388118498 None] CMD "qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c/volume-100279a7-ee41-49d2-8532-176d3ce3291e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c/volume-100279a7-ee41-49d2-8532-176d3ce3291e.1036e60b-7d2b-4612-a05d-de598608f23b 1G" returned: 0 in 0.430s {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 15:13:54 devstack quobyte-client[83286]: System call of process 96527 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 16 15:13:54 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [None req-4f68ff0e-ce7f-4546-aa4e-4c2a7ce16d41 tempest-CreateVolumesFromSnapshotTest-388118498 None] Running cmd (subprocess): qemu-img rebase -u -b volume-100279a7-ee41-49d2-8532-176d3ce3291e -F qcow2 /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c/volume-100279a7-ee41-49d2-8532-176d3ce3291e.1036e60b-7d2b-4612-a05d-de598608f23b {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 15:13:54 devstack quobyte-client[83286]: System call of process 96530 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 16 15:13:54 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [None req-4f68ff0e-ce7f-4546-aa4e-4c2a7ce16d41 tempest-CreateVolumesFromSnapshotTest-388118498 None] CMD "qemu-img rebase -u -b volume-100279a7-ee41-49d2-8532-176d3ce3291e -F qcow2 /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c/volume-100279a7-ee41-49d2-8532-176d3ce3291e.1036e60b-7d2b-4612-a05d-de598608f23b" returned: 0 in 0.191s {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 15:13:54 devstack cinder-volume[83259]: DEBUG cinder.volume.drivers.remotefs [None req-4f68ff0e-ce7f-4546-aa4e-4c2a7ce16d41 tempest-CreateVolumesFromSnapshotTest-388118498 None] File path /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c/volume-100279a7-ee41-49d2-8532-176d3ce3291e.1036e60b-7d2b-4612-a05d-de598608f23b is being set with permissions: 660 {{(pid=83259) _set_rw_permissions /opt/stack/cinder/cinder/volume/drivers/remotefs.py:492}} Sep 16 15:13:54 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [None req-4f68ff0e-ce7f-4546-aa4e-4c2a7ce16d41 tempest-CreateVolumesFromSnapshotTest-388118498 None] Running cmd (subprocess): chmod 660 /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c/volume-100279a7-ee41-49d2-8532-176d3ce3291e.1036e60b-7d2b-4612-a05d-de598608f23b {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 15:13:55 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [None req-c8f63872-d941-4053-bd04-0fc9ab6773f2 tempest-VolumesSnapshotListTestJSON-248203627 None] CMD "qemu-img commit -d /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c/volume-68324198-e4bf-4e89-934a-b125055ec9ed.1ef934d5-3f4b-4d5c-bece-7453d803d338" returned: 0 in 0.534s {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 15:13:55 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [None req-c8f63872-d941-4053-bd04-0fc9ab6773f2 tempest-VolumesSnapshotListTestJSON-248203627 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c/volume-68324198-e4bf-4e89-934a-b125055ec9ed.1ef934d5-3f4b-4d5c-bece-7453d803d338 {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 15:13:55 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [None req-4f68ff0e-ce7f-4546-aa4e-4c2a7ce16d41 tempest-CreateVolumesFromSnapshotTest-388118498 None] CMD "chmod 660 /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c/volume-100279a7-ee41-49d2-8532-176d3ce3291e.1036e60b-7d2b-4612-a05d-de598608f23b" returned: 0 in 0.476s {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 15:13:55 devstack cinder-volume[83259]: DEBUG cinder.volume.drivers.remotefs [None req-4f68ff0e-ce7f-4546-aa4e-4c2a7ce16d41 tempest-CreateVolumesFromSnapshotTest-388118498 None] Setting permissions: /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c/volume-100279a7-ee41-49d2-8532-176d3ce3291e -> 1000:1000 {{(pid=83259) _do_create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1584}} Sep 16 15:13:55 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [None req-4f68ff0e-ce7f-4546-aa4e-4c2a7ce16d41 tempest-CreateVolumesFromSnapshotTest-388118498 None] Running cmd (subprocess): chown --reference=/opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c/volume-100279a7-ee41-49d2-8532-176d3ce3291e /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c/volume-100279a7-ee41-49d2-8532-176d3ce3291e.1036e60b-7d2b-4612-a05d-de598608f23b {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 15:13:55 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [None req-c8f63872-d941-4053-bd04-0fc9ab6773f2 tempest-VolumesSnapshotListTestJSON-248203627 None] CMD "rm -f /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c/volume-68324198-e4bf-4e89-934a-b125055ec9ed.1ef934d5-3f4b-4d5c-bece-7453d803d338" returned: 0 in 0.497s {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 15:13:55 devstack cinder-volume[83259]: DEBUG cinder.coordination [None req-c8f63872-d941-4053-bd04-0fc9ab6773f2 tempest-VolumesSnapshotListTestJSON-248203627 None] Lock "cinder-quobyte-1ef934d5-3f4b-4d5c-bece-7453d803d338" released by "_delete_snapshot" :: held 2.682s {{(pid=83259) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 16 15:13:55 devstack cinder-volume[83259]: WARNING cinder.volume.volume_utils [None req-4dd3fd20-18b1-4762-be21-4da31c52e43b tempest-VolumesListTestJSON-1108154855 None] Volume driver (QuobyteDriver 1.2) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 16 15:13:55 devstack cinder-volume[83259]: DEBUG cinder.volume.flows.manager.create_volume [None req-4dd3fd20-18b1-4762-be21-4da31c52e43b tempest-VolumesListTestJSON-1108154855 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#Quobyte'], 'hosts': ['devstack@QuobyteHD#Quobyte']} {{(pid=83259) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1387}} Sep 16 15:13:55 devstack cinder-volume[83259]: DEBUG cinder.volume.manager [None req-4dd3fd20-18b1-4762-be21-4da31c52e43b tempest-VolumesListTestJSON-1108154855 None] Flow 'volume_create_manager' (49d01b96-7b5f-4e90-aefe-ac5230cd0237) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83259) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 16 15:13:55 devstack cinder-volume[83259]: DEBUG cinder.volume.manager [None req-4dd3fd20-18b1-4762-be21-4da31c52e43b tempest-VolumesListTestJSON-1108154855 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (08223faa-c0b8-49a8-b654-b0544b7d91d7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83259) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 15:13:55 devstack cinder-volume[83259]: DEBUG cinder.volume.manager [None req-4dd3fd20-18b1-4762-be21-4da31c52e43b tempest-VolumesListTestJSON-1108154855 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (08223faa-c0b8-49a8-b654-b0544b7d91d7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-16T13:13:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-728251212',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#Quobyte',id=01ac8da2-a978-4bbb-8b89-58d7d25525e6,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='865f0d0f7af2430d9697eb01904b9bb0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-16T13:13:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-16T13:13:55Z,use_quota=True,user_id='8871143af23e48c0bc960a4ebe1d5ddc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(485ead50-3df8-4d76-8d34-a4db136c980a),volume_type_id=485ead50-3df8-4d76-8d34-a4db136c980a)' {{(pid=83259) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 15:13:55 devstack cinder-volume[83259]: DEBUG cinder.volume.manager [None req-4dd3fd20-18b1-4762-be21-4da31c52e43b tempest-VolumesListTestJSON-1108154855 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (74dc7b0e-ff67-4612-8283-7db3b867e31e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83259) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 15:13:55 devstack cinder-volume[83259]: DEBUG cinder.volume.manager [None req-4dd3fd20-18b1-4762-be21-4da31c52e43b tempest-VolumesListTestJSON-1108154855 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (74dc7b0e-ff67-4612-8283-7db3b867e31e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83259) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 15:13:55 devstack cinder-volume[83259]: DEBUG cinder.volume.manager [None req-4dd3fd20-18b1-4762-be21-4da31c52e43b tempest-VolumesListTestJSON-1108154855 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c5fa1e0f-fe8a-48c8-a353-b85cd6bd93e4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83259) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 15:13:55 devstack cinder-volume[83259]: DEBUG cinder.volume.manager [None req-4dd3fd20-18b1-4762-be21-4da31c52e43b tempest-VolumesListTestJSON-1108154855 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c5fa1e0f-fe8a-48c8-a353-b85cd6bd93e4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '01ac8da2-a978-4bbb-8b89-58d7d25525e6', 'volume_name': 'volume-01ac8da2-a978-4bbb-8b89-58d7d25525e6', 'volume_size': 1}' {{(pid=83259) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 15:13:55 devstack cinder-volume[83259]: DEBUG cinder.volume.manager [None req-4dd3fd20-18b1-4762-be21-4da31c52e43b tempest-VolumesListTestJSON-1108154855 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3bf7f0cc-ada8-4ce1-adad-61d23c0d73a7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83259) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 15:13:55 devstack cinder-volume[83259]: DEBUG cinder.volume.manager [None req-4dd3fd20-18b1-4762-be21-4da31c52e43b tempest-VolumesListTestJSON-1108154855 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3bf7f0cc-ada8-4ce1-adad-61d23c0d73a7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83259) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 15:13:55 devstack cinder-volume[83259]: DEBUG cinder.volume.manager [None req-4dd3fd20-18b1-4762-be21-4da31c52e43b tempest-VolumesListTestJSON-1108154855 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (639055d4-e401-4004-a329-08a90e8ad42e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83259) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 15:13:55 devstack cinder-volume[83259]: INFO cinder.volume.flows.manager.create_volume [None req-4dd3fd20-18b1-4762-be21-4da31c52e43b tempest-VolumesListTestJSON-1108154855 None] Volume 01ac8da2-a978-4bbb-8b89-58d7d25525e6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-01ac8da2-a978-4bbb-8b89-58d7d25525e6', 'volume_size': 1} Sep 16 15:13:55 devstack cinder-volume[83259]: DEBUG oslo_concurrency.lockutils [None req-4dd3fd20-18b1-4762-be21-4da31c52e43b tempest-VolumesListTestJSON-1108154855 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83259) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 16 15:13:55 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [None req-4f68ff0e-ce7f-4546-aa4e-4c2a7ce16d41 tempest-CreateVolumesFromSnapshotTest-388118498 None] CMD "chown --reference=/opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c/volume-100279a7-ee41-49d2-8532-176d3ce3291e /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c/volume-100279a7-ee41-49d2-8532-176d3ce3291e.1036e60b-7d2b-4612-a05d-de598608f23b" returned: 0 in 0.535s {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 15:13:55 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [None req-4f68ff0e-ce7f-4546-aa4e-4c2a7ce16d41 tempest-CreateVolumesFromSnapshotTest-388118498 None] Running cmd (subprocess): truncate -s0 /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c/volume-100279a7-ee41-49d2-8532-176d3ce3291e.info {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 15:13:56 devstack cinder-volume[83259]: DEBUG cinder.coordination [None req-c8f63872-d941-4053-bd04-0fc9ab6773f2 tempest-VolumesSnapshotListTestJSON-248203627 None] Lock "cinder-quobyte-68324198-e4bf-4e89-934a-b125055ec9ed" released by "delete_snapshot" :: held 3.095s {{(pid=83259) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 16 15:13:56 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [None req-4f68ff0e-ce7f-4546-aa4e-4c2a7ce16d41 tempest-CreateVolumesFromSnapshotTest-388118498 None] CMD "truncate -s0 /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c/volume-100279a7-ee41-49d2-8532-176d3ce3291e.info" returned: 0 in 0.390s {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 15:13:56 devstack cinder-volume[83259]: DEBUG cinder.volume.drivers.remotefs [None req-4f68ff0e-ce7f-4546-aa4e-4c2a7ce16d41 tempest-CreateVolumesFromSnapshotTest-388118498 None] File path /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c/volume-100279a7-ee41-49d2-8532-176d3ce3291e.info is being set with permissions: 660 {{(pid=83259) _set_rw_permissions /opt/stack/cinder/cinder/volume/drivers/remotefs.py:492}} Sep 16 15:13:56 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [None req-4f68ff0e-ce7f-4546-aa4e-4c2a7ce16d41 tempest-CreateVolumesFromSnapshotTest-388118498 None] Running cmd (subprocess): chmod 660 /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c/volume-100279a7-ee41-49d2-8532-176d3ce3291e.info {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 15:13:56 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [None req-4f68ff0e-ce7f-4546-aa4e-4c2a7ce16d41 tempest-CreateVolumesFromSnapshotTest-388118498 None] CMD "chmod 660 /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c/volume-100279a7-ee41-49d2-8532-176d3ce3291e.info" returned: 0 in 0.249s {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 15:13:56 devstack cinder-volume[83259]: DEBUG oslo_concurrency.lockutils [None req-4f68ff0e-ce7f-4546-aa4e-4c2a7ce16d41 tempest-CreateVolumesFromSnapshotTest-388118498 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.599s {{(pid=83259) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 16 15:13:56 devstack cinder-volume[83259]: DEBUG oslo_concurrency.lockutils [None req-4dd3fd20-18b1-4762-be21-4da31c52e43b tempest-VolumesListTestJSON-1108154855 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.810s {{(pid=83259) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 16 15:13:56 devstack cinder-volume[83259]: DEBUG cinder.volume.drivers.quobyte [None req-4dd3fd20-18b1-4762-be21-4da31c52e43b tempest-VolumesListTestJSON-1108154855 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-16T13:13:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-728251212',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#Quobyte',id=01ac8da2-a978-4bbb-8b89-58d7d25525e6,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='865f0d0f7af2430d9697eb01904b9bb0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-16T13:13:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-16T13:13:55Z,use_quota=True,user_id='8871143af23e48c0bc960a4ebe1d5ddc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(485ead50-3df8-4d76-8d34-a4db136c980a),volume_type_id=485ead50-3df8-4d76-8d34-a4db136c980a)}" {{(pid=83259) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Sep 16 15:13:56 devstack cinder-volume[83259]: DEBUG cinder.volume.drivers.remotefs [None req-4dd3fd20-18b1-4762-be21-4da31c52e43b tempest-VolumesListTestJSON-1108154855 None] Creating volume 01ac8da2-a978-4bbb-8b89-58d7d25525e6 {{(pid=83259) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}} Sep 16 15:13:56 devstack cinder-volume[83259]: DEBUG oslo_concurrency.lockutils [None req-4dd3fd20-18b1-4762-be21-4da31c52e43b tempest-VolumesListTestJSON-1108154855 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83259) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 16 15:13:56 devstack cinder-volume[83259]: DEBUG oslo_concurrency.lockutils [None req-4dd3fd20-18b1-4762-be21-4da31c52e43b tempest-VolumesListTestJSON-1108154855 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=83259) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 16 15:13:56 devstack cinder-volume[83259]: DEBUG cinder.volume.drivers.quobyte [None req-4dd3fd20-18b1-4762-be21-4da31c52e43b tempest-VolumesListTestJSON-1108154855 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-61f585ac-f8e2-4d19-a890-7ebc2726cc72': None} {{(pid=83259) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:639}} Sep 16 15:13:56 devstack cinder-volume[83259]: DEBUG cinder.volume.drivers.quobyte [None req-4dd3fd20-18b1-4762-be21-4da31c52e43b tempest-VolumesListTestJSON-1108154855 None] Available shares ['10.10.41.181/cinder-vol-61f585ac-f8e2-4d19-a890-7ebc2726cc72'] {{(pid=83259) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:669}} Sep 16 15:13:56 devstack cinder-volume[83259]: DEBUG oslo_concurrency.lockutils [None req-4dd3fd20-18b1-4762-be21-4da31c52e43b tempest-VolumesListTestJSON-1108154855 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=83259) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 16 15:13:56 devstack cinder-volume[83259]: DEBUG cinder.volume.drivers.quobyte [None req-4dd3fd20-18b1-4762-be21-4da31c52e43b tempest-VolumesListTestJSON-1108154855 None] Selected 10.10.41.181/cinder-vol-61f585ac-f8e2-4d19-a890-7ebc2726cc72 as target Quobyte volume. {{(pid=83259) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:690}} Sep 16 15:13:56 devstack cinder-volume[83259]: INFO cinder.volume.drivers.remotefs [None req-4dd3fd20-18b1-4762-be21-4da31c52e43b tempest-VolumesListTestJSON-1108154855 None] casted to 10.10.41.181/cinder-vol-61f585ac-f8e2-4d19-a890-7ebc2726cc72 Sep 16 15:13:56 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [None req-4dd3fd20-18b1-4762-be21-4da31c52e43b tempest-VolumesListTestJSON-1108154855 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c/volume-01ac8da2-a978-4bbb-8b89-58d7d25525e6 1073741824 {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 15:13:56 devstack quobyte-client[83286]: System call of process 96538 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 16 15:13:56 devstack quobyte-client[83286]: The server volume:87712ffe-8a69-446d-9ed6-4430c7ee9792@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=87712ffe-8a69-446d-9ed6-4430c7ee9792, inode=118, name=volume-01ac8da2-a978-4bbb-8b89-58d7d25525e6, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.206), requestorAccessMask=0 Sep 16 15:13:57 devstack cinder-volume[83259]: INFO cinder.volume.manager [None req-4f68ff0e-ce7f-4546-aa4e-4c2a7ce16d41 tempest-CreateVolumesFromSnapshotTest-388118498 None] Create snapshot completed successfully Sep 16 15:13:57 devstack cinder-volume[83259]: DEBUG cinder.quota [None req-c8f63872-d941-4053-bd04-0fc9ab6773f2 tempest-VolumesSnapshotListTestJSON-248203627 None] Created reservations ['75acb815-9302-4a39-a576-f639fc94d0e9', '2b44cb88-21ca-4d30-97ee-0010fd2dff79', '3f24be11-1570-45fa-99c5-4f35bda86066', 'af3f2a25-0477-40e3-af55-1fbcaafdad86'] {{(pid=83259) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 16 15:13:57 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [None req-4dd3fd20-18b1-4762-be21-4da31c52e43b tempest-VolumesListTestJSON-1108154855 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c/volume-01ac8da2-a978-4bbb-8b89-58d7d25525e6 1073741824" returned: 0 in 0.501s {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 15:13:57 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [None req-4dd3fd20-18b1-4762-be21-4da31c52e43b tempest-VolumesListTestJSON-1108154855 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c/volume-01ac8da2-a978-4bbb-8b89-58d7d25525e6 {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 15:13:57 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [None req-4dd3fd20-18b1-4762-be21-4da31c52e43b tempest-VolumesListTestJSON-1108154855 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c/volume-01ac8da2-a978-4bbb-8b89-58d7d25525e6" returned: 0 in 0.205s {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 15:13:57 devstack cinder-volume[83259]: DEBUG cinder.volume.drivers.quobyte [None req-4dd3fd20-18b1-4762-be21-4da31c52e43b tempest-VolumesListTestJSON-1108154855 None] <== create_volume: return (748ms) {'provider_location': '10.10.41.181/cinder-vol-61f585ac-f8e2-4d19-a890-7ebc2726cc72'} {{(pid=83259) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Sep 16 15:13:57 devstack cinder-volume[83259]: DEBUG oslo_concurrency.lockutils [None req-4dd3fd20-18b1-4762-be21-4da31c52e43b tempest-VolumesListTestJSON-1108154855 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.772s {{(pid=83259) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 16 15:13:57 devstack cinder-volume[83259]: DEBUG cinder.volume.manager [None req-4dd3fd20-18b1-4762-be21-4da31c52e43b tempest-VolumesListTestJSON-1108154855 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (639055d4-e401-4004-a329-08a90e8ad42e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-01ac8da2-a978-4bbb-8b89-58d7d25525e6', 'volume_size': 1}' {{(pid=83259) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 15:13:57 devstack cinder-volume[83259]: DEBUG cinder.volume.manager [None req-4dd3fd20-18b1-4762-be21-4da31c52e43b tempest-VolumesListTestJSON-1108154855 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (505b5c33-e9c4-4d83-8a36-35a96ee6454b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83259) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 15:13:57 devstack cinder-volume[83259]: INFO cinder.volume.manager [None req-c8f63872-d941-4053-bd04-0fc9ab6773f2 tempest-VolumesSnapshotListTestJSON-248203627 None] Delete snapshot completed successfully. Sep 16 15:13:57 devstack cinder-volume[83259]: DEBUG cinder.coordination [None req-c8f63872-d941-4053-bd04-0fc9ab6773f2 tempest-VolumesSnapshotListTestJSON-248203627 None] Lock "cinder-1ef934d5-3f4b-4d5c-bece-7453d803d338-delete_snapshot" released by "delete_snapshot" :: held 4.838s {{(pid=83259) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 16 15:13:57 devstack cinder-volume[83259]: INFO cinder.volume.flows.manager.create_volume [None req-4dd3fd20-18b1-4762-be21-4da31c52e43b tempest-VolumesListTestJSON-1108154855 None] Volume volume-01ac8da2-a978-4bbb-8b89-58d7d25525e6 (01ac8da2-a978-4bbb-8b89-58d7d25525e6): created successfully Sep 16 15:13:57 devstack cinder-volume[83259]: DEBUG cinder.volume.manager [None req-4dd3fd20-18b1-4762-be21-4da31c52e43b tempest-VolumesListTestJSON-1108154855 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (505b5c33-e9c4-4d83-8a36-35a96ee6454b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83259) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 15:13:57 devstack cinder-volume[83259]: DEBUG cinder.volume.manager [None req-4dd3fd20-18b1-4762-be21-4da31c52e43b tempest-VolumesListTestJSON-1108154855 None] Flow 'volume_create_manager' (49d01b96-7b5f-4e90-aefe-ac5230cd0237) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83259) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 16 15:13:57 devstack cinder-volume[83259]: INFO cinder.volume.manager [None req-4dd3fd20-18b1-4762-be21-4da31c52e43b tempest-VolumesListTestJSON-1108154855 None] Created volume successfully. Sep 16 15:13:58 devstack cinder-volume[83259]: WARNING cinder.volume.volume_utils [None req-90f304d0-ba29-41e1-9b06-a1731eca5303 tempest-CreateVolumesFromSnapshotTest-388118498 None] Volume driver (QuobyteDriver 1.2) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 16 15:13:58 devstack cinder-volume[83259]: DEBUG cinder.volume.flows.manager.create_volume [None req-90f304d0-ba29-41e1-9b06-a1731eca5303 tempest-CreateVolumesFromSnapshotTest-388118498 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#Quobyte'], 'hosts': ['devstack@QuobyteHD#Quobyte']} {{(pid=83259) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1387}} Sep 16 15:13:58 devstack cinder-volume[83259]: DEBUG cinder.volume.manager [None req-90f304d0-ba29-41e1-9b06-a1731eca5303 tempest-CreateVolumesFromSnapshotTest-388118498 None] Flow 'volume_create_manager' (d979f82e-6785-4c6f-b257-b04340fe5f37) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83259) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 16 15:13:58 devstack cinder-volume[83259]: DEBUG cinder.volume.manager [None req-90f304d0-ba29-41e1-9b06-a1731eca5303 tempest-CreateVolumesFromSnapshotTest-388118498 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e1c2725c-3657-4dff-9577-9394b663eaa0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83259) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 15:13:58 devstack cinder-volume[83259]: DEBUG cinder.volume.manager [None req-90f304d0-ba29-41e1-9b06-a1731eca5303 tempest-CreateVolumesFromSnapshotTest-388118498 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e1c2725c-3657-4dff-9577-9394b663eaa0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-16T13:13:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-311015861',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#Quobyte',id=e895ddab-09be-40b1-83fd-7494828f6769,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8468a91973714863896d263c8f21babb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-16T13:13:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-16T13:13:58Z,use_quota=True,user_id='b8e110a8439d457b8c0f8cec54bb1b14',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(485ead50-3df8-4d76-8d34-a4db136c980a),volume_type_id=485ead50-3df8-4d76-8d34-a4db136c980a)' {{(pid=83259) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 15:13:58 devstack cinder-volume[83259]: DEBUG cinder.volume.manager [None req-90f304d0-ba29-41e1-9b06-a1731eca5303 tempest-CreateVolumesFromSnapshotTest-388118498 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (429408ff-887b-4706-8948-d2d7e1a8a614) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83259) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 15:13:58 devstack cinder-volume[83259]: DEBUG cinder.volume.manager [None req-90f304d0-ba29-41e1-9b06-a1731eca5303 tempest-CreateVolumesFromSnapshotTest-388118498 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (429408ff-887b-4706-8948-d2d7e1a8a614) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83259) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 15:13:58 devstack cinder-volume[83259]: DEBUG cinder.volume.manager [None req-90f304d0-ba29-41e1-9b06-a1731eca5303 tempest-CreateVolumesFromSnapshotTest-388118498 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c1df2648-739d-439a-aec4-21fefbe2947b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83259) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 15:13:58 devstack cinder-volume[83259]: DEBUG cinder.volume.manager [None req-90f304d0-ba29-41e1-9b06-a1731eca5303 tempest-CreateVolumesFromSnapshotTest-388118498 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c1df2648-739d-439a-aec4-21fefbe2947b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e895ddab-09be-40b1-83fd-7494828f6769', 'volume_name': 'volume-e895ddab-09be-40b1-83fd-7494828f6769', 'volume_size': 1}' {{(pid=83259) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 15:13:58 devstack cinder-volume[83259]: DEBUG cinder.volume.manager [None req-90f304d0-ba29-41e1-9b06-a1731eca5303 tempest-CreateVolumesFromSnapshotTest-388118498 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2957dfc4-a2f5-4b7d-802f-5d53d3b70c72) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83259) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 15:13:58 devstack cinder-volume[83259]: DEBUG cinder.volume.manager [None req-90f304d0-ba29-41e1-9b06-a1731eca5303 tempest-CreateVolumesFromSnapshotTest-388118498 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2957dfc4-a2f5-4b7d-802f-5d53d3b70c72) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83259) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 15:13:58 devstack cinder-volume[83259]: DEBUG cinder.volume.manager [None req-90f304d0-ba29-41e1-9b06-a1731eca5303 tempest-CreateVolumesFromSnapshotTest-388118498 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (323abd3e-5dc3-44d7-b5b2-9e9e182cf75f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83259) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 15:13:58 devstack cinder-volume[83259]: INFO cinder.volume.flows.manager.create_volume [None req-90f304d0-ba29-41e1-9b06-a1731eca5303 tempest-CreateVolumesFromSnapshotTest-388118498 None] Volume e895ddab-09be-40b1-83fd-7494828f6769: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e895ddab-09be-40b1-83fd-7494828f6769', 'volume_size': 1} Sep 16 15:13:58 devstack cinder-volume[83259]: DEBUG oslo_concurrency.lockutils [None req-90f304d0-ba29-41e1-9b06-a1731eca5303 tempest-CreateVolumesFromSnapshotTest-388118498 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83259) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 16 15:13:58 devstack cinder-volume[83259]: DEBUG oslo_concurrency.lockutils [None req-90f304d0-ba29-41e1-9b06-a1731eca5303 tempest-CreateVolumesFromSnapshotTest-388118498 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=83259) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 16 15:13:58 devstack cinder-volume[83259]: DEBUG cinder.volume.drivers.quobyte [None req-90f304d0-ba29-41e1-9b06-a1731eca5303 tempest-CreateVolumesFromSnapshotTest-388118498 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-16T13:13:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-311015861',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#Quobyte',id=e895ddab-09be-40b1-83fd-7494828f6769,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8468a91973714863896d263c8f21babb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-16T13:13:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-16T13:13:58Z,use_quota=True,user_id='b8e110a8439d457b8c0f8cec54bb1b14',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(485ead50-3df8-4d76-8d34-a4db136c980a),volume_type_id=485ead50-3df8-4d76-8d34-a4db136c980a)}" {{(pid=83259) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Sep 16 15:13:58 devstack cinder-volume[83259]: DEBUG cinder.volume.drivers.remotefs [None req-90f304d0-ba29-41e1-9b06-a1731eca5303 tempest-CreateVolumesFromSnapshotTest-388118498 None] Creating volume e895ddab-09be-40b1-83fd-7494828f6769 {{(pid=83259) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}} Sep 16 15:13:58 devstack cinder-volume[83259]: DEBUG oslo_concurrency.lockutils [None req-90f304d0-ba29-41e1-9b06-a1731eca5303 tempest-CreateVolumesFromSnapshotTest-388118498 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83259) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 16 15:13:58 devstack cinder-volume[83259]: DEBUG oslo_concurrency.lockutils [None req-90f304d0-ba29-41e1-9b06-a1731eca5303 tempest-CreateVolumesFromSnapshotTest-388118498 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83259) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 16 15:13:58 devstack cinder-volume[83259]: DEBUG cinder.volume.drivers.quobyte [None req-90f304d0-ba29-41e1-9b06-a1731eca5303 tempest-CreateVolumesFromSnapshotTest-388118498 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-61f585ac-f8e2-4d19-a890-7ebc2726cc72': None} {{(pid=83259) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:639}} Sep 16 15:13:58 devstack cinder-volume[83259]: DEBUG cinder.volume.drivers.quobyte [None req-90f304d0-ba29-41e1-9b06-a1731eca5303 tempest-CreateVolumesFromSnapshotTest-388118498 None] Available shares ['10.10.41.181/cinder-vol-61f585ac-f8e2-4d19-a890-7ebc2726cc72'] {{(pid=83259) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:669}} Sep 16 15:13:58 devstack cinder-volume[83259]: DEBUG oslo_concurrency.lockutils [None req-90f304d0-ba29-41e1-9b06-a1731eca5303 tempest-CreateVolumesFromSnapshotTest-388118498 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=83259) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 16 15:13:58 devstack cinder-volume[83259]: DEBUG cinder.volume.drivers.quobyte [None req-90f304d0-ba29-41e1-9b06-a1731eca5303 tempest-CreateVolumesFromSnapshotTest-388118498 None] Selected 10.10.41.181/cinder-vol-61f585ac-f8e2-4d19-a890-7ebc2726cc72 as target Quobyte volume. {{(pid=83259) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:690}} Sep 16 15:13:58 devstack cinder-volume[83259]: INFO cinder.volume.drivers.remotefs [None req-90f304d0-ba29-41e1-9b06-a1731eca5303 tempest-CreateVolumesFromSnapshotTest-388118498 None] casted to 10.10.41.181/cinder-vol-61f585ac-f8e2-4d19-a890-7ebc2726cc72 Sep 16 15:13:58 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [None req-90f304d0-ba29-41e1-9b06-a1731eca5303 tempest-CreateVolumesFromSnapshotTest-388118498 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c/volume-e895ddab-09be-40b1-83fd-7494828f6769 1073741824 {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 15:13:58 devstack quobyte-client[83286]: The server volume:87712ffe-8a69-446d-9ed6-4430c7ee9792@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=87712ffe-8a69-446d-9ed6-4430c7ee9792, inode=119, name=volume-e895ddab-09be-40b1-83fd-7494828f6769, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.206), requestorAccessMask=0 Sep 16 15:13:58 devstack cinder-volume[83259]: DEBUG cinder.coordination [None req-b1850a45-30a0-47e8-875c-533412becd6e tempest-VolumesSnapshotListTestJSON-248203627 None] Acquiring lock "cinder-d3fb3e12-9afe-44d7-8d93-0d1a88315aa4-delete_snapshot" by "delete_snapshot" {{(pid=83259) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 16 15:13:58 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [None req-90f304d0-ba29-41e1-9b06-a1731eca5303 tempest-CreateVolumesFromSnapshotTest-388118498 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c/volume-e895ddab-09be-40b1-83fd-7494828f6769 1073741824" returned: 0 in 0.722s {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 15:13:58 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [None req-90f304d0-ba29-41e1-9b06-a1731eca5303 tempest-CreateVolumesFromSnapshotTest-388118498 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c/volume-e895ddab-09be-40b1-83fd-7494828f6769 {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 15:13:59 devstack cinder-volume[83259]: WARNING cinder.volume.volume_utils [None req-665ee6b1-64bf-4338-9aae-5e44af3abc1c tempest-CreateVolumesFromSnapshotTest-388118498 None] Volume driver (QuobyteDriver 1.2) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 16 15:13:59 devstack cinder-volume[83259]: DEBUG cinder.volume.flows.manager.create_volume [None req-665ee6b1-64bf-4338-9aae-5e44af3abc1c tempest-CreateVolumesFromSnapshotTest-388118498 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#Quobyte'], 'hosts': ['devstack@QuobyteHD#Quobyte']} {{(pid=83259) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1387}} Sep 16 15:13:59 devstack cinder-volume[83259]: DEBUG cinder.volume.manager [None req-665ee6b1-64bf-4338-9aae-5e44af3abc1c tempest-CreateVolumesFromSnapshotTest-388118498 None] Flow 'volume_create_manager' (34313346-4858-47bb-887b-fc4c85d95dff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83259) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 16 15:13:59 devstack cinder-volume[83259]: DEBUG cinder.volume.manager [None req-665ee6b1-64bf-4338-9aae-5e44af3abc1c tempest-CreateVolumesFromSnapshotTest-388118498 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (40912f83-3668-47fe-a6af-04e5273bf327) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83259) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 15:13:59 devstack cinder-volume[83259]: DEBUG cinder.volume.manager [None req-665ee6b1-64bf-4338-9aae-5e44af3abc1c tempest-CreateVolumesFromSnapshotTest-388118498 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (40912f83-3668-47fe-a6af-04e5273bf327) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-16T13:13:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-813747966',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#Quobyte',id=e1a17f05-33a9-4837-8c5f-2e5b8c6f5bf0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8468a91973714863896d263c8f21babb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-16T13:13:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-16T13:13:58Z,use_quota=True,user_id='b8e110a8439d457b8c0f8cec54bb1b14',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(485ead50-3df8-4d76-8d34-a4db136c980a),volume_type_id=485ead50-3df8-4d76-8d34-a4db136c980a)' {{(pid=83259) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 15:13:59 devstack cinder-volume[83259]: DEBUG cinder.volume.manager [None req-665ee6b1-64bf-4338-9aae-5e44af3abc1c tempest-CreateVolumesFromSnapshotTest-388118498 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (473e3042-967e-4833-98be-ee427d47af11) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83259) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 15:13:59 devstack cinder-volume[83259]: DEBUG cinder.volume.manager [None req-665ee6b1-64bf-4338-9aae-5e44af3abc1c tempest-CreateVolumesFromSnapshotTest-388118498 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (473e3042-967e-4833-98be-ee427d47af11) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83259) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 15:13:59 devstack cinder-volume[83259]: DEBUG cinder.volume.manager [None req-665ee6b1-64bf-4338-9aae-5e44af3abc1c tempest-CreateVolumesFromSnapshotTest-388118498 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (181c0fcb-e0ce-41b8-9dfe-e4393ad8612a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83259) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 15:13:59 devstack cinder-volume[83259]: DEBUG cinder.volume.manager [None req-665ee6b1-64bf-4338-9aae-5e44af3abc1c tempest-CreateVolumesFromSnapshotTest-388118498 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (181c0fcb-e0ce-41b8-9dfe-e4393ad8612a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e1a17f05-33a9-4837-8c5f-2e5b8c6f5bf0', 'volume_name': 'volume-e1a17f05-33a9-4837-8c5f-2e5b8c6f5bf0', 'volume_size': 1}' {{(pid=83259) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 15:13:59 devstack cinder-volume[83259]: DEBUG cinder.volume.manager [None req-665ee6b1-64bf-4338-9aae-5e44af3abc1c tempest-CreateVolumesFromSnapshotTest-388118498 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2875d747-9149-46d1-9351-94d5dfb51a94) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83259) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 15:13:59 devstack cinder-volume[83259]: DEBUG cinder.volume.manager [None req-665ee6b1-64bf-4338-9aae-5e44af3abc1c tempest-CreateVolumesFromSnapshotTest-388118498 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2875d747-9149-46d1-9351-94d5dfb51a94) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83259) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 15:13:59 devstack cinder-volume[83259]: DEBUG cinder.volume.manager [None req-665ee6b1-64bf-4338-9aae-5e44af3abc1c tempest-CreateVolumesFromSnapshotTest-388118498 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (53e98c99-c56e-4cc5-b322-bc6a5ee30288) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83259) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 15:13:59 devstack cinder-volume[83259]: INFO cinder.volume.flows.manager.create_volume [None req-665ee6b1-64bf-4338-9aae-5e44af3abc1c tempest-CreateVolumesFromSnapshotTest-388118498 None] Volume e1a17f05-33a9-4837-8c5f-2e5b8c6f5bf0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e1a17f05-33a9-4837-8c5f-2e5b8c6f5bf0', 'volume_size': 1} Sep 16 15:13:59 devstack cinder-volume[83259]: DEBUG oslo_concurrency.lockutils [None req-665ee6b1-64bf-4338-9aae-5e44af3abc1c tempest-CreateVolumesFromSnapshotTest-388118498 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83259) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 16 15:13:59 devstack cinder-volume[83259]: DEBUG cinder.coordination [None req-b1850a45-30a0-47e8-875c-533412becd6e tempest-VolumesSnapshotListTestJSON-248203627 None] Lock "cinder-d3fb3e12-9afe-44d7-8d93-0d1a88315aa4-delete_snapshot" acquired by "delete_snapshot" :: waited 0.752s {{(pid=83259) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 16 15:13:59 devstack cinder-volume[83259]: WARNING cinder.volume.volume_utils [None req-b1850a45-30a0-47e8-875c-533412becd6e tempest-VolumesSnapshotListTestJSON-248203627 None] Volume driver (QuobyteDriver 1.2) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 16 15:13:59 devstack cinder-volume[83259]: DEBUG cinder.coordination [None req-b1850a45-30a0-47e8-875c-533412becd6e tempest-VolumesSnapshotListTestJSON-248203627 None] Acquiring lock "cinder-quobyte-68324198-e4bf-4e89-934a-b125055ec9ed" by "delete_snapshot" {{(pid=83259) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 16 15:13:59 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [None req-90f304d0-ba29-41e1-9b06-a1731eca5303 tempest-CreateVolumesFromSnapshotTest-388118498 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c/volume-e895ddab-09be-40b1-83fd-7494828f6769" returned: 0 in 0.638s {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 15:13:59 devstack cinder-volume[83259]: DEBUG cinder.volume.drivers.quobyte [None req-90f304d0-ba29-41e1-9b06-a1731eca5303 tempest-CreateVolumesFromSnapshotTest-388118498 None] <== create_volume: return (1395ms) {'provider_location': '10.10.41.181/cinder-vol-61f585ac-f8e2-4d19-a890-7ebc2726cc72'} {{(pid=83259) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Sep 16 15:13:59 devstack cinder-volume[83259]: DEBUG oslo_concurrency.lockutils [None req-90f304d0-ba29-41e1-9b06-a1731eca5303 tempest-CreateVolumesFromSnapshotTest-388118498 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.401s {{(pid=83259) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 16 15:13:59 devstack cinder-volume[83259]: DEBUG oslo_concurrency.lockutils [None req-665ee6b1-64bf-4338-9aae-5e44af3abc1c tempest-CreateVolumesFromSnapshotTest-388118498 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.093s {{(pid=83259) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 16 15:13:59 devstack cinder-volume[83259]: DEBUG cinder.volume.drivers.quobyte [None req-665ee6b1-64bf-4338-9aae-5e44af3abc1c tempest-CreateVolumesFromSnapshotTest-388118498 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-16T13:13:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-813747966',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#Quobyte',id=e1a17f05-33a9-4837-8c5f-2e5b8c6f5bf0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8468a91973714863896d263c8f21babb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-16T13:13:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-16T13:13:58Z,use_quota=True,user_id='b8e110a8439d457b8c0f8cec54bb1b14',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(485ead50-3df8-4d76-8d34-a4db136c980a),volume_type_id=485ead50-3df8-4d76-8d34-a4db136c980a)}" {{(pid=83259) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Sep 16 15:13:59 devstack cinder-volume[83259]: DEBUG cinder.volume.drivers.remotefs [None req-665ee6b1-64bf-4338-9aae-5e44af3abc1c tempest-CreateVolumesFromSnapshotTest-388118498 None] Creating volume e1a17f05-33a9-4837-8c5f-2e5b8c6f5bf0 {{(pid=83259) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}} Sep 16 15:13:59 devstack cinder-volume[83259]: DEBUG oslo_concurrency.lockutils [None req-665ee6b1-64bf-4338-9aae-5e44af3abc1c tempest-CreateVolumesFromSnapshotTest-388118498 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83259) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 16 15:13:59 devstack cinder-volume[83259]: DEBUG oslo_concurrency.lockutils [None req-665ee6b1-64bf-4338-9aae-5e44af3abc1c tempest-CreateVolumesFromSnapshotTest-388118498 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=83259) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 16 15:13:59 devstack cinder-volume[83259]: DEBUG cinder.volume.drivers.quobyte [None req-665ee6b1-64bf-4338-9aae-5e44af3abc1c tempest-CreateVolumesFromSnapshotTest-388118498 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-61f585ac-f8e2-4d19-a890-7ebc2726cc72': None} {{(pid=83259) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:639}} Sep 16 15:13:59 devstack cinder-volume[83259]: DEBUG cinder.volume.drivers.quobyte [None req-665ee6b1-64bf-4338-9aae-5e44af3abc1c tempest-CreateVolumesFromSnapshotTest-388118498 None] Available shares ['10.10.41.181/cinder-vol-61f585ac-f8e2-4d19-a890-7ebc2726cc72'] {{(pid=83259) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:669}} Sep 16 15:13:59 devstack cinder-volume[83259]: DEBUG oslo_concurrency.lockutils [None req-665ee6b1-64bf-4338-9aae-5e44af3abc1c tempest-CreateVolumesFromSnapshotTest-388118498 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=83259) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 16 15:13:59 devstack cinder-volume[83259]: DEBUG cinder.volume.drivers.quobyte [None req-665ee6b1-64bf-4338-9aae-5e44af3abc1c tempest-CreateVolumesFromSnapshotTest-388118498 None] Selected 10.10.41.181/cinder-vol-61f585ac-f8e2-4d19-a890-7ebc2726cc72 as target Quobyte volume. {{(pid=83259) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:690}} Sep 16 15:13:59 devstack cinder-volume[83259]: INFO cinder.volume.drivers.remotefs [None req-665ee6b1-64bf-4338-9aae-5e44af3abc1c tempest-CreateVolumesFromSnapshotTest-388118498 None] casted to 10.10.41.181/cinder-vol-61f585ac-f8e2-4d19-a890-7ebc2726cc72 Sep 16 15:13:59 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [None req-665ee6b1-64bf-4338-9aae-5e44af3abc1c tempest-CreateVolumesFromSnapshotTest-388118498 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c/volume-e1a17f05-33a9-4837-8c5f-2e5b8c6f5bf0 1073741824 {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 15:13:59 devstack quobyte-client[83286]: System call of process 96546 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 16 15:13:59 devstack quobyte-client[83286]: The server volume:87712ffe-8a69-446d-9ed6-4430c7ee9792@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=87712ffe-8a69-446d-9ed6-4430c7ee9792, inode=120, name=volume-e1a17f05-33a9-4837-8c5f-2e5b8c6f5bf0, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.206), requestorAccessMask=0 Sep 16 15:14:00 devstack cinder-volume[83259]: DEBUG cinder.volume.manager [None req-90f304d0-ba29-41e1-9b06-a1731eca5303 tempest-CreateVolumesFromSnapshotTest-388118498 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (323abd3e-5dc3-44d7-b5b2-9e9e182cf75f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e895ddab-09be-40b1-83fd-7494828f6769', 'volume_size': 1}' {{(pid=83259) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 15:14:00 devstack cinder-volume[83259]: DEBUG cinder.volume.manager [None req-90f304d0-ba29-41e1-9b06-a1731eca5303 tempest-CreateVolumesFromSnapshotTest-388118498 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e901fb7c-dfba-4dbf-867c-3570b4d5307e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83259) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 15:14:00 devstack cinder-volume[83259]: DEBUG cinder.coordination [None req-b1850a45-30a0-47e8-875c-533412becd6e tempest-VolumesSnapshotListTestJSON-248203627 None] Lock "cinder-quobyte-68324198-e4bf-4e89-934a-b125055ec9ed" acquired by "delete_snapshot" :: waited 0.647s {{(pid=83259) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 16 15:14:00 devstack cinder-volume[83259]: DEBUG cinder.coordination [None req-b1850a45-30a0-47e8-875c-533412becd6e tempest-VolumesSnapshotListTestJSON-248203627 None] Acquiring lock "cinder-quobyte-d3fb3e12-9afe-44d7-8d93-0d1a88315aa4" by "_delete_snapshot" {{(pid=83259) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 16 15:14:00 devstack cinder-volume[83259]: WARNING cinder.volume.volume_utils [None req-c07205d6-b3c9-4348-a0f5-1280bdc4641a tempest-CreateVolumesFromSnapshotTest-388118498 None] Volume driver (QuobyteDriver 1.2) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 16 15:14:00 devstack cinder-volume[83259]: DEBUG cinder.volume.flows.manager.create_volume [None req-c07205d6-b3c9-4348-a0f5-1280bdc4641a tempest-CreateVolumesFromSnapshotTest-388118498 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#Quobyte'], 'hosts': ['devstack@QuobyteHD#Quobyte']} {{(pid=83259) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1387}} Sep 16 15:14:00 devstack cinder-volume[83259]: DEBUG cinder.volume.manager [None req-c07205d6-b3c9-4348-a0f5-1280bdc4641a tempest-CreateVolumesFromSnapshotTest-388118498 None] Flow 'volume_create_manager' (85a6ffa3-feee-48fc-a764-c7122ab58561) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83259) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 16 15:14:00 devstack cinder-volume[83259]: DEBUG cinder.volume.manager [None req-c07205d6-b3c9-4348-a0f5-1280bdc4641a tempest-CreateVolumesFromSnapshotTest-388118498 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8ade2f9b-8b5f-433f-863c-6289661b427b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83259) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 15:14:00 devstack cinder-volume[83259]: INFO cinder.volume.flows.manager.create_volume [None req-90f304d0-ba29-41e1-9b06-a1731eca5303 tempest-CreateVolumesFromSnapshotTest-388118498 None] Volume volume-e895ddab-09be-40b1-83fd-7494828f6769 (e895ddab-09be-40b1-83fd-7494828f6769): created successfully Sep 16 15:14:00 devstack cinder-volume[83259]: DEBUG cinder.volume.manager [None req-90f304d0-ba29-41e1-9b06-a1731eca5303 tempest-CreateVolumesFromSnapshotTest-388118498 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e901fb7c-dfba-4dbf-867c-3570b4d5307e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83259) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 15:14:00 devstack cinder-volume[83259]: DEBUG cinder.volume.manager [None req-90f304d0-ba29-41e1-9b06-a1731eca5303 tempest-CreateVolumesFromSnapshotTest-388118498 None] Flow 'volume_create_manager' (d979f82e-6785-4c6f-b257-b04340fe5f37) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83259) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 16 15:14:00 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [None req-665ee6b1-64bf-4338-9aae-5e44af3abc1c tempest-CreateVolumesFromSnapshotTest-388118498 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c/volume-e1a17f05-33a9-4837-8c5f-2e5b8c6f5bf0 1073741824" returned: 0 in 0.876s {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 15:14:00 devstack cinder-volume[83259]: DEBUG cinder.volume.manager [None req-c07205d6-b3c9-4348-a0f5-1280bdc4641a tempest-CreateVolumesFromSnapshotTest-388118498 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8ade2f9b-8b5f-433f-863c-6289661b427b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-16T13:13:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1857808742',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#Quobyte',id=3e2d40fb-dc6a-4710-ad8c-56122c3824ac,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8468a91973714863896d263c8f21babb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-16T13:13:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-16T13:13:59Z,use_quota=True,user_id='b8e110a8439d457b8c0f8cec54bb1b14',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(485ead50-3df8-4d76-8d34-a4db136c980a),volume_type_id=485ead50-3df8-4d76-8d34-a4db136c980a)' {{(pid=83259) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 15:14:00 devstack cinder-volume[83259]: DEBUG cinder.volume.manager [None req-c07205d6-b3c9-4348-a0f5-1280bdc4641a tempest-CreateVolumesFromSnapshotTest-388118498 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f1d37f72-a748-476d-a9fb-55f99b75685d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83259) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 15:14:00 devstack cinder-volume[83259]: DEBUG cinder.volume.manager [None req-c07205d6-b3c9-4348-a0f5-1280bdc4641a tempest-CreateVolumesFromSnapshotTest-388118498 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f1d37f72-a748-476d-a9fb-55f99b75685d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83259) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 15:14:00 devstack cinder-volume[83259]: DEBUG cinder.volume.manager [None req-c07205d6-b3c9-4348-a0f5-1280bdc4641a tempest-CreateVolumesFromSnapshotTest-388118498 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f0e8a40e-35f8-44e5-9c50-37c575065852) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83259) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 15:14:00 devstack cinder-volume[83259]: DEBUG cinder.volume.manager [None req-c07205d6-b3c9-4348-a0f5-1280bdc4641a tempest-CreateVolumesFromSnapshotTest-388118498 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f0e8a40e-35f8-44e5-9c50-37c575065852) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3e2d40fb-dc6a-4710-ad8c-56122c3824ac', 'volume_name': 'volume-3e2d40fb-dc6a-4710-ad8c-56122c3824ac', 'volume_size': 1}' {{(pid=83259) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 15:14:00 devstack cinder-volume[83259]: DEBUG cinder.volume.manager [None req-c07205d6-b3c9-4348-a0f5-1280bdc4641a tempest-CreateVolumesFromSnapshotTest-388118498 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (17866cf4-2ecf-426d-8800-bb2668fe9aec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83259) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 15:14:00 devstack cinder-volume[83259]: DEBUG cinder.volume.manager [None req-c07205d6-b3c9-4348-a0f5-1280bdc4641a tempest-CreateVolumesFromSnapshotTest-388118498 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (17866cf4-2ecf-426d-8800-bb2668fe9aec) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83259) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 15:14:00 devstack cinder-volume[83259]: DEBUG cinder.volume.manager [None req-c07205d6-b3c9-4348-a0f5-1280bdc4641a tempest-CreateVolumesFromSnapshotTest-388118498 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (57bdfefe-20d8-4e7a-9909-13d39d3eb161) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83259) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 15:14:00 devstack cinder-volume[83259]: INFO cinder.volume.flows.manager.create_volume [None req-c07205d6-b3c9-4348-a0f5-1280bdc4641a tempest-CreateVolumesFromSnapshotTest-388118498 None] Volume 3e2d40fb-dc6a-4710-ad8c-56122c3824ac: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3e2d40fb-dc6a-4710-ad8c-56122c3824ac', 'volume_size': 1} Sep 16 15:14:00 devstack cinder-volume[83259]: DEBUG oslo_concurrency.lockutils [None req-c07205d6-b3c9-4348-a0f5-1280bdc4641a tempest-CreateVolumesFromSnapshotTest-388118498 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83259) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 16 15:14:00 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [None req-665ee6b1-64bf-4338-9aae-5e44af3abc1c tempest-CreateVolumesFromSnapshotTest-388118498 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c/volume-e1a17f05-33a9-4837-8c5f-2e5b8c6f5bf0 {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 15:14:00 devstack cinder-volume[83259]: DEBUG cinder.coordination [None req-b1850a45-30a0-47e8-875c-533412becd6e tempest-VolumesSnapshotListTestJSON-248203627 None] Lock "cinder-quobyte-d3fb3e12-9afe-44d7-8d93-0d1a88315aa4" acquired by "_delete_snapshot" :: waited 0.617s {{(pid=83259) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 16 15:14:00 devstack cinder-volume[83259]: DEBUG cinder.volume.drivers.remotefs [None req-b1850a45-30a0-47e8-875c-533412becd6e tempest-VolumesSnapshotListTestJSON-248203627 None] Deleting offline snapshot d3fb3e12-9afe-44d7-8d93-0d1a88315aa4 of volume 68324198-e4bf-4e89-934a-b125055ec9ed {{(pid=83259) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1278}} Sep 16 15:14:00 devstack cinder-volume[83259]: DEBUG cinder.volume.drivers.remotefs [None req-b1850a45-30a0-47e8-875c-533412becd6e tempest-VolumesSnapshotListTestJSON-248203627 None] snapshot_file for this snap is: volume-68324198-e4bf-4e89-934a-b125055ec9ed.d3fb3e12-9afe-44d7-8d93-0d1a88315aa4 {{(pid=83259) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1307}} Sep 16 15:14:01 devstack cinder-volume[83259]: DEBUG oslo.privsep.daemon [-] privsep: reply[8e0891cf-b840-4fcb-8366-c138fb64e206]: (4, 'qcow2') {{(pid=84312) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 16 15:14:01 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [None req-b1850a45-30a0-47e8-875c-533412becd6e tempest-VolumesSnapshotListTestJSON-248203627 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c/volume-68324198-e4bf-4e89-934a-b125055ec9ed.d3fb3e12-9afe-44d7-8d93-0d1a88315aa4 {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 15:14:01 devstack cinder-volume[83259]: INFO cinder.volume.manager [None req-90f304d0-ba29-41e1-9b06-a1731eca5303 tempest-CreateVolumesFromSnapshotTest-388118498 None] Created volume successfully. Sep 16 15:14:01 devstack cinder-volume[83259]: WARNING cinder.volume.volume_utils [None req-0c893b68-7598-4e72-bfcf-92d3b2e200e9 tempest-VolumesListTestJSON-1108154855 None] Volume driver (QuobyteDriver 1.2) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 16 15:14:01 devstack cinder-volume[83259]: DEBUG cinder.volume.flows.manager.create_volume [None req-0c893b68-7598-4e72-bfcf-92d3b2e200e9 tempest-VolumesListTestJSON-1108154855 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#Quobyte'], 'hosts': ['devstack@QuobyteHD#Quobyte']} {{(pid=83259) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1387}} Sep 16 15:14:01 devstack cinder-volume[83259]: DEBUG cinder.volume.manager [None req-0c893b68-7598-4e72-bfcf-92d3b2e200e9 tempest-VolumesListTestJSON-1108154855 None] Flow 'volume_create_manager' (3aa6e605-98da-4bc3-8081-6fb438ece25d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83259) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 16 15:14:01 devstack cinder-volume[83259]: DEBUG cinder.volume.manager [None req-0c893b68-7598-4e72-bfcf-92d3b2e200e9 tempest-VolumesListTestJSON-1108154855 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c5538317-572d-404d-859a-5e2c60188167) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83259) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 15:14:01 devstack quobyte-client[83286]: System call of process 96552 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 16 15:14:01 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [None req-665ee6b1-64bf-4338-9aae-5e44af3abc1c tempest-CreateVolumesFromSnapshotTest-388118498 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c/volume-e1a17f05-33a9-4837-8c5f-2e5b8c6f5bf0" returned: 0 in 1.010s {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 15:14:01 devstack cinder-volume[83259]: DEBUG cinder.volume.drivers.quobyte [None req-665ee6b1-64bf-4338-9aae-5e44af3abc1c tempest-CreateVolumesFromSnapshotTest-388118498 None] <== create_volume: return (1970ms) {'provider_location': '10.10.41.181/cinder-vol-61f585ac-f8e2-4d19-a890-7ebc2726cc72'} {{(pid=83259) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Sep 16 15:14:01 devstack cinder-volume[83259]: DEBUG oslo_concurrency.lockutils [None req-665ee6b1-64bf-4338-9aae-5e44af3abc1c tempest-CreateVolumesFromSnapshotTest-388118498 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.976s {{(pid=83259) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 16 15:14:01 devstack cinder-volume[83259]: DEBUG oslo_concurrency.lockutils [None req-c07205d6-b3c9-4348-a0f5-1280bdc4641a tempest-CreateVolumesFromSnapshotTest-388118498 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.045s {{(pid=83259) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 16 15:14:01 devstack cinder-volume[83259]: DEBUG cinder.volume.drivers.quobyte [None req-c07205d6-b3c9-4348-a0f5-1280bdc4641a tempest-CreateVolumesFromSnapshotTest-388118498 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-16T13:13:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1857808742',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#Quobyte',id=3e2d40fb-dc6a-4710-ad8c-56122c3824ac,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8468a91973714863896d263c8f21babb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-16T13:13:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-16T13:13:59Z,use_quota=True,user_id='b8e110a8439d457b8c0f8cec54bb1b14',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(485ead50-3df8-4d76-8d34-a4db136c980a),volume_type_id=485ead50-3df8-4d76-8d34-a4db136c980a)}" {{(pid=83259) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Sep 16 15:14:01 devstack cinder-volume[83259]: DEBUG cinder.volume.drivers.remotefs [None req-c07205d6-b3c9-4348-a0f5-1280bdc4641a tempest-CreateVolumesFromSnapshotTest-388118498 None] Creating volume 3e2d40fb-dc6a-4710-ad8c-56122c3824ac {{(pid=83259) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}} Sep 16 15:14:01 devstack cinder-volume[83259]: DEBUG oslo_concurrency.lockutils [None req-c07205d6-b3c9-4348-a0f5-1280bdc4641a tempest-CreateVolumesFromSnapshotTest-388118498 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83259) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 16 15:14:01 devstack cinder-volume[83259]: DEBUG oslo_concurrency.lockutils [None req-c07205d6-b3c9-4348-a0f5-1280bdc4641a tempest-CreateVolumesFromSnapshotTest-388118498 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=83259) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 16 15:14:01 devstack cinder-volume[83259]: DEBUG cinder.volume.drivers.quobyte [None req-c07205d6-b3c9-4348-a0f5-1280bdc4641a tempest-CreateVolumesFromSnapshotTest-388118498 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-61f585ac-f8e2-4d19-a890-7ebc2726cc72': None} {{(pid=83259) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:639}} Sep 16 15:14:01 devstack cinder-volume[83259]: DEBUG cinder.volume.drivers.quobyte [None req-c07205d6-b3c9-4348-a0f5-1280bdc4641a tempest-CreateVolumesFromSnapshotTest-388118498 None] Available shares ['10.10.41.181/cinder-vol-61f585ac-f8e2-4d19-a890-7ebc2726cc72'] {{(pid=83259) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:669}} Sep 16 15:14:01 devstack cinder-volume[83259]: DEBUG oslo_concurrency.lockutils [None req-c07205d6-b3c9-4348-a0f5-1280bdc4641a tempest-CreateVolumesFromSnapshotTest-388118498 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=83259) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 16 15:14:01 devstack cinder-volume[83259]: DEBUG cinder.volume.drivers.quobyte [None req-c07205d6-b3c9-4348-a0f5-1280bdc4641a tempest-CreateVolumesFromSnapshotTest-388118498 None] Selected 10.10.41.181/cinder-vol-61f585ac-f8e2-4d19-a890-7ebc2726cc72 as target Quobyte volume. {{(pid=83259) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:690}} Sep 16 15:14:01 devstack cinder-volume[83259]: INFO cinder.volume.drivers.remotefs [None req-c07205d6-b3c9-4348-a0f5-1280bdc4641a tempest-CreateVolumesFromSnapshotTest-388118498 None] casted to 10.10.41.181/cinder-vol-61f585ac-f8e2-4d19-a890-7ebc2726cc72 Sep 16 15:14:01 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [None req-c07205d6-b3c9-4348-a0f5-1280bdc4641a tempest-CreateVolumesFromSnapshotTest-388118498 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c/volume-3e2d40fb-dc6a-4710-ad8c-56122c3824ac 1073741824 {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 15:14:01 devstack quobyte-client[83286]: System call of process 96555 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 16 15:14:01 devstack cinder-volume[83259]: WARNING cinder.volume.volume_utils [None req-934ae27c-4be5-4c5d-aeee-63233c5f7e3d tempest-CreateVolumesFromSnapshotTest-388118498 None] Volume driver (QuobyteDriver 1.2) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 16 15:14:01 devstack quobyte-client[83286]: The server volume:87712ffe-8a69-446d-9ed6-4430c7ee9792@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=87712ffe-8a69-446d-9ed6-4430c7ee9792, inode=121, name=volume-3e2d40fb-dc6a-4710-ad8c-56122c3824ac, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.206), requestorAccessMask=0 Sep 16 15:14:01 devstack cinder-volume[83259]: DEBUG cinder.volume.flows.manager.create_volume [None req-934ae27c-4be5-4c5d-aeee-63233c5f7e3d tempest-CreateVolumesFromSnapshotTest-388118498 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#Quobyte'], 'hosts': ['devstack@QuobyteHD#Quobyte']} {{(pid=83259) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1387}} Sep 16 15:14:01 devstack cinder-volume[83259]: DEBUG cinder.volume.manager [None req-934ae27c-4be5-4c5d-aeee-63233c5f7e3d tempest-CreateVolumesFromSnapshotTest-388118498 None] Flow 'volume_create_manager' (8cf2c5a9-6d11-472e-be0a-ff47c6a3a88a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83259) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 16 15:14:01 devstack cinder-volume[83259]: DEBUG cinder.volume.manager [None req-934ae27c-4be5-4c5d-aeee-63233c5f7e3d tempest-CreateVolumesFromSnapshotTest-388118498 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a18e270c-8d97-4326-baee-ae1eb3c40d41) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83259) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 15:14:02 devstack cinder-volume[83259]: DEBUG cinder.volume.manager [None req-0c893b68-7598-4e72-bfcf-92d3b2e200e9 tempest-VolumesListTestJSON-1108154855 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c5538317-572d-404d-859a-5e2c60188167) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-16T13:13:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-1678092101',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#Quobyte',id=feac8d15-fdb5-4c20-9052-e5a2df8be0cf,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='865f0d0f7af2430d9697eb01904b9bb0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-16T13:14:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-16T13:14:00Z,use_quota=True,user_id='8871143af23e48c0bc960a4ebe1d5ddc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(485ead50-3df8-4d76-8d34-a4db136c980a),volume_type_id=485ead50-3df8-4d76-8d34-a4db136c980a)' {{(pid=83259) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 15:14:02 devstack cinder-volume[83259]: DEBUG cinder.volume.manager [None req-0c893b68-7598-4e72-bfcf-92d3b2e200e9 tempest-VolumesListTestJSON-1108154855 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e3386832-9d7b-455d-bc94-4a879f053086) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83259) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 15:14:02 devstack cinder-volume[83259]: DEBUG cinder.volume.manager [None req-0c893b68-7598-4e72-bfcf-92d3b2e200e9 tempest-VolumesListTestJSON-1108154855 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e3386832-9d7b-455d-bc94-4a879f053086) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83259) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 15:14:02 devstack cinder-volume[83259]: DEBUG cinder.volume.manager [None req-0c893b68-7598-4e72-bfcf-92d3b2e200e9 tempest-VolumesListTestJSON-1108154855 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7f6244d2-7c47-408f-8698-bafa98c4a760) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83259) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 15:14:02 devstack cinder-volume[83259]: DEBUG cinder.volume.manager [None req-0c893b68-7598-4e72-bfcf-92d3b2e200e9 tempest-VolumesListTestJSON-1108154855 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7f6244d2-7c47-408f-8698-bafa98c4a760) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'feac8d15-fdb5-4c20-9052-e5a2df8be0cf', 'volume_name': 'volume-feac8d15-fdb5-4c20-9052-e5a2df8be0cf', 'volume_size': 1}' {{(pid=83259) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 15:14:02 devstack cinder-volume[83259]: DEBUG cinder.volume.manager [None req-0c893b68-7598-4e72-bfcf-92d3b2e200e9 tempest-VolumesListTestJSON-1108154855 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1be40b55-4a81-4613-8c56-dfa426b98910) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83259) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 15:14:02 devstack cinder-volume[83259]: DEBUG cinder.volume.manager [None req-0c893b68-7598-4e72-bfcf-92d3b2e200e9 tempest-VolumesListTestJSON-1108154855 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1be40b55-4a81-4613-8c56-dfa426b98910) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83259) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 15:14:02 devstack cinder-volume[83259]: DEBUG cinder.volume.manager [None req-0c893b68-7598-4e72-bfcf-92d3b2e200e9 tempest-VolumesListTestJSON-1108154855 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5d60fa8f-9e4f-4d1c-a303-3265a70252dd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83259) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 15:14:02 devstack cinder-volume[83259]: INFO cinder.volume.flows.manager.create_volume [None req-0c893b68-7598-4e72-bfcf-92d3b2e200e9 tempest-VolumesListTestJSON-1108154855 None] Volume feac8d15-fdb5-4c20-9052-e5a2df8be0cf: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-feac8d15-fdb5-4c20-9052-e5a2df8be0cf', 'volume_size': 1} Sep 16 15:14:02 devstack cinder-volume[83259]: DEBUG oslo_concurrency.lockutils [None req-0c893b68-7598-4e72-bfcf-92d3b2e200e9 tempest-VolumesListTestJSON-1108154855 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83259) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 16 15:14:02 devstack cinder-volume[83259]: WARNING cinder.volume.volume_utils [None req-e7e61369-7579-4fad-8e1e-098fff49a053 tempest-CreateVolumesFromSnapshotTest-388118498 None] Volume driver (QuobyteDriver 1.2) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 16 15:14:02 devstack cinder-volume[83259]: DEBUG cinder.volume.flows.manager.create_volume [None req-e7e61369-7579-4fad-8e1e-098fff49a053 tempest-CreateVolumesFromSnapshotTest-388118498 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#Quobyte'], 'hosts': ['devstack@QuobyteHD#Quobyte']} {{(pid=83259) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1387}} Sep 16 15:14:02 devstack cinder-volume[83259]: DEBUG cinder.volume.manager [None req-e7e61369-7579-4fad-8e1e-098fff49a053 tempest-CreateVolumesFromSnapshotTest-388118498 None] Flow 'volume_create_manager' (ce7dbfc0-4d45-4ed2-a3e0-05e7ba6d263b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83259) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 16 15:14:02 devstack cinder-volume[83259]: DEBUG cinder.volume.manager [None req-e7e61369-7579-4fad-8e1e-098fff49a053 tempest-CreateVolumesFromSnapshotTest-388118498 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (32ad4dd6-4e22-455c-bac8-45a724a22532) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83259) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 15:14:02 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [None req-b1850a45-30a0-47e8-875c-533412becd6e tempest-VolumesSnapshotListTestJSON-248203627 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c/volume-68324198-e4bf-4e89-934a-b125055ec9ed.d3fb3e12-9afe-44d7-8d93-0d1a88315aa4" returned: 0 in 1.249s {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 15:14:02 devstack cinder-volume[83259]: DEBUG cinder.volume.manager [None req-934ae27c-4be5-4c5d-aeee-63233c5f7e3d tempest-CreateVolumesFromSnapshotTest-388118498 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a18e270c-8d97-4326-baee-ae1eb3c40d41) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-16T13:13:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1784197218',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#Quobyte',id=c3ebbee7-d2a2-4f09-b68c-7861b4b0bc3a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8468a91973714863896d263c8f21babb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-16T13:14:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-16T13:14:00Z,use_quota=True,user_id='b8e110a8439d457b8c0f8cec54bb1b14',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(485ead50-3df8-4d76-8d34-a4db136c980a),volume_type_id=485ead50-3df8-4d76-8d34-a4db136c980a)' {{(pid=83259) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 15:14:02 devstack cinder-volume[83259]: DEBUG cinder.volume.manager [None req-934ae27c-4be5-4c5d-aeee-63233c5f7e3d tempest-CreateVolumesFromSnapshotTest-388118498 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6f603114-911c-49d1-91b9-f739e2aaee9f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83259) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 15:14:02 devstack cinder-volume[83259]: DEBUG cinder.volume.manager [None req-934ae27c-4be5-4c5d-aeee-63233c5f7e3d tempest-CreateVolumesFromSnapshotTest-388118498 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6f603114-911c-49d1-91b9-f739e2aaee9f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83259) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 15:14:02 devstack cinder-volume[83259]: DEBUG cinder.volume.manager [None req-934ae27c-4be5-4c5d-aeee-63233c5f7e3d tempest-CreateVolumesFromSnapshotTest-388118498 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d459005b-cf11-4ab2-845d-a2aabeb9bc73) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83259) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 15:14:02 devstack cinder-volume[83259]: DEBUG cinder.volume.manager [None req-934ae27c-4be5-4c5d-aeee-63233c5f7e3d tempest-CreateVolumesFromSnapshotTest-388118498 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d459005b-cf11-4ab2-845d-a2aabeb9bc73) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c3ebbee7-d2a2-4f09-b68c-7861b4b0bc3a', 'volume_name': 'volume-c3ebbee7-d2a2-4f09-b68c-7861b4b0bc3a', 'volume_size': 1}' {{(pid=83259) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 15:14:02 devstack cinder-volume[83259]: DEBUG cinder.volume.manager [None req-934ae27c-4be5-4c5d-aeee-63233c5f7e3d tempest-CreateVolumesFromSnapshotTest-388118498 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ba9e86f5-a877-4f8a-b5e4-365f897a36d6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83259) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 15:14:02 devstack cinder-volume[83259]: DEBUG cinder.volume.manager [None req-934ae27c-4be5-4c5d-aeee-63233c5f7e3d tempest-CreateVolumesFromSnapshotTest-388118498 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ba9e86f5-a877-4f8a-b5e4-365f897a36d6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83259) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 15:14:02 devstack cinder-volume[83259]: DEBUG cinder.volume.manager [None req-934ae27c-4be5-4c5d-aeee-63233c5f7e3d tempest-CreateVolumesFromSnapshotTest-388118498 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c7562488-b19c-41c2-808c-43132a1d1482) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83259) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 15:14:02 devstack cinder-volume[83259]: INFO cinder.volume.flows.manager.create_volume [None req-934ae27c-4be5-4c5d-aeee-63233c5f7e3d tempest-CreateVolumesFromSnapshotTest-388118498 None] Volume c3ebbee7-d2a2-4f09-b68c-7861b4b0bc3a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c3ebbee7-d2a2-4f09-b68c-7861b4b0bc3a', 'volume_size': 1} Sep 16 15:14:02 devstack cinder-volume[83259]: DEBUG oslo_concurrency.lockutils [None req-934ae27c-4be5-4c5d-aeee-63233c5f7e3d tempest-CreateVolumesFromSnapshotTest-388118498 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83259) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 16 15:14:02 devstack cinder-volume[83259]: DEBUG cinder.volume.drivers.remotefs [None req-b1850a45-30a0-47e8-875c-533412becd6e tempest-VolumesSnapshotListTestJSON-248203627 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-68324198-e4bf-4e89-934a-b125055ec9ed(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83259) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:886}} Sep 16 15:14:02 devstack cinder-volume[83259]: DEBUG cinder.volume.manager [None req-665ee6b1-64bf-4338-9aae-5e44af3abc1c tempest-CreateVolumesFromSnapshotTest-388118498 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (53e98c99-c56e-4cc5-b322-bc6a5ee30288) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e1a17f05-33a9-4837-8c5f-2e5b8c6f5bf0', 'volume_size': 1}' {{(pid=83259) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 15:14:02 devstack cinder-volume[83259]: DEBUG cinder.volume.manager [None req-665ee6b1-64bf-4338-9aae-5e44af3abc1c tempest-CreateVolumesFromSnapshotTest-388118498 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4280315e-b1f8-41d4-b426-07d03fed9525) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83259) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 15:14:02 devstack cinder-volume[83259]: DEBUG oslo.privsep.daemon [-] privsep: reply[6369ff01-b136-4c49-841b-bec1bd5ac563]: (4, 'qcow2') {{(pid=84312) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 16 15:14:02 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [None req-b1850a45-30a0-47e8-875c-533412becd6e tempest-VolumesSnapshotListTestJSON-248203627 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c/volume-68324198-e4bf-4e89-934a-b125055ec9ed.0372b193-39a5-4cc5-b188-e72fdea25759 {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 15:14:02 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [None req-c07205d6-b3c9-4348-a0f5-1280bdc4641a tempest-CreateVolumesFromSnapshotTest-388118498 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c/volume-3e2d40fb-dc6a-4710-ad8c-56122c3824ac 1073741824" returned: 0 in 0.900s {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 15:14:02 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [None req-c07205d6-b3c9-4348-a0f5-1280bdc4641a tempest-CreateVolumesFromSnapshotTest-388118498 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c/volume-3e2d40fb-dc6a-4710-ad8c-56122c3824ac {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 15:14:02 devstack cinder-volume[83259]: DEBUG cinder.volume.manager [None req-e7e61369-7579-4fad-8e1e-098fff49a053 tempest-CreateVolumesFromSnapshotTest-388118498 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (32ad4dd6-4e22-455c-bac8-45a724a22532) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-16T13:14:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-2013219163',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#Quobyte',id=b3f3c11b-59c5-4e0e-b32e-c4a06e5d075f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8468a91973714863896d263c8f21babb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-16T13:14:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-16T13:14:00Z,use_quota=True,user_id='b8e110a8439d457b8c0f8cec54bb1b14',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(485ead50-3df8-4d76-8d34-a4db136c980a),volume_type_id=485ead50-3df8-4d76-8d34-a4db136c980a)' {{(pid=83259) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 15:14:02 devstack cinder-volume[83259]: DEBUG cinder.volume.manager [None req-e7e61369-7579-4fad-8e1e-098fff49a053 tempest-CreateVolumesFromSnapshotTest-388118498 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e96a7f30-abd3-4131-a0b0-f8752042aae5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83259) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 15:14:02 devstack cinder-volume[83259]: DEBUG cinder.volume.manager [None req-e7e61369-7579-4fad-8e1e-098fff49a053 tempest-CreateVolumesFromSnapshotTest-388118498 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e96a7f30-abd3-4131-a0b0-f8752042aae5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83259) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 15:14:02 devstack cinder-volume[83259]: DEBUG cinder.volume.manager [None req-e7e61369-7579-4fad-8e1e-098fff49a053 tempest-CreateVolumesFromSnapshotTest-388118498 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cdba68aa-37e8-4584-90b9-cd39d3a97b3f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83259) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 15:14:02 devstack cinder-volume[83259]: DEBUG cinder.volume.manager [None req-e7e61369-7579-4fad-8e1e-098fff49a053 tempest-CreateVolumesFromSnapshotTest-388118498 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cdba68aa-37e8-4584-90b9-cd39d3a97b3f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b3f3c11b-59c5-4e0e-b32e-c4a06e5d075f', 'volume_name': 'volume-b3f3c11b-59c5-4e0e-b32e-c4a06e5d075f', 'volume_size': 1}' {{(pid=83259) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 15:14:02 devstack cinder-volume[83259]: DEBUG cinder.volume.manager [None req-e7e61369-7579-4fad-8e1e-098fff49a053 tempest-CreateVolumesFromSnapshotTest-388118498 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a2d9451a-a005-4bf5-8dfa-b4294115f93d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83259) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 15:14:02 devstack cinder-volume[83259]: DEBUG cinder.volume.manager [None req-e7e61369-7579-4fad-8e1e-098fff49a053 tempest-CreateVolumesFromSnapshotTest-388118498 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a2d9451a-a005-4bf5-8dfa-b4294115f93d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83259) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 15:14:02 devstack cinder-volume[83259]: DEBUG cinder.volume.manager [None req-e7e61369-7579-4fad-8e1e-098fff49a053 tempest-CreateVolumesFromSnapshotTest-388118498 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2c10ffc4-421c-47c2-a3f5-c210548935df) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83259) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 15:14:02 devstack cinder-volume[83259]: INFO cinder.volume.flows.manager.create_volume [None req-e7e61369-7579-4fad-8e1e-098fff49a053 tempest-CreateVolumesFromSnapshotTest-388118498 None] Volume b3f3c11b-59c5-4e0e-b32e-c4a06e5d075f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b3f3c11b-59c5-4e0e-b32e-c4a06e5d075f', 'volume_size': 1} Sep 16 15:14:02 devstack cinder-volume[83259]: DEBUG oslo_concurrency.lockutils [None req-e7e61369-7579-4fad-8e1e-098fff49a053 tempest-CreateVolumesFromSnapshotTest-388118498 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83259) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 16 15:14:02 devstack cinder-volume[83259]: INFO cinder.volume.flows.manager.create_volume [None req-665ee6b1-64bf-4338-9aae-5e44af3abc1c tempest-CreateVolumesFromSnapshotTest-388118498 None] Volume volume-e1a17f05-33a9-4837-8c5f-2e5b8c6f5bf0 (e1a17f05-33a9-4837-8c5f-2e5b8c6f5bf0): created successfully Sep 16 15:14:02 devstack cinder-volume[83259]: DEBUG cinder.volume.manager [None req-665ee6b1-64bf-4338-9aae-5e44af3abc1c tempest-CreateVolumesFromSnapshotTest-388118498 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4280315e-b1f8-41d4-b426-07d03fed9525) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83259) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 15:14:02 devstack cinder-volume[83259]: DEBUG cinder.volume.manager [None req-665ee6b1-64bf-4338-9aae-5e44af3abc1c tempest-CreateVolumesFromSnapshotTest-388118498 None] Flow 'volume_create_manager' (34313346-4858-47bb-887b-fc4c85d95dff) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83259) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 16 15:14:03 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [None req-c07205d6-b3c9-4348-a0f5-1280bdc4641a tempest-CreateVolumesFromSnapshotTest-388118498 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c/volume-3e2d40fb-dc6a-4710-ad8c-56122c3824ac" returned: 0 in 0.495s {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 15:14:03 devstack cinder-volume[83259]: DEBUG cinder.volume.drivers.quobyte [None req-c07205d6-b3c9-4348-a0f5-1280bdc4641a tempest-CreateVolumesFromSnapshotTest-388118498 None] <== create_volume: return (1452ms) {'provider_location': '10.10.41.181/cinder-vol-61f585ac-f8e2-4d19-a890-7ebc2726cc72'} {{(pid=83259) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Sep 16 15:14:03 devstack cinder-volume[83259]: DEBUG oslo_concurrency.lockutils [None req-c07205d6-b3c9-4348-a0f5-1280bdc4641a tempest-CreateVolumesFromSnapshotTest-388118498 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.467s {{(pid=83259) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 16 15:14:03 devstack cinder-volume[83259]: INFO cinder.volume.manager [None req-665ee6b1-64bf-4338-9aae-5e44af3abc1c tempest-CreateVolumesFromSnapshotTest-388118498 None] Created volume successfully. Sep 16 15:14:03 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [None req-b1850a45-30a0-47e8-875c-533412becd6e tempest-VolumesSnapshotListTestJSON-248203627 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c/volume-68324198-e4bf-4e89-934a-b125055ec9ed.0372b193-39a5-4cc5-b188-e72fdea25759" returned: 0 in 0.728s {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 15:14:03 devstack cinder-volume[83259]: DEBUG oslo_concurrency.lockutils [None req-0c893b68-7598-4e72-bfcf-92d3b2e200e9 tempest-VolumesListTestJSON-1108154855 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.929s {{(pid=83259) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 16 15:14:03 devstack cinder-volume[83259]: DEBUG cinder.volume.drivers.quobyte [None req-0c893b68-7598-4e72-bfcf-92d3b2e200e9 tempest-VolumesListTestJSON-1108154855 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-16T13:13:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-1678092101',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#Quobyte',id=feac8d15-fdb5-4c20-9052-e5a2df8be0cf,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='865f0d0f7af2430d9697eb01904b9bb0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-16T13:14:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-16T13:14:00Z,use_quota=True,user_id='8871143af23e48c0bc960a4ebe1d5ddc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(485ead50-3df8-4d76-8d34-a4db136c980a),volume_type_id=485ead50-3df8-4d76-8d34-a4db136c980a)}" {{(pid=83259) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Sep 16 15:14:03 devstack cinder-volume[83259]: DEBUG cinder.volume.drivers.remotefs [None req-0c893b68-7598-4e72-bfcf-92d3b2e200e9 tempest-VolumesListTestJSON-1108154855 None] Creating volume feac8d15-fdb5-4c20-9052-e5a2df8be0cf {{(pid=83259) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}} Sep 16 15:14:03 devstack cinder-volume[83259]: DEBUG oslo_concurrency.lockutils [None req-0c893b68-7598-4e72-bfcf-92d3b2e200e9 tempest-VolumesListTestJSON-1108154855 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83259) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 16 15:14:03 devstack cinder-volume[83259]: DEBUG oslo_concurrency.lockutils [None req-0c893b68-7598-4e72-bfcf-92d3b2e200e9 tempest-VolumesListTestJSON-1108154855 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83259) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 16 15:14:03 devstack cinder-volume[83259]: DEBUG cinder.volume.drivers.quobyte [None req-0c893b68-7598-4e72-bfcf-92d3b2e200e9 tempest-VolumesListTestJSON-1108154855 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-61f585ac-f8e2-4d19-a890-7ebc2726cc72': None} {{(pid=83259) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:639}} Sep 16 15:14:03 devstack cinder-volume[83259]: DEBUG cinder.volume.drivers.quobyte [None req-0c893b68-7598-4e72-bfcf-92d3b2e200e9 tempest-VolumesListTestJSON-1108154855 None] Available shares ['10.10.41.181/cinder-vol-61f585ac-f8e2-4d19-a890-7ebc2726cc72'] {{(pid=83259) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:669}} Sep 16 15:14:03 devstack cinder-volume[83259]: DEBUG oslo_concurrency.lockutils [None req-0c893b68-7598-4e72-bfcf-92d3b2e200e9 tempest-VolumesListTestJSON-1108154855 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=83259) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 16 15:14:03 devstack cinder-volume[83259]: DEBUG cinder.volume.drivers.quobyte [None req-0c893b68-7598-4e72-bfcf-92d3b2e200e9 tempest-VolumesListTestJSON-1108154855 None] Selected 10.10.41.181/cinder-vol-61f585ac-f8e2-4d19-a890-7ebc2726cc72 as target Quobyte volume. {{(pid=83259) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:690}} Sep 16 15:14:03 devstack cinder-volume[83259]: INFO cinder.volume.drivers.remotefs [None req-0c893b68-7598-4e72-bfcf-92d3b2e200e9 tempest-VolumesListTestJSON-1108154855 None] casted to 10.10.41.181/cinder-vol-61f585ac-f8e2-4d19-a890-7ebc2726cc72 Sep 16 15:14:03 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [None req-0c893b68-7598-4e72-bfcf-92d3b2e200e9 tempest-VolumesListTestJSON-1108154855 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c/volume-feac8d15-fdb5-4c20-9052-e5a2df8be0cf 1073741824 {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 15:14:03 devstack cinder-volume[83259]: DEBUG cinder.volume.drivers.remotefs [None req-b1850a45-30a0-47e8-875c-533412becd6e tempest-VolumesSnapshotListTestJSON-248203627 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-68324198-e4bf-4e89-934a-b125055ec9ed(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83259) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:886}} Sep 16 15:14:03 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [None req-b1850a45-30a0-47e8-875c-533412becd6e tempest-VolumesSnapshotListTestJSON-248203627 None] Running cmd (subprocess): qemu-img commit -d /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c/volume-68324198-e4bf-4e89-934a-b125055ec9ed.d3fb3e12-9afe-44d7-8d93-0d1a88315aa4 {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 15:14:03 devstack quobyte-client[83286]: The server volume:87712ffe-8a69-446d-9ed6-4430c7ee9792@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=87712ffe-8a69-446d-9ed6-4430c7ee9792, inode=122, name=volume-feac8d15-fdb5-4c20-9052-e5a2df8be0cf, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.206), requestorAccessMask=0 Sep 16 15:14:03 devstack quobyte-client[83286]: System call of process 96565 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 16 15:14:03 devstack cinder-volume[83259]: DEBUG cinder.volume.manager [None req-c07205d6-b3c9-4348-a0f5-1280bdc4641a tempest-CreateVolumesFromSnapshotTest-388118498 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (57bdfefe-20d8-4e7a-9909-13d39d3eb161) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3e2d40fb-dc6a-4710-ad8c-56122c3824ac', 'volume_size': 1}' {{(pid=83259) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 15:14:03 devstack cinder-volume[83259]: DEBUG cinder.volume.manager [None req-c07205d6-b3c9-4348-a0f5-1280bdc4641a tempest-CreateVolumesFromSnapshotTest-388118498 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2ec2f30e-5843-40b0-9e7a-0caa227e1c76) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83259) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 15:14:03 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [None req-0c893b68-7598-4e72-bfcf-92d3b2e200e9 tempest-VolumesListTestJSON-1108154855 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c/volume-feac8d15-fdb5-4c20-9052-e5a2df8be0cf 1073741824" returned: 0 in 0.583s {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 15:14:03 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [None req-b1850a45-30a0-47e8-875c-533412becd6e tempest-VolumesSnapshotListTestJSON-248203627 None] CMD "qemu-img commit -d /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c/volume-68324198-e4bf-4e89-934a-b125055ec9ed.d3fb3e12-9afe-44d7-8d93-0d1a88315aa4" returned: 0 in 0.443s {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 15:14:03 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [None req-0c893b68-7598-4e72-bfcf-92d3b2e200e9 tempest-VolumesListTestJSON-1108154855 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c/volume-feac8d15-fdb5-4c20-9052-e5a2df8be0cf {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 15:14:03 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [None req-b1850a45-30a0-47e8-875c-533412becd6e tempest-VolumesSnapshotListTestJSON-248203627 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c/volume-68324198-e4bf-4e89-934a-b125055ec9ed.d3fb3e12-9afe-44d7-8d93-0d1a88315aa4 {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 15:14:04 devstack cinder-volume[83259]: INFO cinder.volume.flows.manager.create_volume [None req-c07205d6-b3c9-4348-a0f5-1280bdc4641a tempest-CreateVolumesFromSnapshotTest-388118498 None] Volume volume-3e2d40fb-dc6a-4710-ad8c-56122c3824ac (3e2d40fb-dc6a-4710-ad8c-56122c3824ac): created successfully Sep 16 15:14:04 devstack cinder-volume[83259]: DEBUG cinder.volume.manager [None req-c07205d6-b3c9-4348-a0f5-1280bdc4641a tempest-CreateVolumesFromSnapshotTest-388118498 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2ec2f30e-5843-40b0-9e7a-0caa227e1c76) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83259) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 15:14:04 devstack cinder-volume[83259]: DEBUG cinder.volume.manager [None req-c07205d6-b3c9-4348-a0f5-1280bdc4641a tempest-CreateVolumesFromSnapshotTest-388118498 None] Flow 'volume_create_manager' (85a6ffa3-feee-48fc-a764-c7122ab58561) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83259) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 16 15:14:04 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [None req-0c893b68-7598-4e72-bfcf-92d3b2e200e9 tempest-VolumesListTestJSON-1108154855 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c/volume-feac8d15-fdb5-4c20-9052-e5a2df8be0cf" returned: 0 in 0.474s {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 15:14:04 devstack cinder-volume[83259]: DEBUG cinder.volume.drivers.quobyte [None req-0c893b68-7598-4e72-bfcf-92d3b2e200e9 tempest-VolumesListTestJSON-1108154855 None] <== create_volume: return (1097ms) {'provider_location': '10.10.41.181/cinder-vol-61f585ac-f8e2-4d19-a890-7ebc2726cc72'} {{(pid=83259) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Sep 16 15:14:04 devstack cinder-volume[83259]: DEBUG oslo_concurrency.lockutils [None req-0c893b68-7598-4e72-bfcf-92d3b2e200e9 tempest-VolumesListTestJSON-1108154855 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.110s {{(pid=83259) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 16 15:14:04 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [None req-b1850a45-30a0-47e8-875c-533412becd6e tempest-VolumesSnapshotListTestJSON-248203627 None] CMD "rm -f /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c/volume-68324198-e4bf-4e89-934a-b125055ec9ed.d3fb3e12-9afe-44d7-8d93-0d1a88315aa4" returned: 0 in 0.442s {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 15:14:04 devstack cinder-volume[83259]: DEBUG oslo_concurrency.lockutils [None req-934ae27c-4be5-4c5d-aeee-63233c5f7e3d tempest-CreateVolumesFromSnapshotTest-388118498 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.920s {{(pid=83259) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 16 15:14:04 devstack cinder-volume[83259]: DEBUG cinder.volume.drivers.quobyte [None req-934ae27c-4be5-4c5d-aeee-63233c5f7e3d tempest-CreateVolumesFromSnapshotTest-388118498 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-16T13:13:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1784197218',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#Quobyte',id=c3ebbee7-d2a2-4f09-b68c-7861b4b0bc3a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8468a91973714863896d263c8f21babb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-16T13:14:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-16T13:14:00Z,use_quota=True,user_id='b8e110a8439d457b8c0f8cec54bb1b14',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(485ead50-3df8-4d76-8d34-a4db136c980a),volume_type_id=485ead50-3df8-4d76-8d34-a4db136c980a)}" {{(pid=83259) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Sep 16 15:14:04 devstack cinder-volume[83259]: DEBUG cinder.volume.drivers.remotefs [None req-934ae27c-4be5-4c5d-aeee-63233c5f7e3d tempest-CreateVolumesFromSnapshotTest-388118498 None] Creating volume c3ebbee7-d2a2-4f09-b68c-7861b4b0bc3a {{(pid=83259) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}} Sep 16 15:14:04 devstack cinder-volume[83259]: DEBUG oslo_concurrency.lockutils [None req-934ae27c-4be5-4c5d-aeee-63233c5f7e3d tempest-CreateVolumesFromSnapshotTest-388118498 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83259) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 16 15:14:04 devstack cinder-volume[83259]: DEBUG oslo_concurrency.lockutils [None req-934ae27c-4be5-4c5d-aeee-63233c5f7e3d tempest-CreateVolumesFromSnapshotTest-388118498 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=83259) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 16 15:14:04 devstack cinder-volume[83259]: DEBUG cinder.volume.drivers.quobyte [None req-934ae27c-4be5-4c5d-aeee-63233c5f7e3d tempest-CreateVolumesFromSnapshotTest-388118498 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-61f585ac-f8e2-4d19-a890-7ebc2726cc72': None} {{(pid=83259) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:639}} Sep 16 15:14:04 devstack cinder-volume[83259]: DEBUG cinder.volume.drivers.quobyte [None req-934ae27c-4be5-4c5d-aeee-63233c5f7e3d tempest-CreateVolumesFromSnapshotTest-388118498 None] Available shares ['10.10.41.181/cinder-vol-61f585ac-f8e2-4d19-a890-7ebc2726cc72'] {{(pid=83259) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:669}} Sep 16 15:14:04 devstack cinder-volume[83259]: DEBUG oslo_concurrency.lockutils [None req-934ae27c-4be5-4c5d-aeee-63233c5f7e3d tempest-CreateVolumesFromSnapshotTest-388118498 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=83259) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 16 15:14:04 devstack cinder-volume[83259]: DEBUG cinder.volume.drivers.quobyte [None req-934ae27c-4be5-4c5d-aeee-63233c5f7e3d tempest-CreateVolumesFromSnapshotTest-388118498 None] Selected 10.10.41.181/cinder-vol-61f585ac-f8e2-4d19-a890-7ebc2726cc72 as target Quobyte volume. {{(pid=83259) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:690}} Sep 16 15:14:04 devstack cinder-volume[83259]: INFO cinder.volume.drivers.remotefs [None req-934ae27c-4be5-4c5d-aeee-63233c5f7e3d tempest-CreateVolumesFromSnapshotTest-388118498 None] casted to 10.10.41.181/cinder-vol-61f585ac-f8e2-4d19-a890-7ebc2726cc72 Sep 16 15:14:04 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [None req-934ae27c-4be5-4c5d-aeee-63233c5f7e3d tempest-CreateVolumesFromSnapshotTest-388118498 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c/volume-c3ebbee7-d2a2-4f09-b68c-7861b4b0bc3a 1073741824 {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 15:14:04 devstack quobyte-client[83286]: System call of process 96570 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 16 15:14:04 devstack quobyte-client[83286]: The server volume:87712ffe-8a69-446d-9ed6-4430c7ee9792@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=87712ffe-8a69-446d-9ed6-4430c7ee9792, inode=123, name=volume-c3ebbee7-d2a2-4f09-b68c-7861b4b0bc3a, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.206), requestorAccessMask=0 Sep 16 15:14:04 devstack cinder-volume[83259]: DEBUG cinder.volume.manager [None req-0c893b68-7598-4e72-bfcf-92d3b2e200e9 tempest-VolumesListTestJSON-1108154855 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5d60fa8f-9e4f-4d1c-a303-3265a70252dd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-feac8d15-fdb5-4c20-9052-e5a2df8be0cf', 'volume_size': 1}' {{(pid=83259) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 15:14:04 devstack cinder-volume[83259]: DEBUG cinder.volume.manager [None req-0c893b68-7598-4e72-bfcf-92d3b2e200e9 tempest-VolumesListTestJSON-1108154855 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1d94fc7c-7c8a-435a-9ce5-86a46dad764d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83259) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 15:14:04 devstack cinder-volume[83259]: INFO cinder.volume.manager [None req-c07205d6-b3c9-4348-a0f5-1280bdc4641a tempest-CreateVolumesFromSnapshotTest-388118498 None] Created volume successfully. Sep 16 15:14:04 devstack cinder-volume[83259]: DEBUG cinder.coordination [None req-b1850a45-30a0-47e8-875c-533412becd6e tempest-VolumesSnapshotListTestJSON-248203627 None] Lock "cinder-quobyte-d3fb3e12-9afe-44d7-8d93-0d1a88315aa4" released by "_delete_snapshot" :: held 3.946s {{(pid=83259) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 16 15:14:04 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [None req-934ae27c-4be5-4c5d-aeee-63233c5f7e3d tempest-CreateVolumesFromSnapshotTest-388118498 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c/volume-c3ebbee7-d2a2-4f09-b68c-7861b4b0bc3a 1073741824" returned: 0 in 0.526s {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 15:14:04 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [None req-934ae27c-4be5-4c5d-aeee-63233c5f7e3d tempest-CreateVolumesFromSnapshotTest-388118498 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c/volume-c3ebbee7-d2a2-4f09-b68c-7861b4b0bc3a {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 15:14:04 devstack cinder-volume[83259]: DEBUG cinder.coordination [None req-b1850a45-30a0-47e8-875c-533412becd6e tempest-VolumesSnapshotListTestJSON-248203627 None] Lock "cinder-quobyte-68324198-e4bf-4e89-934a-b125055ec9ed" released by "delete_snapshot" :: held 4.749s {{(pid=83259) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 16 15:14:05 devstack cinder-volume[83259]: INFO cinder.volume.flows.manager.create_volume [None req-0c893b68-7598-4e72-bfcf-92d3b2e200e9 tempest-VolumesListTestJSON-1108154855 None] Volume volume-feac8d15-fdb5-4c20-9052-e5a2df8be0cf (feac8d15-fdb5-4c20-9052-e5a2df8be0cf): created successfully Sep 16 15:14:05 devstack cinder-volume[83259]: DEBUG cinder.volume.manager [None req-0c893b68-7598-4e72-bfcf-92d3b2e200e9 tempest-VolumesListTestJSON-1108154855 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1d94fc7c-7c8a-435a-9ce5-86a46dad764d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83259) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 15:14:05 devstack cinder-volume[83259]: DEBUG cinder.volume.manager [None req-0c893b68-7598-4e72-bfcf-92d3b2e200e9 tempest-VolumesListTestJSON-1108154855 None] Flow 'volume_create_manager' (3aa6e605-98da-4bc3-8081-6fb438ece25d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83259) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 16 15:14:05 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [None req-934ae27c-4be5-4c5d-aeee-63233c5f7e3d tempest-CreateVolumesFromSnapshotTest-388118498 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c/volume-c3ebbee7-d2a2-4f09-b68c-7861b4b0bc3a" returned: 0 in 0.453s {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 15:14:05 devstack cinder-volume[83259]: DEBUG cinder.volume.drivers.quobyte [None req-934ae27c-4be5-4c5d-aeee-63233c5f7e3d tempest-CreateVolumesFromSnapshotTest-388118498 None] <== create_volume: return (1006ms) {'provider_location': '10.10.41.181/cinder-vol-61f585ac-f8e2-4d19-a890-7ebc2726cc72'} {{(pid=83259) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Sep 16 15:14:05 devstack cinder-volume[83259]: DEBUG oslo_concurrency.lockutils [None req-934ae27c-4be5-4c5d-aeee-63233c5f7e3d tempest-CreateVolumesFromSnapshotTest-388118498 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.021s {{(pid=83259) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 16 15:14:05 devstack cinder-volume[83259]: DEBUG oslo_concurrency.lockutils [None req-e7e61369-7579-4fad-8e1e-098fff49a053 tempest-CreateVolumesFromSnapshotTest-388118498 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.409s {{(pid=83259) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 16 15:14:05 devstack cinder-volume[83259]: DEBUG cinder.volume.drivers.quobyte [None req-e7e61369-7579-4fad-8e1e-098fff49a053 tempest-CreateVolumesFromSnapshotTest-388118498 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-16T13:14:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-2013219163',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#Quobyte',id=b3f3c11b-59c5-4e0e-b32e-c4a06e5d075f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8468a91973714863896d263c8f21babb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-16T13:14:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-16T13:14:00Z,use_quota=True,user_id='b8e110a8439d457b8c0f8cec54bb1b14',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(485ead50-3df8-4d76-8d34-a4db136c980a),volume_type_id=485ead50-3df8-4d76-8d34-a4db136c980a)}" {{(pid=83259) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Sep 16 15:14:05 devstack cinder-volume[83259]: DEBUG cinder.volume.drivers.remotefs [None req-e7e61369-7579-4fad-8e1e-098fff49a053 tempest-CreateVolumesFromSnapshotTest-388118498 None] Creating volume b3f3c11b-59c5-4e0e-b32e-c4a06e5d075f {{(pid=83259) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}} Sep 16 15:14:05 devstack cinder-volume[83259]: DEBUG oslo_concurrency.lockutils [None req-e7e61369-7579-4fad-8e1e-098fff49a053 tempest-CreateVolumesFromSnapshotTest-388118498 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83259) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 16 15:14:05 devstack cinder-volume[83259]: DEBUG oslo_concurrency.lockutils [None req-e7e61369-7579-4fad-8e1e-098fff49a053 tempest-CreateVolumesFromSnapshotTest-388118498 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=83259) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 16 15:14:05 devstack cinder-volume[83259]: DEBUG cinder.volume.drivers.quobyte [None req-e7e61369-7579-4fad-8e1e-098fff49a053 tempest-CreateVolumesFromSnapshotTest-388118498 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-61f585ac-f8e2-4d19-a890-7ebc2726cc72': None} {{(pid=83259) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:639}} Sep 16 15:14:05 devstack cinder-volume[83259]: DEBUG cinder.volume.drivers.quobyte [None req-e7e61369-7579-4fad-8e1e-098fff49a053 tempest-CreateVolumesFromSnapshotTest-388118498 None] Available shares ['10.10.41.181/cinder-vol-61f585ac-f8e2-4d19-a890-7ebc2726cc72'] {{(pid=83259) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:669}} Sep 16 15:14:05 devstack cinder-volume[83259]: DEBUG oslo_concurrency.lockutils [None req-e7e61369-7579-4fad-8e1e-098fff49a053 tempest-CreateVolumesFromSnapshotTest-388118498 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=83259) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 16 15:14:05 devstack cinder-volume[83259]: DEBUG cinder.volume.drivers.quobyte [None req-e7e61369-7579-4fad-8e1e-098fff49a053 tempest-CreateVolumesFromSnapshotTest-388118498 None] Selected 10.10.41.181/cinder-vol-61f585ac-f8e2-4d19-a890-7ebc2726cc72 as target Quobyte volume. {{(pid=83259) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:690}} Sep 16 15:14:05 devstack cinder-volume[83259]: INFO cinder.volume.drivers.remotefs [None req-e7e61369-7579-4fad-8e1e-098fff49a053 tempest-CreateVolumesFromSnapshotTest-388118498 None] casted to 10.10.41.181/cinder-vol-61f585ac-f8e2-4d19-a890-7ebc2726cc72 Sep 16 15:14:05 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [None req-e7e61369-7579-4fad-8e1e-098fff49a053 tempest-CreateVolumesFromSnapshotTest-388118498 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c/volume-b3f3c11b-59c5-4e0e-b32e-c4a06e5d075f 1073741824 {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 15:14:05 devstack quobyte-client[83286]: System call of process 96575 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 16 15:14:05 devstack quobyte-client[83286]: System call of process 96575 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 16 15:14:05 devstack quobyte-client[83286]: The server volume:87712ffe-8a69-446d-9ed6-4430c7ee9792@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=87712ffe-8a69-446d-9ed6-4430c7ee9792, inode=124, name=volume-b3f3c11b-59c5-4e0e-b32e-c4a06e5d075f, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.206), requestorAccessMask=0 Sep 16 15:14:05 devstack cinder-volume[83259]: DEBUG cinder.volume.manager [None req-934ae27c-4be5-4c5d-aeee-63233c5f7e3d tempest-CreateVolumesFromSnapshotTest-388118498 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c7562488-b19c-41c2-808c-43132a1d1482) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c3ebbee7-d2a2-4f09-b68c-7861b4b0bc3a', 'volume_size': 1}' {{(pid=83259) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 15:14:05 devstack cinder-volume[83259]: DEBUG cinder.volume.manager [None req-934ae27c-4be5-4c5d-aeee-63233c5f7e3d tempest-CreateVolumesFromSnapshotTest-388118498 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9b121067-5dfe-417a-a0d5-8cc2cc71fff7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83259) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 15:14:05 devstack cinder-volume[83259]: INFO cinder.volume.manager [None req-0c893b68-7598-4e72-bfcf-92d3b2e200e9 tempest-VolumesListTestJSON-1108154855 None] Created volume successfully. Sep 16 15:14:05 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [None req-e7e61369-7579-4fad-8e1e-098fff49a053 tempest-CreateVolumesFromSnapshotTest-388118498 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c/volume-b3f3c11b-59c5-4e0e-b32e-c4a06e5d075f 1073741824" returned: 0 in 0.572s {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 15:14:05 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [None req-e7e61369-7579-4fad-8e1e-098fff49a053 tempest-CreateVolumesFromSnapshotTest-388118498 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c/volume-b3f3c11b-59c5-4e0e-b32e-c4a06e5d075f {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 15:14:06 devstack cinder-volume[83259]: INFO cinder.volume.flows.manager.create_volume [None req-934ae27c-4be5-4c5d-aeee-63233c5f7e3d tempest-CreateVolumesFromSnapshotTest-388118498 None] Volume volume-c3ebbee7-d2a2-4f09-b68c-7861b4b0bc3a (c3ebbee7-d2a2-4f09-b68c-7861b4b0bc3a): created successfully Sep 16 15:14:06 devstack cinder-volume[83259]: DEBUG cinder.volume.manager [None req-934ae27c-4be5-4c5d-aeee-63233c5f7e3d tempest-CreateVolumesFromSnapshotTest-388118498 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9b121067-5dfe-417a-a0d5-8cc2cc71fff7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83259) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 15:14:06 devstack cinder-volume[83259]: DEBUG cinder.volume.manager [None req-934ae27c-4be5-4c5d-aeee-63233c5f7e3d tempest-CreateVolumesFromSnapshotTest-388118498 None] Flow 'volume_create_manager' (8cf2c5a9-6d11-472e-be0a-ff47c6a3a88a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83259) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 16 15:14:06 devstack cinder-volume[83259]: INFO cinder.volume.manager [None req-934ae27c-4be5-4c5d-aeee-63233c5f7e3d tempest-CreateVolumesFromSnapshotTest-388118498 None] Created volume successfully. Sep 16 15:14:06 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [None req-e7e61369-7579-4fad-8e1e-098fff49a053 tempest-CreateVolumesFromSnapshotTest-388118498 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c/volume-b3f3c11b-59c5-4e0e-b32e-c4a06e5d075f" returned: 0 in 0.486s {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 15:14:06 devstack cinder-volume[83259]: DEBUG cinder.volume.drivers.quobyte [None req-e7e61369-7579-4fad-8e1e-098fff49a053 tempest-CreateVolumesFromSnapshotTest-388118498 None] <== create_volume: return (1089ms) {'provider_location': '10.10.41.181/cinder-vol-61f585ac-f8e2-4d19-a890-7ebc2726cc72'} {{(pid=83259) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Sep 16 15:14:06 devstack cinder-volume[83259]: DEBUG oslo_concurrency.lockutils [None req-e7e61369-7579-4fad-8e1e-098fff49a053 tempest-CreateVolumesFromSnapshotTest-388118498 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.103s {{(pid=83259) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 16 15:14:06 devstack cinder-volume[83259]: DEBUG cinder.volume.manager [None req-e7e61369-7579-4fad-8e1e-098fff49a053 tempest-CreateVolumesFromSnapshotTest-388118498 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2c10ffc4-421c-47c2-a3f5-c210548935df) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b3f3c11b-59c5-4e0e-b32e-c4a06e5d075f', 'volume_size': 1}' {{(pid=83259) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 15:14:06 devstack cinder-volume[83259]: DEBUG cinder.volume.manager [None req-e7e61369-7579-4fad-8e1e-098fff49a053 tempest-CreateVolumesFromSnapshotTest-388118498 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9e0aca79-ad42-4739-af12-e3fc3fcfeb12) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83259) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 15:14:06 devstack cinder-volume[83259]: WARNING cinder.volume.volume_utils [None req-24782a82-3783-413f-8a88-e9ae0a7440ca tempest-VolumesListTestJSON-1108154855 None] Volume driver (QuobyteDriver 1.2) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 16 15:14:06 devstack cinder-volume[83259]: DEBUG cinder.volume.flows.manager.create_volume [None req-24782a82-3783-413f-8a88-e9ae0a7440ca tempest-VolumesListTestJSON-1108154855 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#Quobyte'], 'hosts': ['devstack@QuobyteHD#Quobyte']} {{(pid=83259) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1387}} Sep 16 15:14:06 devstack cinder-volume[83259]: DEBUG cinder.volume.manager [None req-24782a82-3783-413f-8a88-e9ae0a7440ca tempest-VolumesListTestJSON-1108154855 None] Flow 'volume_create_manager' (cf8b8b37-b3f6-401f-af91-03076055f840) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83259) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 16 15:14:06 devstack cinder-volume[83259]: DEBUG cinder.volume.manager [None req-24782a82-3783-413f-8a88-e9ae0a7440ca tempest-VolumesListTestJSON-1108154855 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (531c4a75-cf03-4798-956f-6d079c90c240) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83259) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 15:14:06 devstack cinder-volume[83259]: DEBUG cinder.volume.manager [None req-24782a82-3783-413f-8a88-e9ae0a7440ca tempest-VolumesListTestJSON-1108154855 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (531c4a75-cf03-4798-956f-6d079c90c240) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-16T13:14:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-1182858014',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#Quobyte',id=54a40c15-3ff6-4409-9140-444b7aa7262e,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='865f0d0f7af2430d9697eb01904b9bb0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-16T13:14:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-16T13:14:06Z,use_quota=True,user_id='8871143af23e48c0bc960a4ebe1d5ddc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(485ead50-3df8-4d76-8d34-a4db136c980a),volume_type_id=485ead50-3df8-4d76-8d34-a4db136c980a)' {{(pid=83259) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 15:14:06 devstack cinder-volume[83259]: DEBUG cinder.volume.manager [None req-24782a82-3783-413f-8a88-e9ae0a7440ca tempest-VolumesListTestJSON-1108154855 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4144f9d3-7e29-403c-a368-69d58445266e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83259) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 15:14:06 devstack cinder-volume[83259]: DEBUG cinder.volume.manager [None req-24782a82-3783-413f-8a88-e9ae0a7440ca tempest-VolumesListTestJSON-1108154855 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4144f9d3-7e29-403c-a368-69d58445266e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83259) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 15:14:06 devstack cinder-volume[83259]: DEBUG cinder.volume.manager [None req-24782a82-3783-413f-8a88-e9ae0a7440ca tempest-VolumesListTestJSON-1108154855 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e60e3968-6076-4f2f-9f28-0ebd4fdc3e60) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83259) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 15:14:06 devstack cinder-volume[83259]: DEBUG cinder.volume.manager [None req-24782a82-3783-413f-8a88-e9ae0a7440ca tempest-VolumesListTestJSON-1108154855 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e60e3968-6076-4f2f-9f28-0ebd4fdc3e60) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '54a40c15-3ff6-4409-9140-444b7aa7262e', 'volume_name': 'volume-54a40c15-3ff6-4409-9140-444b7aa7262e', 'volume_size': 1}' {{(pid=83259) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 15:14:06 devstack cinder-volume[83259]: DEBUG cinder.volume.manager [None req-24782a82-3783-413f-8a88-e9ae0a7440ca tempest-VolumesListTestJSON-1108154855 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0bc5269f-6c4d-47ab-904e-4a907ec454ca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83259) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 15:14:06 devstack cinder-volume[83259]: DEBUG cinder.volume.manager [None req-24782a82-3783-413f-8a88-e9ae0a7440ca tempest-VolumesListTestJSON-1108154855 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0bc5269f-6c4d-47ab-904e-4a907ec454ca) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83259) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 15:14:06 devstack cinder-volume[83259]: DEBUG cinder.volume.manager [None req-24782a82-3783-413f-8a88-e9ae0a7440ca tempest-VolumesListTestJSON-1108154855 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (967c6ad9-df86-4494-81e2-a35823ada08f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83259) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 15:14:06 devstack cinder-volume[83259]: INFO cinder.volume.flows.manager.create_volume [None req-24782a82-3783-413f-8a88-e9ae0a7440ca tempest-VolumesListTestJSON-1108154855 None] Volume 54a40c15-3ff6-4409-9140-444b7aa7262e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-54a40c15-3ff6-4409-9140-444b7aa7262e', 'volume_size': 1} Sep 16 15:14:06 devstack cinder-volume[83259]: DEBUG oslo_concurrency.lockutils [None req-24782a82-3783-413f-8a88-e9ae0a7440ca tempest-VolumesListTestJSON-1108154855 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83259) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 16 15:14:06 devstack cinder-volume[83259]: DEBUG oslo_concurrency.lockutils [None req-24782a82-3783-413f-8a88-e9ae0a7440ca tempest-VolumesListTestJSON-1108154855 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=83259) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 16 15:14:06 devstack cinder-volume[83259]: DEBUG cinder.volume.drivers.quobyte [None req-24782a82-3783-413f-8a88-e9ae0a7440ca tempest-VolumesListTestJSON-1108154855 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-16T13:14:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-1182858014',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#Quobyte',id=54a40c15-3ff6-4409-9140-444b7aa7262e,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='865f0d0f7af2430d9697eb01904b9bb0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-16T13:14:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-16T13:14:06Z,use_quota=True,user_id='8871143af23e48c0bc960a4ebe1d5ddc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(485ead50-3df8-4d76-8d34-a4db136c980a),volume_type_id=485ead50-3df8-4d76-8d34-a4db136c980a)}" {{(pid=83259) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Sep 16 15:14:06 devstack cinder-volume[83259]: DEBUG cinder.volume.drivers.remotefs [None req-24782a82-3783-413f-8a88-e9ae0a7440ca tempest-VolumesListTestJSON-1108154855 None] Creating volume 54a40c15-3ff6-4409-9140-444b7aa7262e {{(pid=83259) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}} Sep 16 15:14:06 devstack cinder-volume[83259]: DEBUG oslo_concurrency.lockutils [None req-24782a82-3783-413f-8a88-e9ae0a7440ca tempest-VolumesListTestJSON-1108154855 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83259) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 16 15:14:06 devstack cinder-volume[83259]: DEBUG oslo_concurrency.lockutils [None req-24782a82-3783-413f-8a88-e9ae0a7440ca tempest-VolumesListTestJSON-1108154855 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83259) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 16 15:14:06 devstack cinder-volume[83259]: DEBUG cinder.volume.drivers.quobyte [None req-24782a82-3783-413f-8a88-e9ae0a7440ca tempest-VolumesListTestJSON-1108154855 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-61f585ac-f8e2-4d19-a890-7ebc2726cc72': None} {{(pid=83259) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:639}} Sep 16 15:14:06 devstack cinder-volume[83259]: DEBUG cinder.volume.drivers.quobyte [None req-24782a82-3783-413f-8a88-e9ae0a7440ca tempest-VolumesListTestJSON-1108154855 None] Available shares ['10.10.41.181/cinder-vol-61f585ac-f8e2-4d19-a890-7ebc2726cc72'] {{(pid=83259) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:669}} Sep 16 15:14:06 devstack cinder-volume[83259]: DEBUG oslo_concurrency.lockutils [None req-24782a82-3783-413f-8a88-e9ae0a7440ca tempest-VolumesListTestJSON-1108154855 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=83259) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 16 15:14:06 devstack cinder-volume[83259]: DEBUG cinder.volume.drivers.quobyte [None req-24782a82-3783-413f-8a88-e9ae0a7440ca tempest-VolumesListTestJSON-1108154855 None] Selected 10.10.41.181/cinder-vol-61f585ac-f8e2-4d19-a890-7ebc2726cc72 as target Quobyte volume. {{(pid=83259) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:690}} Sep 16 15:14:06 devstack cinder-volume[83259]: INFO cinder.volume.drivers.remotefs [None req-24782a82-3783-413f-8a88-e9ae0a7440ca tempest-VolumesListTestJSON-1108154855 None] casted to 10.10.41.181/cinder-vol-61f585ac-f8e2-4d19-a890-7ebc2726cc72 Sep 16 15:14:06 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [None req-24782a82-3783-413f-8a88-e9ae0a7440ca tempest-VolumesListTestJSON-1108154855 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c/volume-54a40c15-3ff6-4409-9140-444b7aa7262e 1073741824 {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 15:14:06 devstack quobyte-client[83286]: The server volume:87712ffe-8a69-446d-9ed6-4430c7ee9792@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=87712ffe-8a69-446d-9ed6-4430c7ee9792, inode=125, name=volume-54a40c15-3ff6-4409-9140-444b7aa7262e, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.206), requestorAccessMask=0 Sep 16 15:14:06 devstack cinder-volume[83259]: DEBUG cinder.quota [None req-b1850a45-30a0-47e8-875c-533412becd6e tempest-VolumesSnapshotListTestJSON-248203627 None] Created reservations ['3b6beaf7-7d56-42b9-92bc-661bc6b89ef1', '700d2e6b-447a-45fc-9317-f1f4e03d1fa4', '83f11d0b-9a4e-4a91-888e-28127f31d172', '8f1a3bb5-9f6c-438e-8b3b-950e92801bb4'] {{(pid=83259) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 16 15:14:06 devstack cinder-volume[83259]: INFO cinder.volume.flows.manager.create_volume [None req-e7e61369-7579-4fad-8e1e-098fff49a053 tempest-CreateVolumesFromSnapshotTest-388118498 None] Volume volume-b3f3c11b-59c5-4e0e-b32e-c4a06e5d075f (b3f3c11b-59c5-4e0e-b32e-c4a06e5d075f): created successfully Sep 16 15:14:06 devstack cinder-volume[83259]: DEBUG cinder.volume.manager [None req-e7e61369-7579-4fad-8e1e-098fff49a053 tempest-CreateVolumesFromSnapshotTest-388118498 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9e0aca79-ad42-4739-af12-e3fc3fcfeb12) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83259) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 15:14:06 devstack cinder-volume[83259]: DEBUG cinder.volume.manager [None req-e7e61369-7579-4fad-8e1e-098fff49a053 tempest-CreateVolumesFromSnapshotTest-388118498 None] Flow 'volume_create_manager' (ce7dbfc0-4d45-4ed2-a3e0-05e7ba6d263b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83259) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 16 15:14:07 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [None req-24782a82-3783-413f-8a88-e9ae0a7440ca tempest-VolumesListTestJSON-1108154855 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c/volume-54a40c15-3ff6-4409-9140-444b7aa7262e 1073741824" returned: 0 in 0.440s {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 15:14:07 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [None req-24782a82-3783-413f-8a88-e9ae0a7440ca tempest-VolumesListTestJSON-1108154855 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c/volume-54a40c15-3ff6-4409-9140-444b7aa7262e {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 15:14:07 devstack cinder-volume[83259]: INFO cinder.volume.manager [None req-e7e61369-7579-4fad-8e1e-098fff49a053 tempest-CreateVolumesFromSnapshotTest-388118498 None] Created volume successfully. Sep 16 15:14:07 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [None req-24782a82-3783-413f-8a88-e9ae0a7440ca tempest-VolumesListTestJSON-1108154855 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c/volume-54a40c15-3ff6-4409-9140-444b7aa7262e" returned: 0 in 0.353s {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 15:14:07 devstack cinder-volume[83259]: DEBUG cinder.volume.drivers.quobyte [None req-24782a82-3783-413f-8a88-e9ae0a7440ca tempest-VolumesListTestJSON-1108154855 None] <== create_volume: return (848ms) {'provider_location': '10.10.41.181/cinder-vol-61f585ac-f8e2-4d19-a890-7ebc2726cc72'} {{(pid=83259) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Sep 16 15:14:07 devstack cinder-volume[83259]: DEBUG oslo_concurrency.lockutils [None req-24782a82-3783-413f-8a88-e9ae0a7440ca tempest-VolumesListTestJSON-1108154855 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.858s {{(pid=83259) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 16 15:14:07 devstack cinder-volume[83259]: DEBUG cinder.volume.manager [None req-24782a82-3783-413f-8a88-e9ae0a7440ca tempest-VolumesListTestJSON-1108154855 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (967c6ad9-df86-4494-81e2-a35823ada08f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-54a40c15-3ff6-4409-9140-444b7aa7262e', 'volume_size': 1}' {{(pid=83259) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 15:14:07 devstack cinder-volume[83259]: DEBUG cinder.volume.manager [None req-24782a82-3783-413f-8a88-e9ae0a7440ca tempest-VolumesListTestJSON-1108154855 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3b3c230d-cfb4-4167-8816-0c20b3acdb5c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83259) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 15:14:07 devstack cinder-volume[83259]: DEBUG cinder.coordination [None req-5a5f0370-fd27-4bfb-bd20-3625d0f0ef59 tempest-CreateVolumesFromSnapshotTest-388118498 None] Acquiring lock "cinder-b3f3c11b-59c5-4e0e-b32e-c4a06e5d075f-delete_volume" by "delete_volume" {{(pid=83259) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 16 15:14:07 devstack cinder-volume[83259]: INFO cinder.volume.flows.manager.create_volume [None req-24782a82-3783-413f-8a88-e9ae0a7440ca tempest-VolumesListTestJSON-1108154855 None] Volume volume-54a40c15-3ff6-4409-9140-444b7aa7262e (54a40c15-3ff6-4409-9140-444b7aa7262e): created successfully Sep 16 15:14:07 devstack cinder-volume[83259]: DEBUG cinder.volume.manager [None req-24782a82-3783-413f-8a88-e9ae0a7440ca tempest-VolumesListTestJSON-1108154855 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3b3c230d-cfb4-4167-8816-0c20b3acdb5c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83259) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 15:14:07 devstack cinder-volume[83259]: DEBUG cinder.volume.manager [None req-24782a82-3783-413f-8a88-e9ae0a7440ca tempest-VolumesListTestJSON-1108154855 None] Flow 'volume_create_manager' (cf8b8b37-b3f6-401f-af91-03076055f840) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83259) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 16 15:14:07 devstack cinder-volume[83259]: DEBUG cinder.coordination [None req-5a5f0370-fd27-4bfb-bd20-3625d0f0ef59 tempest-CreateVolumesFromSnapshotTest-388118498 None] Lock "cinder-b3f3c11b-59c5-4e0e-b32e-c4a06e5d075f-delete_volume" acquired by "delete_volume" :: waited 0.058s {{(pid=83259) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 16 15:14:07 devstack cinder-volume[83259]: INFO cinder.volume.manager [None req-24782a82-3783-413f-8a88-e9ae0a7440ca tempest-VolumesListTestJSON-1108154855 None] Created volume successfully. Sep 16 15:14:07 devstack cinder-volume[83259]: INFO cinder.volume.manager [None req-b1850a45-30a0-47e8-875c-533412becd6e tempest-VolumesSnapshotListTestJSON-248203627 None] Delete snapshot completed successfully. Sep 16 15:14:07 devstack cinder-volume[83259]: DEBUG cinder.coordination [None req-b1850a45-30a0-47e8-875c-533412becd6e tempest-VolumesSnapshotListTestJSON-248203627 None] Lock "cinder-d3fb3e12-9afe-44d7-8d93-0d1a88315aa4-delete_snapshot" released by "delete_snapshot" :: held 8.278s {{(pid=83259) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 16 15:14:07 devstack cinder-volume[83259]: WARNING cinder.volume.volume_utils [None req-5a5f0370-fd27-4bfb-bd20-3625d0f0ef59 tempest-CreateVolumesFromSnapshotTest-388118498 None] Volume driver (QuobyteDriver 1.2) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 16 15:14:07 devstack cinder-volume[83259]: DEBUG cinder.coordination [None req-5a5f0370-fd27-4bfb-bd20-3625d0f0ef59 tempest-CreateVolumesFromSnapshotTest-388118498 None] Acquiring lock "cinder-quobyte-b3f3c11b-59c5-4e0e-b32e-c4a06e5d075f" by "delete_volume" {{(pid=83259) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 16 15:14:07 devstack cinder-volume[83259]: DEBUG cinder.coordination [None req-5a5f0370-fd27-4bfb-bd20-3625d0f0ef59 tempest-CreateVolumesFromSnapshotTest-388118498 None] Lock "cinder-quobyte-b3f3c11b-59c5-4e0e-b32e-c4a06e5d075f" acquired by "delete_volume" :: waited 0.012s {{(pid=83259) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 16 15:14:07 devstack cinder-volume[83259]: DEBUG oslo.privsep.daemon [-] privsep: reply[5ef126f0-ae0b-486a-aa71-a5c9a237aa94]: (4, 'qcow2') {{(pid=84312) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 16 15:14:07 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [None req-5a5f0370-fd27-4bfb-bd20-3625d0f0ef59 tempest-CreateVolumesFromSnapshotTest-388118498 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c/volume-b3f3c11b-59c5-4e0e-b32e-c4a06e5d075f {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 15:14:08 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [None req-5a5f0370-fd27-4bfb-bd20-3625d0f0ef59 tempest-CreateVolumesFromSnapshotTest-388118498 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c/volume-b3f3c11b-59c5-4e0e-b32e-c4a06e5d075f" returned: 0 in 0.474s {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 15:14:08 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [None req-5a5f0370-fd27-4bfb-bd20-3625d0f0ef59 tempest-CreateVolumesFromSnapshotTest-388118498 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c/volume-b3f3c11b-59c5-4e0e-b32e-c4a06e5d075f {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 15:14:08 devstack cinder-volume[83259]: DEBUG cinder.coordination [None req-33a2b82a-673e-468b-9fc0-7850547a7f62 tempest-VolumesSnapshotListTestJSON-248203627 None] Acquiring lock "cinder-0372b193-39a5-4cc5-b188-e72fdea25759-delete_snapshot" by "delete_snapshot" {{(pid=83259) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 16 15:14:08 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [None req-5a5f0370-fd27-4bfb-bd20-3625d0f0ef59 tempest-CreateVolumesFromSnapshotTest-388118498 None] CMD "rm -f /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c/volume-b3f3c11b-59c5-4e0e-b32e-c4a06e5d075f" returned: 0 in 0.498s {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 15:14:09 devstack cinder-volume[83259]: DEBUG cinder.coordination [None req-33a2b82a-673e-468b-9fc0-7850547a7f62 tempest-VolumesSnapshotListTestJSON-248203627 None] Lock "cinder-0372b193-39a5-4cc5-b188-e72fdea25759-delete_snapshot" acquired by "delete_snapshot" :: waited 0.150s {{(pid=83259) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 16 15:14:09 devstack cinder-volume[83259]: WARNING cinder.volume.volume_utils [None req-33a2b82a-673e-468b-9fc0-7850547a7f62 tempest-VolumesSnapshotListTestJSON-248203627 None] Volume driver (QuobyteDriver 1.2) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 16 15:14:09 devstack cinder-volume[83259]: DEBUG cinder.coordination [None req-33a2b82a-673e-468b-9fc0-7850547a7f62 tempest-VolumesSnapshotListTestJSON-248203627 None] Acquiring lock "cinder-quobyte-68324198-e4bf-4e89-934a-b125055ec9ed" by "delete_snapshot" {{(pid=83259) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 16 15:14:09 devstack cinder-volume[83259]: DEBUG cinder.coordination [None req-5a5f0370-fd27-4bfb-bd20-3625d0f0ef59 tempest-CreateVolumesFromSnapshotTest-388118498 None] Lock "cinder-quobyte-b3f3c11b-59c5-4e0e-b32e-c4a06e5d075f" released by "delete_volume" :: held 1.174s {{(pid=83259) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 16 15:14:09 devstack cinder-volume[83259]: DEBUG cinder.coordination [None req-33a2b82a-673e-468b-9fc0-7850547a7f62 tempest-VolumesSnapshotListTestJSON-248203627 None] Lock "cinder-quobyte-68324198-e4bf-4e89-934a-b125055ec9ed" acquired by "delete_snapshot" :: waited 0.248s {{(pid=83259) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 16 15:14:09 devstack cinder-volume[83259]: DEBUG cinder.coordination [None req-33a2b82a-673e-468b-9fc0-7850547a7f62 tempest-VolumesSnapshotListTestJSON-248203627 None] Acquiring lock "cinder-quobyte-0372b193-39a5-4cc5-b188-e72fdea25759" by "_delete_snapshot" {{(pid=83259) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 16 15:14:09 devstack cinder-volume[83259]: DEBUG cinder.coordination [None req-33a2b82a-673e-468b-9fc0-7850547a7f62 tempest-VolumesSnapshotListTestJSON-248203627 None] Lock "cinder-quobyte-0372b193-39a5-4cc5-b188-e72fdea25759" acquired by "_delete_snapshot" :: waited 0.052s {{(pid=83259) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 16 15:14:09 devstack cinder-volume[83259]: DEBUG cinder.volume.drivers.remotefs [None req-33a2b82a-673e-468b-9fc0-7850547a7f62 tempest-VolumesSnapshotListTestJSON-248203627 None] Deleting offline snapshot 0372b193-39a5-4cc5-b188-e72fdea25759 of volume 68324198-e4bf-4e89-934a-b125055ec9ed {{(pid=83259) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1278}} Sep 16 15:14:09 devstack cinder-volume[83259]: DEBUG cinder.volume.drivers.remotefs [None req-33a2b82a-673e-468b-9fc0-7850547a7f62 tempest-VolumesSnapshotListTestJSON-248203627 None] snapshot_file for this snap is: volume-68324198-e4bf-4e89-934a-b125055ec9ed.0372b193-39a5-4cc5-b188-e72fdea25759 {{(pid=83259) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1307}} Sep 16 15:14:09 devstack cinder-volume[83259]: DEBUG oslo.privsep.daemon [-] privsep: reply[c75463be-b711-41e3-a452-1c33991a5c2a]: (4, 'qcow2') {{(pid=84312) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 16 15:14:09 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [None req-33a2b82a-673e-468b-9fc0-7850547a7f62 tempest-VolumesSnapshotListTestJSON-248203627 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c/volume-68324198-e4bf-4e89-934a-b125055ec9ed.0372b193-39a5-4cc5-b188-e72fdea25759 {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 15:14:09 devstack cinder-volume[83259]: DEBUG cinder.quota [None req-5a5f0370-fd27-4bfb-bd20-3625d0f0ef59 tempest-CreateVolumesFromSnapshotTest-388118498 None] Created reservations ['9b16a71e-fd23-41ce-8f38-06a2deb23031', 'a916ce36-9794-4e8b-a1ca-f4fa2ed73ac0', 'c5a31ca9-d50b-4f45-81a5-992039333142', 'c3766887-6a1f-4db4-8f41-d27b579c1e2c'] {{(pid=83259) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 16 15:14:10 devstack quobyte-client[83286]: System call of process 96587 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 16 15:14:10 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [None req-33a2b82a-673e-468b-9fc0-7850547a7f62 tempest-VolumesSnapshotListTestJSON-248203627 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c/volume-68324198-e4bf-4e89-934a-b125055ec9ed.0372b193-39a5-4cc5-b188-e72fdea25759" returned: 0 in 0.879s {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 15:14:10 devstack cinder-volume[83259]: DEBUG cinder.volume.drivers.remotefs [None req-33a2b82a-673e-468b-9fc0-7850547a7f62 tempest-VolumesSnapshotListTestJSON-248203627 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-68324198-e4bf-4e89-934a-b125055ec9ed(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83259) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:886}} Sep 16 15:14:10 devstack cinder-volume[83259]: DEBUG oslo.privsep.daemon [-] privsep: reply[1bc69e7b-6630-4f5b-9070-13c61b9fb095]: (4, 'qcow2') {{(pid=84312) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 16 15:14:10 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [None req-33a2b82a-673e-468b-9fc0-7850547a7f62 tempest-VolumesSnapshotListTestJSON-248203627 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c/volume-68324198-e4bf-4e89-934a-b125055ec9ed {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 15:14:10 devstack cinder-volume[83259]: DEBUG oslo_concurrency.lockutils [None req-5a5f0370-fd27-4bfb-bd20-3625d0f0ef59 tempest-CreateVolumesFromSnapshotTest-388118498 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83259) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 16 15:14:10 devstack cinder-volume[83259]: DEBUG oslo_concurrency.lockutils [None req-5a5f0370-fd27-4bfb-bd20-3625d0f0ef59 tempest-CreateVolumesFromSnapshotTest-388118498 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.030s {{(pid=83259) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 16 15:14:10 devstack cinder-volume[83259]: DEBUG cinder.volume.drivers.quobyte [None req-5a5f0370-fd27-4bfb-bd20-3625d0f0ef59 tempest-CreateVolumesFromSnapshotTest-388118498 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-61f585ac-f8e2-4d19-a890-7ebc2726cc72': None} {{(pid=83259) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:639}} Sep 16 15:14:10 devstack cinder-volume[83259]: DEBUG cinder.volume.drivers.quobyte [None req-5a5f0370-fd27-4bfb-bd20-3625d0f0ef59 tempest-CreateVolumesFromSnapshotTest-388118498 None] Available shares ['10.10.41.181/cinder-vol-61f585ac-f8e2-4d19-a890-7ebc2726cc72'] {{(pid=83259) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:669}} Sep 16 15:14:10 devstack cinder-volume[83259]: DEBUG oslo_concurrency.lockutils [None req-5a5f0370-fd27-4bfb-bd20-3625d0f0ef59 tempest-CreateVolumesFromSnapshotTest-388118498 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.024s {{(pid=83259) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 16 15:14:10 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [None req-5a5f0370-fd27-4bfb-bd20-3625d0f0ef59 tempest-CreateVolumesFromSnapshotTest-388118498 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 15:14:10 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [None req-5a5f0370-fd27-4bfb-bd20-3625d0f0ef59 tempest-CreateVolumesFromSnapshotTest-388118498 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c" returned: 0 in 0.176s {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 15:14:10 devstack cinder-volume[83259]: DEBUG cinder.manager [None req-5a5f0370-fd27-4bfb-bd20-3625d0f0ef59 tempest-CreateVolumesFromSnapshotTest-388118498 None] Notifying Schedulers of capabilities ... {{(pid=83259) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 16 15:14:10 devstack cinder-volume[83259]: INFO cinder.volume.manager [None req-5a5f0370-fd27-4bfb-bd20-3625d0f0ef59 tempest-CreateVolumesFromSnapshotTest-388118498 None] Deleted volume successfully. Sep 16 15:14:10 devstack quobyte-client[83286]: System call of process 96590 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 16 15:14:11 devstack cinder-volume[83259]: DEBUG cinder.coordination [None req-5a5f0370-fd27-4bfb-bd20-3625d0f0ef59 tempest-CreateVolumesFromSnapshotTest-388118498 None] Lock "cinder-b3f3c11b-59c5-4e0e-b32e-c4a06e5d075f-delete_volume" released by "delete_volume" :: held 3.481s {{(pid=83259) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 16 15:14:11 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [None req-33a2b82a-673e-468b-9fc0-7850547a7f62 tempest-VolumesSnapshotListTestJSON-248203627 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c/volume-68324198-e4bf-4e89-934a-b125055ec9ed" returned: 0 in 1.021s {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 15:14:11 devstack cinder-volume[83259]: DEBUG cinder.coordination [None req-082cfb09-29c5-4450-b563-bfaf221778d4 tempest-CreateVolumesFromSnapshotTest-388118498 None] Acquiring lock "cinder-c3ebbee7-d2a2-4f09-b68c-7861b4b0bc3a-delete_volume" by "delete_volume" {{(pid=83259) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 16 15:14:11 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [None req-33a2b82a-673e-468b-9fc0-7850547a7f62 tempest-VolumesSnapshotListTestJSON-248203627 None] Running cmd (subprocess): qemu-img commit -d /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c/volume-68324198-e4bf-4e89-934a-b125055ec9ed.0372b193-39a5-4cc5-b188-e72fdea25759 {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 15:14:11 devstack quobyte-client[83286]: System call of process 96594 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 16 15:14:11 devstack cinder-volume[83259]: DEBUG cinder.coordination [None req-082cfb09-29c5-4450-b563-bfaf221778d4 tempest-CreateVolumesFromSnapshotTest-388118498 None] Lock "cinder-c3ebbee7-d2a2-4f09-b68c-7861b4b0bc3a-delete_volume" acquired by "delete_volume" :: waited 0.464s {{(pid=83259) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 16 15:14:12 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [None req-33a2b82a-673e-468b-9fc0-7850547a7f62 tempest-VolumesSnapshotListTestJSON-248203627 None] CMD "qemu-img commit -d /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c/volume-68324198-e4bf-4e89-934a-b125055ec9ed.0372b193-39a5-4cc5-b188-e72fdea25759" returned: 0 in 0.684s {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 15:14:12 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [None req-33a2b82a-673e-468b-9fc0-7850547a7f62 tempest-VolumesSnapshotListTestJSON-248203627 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c/volume-68324198-e4bf-4e89-934a-b125055ec9ed.0372b193-39a5-4cc5-b188-e72fdea25759 {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 15:14:12 devstack cinder-volume[83259]: WARNING cinder.volume.volume_utils [None req-082cfb09-29c5-4450-b563-bfaf221778d4 tempest-CreateVolumesFromSnapshotTest-388118498 None] Volume driver (QuobyteDriver 1.2) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 16 15:14:12 devstack cinder-volume[83259]: DEBUG cinder.coordination [None req-082cfb09-29c5-4450-b563-bfaf221778d4 tempest-CreateVolumesFromSnapshotTest-388118498 None] Acquiring lock "cinder-quobyte-c3ebbee7-d2a2-4f09-b68c-7861b4b0bc3a" by "delete_volume" {{(pid=83259) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 16 15:14:12 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [None req-33a2b82a-673e-468b-9fc0-7850547a7f62 tempest-VolumesSnapshotListTestJSON-248203627 None] CMD "rm -f /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c/volume-68324198-e4bf-4e89-934a-b125055ec9ed.0372b193-39a5-4cc5-b188-e72fdea25759" returned: 0 in 0.653s {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 15:14:12 devstack cinder-volume[83259]: DEBUG cinder.coordination [None req-082cfb09-29c5-4450-b563-bfaf221778d4 tempest-CreateVolumesFromSnapshotTest-388118498 None] Lock "cinder-quobyte-c3ebbee7-d2a2-4f09-b68c-7861b4b0bc3a" acquired by "delete_volume" :: waited 0.125s {{(pid=83259) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 16 15:14:12 devstack cinder-volume[83259]: DEBUG cinder.coordination [None req-33a2b82a-673e-468b-9fc0-7850547a7f62 tempest-VolumesSnapshotListTestJSON-248203627 None] Lock "cinder-quobyte-0372b193-39a5-4cc5-b188-e72fdea25759" released by "_delete_snapshot" :: held 3.528s {{(pid=83259) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 16 15:14:12 devstack cinder-volume[83259]: DEBUG oslo.privsep.daemon [-] privsep: reply[90f5f1e5-e486-4020-ae9a-588a29269256]: (4, 'qcow2') {{(pid=84312) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 16 15:14:12 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [None req-082cfb09-29c5-4450-b563-bfaf221778d4 tempest-CreateVolumesFromSnapshotTest-388118498 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c/volume-c3ebbee7-d2a2-4f09-b68c-7861b4b0bc3a {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 15:14:13 devstack cinder-volume[83259]: DEBUG cinder.coordination [None req-33a2b82a-673e-468b-9fc0-7850547a7f62 tempest-VolumesSnapshotListTestJSON-248203627 None] Lock "cinder-quobyte-68324198-e4bf-4e89-934a-b125055ec9ed" released by "delete_snapshot" :: held 3.846s {{(pid=83259) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 16 15:14:13 devstack cinder-volume[83259]: DEBUG cinder.coordination [None req-5ed1c45d-405b-4199-9e69-afbfcf116981 tempest-VolumesListTestJSON-1108154855 None] Acquiring lock "cinder-54a40c15-3ff6-4409-9140-444b7aa7262e-delete_volume" by "delete_volume" {{(pid=83259) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 16 15:14:13 devstack cinder-volume[83259]: DEBUG cinder.coordination [None req-5ed1c45d-405b-4199-9e69-afbfcf116981 tempest-VolumesListTestJSON-1108154855 None] Lock "cinder-54a40c15-3ff6-4409-9140-444b7aa7262e-delete_volume" acquired by "delete_volume" :: waited 0.078s {{(pid=83259) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 16 15:14:13 devstack cinder-volume[83259]: WARNING cinder.volume.volume_utils [None req-5ed1c45d-405b-4199-9e69-afbfcf116981 tempest-VolumesListTestJSON-1108154855 None] Volume driver (QuobyteDriver 1.2) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 16 15:14:13 devstack cinder-volume[83259]: DEBUG cinder.coordination [None req-5ed1c45d-405b-4199-9e69-afbfcf116981 tempest-VolumesListTestJSON-1108154855 None] Acquiring lock "cinder-quobyte-54a40c15-3ff6-4409-9140-444b7aa7262e" by "delete_volume" {{(pid=83259) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 16 15:14:13 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [None req-082cfb09-29c5-4450-b563-bfaf221778d4 tempest-CreateVolumesFromSnapshotTest-388118498 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c/volume-c3ebbee7-d2a2-4f09-b68c-7861b4b0bc3a" returned: 0 in 0.814s {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 15:14:13 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [None req-082cfb09-29c5-4450-b563-bfaf221778d4 tempest-CreateVolumesFromSnapshotTest-388118498 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c/volume-c3ebbee7-d2a2-4f09-b68c-7861b4b0bc3a {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 15:14:14 devstack cinder-volume[83259]: DEBUG cinder.coordination [None req-5ed1c45d-405b-4199-9e69-afbfcf116981 tempest-VolumesListTestJSON-1108154855 None] Lock "cinder-quobyte-54a40c15-3ff6-4409-9140-444b7aa7262e" acquired by "delete_volume" :: waited 0.288s {{(pid=83259) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 16 15:14:14 devstack cinder-volume[83259]: DEBUG cinder.quota [None req-33a2b82a-673e-468b-9fc0-7850547a7f62 tempest-VolumesSnapshotListTestJSON-248203627 None] Created reservations ['5e89ebb9-696f-4707-8318-5ab3283ca6c1', '13c64ac4-af6f-4160-9a61-9d7be74491c0', '59026999-3448-4b0d-8447-a5a39fd6aad8', '2025f73f-b6c2-409f-870c-12ef143d4271'] {{(pid=83259) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 16 15:14:14 devstack cinder-volume[83259]: DEBUG oslo.privsep.daemon [-] privsep: reply[362bc2e5-6a40-428e-86dc-3c1faf996a0d]: (4, 'qcow2') {{(pid=84312) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 16 15:14:14 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [None req-5ed1c45d-405b-4199-9e69-afbfcf116981 tempest-VolumesListTestJSON-1108154855 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c/volume-54a40c15-3ff6-4409-9140-444b7aa7262e {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 15:14:14 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [None req-082cfb09-29c5-4450-b563-bfaf221778d4 tempest-CreateVolumesFromSnapshotTest-388118498 None] CMD "rm -f /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c/volume-c3ebbee7-d2a2-4f09-b68c-7861b4b0bc3a" returned: 0 in 0.441s {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 15:14:14 devstack cinder-volume[83259]: DEBUG cinder.coordination [None req-082cfb09-29c5-4450-b563-bfaf221778d4 tempest-CreateVolumesFromSnapshotTest-388118498 None] Lock "cinder-quobyte-c3ebbee7-d2a2-4f09-b68c-7861b4b0bc3a" released by "delete_volume" :: held 1.633s {{(pid=83259) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 16 15:14:14 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [None req-5ed1c45d-405b-4199-9e69-afbfcf116981 tempest-VolumesListTestJSON-1108154855 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c/volume-54a40c15-3ff6-4409-9140-444b7aa7262e" returned: 0 in 0.624s {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 15:14:14 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [None req-5ed1c45d-405b-4199-9e69-afbfcf116981 tempest-VolumesListTestJSON-1108154855 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c/volume-54a40c15-3ff6-4409-9140-444b7aa7262e {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 15:14:14 devstack cinder-volume[83259]: INFO cinder.volume.manager [None req-33a2b82a-673e-468b-9fc0-7850547a7f62 tempest-VolumesSnapshotListTestJSON-248203627 None] Delete snapshot completed successfully. Sep 16 15:14:15 devstack cinder-volume[83259]: DEBUG dbcounter [-] [83259] Writing DB stats cinder:SELECT=74,cinder:UPDATE=103,cinder:DELETE=10,cinder:INSERT=16 {{(pid=83259) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Sep 16 15:14:15 devstack cinder-volume[83259]: DEBUG cinder.quota [None req-082cfb09-29c5-4450-b563-bfaf221778d4 tempest-CreateVolumesFromSnapshotTest-388118498 None] Created reservations ['0ff9a26d-6fe3-41d8-a5ac-811f3f8821d6', '7ed8b61a-9cef-4e3b-9f9b-7fd3aa4a3735', 'ef77fefa-e191-4cde-a9ba-f3ea97de0aa7', '4c3a592b-325c-427a-997a-a67b8293f784'] {{(pid=83259) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 16 15:14:15 devstack cinder-volume[83259]: DEBUG cinder.coordination [None req-33a2b82a-673e-468b-9fc0-7850547a7f62 tempest-VolumesSnapshotListTestJSON-248203627 None] Lock "cinder-0372b193-39a5-4cc5-b188-e72fdea25759-delete_snapshot" released by "delete_snapshot" :: held 6.085s {{(pid=83259) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 16 15:14:15 devstack cinder-volume[83259]: DEBUG dbcounter [-] [83259] Writing DB stats cinder:UPDATE=110,cinder:DELETE=16,cinder:SELECT=68,cinder:INSERT=28 {{(pid=83259) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Sep 16 15:14:15 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [None req-5ed1c45d-405b-4199-9e69-afbfcf116981 tempest-VolumesListTestJSON-1108154855 None] CMD "rm -f /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c/volume-54a40c15-3ff6-4409-9140-444b7aa7262e" returned: 0 in 0.403s {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 15:14:15 devstack cinder-volume[83259]: DEBUG cinder.coordination [None req-5ed1c45d-405b-4199-9e69-afbfcf116981 tempest-VolumesListTestJSON-1108154855 None] Lock "cinder-quobyte-54a40c15-3ff6-4409-9140-444b7aa7262e" released by "delete_volume" :: held 1.199s {{(pid=83259) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 16 15:14:15 devstack cinder-volume[83259]: DEBUG cinder.quota [None req-5ed1c45d-405b-4199-9e69-afbfcf116981 tempest-VolumesListTestJSON-1108154855 None] Created reservations ['7aca8ebc-13bb-4c25-bfb7-b04845d044f2', '1f9c28aa-2a94-49ce-9f13-0ecb9c7d6d04', 'db3b52f3-d4c1-4c7f-ab2f-f9d2b111ba5b', 'ac56d503-cd0e-42cb-8b80-543619d5eb3c'] {{(pid=83259) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 16 15:14:15 devstack cinder-volume[83259]: DEBUG cinder.coordination [None req-ec78f19e-da89-4cda-a531-91cd91924ad6 tempest-VolumesSnapshotListTestJSON-248203627 None] Acquiring lock "cinder-68324198-e4bf-4e89-934a-b125055ec9ed-delete_volume" by "delete_volume" {{(pid=83259) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 16 15:14:15 devstack cinder-volume[83259]: DEBUG oslo_concurrency.lockutils [None req-082cfb09-29c5-4450-b563-bfaf221778d4 tempest-CreateVolumesFromSnapshotTest-388118498 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83259) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 16 15:14:15 devstack cinder-volume[83259]: DEBUG oslo_concurrency.lockutils [None req-082cfb09-29c5-4450-b563-bfaf221778d4 tempest-CreateVolumesFromSnapshotTest-388118498 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=83259) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 16 15:14:15 devstack cinder-volume[83259]: DEBUG cinder.volume.drivers.quobyte [None req-082cfb09-29c5-4450-b563-bfaf221778d4 tempest-CreateVolumesFromSnapshotTest-388118498 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-61f585ac-f8e2-4d19-a890-7ebc2726cc72': None} {{(pid=83259) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:639}} Sep 16 15:14:15 devstack cinder-volume[83259]: DEBUG cinder.volume.drivers.quobyte [None req-082cfb09-29c5-4450-b563-bfaf221778d4 tempest-CreateVolumesFromSnapshotTest-388118498 None] Available shares ['10.10.41.181/cinder-vol-61f585ac-f8e2-4d19-a890-7ebc2726cc72'] {{(pid=83259) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:669}} Sep 16 15:14:15 devstack cinder-volume[83259]: DEBUG oslo_concurrency.lockutils [None req-082cfb09-29c5-4450-b563-bfaf221778d4 tempest-CreateVolumesFromSnapshotTest-388118498 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=83259) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 16 15:14:15 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [None req-082cfb09-29c5-4450-b563-bfaf221778d4 tempest-CreateVolumesFromSnapshotTest-388118498 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 15:14:15 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [None req-082cfb09-29c5-4450-b563-bfaf221778d4 tempest-CreateVolumesFromSnapshotTest-388118498 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c" returned: 0 in 0.453s {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 15:14:15 devstack cinder-volume[83259]: DEBUG cinder.coordination [None req-ec78f19e-da89-4cda-a531-91cd91924ad6 tempest-VolumesSnapshotListTestJSON-248203627 None] Lock "cinder-68324198-e4bf-4e89-934a-b125055ec9ed-delete_volume" acquired by "delete_volume" :: waited 0.505s {{(pid=83259) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 16 15:14:16 devstack cinder-volume[83259]: DEBUG cinder.manager [None req-082cfb09-29c5-4450-b563-bfaf221778d4 tempest-CreateVolumesFromSnapshotTest-388118498 None] Notifying Schedulers of capabilities ... {{(pid=83259) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 16 15:14:16 devstack cinder-volume[83259]: DEBUG cinder.coordination [None req-b1f0637e-65d2-47fb-ac45-ee63217aecb8 tempest-CreateVolumesFromSnapshotTest-388118498 None] Acquiring lock "cinder-3e2d40fb-dc6a-4710-ad8c-56122c3824ac-delete_volume" by "delete_volume" {{(pid=83259) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 16 15:14:16 devstack cinder-volume[83259]: INFO cinder.volume.manager [None req-082cfb09-29c5-4450-b563-bfaf221778d4 tempest-CreateVolumesFromSnapshotTest-388118498 None] Deleted volume successfully. Sep 16 15:14:16 devstack cinder-volume[83259]: DEBUG oslo_concurrency.lockutils [None req-5ed1c45d-405b-4199-9e69-afbfcf116981 tempest-VolumesListTestJSON-1108154855 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83259) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 16 15:14:16 devstack cinder-volume[83259]: DEBUG oslo_concurrency.lockutils [None req-5ed1c45d-405b-4199-9e69-afbfcf116981 tempest-VolumesListTestJSON-1108154855 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=83259) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 16 15:14:16 devstack cinder-volume[83259]: DEBUG cinder.volume.drivers.quobyte [None req-5ed1c45d-405b-4199-9e69-afbfcf116981 tempest-VolumesListTestJSON-1108154855 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-61f585ac-f8e2-4d19-a890-7ebc2726cc72': None} {{(pid=83259) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:639}} Sep 16 15:14:16 devstack cinder-volume[83259]: DEBUG cinder.volume.drivers.quobyte [None req-5ed1c45d-405b-4199-9e69-afbfcf116981 tempest-VolumesListTestJSON-1108154855 None] Available shares ['10.10.41.181/cinder-vol-61f585ac-f8e2-4d19-a890-7ebc2726cc72'] {{(pid=83259) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:669}} Sep 16 15:14:16 devstack cinder-volume[83259]: DEBUG oslo_concurrency.lockutils [None req-5ed1c45d-405b-4199-9e69-afbfcf116981 tempest-VolumesListTestJSON-1108154855 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=83259) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 16 15:14:16 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [None req-5ed1c45d-405b-4199-9e69-afbfcf116981 tempest-VolumesListTestJSON-1108154855 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 15:14:16 devstack cinder-volume[83259]: DEBUG cinder.coordination [None req-b1f0637e-65d2-47fb-ac45-ee63217aecb8 tempest-CreateVolumesFromSnapshotTest-388118498 None] Lock "cinder-3e2d40fb-dc6a-4710-ad8c-56122c3824ac-delete_volume" acquired by "delete_volume" :: waited 0.192s {{(pid=83259) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 16 15:14:16 devstack cinder-volume[83259]: WARNING cinder.volume.volume_utils [None req-ec78f19e-da89-4cda-a531-91cd91924ad6 tempest-VolumesSnapshotListTestJSON-248203627 None] Volume driver (QuobyteDriver 1.2) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 16 15:14:16 devstack cinder-volume[83259]: DEBUG cinder.coordination [None req-ec78f19e-da89-4cda-a531-91cd91924ad6 tempest-VolumesSnapshotListTestJSON-248203627 None] Acquiring lock "cinder-quobyte-68324198-e4bf-4e89-934a-b125055ec9ed" by "delete_volume" {{(pid=83259) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 16 15:14:16 devstack cinder-volume[83259]: DEBUG cinder.coordination [None req-082cfb09-29c5-4450-b563-bfaf221778d4 tempest-CreateVolumesFromSnapshotTest-388118498 None] Lock "cinder-c3ebbee7-d2a2-4f09-b68c-7861b4b0bc3a-delete_volume" released by "delete_volume" :: held 4.651s {{(pid=83259) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 16 15:14:16 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [None req-5ed1c45d-405b-4199-9e69-afbfcf116981 tempest-VolumesListTestJSON-1108154855 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c" returned: 0 in 0.457s {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 15:14:16 devstack cinder-volume[83259]: DEBUG cinder.manager [None req-5ed1c45d-405b-4199-9e69-afbfcf116981 tempest-VolumesListTestJSON-1108154855 None] Notifying Schedulers of capabilities ... {{(pid=83259) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 16 15:14:16 devstack cinder-volume[83259]: INFO cinder.volume.manager [None req-5ed1c45d-405b-4199-9e69-afbfcf116981 tempest-VolumesListTestJSON-1108154855 None] Deleted volume successfully. Sep 16 15:14:16 devstack cinder-volume[83259]: DEBUG cinder.coordination [None req-ec78f19e-da89-4cda-a531-91cd91924ad6 tempest-VolumesSnapshotListTestJSON-248203627 None] Lock "cinder-quobyte-68324198-e4bf-4e89-934a-b125055ec9ed" acquired by "delete_volume" :: waited 0.090s {{(pid=83259) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 16 15:14:16 devstack cinder-volume[83259]: DEBUG oslo.privsep.daemon [-] privsep: reply[f4d7932f-69e4-4875-8753-ab1a8893c45c]: (4, 'qcow2') {{(pid=84312) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 16 15:14:16 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [None req-ec78f19e-da89-4cda-a531-91cd91924ad6 tempest-VolumesSnapshotListTestJSON-248203627 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c/volume-68324198-e4bf-4e89-934a-b125055ec9ed {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 15:14:16 devstack cinder-volume[83259]: WARNING cinder.volume.volume_utils [None req-b1f0637e-65d2-47fb-ac45-ee63217aecb8 tempest-CreateVolumesFromSnapshotTest-388118498 None] Volume driver (QuobyteDriver 1.2) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 16 15:14:16 devstack cinder-volume[83259]: DEBUG cinder.coordination [None req-b1f0637e-65d2-47fb-ac45-ee63217aecb8 tempest-CreateVolumesFromSnapshotTest-388118498 None] Acquiring lock "cinder-quobyte-3e2d40fb-dc6a-4710-ad8c-56122c3824ac" by "delete_volume" {{(pid=83259) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 16 15:14:16 devstack cinder-volume[83259]: DEBUG cinder.coordination [None req-302f9296-51e8-4d86-9821-1ecd679f70ad tempest-VolumesListTestJSON-1108154855 None] Acquiring lock "cinder-feac8d15-fdb5-4c20-9052-e5a2df8be0cf-delete_volume" by "delete_volume" {{(pid=83259) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 16 15:14:17 devstack cinder-volume[83259]: DEBUG cinder.coordination [None req-5ed1c45d-405b-4199-9e69-afbfcf116981 tempest-VolumesListTestJSON-1108154855 None] Lock "cinder-54a40c15-3ff6-4409-9140-444b7aa7262e-delete_volume" released by "delete_volume" :: held 3.477s {{(pid=83259) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 16 15:14:17 devstack cinder-volume[83259]: DEBUG cinder.coordination [None req-b1f0637e-65d2-47fb-ac45-ee63217aecb8 tempest-CreateVolumesFromSnapshotTest-388118498 None] Lock "cinder-quobyte-3e2d40fb-dc6a-4710-ad8c-56122c3824ac" acquired by "delete_volume" :: waited 0.090s {{(pid=83259) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 16 15:14:17 devstack cinder-volume[83259]: DEBUG cinder.coordination [None req-302f9296-51e8-4d86-9821-1ecd679f70ad tempest-VolumesListTestJSON-1108154855 None] Lock "cinder-feac8d15-fdb5-4c20-9052-e5a2df8be0cf-delete_volume" acquired by "delete_volume" :: waited 0.087s {{(pid=83259) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 16 15:14:17 devstack cinder-volume[83259]: DEBUG oslo.privsep.daemon [-] privsep: reply[531feb42-8fda-44c0-8c8e-fbe5cc338531]: (4, 'qcow2') {{(pid=84312) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 16 15:14:17 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [None req-b1f0637e-65d2-47fb-ac45-ee63217aecb8 tempest-CreateVolumesFromSnapshotTest-388118498 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c/volume-3e2d40fb-dc6a-4710-ad8c-56122c3824ac {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 15:14:17 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [None req-ec78f19e-da89-4cda-a531-91cd91924ad6 tempest-VolumesSnapshotListTestJSON-248203627 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c/volume-68324198-e4bf-4e89-934a-b125055ec9ed" returned: 0 in 0.799s {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 15:14:17 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [None req-ec78f19e-da89-4cda-a531-91cd91924ad6 tempest-VolumesSnapshotListTestJSON-248203627 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c/volume-68324198-e4bf-4e89-934a-b125055ec9ed {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 15:14:17 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [None req-ec78f19e-da89-4cda-a531-91cd91924ad6 tempest-VolumesSnapshotListTestJSON-248203627 None] CMD "rm -f /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c/volume-68324198-e4bf-4e89-934a-b125055ec9ed" returned: 0 in 0.347s {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 15:14:17 devstack cinder-volume[83259]: WARNING cinder.volume.volume_utils [None req-302f9296-51e8-4d86-9821-1ecd679f70ad tempest-VolumesListTestJSON-1108154855 None] Volume driver (QuobyteDriver 1.2) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 16 15:14:17 devstack cinder-volume[83259]: DEBUG cinder.coordination [None req-302f9296-51e8-4d86-9821-1ecd679f70ad tempest-VolumesListTestJSON-1108154855 None] Acquiring lock "cinder-quobyte-feac8d15-fdb5-4c20-9052-e5a2df8be0cf" by "delete_volume" {{(pid=83259) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 16 15:14:17 devstack cinder-volume[83259]: DEBUG cinder.coordination [None req-ec78f19e-da89-4cda-a531-91cd91924ad6 tempest-VolumesSnapshotListTestJSON-248203627 None] Lock "cinder-quobyte-68324198-e4bf-4e89-934a-b125055ec9ed" released by "delete_volume" :: held 1.343s {{(pid=83259) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 16 15:14:17 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [None req-b1f0637e-65d2-47fb-ac45-ee63217aecb8 tempest-CreateVolumesFromSnapshotTest-388118498 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c/volume-3e2d40fb-dc6a-4710-ad8c-56122c3824ac" returned: 0 in 0.822s {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 15:14:18 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [None req-b1f0637e-65d2-47fb-ac45-ee63217aecb8 tempest-CreateVolumesFromSnapshotTest-388118498 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c/volume-3e2d40fb-dc6a-4710-ad8c-56122c3824ac {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 15:14:18 devstack cinder-volume[83259]: DEBUG cinder.coordination [None req-302f9296-51e8-4d86-9821-1ecd679f70ad tempest-VolumesListTestJSON-1108154855 None] Lock "cinder-quobyte-feac8d15-fdb5-4c20-9052-e5a2df8be0cf" acquired by "delete_volume" :: waited 0.320s {{(pid=83259) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 16 15:14:18 devstack cinder-volume[83259]: DEBUG oslo.privsep.daemon [-] privsep: reply[644f11d9-59dd-4593-8229-ccc33ca60db0]: (4, 'qcow2') {{(pid=84312) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 16 15:14:18 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [None req-302f9296-51e8-4d86-9821-1ecd679f70ad tempest-VolumesListTestJSON-1108154855 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c/volume-feac8d15-fdb5-4c20-9052-e5a2df8be0cf {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 15:14:18 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [None req-b1f0637e-65d2-47fb-ac45-ee63217aecb8 tempest-CreateVolumesFromSnapshotTest-388118498 None] CMD "rm -f /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c/volume-3e2d40fb-dc6a-4710-ad8c-56122c3824ac" returned: 0 in 0.653s {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 15:14:18 devstack cinder-volume[83259]: DEBUG cinder.coordination [None req-b1f0637e-65d2-47fb-ac45-ee63217aecb8 tempest-CreateVolumesFromSnapshotTest-388118498 None] Lock "cinder-quobyte-3e2d40fb-dc6a-4710-ad8c-56122c3824ac" released by "delete_volume" :: held 1.744s {{(pid=83259) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 16 15:14:18 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [None req-302f9296-51e8-4d86-9821-1ecd679f70ad tempest-VolumesListTestJSON-1108154855 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c/volume-feac8d15-fdb5-4c20-9052-e5a2df8be0cf" returned: 0 in 0.566s {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 15:14:18 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [None req-302f9296-51e8-4d86-9821-1ecd679f70ad tempest-VolumesListTestJSON-1108154855 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c/volume-feac8d15-fdb5-4c20-9052-e5a2df8be0cf {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 15:14:19 devstack cinder-volume[83259]: DEBUG cinder.quota [None req-ec78f19e-da89-4cda-a531-91cd91924ad6 tempest-VolumesSnapshotListTestJSON-248203627 None] Created reservations ['e916dcea-aec7-40f7-847c-2cabaafdf50b', '2707f8a0-40ce-45b9-8d87-7bedb19e3ae1', '67c3b6ef-93a8-4c24-80d4-21058e5c4aa8', '9e7417c9-0aed-4085-814c-702929b347b9'] {{(pid=83259) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 16 15:14:19 devstack cinder-volume[83259]: DEBUG cinder.quota [None req-b1f0637e-65d2-47fb-ac45-ee63217aecb8 tempest-CreateVolumesFromSnapshotTest-388118498 None] Created reservations ['3828c351-656f-4c99-bf34-2c53256c66e7', '7b575135-e53f-4e82-86cf-50233273e961', 'e2a8ff63-6f45-42ae-95c9-776a3ab0edb7', 'bf85e73b-5841-4867-9d16-df32ec7f92e1'] {{(pid=83259) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 16 15:14:19 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [None req-302f9296-51e8-4d86-9821-1ecd679f70ad tempest-VolumesListTestJSON-1108154855 None] CMD "rm -f /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c/volume-feac8d15-fdb5-4c20-9052-e5a2df8be0cf" returned: 0 in 0.359s {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 15:14:19 devstack cinder-volume[83259]: DEBUG oslo_concurrency.lockutils [None req-ec78f19e-da89-4cda-a531-91cd91924ad6 tempest-VolumesSnapshotListTestJSON-248203627 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83259) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 16 15:14:19 devstack cinder-volume[83259]: DEBUG oslo_concurrency.lockutils [None req-ec78f19e-da89-4cda-a531-91cd91924ad6 tempest-VolumesSnapshotListTestJSON-248203627 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=83259) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 16 15:14:19 devstack cinder-volume[83259]: DEBUG cinder.volume.drivers.quobyte [None req-ec78f19e-da89-4cda-a531-91cd91924ad6 tempest-VolumesSnapshotListTestJSON-248203627 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-61f585ac-f8e2-4d19-a890-7ebc2726cc72': None} {{(pid=83259) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:639}} Sep 16 15:14:19 devstack cinder-volume[83259]: DEBUG cinder.volume.drivers.quobyte [None req-ec78f19e-da89-4cda-a531-91cd91924ad6 tempest-VolumesSnapshotListTestJSON-248203627 None] Available shares ['10.10.41.181/cinder-vol-61f585ac-f8e2-4d19-a890-7ebc2726cc72'] {{(pid=83259) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:669}} Sep 16 15:14:19 devstack cinder-volume[83259]: DEBUG oslo_concurrency.lockutils [None req-ec78f19e-da89-4cda-a531-91cd91924ad6 tempest-VolumesSnapshotListTestJSON-248203627 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=83259) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 16 15:14:19 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [None req-ec78f19e-da89-4cda-a531-91cd91924ad6 tempest-VolumesSnapshotListTestJSON-248203627 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 15:14:19 devstack cinder-volume[83259]: DEBUG cinder.coordination [None req-302f9296-51e8-4d86-9821-1ecd679f70ad tempest-VolumesListTestJSON-1108154855 None] Lock "cinder-quobyte-feac8d15-fdb5-4c20-9052-e5a2df8be0cf" released by "delete_volume" :: held 1.482s {{(pid=83259) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 16 15:14:19 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [None req-ec78f19e-da89-4cda-a531-91cd91924ad6 tempest-VolumesSnapshotListTestJSON-248203627 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c" returned: 0 in 0.380s {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 15:14:19 devstack cinder-volume[83259]: DEBUG cinder.manager [None req-ec78f19e-da89-4cda-a531-91cd91924ad6 tempest-VolumesSnapshotListTestJSON-248203627 None] Notifying Schedulers of capabilities ... {{(pid=83259) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 16 15:14:19 devstack cinder-volume[83259]: INFO cinder.volume.manager [None req-ec78f19e-da89-4cda-a531-91cd91924ad6 tempest-VolumesSnapshotListTestJSON-248203627 None] Deleted volume successfully. Sep 16 15:14:20 devstack cinder-volume[83259]: DEBUG oslo_concurrency.lockutils [None req-b1f0637e-65d2-47fb-ac45-ee63217aecb8 tempest-CreateVolumesFromSnapshotTest-388118498 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83259) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 16 15:14:20 devstack cinder-volume[83259]: DEBUG oslo_concurrency.lockutils [None req-b1f0637e-65d2-47fb-ac45-ee63217aecb8 tempest-CreateVolumesFromSnapshotTest-388118498 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=83259) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 16 15:14:20 devstack cinder-volume[83259]: DEBUG cinder.volume.drivers.quobyte [None req-b1f0637e-65d2-47fb-ac45-ee63217aecb8 tempest-CreateVolumesFromSnapshotTest-388118498 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-61f585ac-f8e2-4d19-a890-7ebc2726cc72': None} {{(pid=83259) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:639}} Sep 16 15:14:20 devstack cinder-volume[83259]: DEBUG cinder.volume.drivers.quobyte [None req-b1f0637e-65d2-47fb-ac45-ee63217aecb8 tempest-CreateVolumesFromSnapshotTest-388118498 None] Available shares ['10.10.41.181/cinder-vol-61f585ac-f8e2-4d19-a890-7ebc2726cc72'] {{(pid=83259) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:669}} Sep 16 15:14:20 devstack cinder-volume[83259]: DEBUG oslo_concurrency.lockutils [None req-b1f0637e-65d2-47fb-ac45-ee63217aecb8 tempest-CreateVolumesFromSnapshotTest-388118498 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=83259) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 16 15:14:20 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [None req-b1f0637e-65d2-47fb-ac45-ee63217aecb8 tempest-CreateVolumesFromSnapshotTest-388118498 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 15:14:20 devstack cinder-volume[83259]: DEBUG cinder.coordination [None req-ec78f19e-da89-4cda-a531-91cd91924ad6 tempest-VolumesSnapshotListTestJSON-248203627 None] Lock "cinder-68324198-e4bf-4e89-934a-b125055ec9ed-delete_volume" released by "delete_volume" :: held 4.169s {{(pid=83259) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 16 15:14:20 devstack cinder-volume[83259]: DEBUG cinder.quota [None req-302f9296-51e8-4d86-9821-1ecd679f70ad tempest-VolumesListTestJSON-1108154855 None] Created reservations ['c5f8eeea-f0de-407b-aae9-69282e454180', 'f5138376-afc4-43a3-9214-4d765f255d8f', '4b40631e-6ef6-4f23-88f6-910f3b0fce39', '0433ac09-772e-407c-be6a-65fd83681f6c'] {{(pid=83259) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 16 15:14:20 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [None req-b1f0637e-65d2-47fb-ac45-ee63217aecb8 tempest-CreateVolumesFromSnapshotTest-388118498 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c" returned: 0 in 0.405s {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 15:14:20 devstack cinder-volume[83259]: DEBUG cinder.manager [None req-b1f0637e-65d2-47fb-ac45-ee63217aecb8 tempest-CreateVolumesFromSnapshotTest-388118498 None] Notifying Schedulers of capabilities ... {{(pid=83259) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 16 15:14:20 devstack cinder-volume[83259]: INFO cinder.volume.manager [None req-b1f0637e-65d2-47fb-ac45-ee63217aecb8 tempest-CreateVolumesFromSnapshotTest-388118498 None] Deleted volume successfully. Sep 16 15:14:20 devstack cinder-volume[83259]: DEBUG cinder.coordination [None req-ec9f1f7d-c1ee-4392-bb48-fdf78b9b2b2b tempest-CreateVolumesFromSnapshotTest-388118498 None] Acquiring lock "cinder-e1a17f05-33a9-4837-8c5f-2e5b8c6f5bf0-delete_volume" by "delete_volume" {{(pid=83259) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 16 15:14:20 devstack cinder-volume[83259]: DEBUG cinder.coordination [None req-b1f0637e-65d2-47fb-ac45-ee63217aecb8 tempest-CreateVolumesFromSnapshotTest-388118498 None] Lock "cinder-3e2d40fb-dc6a-4710-ad8c-56122c3824ac-delete_volume" released by "delete_volume" :: held 4.389s {{(pid=83259) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 16 15:14:20 devstack cinder-volume[83259]: DEBUG cinder.coordination [None req-ec9f1f7d-c1ee-4392-bb48-fdf78b9b2b2b tempest-CreateVolumesFromSnapshotTest-388118498 None] Lock "cinder-e1a17f05-33a9-4837-8c5f-2e5b8c6f5bf0-delete_volume" acquired by "delete_volume" :: waited 0.045s {{(pid=83259) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 16 15:14:20 devstack cinder-volume[83259]: DEBUG oslo_concurrency.lockutils [None req-302f9296-51e8-4d86-9821-1ecd679f70ad tempest-VolumesListTestJSON-1108154855 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83259) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 16 15:14:20 devstack cinder-volume[83259]: DEBUG oslo_concurrency.lockutils [None req-302f9296-51e8-4d86-9821-1ecd679f70ad tempest-VolumesListTestJSON-1108154855 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83259) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 16 15:14:20 devstack cinder-volume[83259]: DEBUG cinder.volume.drivers.quobyte [None req-302f9296-51e8-4d86-9821-1ecd679f70ad tempest-VolumesListTestJSON-1108154855 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-61f585ac-f8e2-4d19-a890-7ebc2726cc72': None} {{(pid=83259) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:639}} Sep 16 15:14:20 devstack cinder-volume[83259]: DEBUG cinder.volume.drivers.quobyte [None req-302f9296-51e8-4d86-9821-1ecd679f70ad tempest-VolumesListTestJSON-1108154855 None] Available shares ['10.10.41.181/cinder-vol-61f585ac-f8e2-4d19-a890-7ebc2726cc72'] {{(pid=83259) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:669}} Sep 16 15:14:20 devstack cinder-volume[83259]: DEBUG oslo_concurrency.lockutils [None req-302f9296-51e8-4d86-9821-1ecd679f70ad tempest-VolumesListTestJSON-1108154855 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=83259) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 16 15:14:20 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [None req-302f9296-51e8-4d86-9821-1ecd679f70ad tempest-VolumesListTestJSON-1108154855 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 15:14:21 devstack cinder-volume[83259]: WARNING cinder.volume.volume_utils [None req-ec9f1f7d-c1ee-4392-bb48-fdf78b9b2b2b tempest-CreateVolumesFromSnapshotTest-388118498 None] Volume driver (QuobyteDriver 1.2) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 16 15:14:21 devstack cinder-volume[83259]: DEBUG cinder.coordination [None req-ec9f1f7d-c1ee-4392-bb48-fdf78b9b2b2b tempest-CreateVolumesFromSnapshotTest-388118498 None] Acquiring lock "cinder-quobyte-e1a17f05-33a9-4837-8c5f-2e5b8c6f5bf0" by "delete_volume" {{(pid=83259) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 16 15:14:21 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [None req-302f9296-51e8-4d86-9821-1ecd679f70ad tempest-VolumesListTestJSON-1108154855 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c" returned: 0 in 0.486s {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 15:14:21 devstack cinder-volume[83259]: DEBUG cinder.manager [None req-302f9296-51e8-4d86-9821-1ecd679f70ad tempest-VolumesListTestJSON-1108154855 None] Notifying Schedulers of capabilities ... {{(pid=83259) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 16 15:14:21 devstack cinder-volume[83259]: INFO cinder.volume.manager [None req-302f9296-51e8-4d86-9821-1ecd679f70ad tempest-VolumesListTestJSON-1108154855 None] Deleted volume successfully. Sep 16 15:14:21 devstack cinder-volume[83259]: DEBUG cinder.coordination [None req-ec9f1f7d-c1ee-4392-bb48-fdf78b9b2b2b tempest-CreateVolumesFromSnapshotTest-388118498 None] Lock "cinder-quobyte-e1a17f05-33a9-4837-8c5f-2e5b8c6f5bf0" acquired by "delete_volume" :: waited 0.193s {{(pid=83259) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 16 15:14:21 devstack cinder-volume[83259]: DEBUG oslo.privsep.daemon [-] privsep: reply[6e83867d-1821-4245-9f1c-8dc2a98e399a]: (4, 'qcow2') {{(pid=84312) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 16 15:14:21 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [None req-ec9f1f7d-c1ee-4392-bb48-fdf78b9b2b2b tempest-CreateVolumesFromSnapshotTest-388118498 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c/volume-e1a17f05-33a9-4837-8c5f-2e5b8c6f5bf0 {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 15:14:21 devstack cinder-volume[83259]: DEBUG cinder.coordination [None req-302f9296-51e8-4d86-9821-1ecd679f70ad tempest-VolumesListTestJSON-1108154855 None] Lock "cinder-feac8d15-fdb5-4c20-9052-e5a2df8be0cf-delete_volume" released by "delete_volume" :: held 4.492s {{(pid=83259) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 16 15:14:21 devstack cinder-volume[83259]: DEBUG cinder.coordination [None req-0f70a48f-3fe2-47e3-ae62-2e48f4041670 tempest-VolumesListTestJSON-1108154855 None] Acquiring lock "cinder-01ac8da2-a978-4bbb-8b89-58d7d25525e6-delete_volume" by "delete_volume" {{(pid=83259) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 16 15:14:21 devstack cinder-volume[83259]: DEBUG cinder.coordination [None req-0f70a48f-3fe2-47e3-ae62-2e48f4041670 tempest-VolumesListTestJSON-1108154855 None] Lock "cinder-01ac8da2-a978-4bbb-8b89-58d7d25525e6-delete_volume" acquired by "delete_volume" :: waited 0.072s {{(pid=83259) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 16 15:14:22 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [None req-ec9f1f7d-c1ee-4392-bb48-fdf78b9b2b2b tempest-CreateVolumesFromSnapshotTest-388118498 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c/volume-e1a17f05-33a9-4837-8c5f-2e5b8c6f5bf0" returned: 0 in 0.656s {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 15:14:22 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [None req-ec9f1f7d-c1ee-4392-bb48-fdf78b9b2b2b tempest-CreateVolumesFromSnapshotTest-388118498 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c/volume-e1a17f05-33a9-4837-8c5f-2e5b8c6f5bf0 {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 15:14:22 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [None req-ec9f1f7d-c1ee-4392-bb48-fdf78b9b2b2b tempest-CreateVolumesFromSnapshotTest-388118498 None] CMD "rm -f /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c/volume-e1a17f05-33a9-4837-8c5f-2e5b8c6f5bf0" returned: 0 in 0.292s {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 15:14:22 devstack cinder-volume[83259]: DEBUG cinder.coordination [None req-ec9f1f7d-c1ee-4392-bb48-fdf78b9b2b2b tempest-CreateVolumesFromSnapshotTest-388118498 None] Lock "cinder-quobyte-e1a17f05-33a9-4837-8c5f-2e5b8c6f5bf0" released by "delete_volume" :: held 1.191s {{(pid=83259) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 16 15:14:22 devstack cinder-volume[83259]: WARNING cinder.volume.volume_utils [None req-0f70a48f-3fe2-47e3-ae62-2e48f4041670 tempest-VolumesListTestJSON-1108154855 None] Volume driver (QuobyteDriver 1.2) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 16 15:14:22 devstack cinder-volume[83259]: DEBUG cinder.coordination [None req-0f70a48f-3fe2-47e3-ae62-2e48f4041670 tempest-VolumesListTestJSON-1108154855 None] Acquiring lock "cinder-quobyte-01ac8da2-a978-4bbb-8b89-58d7d25525e6" by "delete_volume" {{(pid=83259) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 16 15:14:22 devstack cinder-volume[83259]: DEBUG cinder.coordination [None req-0f70a48f-3fe2-47e3-ae62-2e48f4041670 tempest-VolumesListTestJSON-1108154855 None] Lock "cinder-quobyte-01ac8da2-a978-4bbb-8b89-58d7d25525e6" acquired by "delete_volume" :: waited 0.066s {{(pid=83259) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 16 15:14:22 devstack cinder-volume[83259]: DEBUG oslo.privsep.daemon [-] privsep: reply[7cc23192-bf47-483c-9def-9cba8e2f5780]: (4, 'qcow2') {{(pid=84312) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 16 15:14:22 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [None req-0f70a48f-3fe2-47e3-ae62-2e48f4041670 tempest-VolumesListTestJSON-1108154855 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c/volume-01ac8da2-a978-4bbb-8b89-58d7d25525e6 {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 15:14:22 devstack cinder-volume[83259]: DEBUG cinder.quota [None req-ec9f1f7d-c1ee-4392-bb48-fdf78b9b2b2b tempest-CreateVolumesFromSnapshotTest-388118498 None] Created reservations ['ab798a3d-fc2b-462a-bdcb-cd2072cb763f', 'd5a15c6f-f0aa-4343-b178-18c58466eab6', '56e12167-34b6-4245-a1c0-d90271540652', '3f903223-97d1-4d3f-9e37-96428b0f7b67'] {{(pid=83259) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 16 15:14:23 devstack cinder-volume[83259]: DEBUG oslo_concurrency.lockutils [None req-ec9f1f7d-c1ee-4392-bb48-fdf78b9b2b2b tempest-CreateVolumesFromSnapshotTest-388118498 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83259) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 16 15:14:23 devstack cinder-volume[83259]: DEBUG oslo_concurrency.lockutils [None req-ec9f1f7d-c1ee-4392-bb48-fdf78b9b2b2b tempest-CreateVolumesFromSnapshotTest-388118498 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.005s {{(pid=83259) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 16 15:14:23 devstack cinder-volume[83259]: DEBUG cinder.volume.drivers.quobyte [None req-ec9f1f7d-c1ee-4392-bb48-fdf78b9b2b2b tempest-CreateVolumesFromSnapshotTest-388118498 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-61f585ac-f8e2-4d19-a890-7ebc2726cc72': None} {{(pid=83259) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:639}} Sep 16 15:14:23 devstack cinder-volume[83259]: DEBUG cinder.volume.drivers.quobyte [None req-ec9f1f7d-c1ee-4392-bb48-fdf78b9b2b2b tempest-CreateVolumesFromSnapshotTest-388118498 None] Available shares ['10.10.41.181/cinder-vol-61f585ac-f8e2-4d19-a890-7ebc2726cc72'] {{(pid=83259) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:669}} Sep 16 15:14:23 devstack cinder-volume[83259]: DEBUG oslo_concurrency.lockutils [None req-ec9f1f7d-c1ee-4392-bb48-fdf78b9b2b2b tempest-CreateVolumesFromSnapshotTest-388118498 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=83259) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 16 15:14:23 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [None req-ec9f1f7d-c1ee-4392-bb48-fdf78b9b2b2b tempest-CreateVolumesFromSnapshotTest-388118498 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 15:14:23 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [None req-ec9f1f7d-c1ee-4392-bb48-fdf78b9b2b2b tempest-CreateVolumesFromSnapshotTest-388118498 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c" returned: 0 in 0.189s {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 15:14:23 devstack cinder-volume[83259]: DEBUG cinder.manager [None req-ec9f1f7d-c1ee-4392-bb48-fdf78b9b2b2b tempest-CreateVolumesFromSnapshotTest-388118498 None] Notifying Schedulers of capabilities ... {{(pid=83259) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 16 15:14:23 devstack cinder-volume[83259]: INFO cinder.volume.manager [None req-ec9f1f7d-c1ee-4392-bb48-fdf78b9b2b2b tempest-CreateVolumesFromSnapshotTest-388118498 None] Deleted volume successfully. Sep 16 15:14:23 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [None req-0f70a48f-3fe2-47e3-ae62-2e48f4041670 tempest-VolumesListTestJSON-1108154855 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c/volume-01ac8da2-a978-4bbb-8b89-58d7d25525e6" returned: 0 in 0.954s {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 15:14:23 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [None req-0f70a48f-3fe2-47e3-ae62-2e48f4041670 tempest-VolumesListTestJSON-1108154855 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c/volume-01ac8da2-a978-4bbb-8b89-58d7d25525e6 {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 15:14:23 devstack cinder-volume[83259]: DEBUG cinder.coordination [None req-ec9f1f7d-c1ee-4392-bb48-fdf78b9b2b2b tempest-CreateVolumesFromSnapshotTest-388118498 None] Lock "cinder-e1a17f05-33a9-4837-8c5f-2e5b8c6f5bf0-delete_volume" released by "delete_volume" :: held 3.214s {{(pid=83259) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 16 15:14:23 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [None req-0f70a48f-3fe2-47e3-ae62-2e48f4041670 tempest-VolumesListTestJSON-1108154855 None] CMD "rm -f /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c/volume-01ac8da2-a978-4bbb-8b89-58d7d25525e6" returned: 0 in 0.299s {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 15:14:23 devstack cinder-volume[83259]: DEBUG cinder.coordination [None req-0f70a48f-3fe2-47e3-ae62-2e48f4041670 tempest-VolumesListTestJSON-1108154855 None] Lock "cinder-quobyte-01ac8da2-a978-4bbb-8b89-58d7d25525e6" released by "delete_volume" :: held 1.356s {{(pid=83259) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 16 15:14:24 devstack cinder-volume[83259]: DEBUG cinder.quota [None req-0f70a48f-3fe2-47e3-ae62-2e48f4041670 tempest-VolumesListTestJSON-1108154855 None] Created reservations ['96810b17-1905-4e7f-9038-f148e8d62e24', 'ea19b5d9-c065-4786-98b7-e6977b6eafd0', '889989fa-7bb9-4524-a2f6-5f8b526ed7d6', 'd859dc18-5294-4900-9d8c-6516b0c5cb88'] {{(pid=83259) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 16 15:14:24 devstack cinder-volume[83259]: DEBUG cinder.coordination [None req-26793d22-4445-4b21-95ae-7f1f3a33a70f tempest-CreateVolumesFromSnapshotTest-388118498 None] Acquiring lock "cinder-e895ddab-09be-40b1-83fd-7494828f6769-delete_volume" by "delete_volume" {{(pid=83259) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 16 15:14:24 devstack cinder-volume[83259]: DEBUG cinder.coordination [None req-26793d22-4445-4b21-95ae-7f1f3a33a70f tempest-CreateVolumesFromSnapshotTest-388118498 None] Lock "cinder-e895ddab-09be-40b1-83fd-7494828f6769-delete_volume" acquired by "delete_volume" :: waited 0.120s {{(pid=83259) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 16 15:14:24 devstack cinder-volume[83259]: WARNING cinder.volume.volume_utils [None req-26793d22-4445-4b21-95ae-7f1f3a33a70f tempest-CreateVolumesFromSnapshotTest-388118498 None] Volume driver (QuobyteDriver 1.2) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 16 15:14:24 devstack cinder-volume[83259]: DEBUG cinder.coordination [None req-26793d22-4445-4b21-95ae-7f1f3a33a70f tempest-CreateVolumesFromSnapshotTest-388118498 None] Acquiring lock "cinder-quobyte-e895ddab-09be-40b1-83fd-7494828f6769" by "delete_volume" {{(pid=83259) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 16 15:14:24 devstack cinder-volume[83259]: DEBUG cinder.coordination [None req-26793d22-4445-4b21-95ae-7f1f3a33a70f tempest-CreateVolumesFromSnapshotTest-388118498 None] Lock "cinder-quobyte-e895ddab-09be-40b1-83fd-7494828f6769" acquired by "delete_volume" :: waited 0.046s {{(pid=83259) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 16 15:14:24 devstack cinder-volume[83259]: DEBUG oslo_concurrency.lockutils [None req-0f70a48f-3fe2-47e3-ae62-2e48f4041670 tempest-VolumesListTestJSON-1108154855 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83259) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 16 15:14:24 devstack cinder-volume[83259]: DEBUG oslo_concurrency.lockutils [None req-0f70a48f-3fe2-47e3-ae62-2e48f4041670 tempest-VolumesListTestJSON-1108154855 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=83259) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 16 15:14:24 devstack cinder-volume[83259]: DEBUG cinder.volume.drivers.quobyte [None req-0f70a48f-3fe2-47e3-ae62-2e48f4041670 tempest-VolumesListTestJSON-1108154855 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-61f585ac-f8e2-4d19-a890-7ebc2726cc72': None} {{(pid=83259) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:639}} Sep 16 15:14:24 devstack cinder-volume[83259]: DEBUG cinder.volume.drivers.quobyte [None req-0f70a48f-3fe2-47e3-ae62-2e48f4041670 tempest-VolumesListTestJSON-1108154855 None] Available shares ['10.10.41.181/cinder-vol-61f585ac-f8e2-4d19-a890-7ebc2726cc72'] {{(pid=83259) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:669}} Sep 16 15:14:24 devstack cinder-volume[83259]: DEBUG oslo_concurrency.lockutils [None req-0f70a48f-3fe2-47e3-ae62-2e48f4041670 tempest-VolumesListTestJSON-1108154855 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=83259) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 16 15:14:24 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [None req-0f70a48f-3fe2-47e3-ae62-2e48f4041670 tempest-VolumesListTestJSON-1108154855 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 15:14:25 devstack cinder-volume[83259]: DEBUG oslo.privsep.daemon [-] privsep: reply[95b0f086-7998-464b-a7d8-c1662689c42e]: (4, 'qcow2') {{(pid=84312) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 16 15:14:25 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [None req-26793d22-4445-4b21-95ae-7f1f3a33a70f tempest-CreateVolumesFromSnapshotTest-388118498 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c/volume-e895ddab-09be-40b1-83fd-7494828f6769 {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 15:14:25 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [None req-0f70a48f-3fe2-47e3-ae62-2e48f4041670 tempest-VolumesListTestJSON-1108154855 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c" returned: 0 in 0.297s {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 15:14:25 devstack cinder-volume[83259]: DEBUG cinder.manager [None req-0f70a48f-3fe2-47e3-ae62-2e48f4041670 tempest-VolumesListTestJSON-1108154855 None] Notifying Schedulers of capabilities ... {{(pid=83259) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 16 15:14:25 devstack cinder-volume[83259]: INFO cinder.volume.manager [None req-0f70a48f-3fe2-47e3-ae62-2e48f4041670 tempest-VolumesListTestJSON-1108154855 None] Deleted volume successfully. Sep 16 15:14:25 devstack cinder-volume[83259]: DEBUG cinder.coordination [None req-0f70a48f-3fe2-47e3-ae62-2e48f4041670 tempest-VolumesListTestJSON-1108154855 None] Lock "cinder-01ac8da2-a978-4bbb-8b89-58d7d25525e6-delete_volume" released by "delete_volume" :: held 4.083s {{(pid=83259) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 16 15:14:25 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [None req-26793d22-4445-4b21-95ae-7f1f3a33a70f tempest-CreateVolumesFromSnapshotTest-388118498 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c/volume-e895ddab-09be-40b1-83fd-7494828f6769" returned: 0 in 0.874s {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 15:14:25 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [None req-26793d22-4445-4b21-95ae-7f1f3a33a70f tempest-CreateVolumesFromSnapshotTest-388118498 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c/volume-e895ddab-09be-40b1-83fd-7494828f6769 {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 15:14:26 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [None req-26793d22-4445-4b21-95ae-7f1f3a33a70f tempest-CreateVolumesFromSnapshotTest-388118498 None] CMD "rm -f /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c/volume-e895ddab-09be-40b1-83fd-7494828f6769" returned: 0 in 0.151s {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 15:14:26 devstack cinder-volume[83259]: DEBUG cinder.coordination [None req-26793d22-4445-4b21-95ae-7f1f3a33a70f tempest-CreateVolumesFromSnapshotTest-388118498 None] Lock "cinder-quobyte-e895ddab-09be-40b1-83fd-7494828f6769" released by "delete_volume" :: held 1.444s {{(pid=83259) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 16 15:14:26 devstack cinder-volume[83259]: DEBUG cinder.quota [None req-26793d22-4445-4b21-95ae-7f1f3a33a70f tempest-CreateVolumesFromSnapshotTest-388118498 None] Created reservations ['e988e93f-102e-4f53-9c72-03d5d4feddc2', 'cb07c82c-067a-4ecb-86e2-f64e420e4d81', 'f9c38145-4cbc-4850-95b2-4a38b3e0f9e5', '288eaa71-e226-473f-bcfe-805ec8691116'] {{(pid=83259) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 16 15:14:27 devstack cinder-volume[83259]: DEBUG oslo_concurrency.lockutils [None req-26793d22-4445-4b21-95ae-7f1f3a33a70f tempest-CreateVolumesFromSnapshotTest-388118498 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83259) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 16 15:14:27 devstack cinder-volume[83259]: DEBUG oslo_concurrency.lockutils [None req-26793d22-4445-4b21-95ae-7f1f3a33a70f tempest-CreateVolumesFromSnapshotTest-388118498 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.005s {{(pid=83259) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 16 15:14:27 devstack cinder-volume[83259]: DEBUG cinder.volume.drivers.quobyte [None req-26793d22-4445-4b21-95ae-7f1f3a33a70f tempest-CreateVolumesFromSnapshotTest-388118498 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-61f585ac-f8e2-4d19-a890-7ebc2726cc72': None} {{(pid=83259) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:639}} Sep 16 15:14:27 devstack cinder-volume[83259]: DEBUG cinder.volume.drivers.quobyte [None req-26793d22-4445-4b21-95ae-7f1f3a33a70f tempest-CreateVolumesFromSnapshotTest-388118498 None] Available shares ['10.10.41.181/cinder-vol-61f585ac-f8e2-4d19-a890-7ebc2726cc72'] {{(pid=83259) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:669}} Sep 16 15:14:27 devstack cinder-volume[83259]: DEBUG oslo_concurrency.lockutils [None req-26793d22-4445-4b21-95ae-7f1f3a33a70f tempest-CreateVolumesFromSnapshotTest-388118498 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=83259) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 16 15:14:27 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [None req-26793d22-4445-4b21-95ae-7f1f3a33a70f tempest-CreateVolumesFromSnapshotTest-388118498 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 15:14:27 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [None req-26793d22-4445-4b21-95ae-7f1f3a33a70f tempest-CreateVolumesFromSnapshotTest-388118498 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c" returned: 0 in 0.164s {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 15:14:27 devstack cinder-volume[83259]: DEBUG cinder.manager [None req-26793d22-4445-4b21-95ae-7f1f3a33a70f tempest-CreateVolumesFromSnapshotTest-388118498 None] Notifying Schedulers of capabilities ... {{(pid=83259) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 16 15:14:27 devstack cinder-volume[83259]: INFO cinder.volume.manager [None req-26793d22-4445-4b21-95ae-7f1f3a33a70f tempest-CreateVolumesFromSnapshotTest-388118498 None] Deleted volume successfully. Sep 16 15:14:27 devstack cinder-volume[83259]: DEBUG cinder.coordination [None req-26793d22-4445-4b21-95ae-7f1f3a33a70f tempest-CreateVolumesFromSnapshotTest-388118498 None] Lock "cinder-e895ddab-09be-40b1-83fd-7494828f6769-delete_volume" released by "delete_volume" :: held 3.058s {{(pid=83259) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 16 15:14:28 devstack cinder-volume[83259]: DEBUG cinder.coordination [None req-4e2ad896-b8c4-44c1-935d-6e55417bfd82 tempest-CreateVolumesFromSnapshotTest-388118498 None] Acquiring lock "cinder-1036e60b-7d2b-4612-a05d-de598608f23b-delete_snapshot" by "delete_snapshot" {{(pid=83259) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 16 15:14:28 devstack cinder-volume[83259]: DEBUG cinder.coordination [None req-4e2ad896-b8c4-44c1-935d-6e55417bfd82 tempest-CreateVolumesFromSnapshotTest-388118498 None] Lock "cinder-1036e60b-7d2b-4612-a05d-de598608f23b-delete_snapshot" acquired by "delete_snapshot" :: waited 0.032s {{(pid=83259) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 16 15:14:28 devstack cinder-volume[83259]: WARNING cinder.volume.volume_utils [None req-4e2ad896-b8c4-44c1-935d-6e55417bfd82 tempest-CreateVolumesFromSnapshotTest-388118498 None] Volume driver (QuobyteDriver 1.2) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 16 15:14:28 devstack cinder-volume[83259]: DEBUG cinder.coordination [None req-4e2ad896-b8c4-44c1-935d-6e55417bfd82 tempest-CreateVolumesFromSnapshotTest-388118498 None] Acquiring lock "cinder-quobyte-100279a7-ee41-49d2-8532-176d3ce3291e" by "delete_snapshot" {{(pid=83259) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 16 15:14:28 devstack cinder-volume[83259]: DEBUG cinder.coordination [None req-4e2ad896-b8c4-44c1-935d-6e55417bfd82 tempest-CreateVolumesFromSnapshotTest-388118498 None] Lock "cinder-quobyte-100279a7-ee41-49d2-8532-176d3ce3291e" acquired by "delete_snapshot" :: waited 0.347s {{(pid=83259) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 16 15:14:28 devstack cinder-volume[83259]: DEBUG cinder.coordination [None req-4e2ad896-b8c4-44c1-935d-6e55417bfd82 tempest-CreateVolumesFromSnapshotTest-388118498 None] Acquiring lock "cinder-quobyte-1036e60b-7d2b-4612-a05d-de598608f23b" by "_delete_snapshot" {{(pid=83259) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 16 15:14:28 devstack cinder-volume[83259]: DEBUG cinder.coordination [None req-4e2ad896-b8c4-44c1-935d-6e55417bfd82 tempest-CreateVolumesFromSnapshotTest-388118498 None] Lock "cinder-quobyte-1036e60b-7d2b-4612-a05d-de598608f23b" acquired by "_delete_snapshot" :: waited 0.010s {{(pid=83259) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 16 15:14:28 devstack cinder-volume[83259]: DEBUG cinder.volume.drivers.remotefs [None req-4e2ad896-b8c4-44c1-935d-6e55417bfd82 tempest-CreateVolumesFromSnapshotTest-388118498 None] Deleting offline snapshot 1036e60b-7d2b-4612-a05d-de598608f23b of volume 100279a7-ee41-49d2-8532-176d3ce3291e {{(pid=83259) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1278}} Sep 16 15:14:28 devstack cinder-volume[83259]: DEBUG cinder.volume.drivers.remotefs [None req-4e2ad896-b8c4-44c1-935d-6e55417bfd82 tempest-CreateVolumesFromSnapshotTest-388118498 None] snapshot_file for this snap is: volume-100279a7-ee41-49d2-8532-176d3ce3291e.1036e60b-7d2b-4612-a05d-de598608f23b {{(pid=83259) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1307}} Sep 16 15:14:28 devstack cinder-volume[83259]: DEBUG oslo.privsep.daemon [-] privsep: reply[4b1ebd86-49ee-4d7d-babd-d69a29f500e7]: (4, 'qcow2') {{(pid=84312) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 16 15:14:28 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [None req-4e2ad896-b8c4-44c1-935d-6e55417bfd82 tempest-CreateVolumesFromSnapshotTest-388118498 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c/volume-100279a7-ee41-49d2-8532-176d3ce3291e.1036e60b-7d2b-4612-a05d-de598608f23b {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 15:14:29 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [None req-4e2ad896-b8c4-44c1-935d-6e55417bfd82 tempest-CreateVolumesFromSnapshotTest-388118498 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c/volume-100279a7-ee41-49d2-8532-176d3ce3291e.1036e60b-7d2b-4612-a05d-de598608f23b" returned: 0 in 0.528s {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 15:14:29 devstack cinder-volume[83259]: DEBUG cinder.volume.drivers.remotefs [None req-4e2ad896-b8c4-44c1-935d-6e55417bfd82 tempest-CreateVolumesFromSnapshotTest-388118498 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-100279a7-ee41-49d2-8532-176d3ce3291e(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83259) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:886}} Sep 16 15:14:29 devstack cinder-volume[83259]: DEBUG oslo.privsep.daemon [-] privsep: reply[3cfbb49e-f324-4f26-880e-2fb9b7ee9e35]: (4, 'qcow2') {{(pid=84312) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 16 15:14:29 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [None req-4e2ad896-b8c4-44c1-935d-6e55417bfd82 tempest-CreateVolumesFromSnapshotTest-388118498 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c/volume-100279a7-ee41-49d2-8532-176d3ce3291e {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 15:14:29 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [None req-4e2ad896-b8c4-44c1-935d-6e55417bfd82 tempest-CreateVolumesFromSnapshotTest-388118498 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c/volume-100279a7-ee41-49d2-8532-176d3ce3291e" returned: 0 in 0.508s {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 15:14:29 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [None req-4e2ad896-b8c4-44c1-935d-6e55417bfd82 tempest-CreateVolumesFromSnapshotTest-388118498 None] Running cmd (subprocess): qemu-img commit -d /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c/volume-100279a7-ee41-49d2-8532-176d3ce3291e.1036e60b-7d2b-4612-a05d-de598608f23b {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 15:14:29 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [None req-4e2ad896-b8c4-44c1-935d-6e55417bfd82 tempest-CreateVolumesFromSnapshotTest-388118498 None] CMD "qemu-img commit -d /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c/volume-100279a7-ee41-49d2-8532-176d3ce3291e.1036e60b-7d2b-4612-a05d-de598608f23b" returned: 0 in 0.222s {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 15:14:29 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [None req-4e2ad896-b8c4-44c1-935d-6e55417bfd82 tempest-CreateVolumesFromSnapshotTest-388118498 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c/volume-100279a7-ee41-49d2-8532-176d3ce3291e.1036e60b-7d2b-4612-a05d-de598608f23b {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 15:14:30 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [None req-4e2ad896-b8c4-44c1-935d-6e55417bfd82 tempest-CreateVolumesFromSnapshotTest-388118498 None] CMD "rm -f /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c/volume-100279a7-ee41-49d2-8532-176d3ce3291e.1036e60b-7d2b-4612-a05d-de598608f23b" returned: 0 in 0.132s {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 15:14:30 devstack cinder-volume[83259]: DEBUG cinder.coordination [None req-4e2ad896-b8c4-44c1-935d-6e55417bfd82 tempest-CreateVolumesFromSnapshotTest-388118498 None] Lock "cinder-quobyte-1036e60b-7d2b-4612-a05d-de598608f23b" released by "_delete_snapshot" :: held 1.782s {{(pid=83259) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 16 15:14:30 devstack cinder-volume[83259]: DEBUG cinder.coordination [None req-4e2ad896-b8c4-44c1-935d-6e55417bfd82 tempest-CreateVolumesFromSnapshotTest-388118498 None] Lock "cinder-quobyte-100279a7-ee41-49d2-8532-176d3ce3291e" released by "delete_snapshot" :: held 1.807s {{(pid=83259) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 16 15:14:30 devstack cinder-volume[83259]: DEBUG cinder.quota [None req-4e2ad896-b8c4-44c1-935d-6e55417bfd82 tempest-CreateVolumesFromSnapshotTest-388118498 None] Created reservations ['9e34708c-6ebf-4294-ac01-65272f20f74e', 'd4971ddf-2dc2-4c9f-9329-f0dab7b08f8c', '4603ba29-f662-41d3-b9c7-38dcee4e9318', '3fddce78-bbde-4e0b-8edb-897227351bae'] {{(pid=83259) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 16 15:14:30 devstack cinder-volume[83259]: INFO cinder.volume.manager [None req-4e2ad896-b8c4-44c1-935d-6e55417bfd82 tempest-CreateVolumesFromSnapshotTest-388118498 None] Delete snapshot completed successfully. Sep 16 15:14:30 devstack cinder-volume[83259]: DEBUG cinder.coordination [None req-4e2ad896-b8c4-44c1-935d-6e55417bfd82 tempest-CreateVolumesFromSnapshotTest-388118498 None] Lock "cinder-1036e60b-7d2b-4612-a05d-de598608f23b-delete_snapshot" released by "delete_snapshot" :: held 2.815s {{(pid=83259) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 16 15:14:31 devstack cinder-volume[83259]: DEBUG cinder.coordination [None req-2922dc07-3d7c-40e8-936c-050cb00da7ed tempest-CreateVolumesFromSnapshotTest-388118498 None] Acquiring lock "cinder-100279a7-ee41-49d2-8532-176d3ce3291e-delete_volume" by "delete_volume" {{(pid=83259) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 16 15:14:31 devstack cinder-volume[83259]: DEBUG cinder.coordination [None req-2922dc07-3d7c-40e8-936c-050cb00da7ed tempest-CreateVolumesFromSnapshotTest-388118498 None] Lock "cinder-100279a7-ee41-49d2-8532-176d3ce3291e-delete_volume" acquired by "delete_volume" :: waited 0.092s {{(pid=83259) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 16 15:14:31 devstack cinder-volume[83259]: WARNING cinder.volume.volume_utils [None req-2922dc07-3d7c-40e8-936c-050cb00da7ed tempest-CreateVolumesFromSnapshotTest-388118498 None] Volume driver (QuobyteDriver 1.2) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 16 15:14:31 devstack cinder-volume[83259]: DEBUG cinder.coordination [None req-2922dc07-3d7c-40e8-936c-050cb00da7ed tempest-CreateVolumesFromSnapshotTest-388118498 None] Acquiring lock "cinder-quobyte-100279a7-ee41-49d2-8532-176d3ce3291e" by "delete_volume" {{(pid=83259) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 16 15:14:31 devstack cinder-volume[83259]: DEBUG cinder.coordination [None req-2922dc07-3d7c-40e8-936c-050cb00da7ed tempest-CreateVolumesFromSnapshotTest-388118498 None] Lock "cinder-quobyte-100279a7-ee41-49d2-8532-176d3ce3291e" acquired by "delete_volume" :: waited 0.021s {{(pid=83259) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 16 15:14:31 devstack cinder-volume[83259]: DEBUG oslo.privsep.daemon [-] privsep: reply[08620114-e6e5-4505-a510-ceab82e65ec5]: (4, 'qcow2') {{(pid=84312) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 16 15:14:31 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [None req-2922dc07-3d7c-40e8-936c-050cb00da7ed tempest-CreateVolumesFromSnapshotTest-388118498 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c/volume-100279a7-ee41-49d2-8532-176d3ce3291e {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 15:14:32 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [None req-2922dc07-3d7c-40e8-936c-050cb00da7ed tempest-CreateVolumesFromSnapshotTest-388118498 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c/volume-100279a7-ee41-49d2-8532-176d3ce3291e" returned: 0 in 0.822s {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 15:14:32 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [None req-2922dc07-3d7c-40e8-936c-050cb00da7ed tempest-CreateVolumesFromSnapshotTest-388118498 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c/volume-100279a7-ee41-49d2-8532-176d3ce3291e {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 15:14:32 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [None req-2922dc07-3d7c-40e8-936c-050cb00da7ed tempest-CreateVolumesFromSnapshotTest-388118498 None] CMD "rm -f /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c/volume-100279a7-ee41-49d2-8532-176d3ce3291e" returned: 0 in 0.229s {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 15:14:33 devstack cinder-volume[83259]: DEBUG cinder.coordination [None req-2922dc07-3d7c-40e8-936c-050cb00da7ed tempest-CreateVolumesFromSnapshotTest-388118498 None] Lock "cinder-quobyte-100279a7-ee41-49d2-8532-176d3ce3291e" released by "delete_volume" :: held 1.435s {{(pid=83259) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 16 15:14:33 devstack cinder-volume[83259]: DEBUG cinder.quota [None req-2922dc07-3d7c-40e8-936c-050cb00da7ed tempest-CreateVolumesFromSnapshotTest-388118498 None] Created reservations ['4586dfb6-032c-43e2-ba75-f6ac9951cc18', 'f18ebf53-672f-4d33-a589-148bcec4c98d', '052829e1-fd46-4a28-8612-32022e0754a2', 'c68c2634-5f50-4aa5-9e51-b14ace478f0a'] {{(pid=83259) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 16 15:14:34 devstack cinder-volume[83259]: DEBUG oslo_concurrency.lockutils [None req-2922dc07-3d7c-40e8-936c-050cb00da7ed tempest-CreateVolumesFromSnapshotTest-388118498 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83259) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 16 15:14:34 devstack cinder-volume[83259]: DEBUG oslo_concurrency.lockutils [None req-2922dc07-3d7c-40e8-936c-050cb00da7ed tempest-CreateVolumesFromSnapshotTest-388118498 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.006s {{(pid=83259) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 16 15:14:34 devstack cinder-volume[83259]: DEBUG cinder.volume.drivers.quobyte [None req-2922dc07-3d7c-40e8-936c-050cb00da7ed tempest-CreateVolumesFromSnapshotTest-388118498 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-61f585ac-f8e2-4d19-a890-7ebc2726cc72': None} {{(pid=83259) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:639}} Sep 16 15:14:34 devstack cinder-volume[83259]: DEBUG cinder.volume.drivers.quobyte [None req-2922dc07-3d7c-40e8-936c-050cb00da7ed tempest-CreateVolumesFromSnapshotTest-388118498 None] Available shares ['10.10.41.181/cinder-vol-61f585ac-f8e2-4d19-a890-7ebc2726cc72'] {{(pid=83259) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:669}} Sep 16 15:14:34 devstack cinder-volume[83259]: DEBUG oslo_concurrency.lockutils [None req-2922dc07-3d7c-40e8-936c-050cb00da7ed tempest-CreateVolumesFromSnapshotTest-388118498 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.022s {{(pid=83259) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 16 15:14:34 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [None req-2922dc07-3d7c-40e8-936c-050cb00da7ed tempest-CreateVolumesFromSnapshotTest-388118498 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 15:14:34 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [None req-2922dc07-3d7c-40e8-936c-050cb00da7ed tempest-CreateVolumesFromSnapshotTest-388118498 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c" returned: 0 in 0.217s {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 15:14:34 devstack cinder-volume[83259]: DEBUG cinder.manager [None req-2922dc07-3d7c-40e8-936c-050cb00da7ed tempest-CreateVolumesFromSnapshotTest-388118498 None] Notifying Schedulers of capabilities ... {{(pid=83259) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 16 15:14:34 devstack cinder-volume[83259]: INFO cinder.volume.manager [None req-2922dc07-3d7c-40e8-936c-050cb00da7ed tempest-CreateVolumesFromSnapshotTest-388118498 None] Deleted volume successfully. Sep 16 15:14:34 devstack cinder-volume[83259]: DEBUG cinder.coordination [None req-2922dc07-3d7c-40e8-936c-050cb00da7ed tempest-CreateVolumesFromSnapshotTest-388118498 None] Lock "cinder-100279a7-ee41-49d2-8532-176d3ce3291e-delete_volume" released by "delete_volume" :: held 3.122s {{(pid=83259) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 16 15:14:43 devstack cinder-volume[83259]: DEBUG dbcounter [-] [83259] Writing DB stats cinder:UPDATE=65,cinder:SELECT=49,cinder:INSERT=20,cinder:DELETE=3 {{(pid=83259) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Sep 16 15:14:44 devstack cinder-volume[83259]: DEBUG dbcounter [-] [83259] Writing DB stats cinder:UPDATE=87,cinder:SELECT=41,cinder:DELETE=6,cinder:INSERT=16 {{(pid=83259) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Sep 16 15:14:45 devstack cinder-volume[83259]: DEBUG oslo_service.periodic_task [None req-050ec8a1-6ffd-499d-95ad-d548a84437e2 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=83259) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} Sep 16 15:14:45 devstack cinder-volume[83259]: DEBUG oslo_concurrency.lockutils [None req-050ec8a1-6ffd-499d-95ad-d548a84437e2 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83259) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 16 15:14:45 devstack cinder-volume[83259]: DEBUG oslo_concurrency.lockutils [None req-050ec8a1-6ffd-499d-95ad-d548a84437e2 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=83259) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 16 15:14:45 devstack cinder-volume[83259]: DEBUG cinder.volume.drivers.quobyte [None req-050ec8a1-6ffd-499d-95ad-d548a84437e2 None None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-61f585ac-f8e2-4d19-a890-7ebc2726cc72': None} {{(pid=83259) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:639}} Sep 16 15:14:45 devstack cinder-volume[83259]: DEBUG cinder.volume.drivers.quobyte [None req-050ec8a1-6ffd-499d-95ad-d548a84437e2 None None] Available shares ['10.10.41.181/cinder-vol-61f585ac-f8e2-4d19-a890-7ebc2726cc72'] {{(pid=83259) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:669}} Sep 16 15:14:45 devstack cinder-volume[83259]: DEBUG oslo_concurrency.lockutils [None req-050ec8a1-6ffd-499d-95ad-d548a84437e2 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=83259) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 16 15:14:46 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [None req-050ec8a1-6ffd-499d-95ad-d548a84437e2 None None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 15:14:46 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [None req-050ec8a1-6ffd-499d-95ad-d548a84437e2 None None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c" returned: 0 in 0.230s {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 15:14:46 devstack cinder-volume[83259]: DEBUG cinder.manager [None req-050ec8a1-6ffd-499d-95ad-d548a84437e2 None None] Notifying Schedulers of capabilities ... {{(pid=83259) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 16 15:14:48 devstack cinder-volume[83259]: WARNING cinder.volume.volume_utils [None req-466500f4-86d4-491b-9d4d-dbe3f8924490 tempest-CreateVolumesFromSourceVolumeTest-1622191458 None] Volume driver (QuobyteDriver 1.2) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 16 15:14:48 devstack cinder-volume[83259]: DEBUG cinder.volume.flows.manager.create_volume [None req-466500f4-86d4-491b-9d4d-dbe3f8924490 tempest-CreateVolumesFromSourceVolumeTest-1622191458 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#Quobyte'], 'hosts': ['devstack@QuobyteHD#Quobyte']} {{(pid=83259) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1387}} Sep 16 15:14:48 devstack cinder-volume[83259]: DEBUG cinder.volume.manager [None req-466500f4-86d4-491b-9d4d-dbe3f8924490 tempest-CreateVolumesFromSourceVolumeTest-1622191458 None] Flow 'volume_create_manager' (b11a741c-8ec7-4024-99c8-d63471452b4a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83259) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 16 15:14:48 devstack cinder-volume[83259]: DEBUG cinder.volume.manager [None req-466500f4-86d4-491b-9d4d-dbe3f8924490 tempest-CreateVolumesFromSourceVolumeTest-1622191458 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8518bff3-d074-4d68-b3a3-d95b36a8fcb1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83259) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 15:14:48 devstack cinder-volume[83259]: DEBUG cinder.volume.manager [None req-466500f4-86d4-491b-9d4d-dbe3f8924490 tempest-CreateVolumesFromSourceVolumeTest-1622191458 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8518bff3-d074-4d68-b3a3-d95b36a8fcb1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-16T13:14:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-2048967944',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#Quobyte',id=94915b2a-94e2-4d7d-9c16-d1d687f6f99d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4ab98dff323744519e2ad981fe746f1a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-16T13:14:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-16T13:14:48Z,use_quota=True,user_id='1f367acea153461e8f7be852130ab0d8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(485ead50-3df8-4d76-8d34-a4db136c980a),volume_type_id=485ead50-3df8-4d76-8d34-a4db136c980a)' {{(pid=83259) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 15:14:48 devstack cinder-volume[83259]: DEBUG cinder.volume.manager [None req-466500f4-86d4-491b-9d4d-dbe3f8924490 tempest-CreateVolumesFromSourceVolumeTest-1622191458 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a092819c-ddf9-4826-8c1e-b1daf4c823ea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83259) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 15:14:48 devstack cinder-volume[83259]: DEBUG cinder.volume.manager [None req-466500f4-86d4-491b-9d4d-dbe3f8924490 tempest-CreateVolumesFromSourceVolumeTest-1622191458 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a092819c-ddf9-4826-8c1e-b1daf4c823ea) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83259) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 15:14:48 devstack cinder-volume[83259]: DEBUG cinder.volume.manager [None req-466500f4-86d4-491b-9d4d-dbe3f8924490 tempest-CreateVolumesFromSourceVolumeTest-1622191458 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (44917174-ef1a-4107-b887-0ecf2b2cecae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83259) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 15:14:48 devstack cinder-volume[83259]: DEBUG cinder.volume.manager [None req-466500f4-86d4-491b-9d4d-dbe3f8924490 tempest-CreateVolumesFromSourceVolumeTest-1622191458 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (44917174-ef1a-4107-b887-0ecf2b2cecae) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '94915b2a-94e2-4d7d-9c16-d1d687f6f99d', 'volume_name': 'volume-94915b2a-94e2-4d7d-9c16-d1d687f6f99d', 'volume_size': 1}' {{(pid=83259) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 15:14:48 devstack cinder-volume[83259]: DEBUG cinder.volume.manager [None req-466500f4-86d4-491b-9d4d-dbe3f8924490 tempest-CreateVolumesFromSourceVolumeTest-1622191458 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (db725e28-83ca-4e03-b2f4-098f2401eee6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83259) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 15:14:48 devstack cinder-volume[83259]: DEBUG cinder.volume.manager [None req-466500f4-86d4-491b-9d4d-dbe3f8924490 tempest-CreateVolumesFromSourceVolumeTest-1622191458 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (db725e28-83ca-4e03-b2f4-098f2401eee6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83259) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 15:14:48 devstack cinder-volume[83259]: DEBUG cinder.volume.manager [None req-466500f4-86d4-491b-9d4d-dbe3f8924490 tempest-CreateVolumesFromSourceVolumeTest-1622191458 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3f4b974c-b7bf-4cca-9675-db0f57e6e77a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83259) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 15:14:48 devstack cinder-volume[83259]: INFO cinder.volume.flows.manager.create_volume [None req-466500f4-86d4-491b-9d4d-dbe3f8924490 tempest-CreateVolumesFromSourceVolumeTest-1622191458 None] Volume 94915b2a-94e2-4d7d-9c16-d1d687f6f99d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-94915b2a-94e2-4d7d-9c16-d1d687f6f99d', 'volume_size': 1} Sep 16 15:14:48 devstack cinder-volume[83259]: DEBUG oslo_concurrency.lockutils [None req-466500f4-86d4-491b-9d4d-dbe3f8924490 tempest-CreateVolumesFromSourceVolumeTest-1622191458 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83259) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 16 15:14:48 devstack cinder-volume[83259]: DEBUG oslo_concurrency.lockutils [None req-466500f4-86d4-491b-9d4d-dbe3f8924490 tempest-CreateVolumesFromSourceVolumeTest-1622191458 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.005s {{(pid=83259) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 16 15:14:48 devstack cinder-volume[83259]: DEBUG cinder.volume.drivers.quobyte [None req-466500f4-86d4-491b-9d4d-dbe3f8924490 tempest-CreateVolumesFromSourceVolumeTest-1622191458 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-16T13:14:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-2048967944',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#Quobyte',id=94915b2a-94e2-4d7d-9c16-d1d687f6f99d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4ab98dff323744519e2ad981fe746f1a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-16T13:14:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-16T13:14:48Z,use_quota=True,user_id='1f367acea153461e8f7be852130ab0d8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(485ead50-3df8-4d76-8d34-a4db136c980a),volume_type_id=485ead50-3df8-4d76-8d34-a4db136c980a)}" {{(pid=83259) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Sep 16 15:14:48 devstack cinder-volume[83259]: DEBUG cinder.volume.drivers.remotefs [None req-466500f4-86d4-491b-9d4d-dbe3f8924490 tempest-CreateVolumesFromSourceVolumeTest-1622191458 None] Creating volume 94915b2a-94e2-4d7d-9c16-d1d687f6f99d {{(pid=83259) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}} Sep 16 15:14:48 devstack cinder-volume[83259]: DEBUG oslo_concurrency.lockutils [None req-466500f4-86d4-491b-9d4d-dbe3f8924490 tempest-CreateVolumesFromSourceVolumeTest-1622191458 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83259) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 16 15:14:48 devstack cinder-volume[83259]: DEBUG oslo_concurrency.lockutils [None req-466500f4-86d4-491b-9d4d-dbe3f8924490 tempest-CreateVolumesFromSourceVolumeTest-1622191458 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83259) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 16 15:14:48 devstack cinder-volume[83259]: DEBUG cinder.volume.drivers.quobyte [None req-466500f4-86d4-491b-9d4d-dbe3f8924490 tempest-CreateVolumesFromSourceVolumeTest-1622191458 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-61f585ac-f8e2-4d19-a890-7ebc2726cc72': None} {{(pid=83259) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:639}} Sep 16 15:14:48 devstack cinder-volume[83259]: DEBUG cinder.volume.drivers.quobyte [None req-466500f4-86d4-491b-9d4d-dbe3f8924490 tempest-CreateVolumesFromSourceVolumeTest-1622191458 None] Available shares ['10.10.41.181/cinder-vol-61f585ac-f8e2-4d19-a890-7ebc2726cc72'] {{(pid=83259) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:669}} Sep 16 15:14:48 devstack cinder-volume[83259]: DEBUG oslo_concurrency.lockutils [None req-466500f4-86d4-491b-9d4d-dbe3f8924490 tempest-CreateVolumesFromSourceVolumeTest-1622191458 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=83259) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 16 15:14:48 devstack cinder-volume[83259]: DEBUG cinder.volume.drivers.quobyte [None req-466500f4-86d4-491b-9d4d-dbe3f8924490 tempest-CreateVolumesFromSourceVolumeTest-1622191458 None] Selected 10.10.41.181/cinder-vol-61f585ac-f8e2-4d19-a890-7ebc2726cc72 as target Quobyte volume. {{(pid=83259) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:690}} Sep 16 15:14:48 devstack cinder-volume[83259]: INFO cinder.volume.drivers.remotefs [None req-466500f4-86d4-491b-9d4d-dbe3f8924490 tempest-CreateVolumesFromSourceVolumeTest-1622191458 None] casted to 10.10.41.181/cinder-vol-61f585ac-f8e2-4d19-a890-7ebc2726cc72 Sep 16 15:14:48 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [None req-466500f4-86d4-491b-9d4d-dbe3f8924490 tempest-CreateVolumesFromSourceVolumeTest-1622191458 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c/volume-94915b2a-94e2-4d7d-9c16-d1d687f6f99d 1073741824 {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 15:14:48 devstack quobyte-client[83286]: System call of process 96701 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 16 15:14:48 devstack quobyte-client[83286]: The server volume:87712ffe-8a69-446d-9ed6-4430c7ee9792@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=87712ffe-8a69-446d-9ed6-4430c7ee9792, inode=126, name=volume-94915b2a-94e2-4d7d-9c16-d1d687f6f99d, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.206), requestorAccessMask=0 Sep 16 15:14:49 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [None req-466500f4-86d4-491b-9d4d-dbe3f8924490 tempest-CreateVolumesFromSourceVolumeTest-1622191458 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c/volume-94915b2a-94e2-4d7d-9c16-d1d687f6f99d 1073741824" returned: 0 in 0.575s {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 15:14:49 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [None req-466500f4-86d4-491b-9d4d-dbe3f8924490 tempest-CreateVolumesFromSourceVolumeTest-1622191458 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c/volume-94915b2a-94e2-4d7d-9c16-d1d687f6f99d {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 15:14:49 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [None req-466500f4-86d4-491b-9d4d-dbe3f8924490 tempest-CreateVolumesFromSourceVolumeTest-1622191458 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c/volume-94915b2a-94e2-4d7d-9c16-d1d687f6f99d" returned: 0 in 0.214s {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 15:14:49 devstack cinder-volume[83259]: DEBUG cinder.volume.drivers.quobyte [None req-466500f4-86d4-491b-9d4d-dbe3f8924490 tempest-CreateVolumesFromSourceVolumeTest-1622191458 None] <== create_volume: return (902ms) {'provider_location': '10.10.41.181/cinder-vol-61f585ac-f8e2-4d19-a890-7ebc2726cc72'} {{(pid=83259) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Sep 16 15:14:49 devstack cinder-volume[83259]: DEBUG oslo_concurrency.lockutils [None req-466500f4-86d4-491b-9d4d-dbe3f8924490 tempest-CreateVolumesFromSourceVolumeTest-1622191458 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.926s {{(pid=83259) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 16 15:14:49 devstack cinder-volume[83259]: DEBUG cinder.volume.manager [None req-466500f4-86d4-491b-9d4d-dbe3f8924490 tempest-CreateVolumesFromSourceVolumeTest-1622191458 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3f4b974c-b7bf-4cca-9675-db0f57e6e77a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-94915b2a-94e2-4d7d-9c16-d1d687f6f99d', 'volume_size': 1}' {{(pid=83259) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 15:14:49 devstack cinder-volume[83259]: DEBUG cinder.volume.manager [None req-466500f4-86d4-491b-9d4d-dbe3f8924490 tempest-CreateVolumesFromSourceVolumeTest-1622191458 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (889895c5-61b9-475e-8c78-f72d32875c94) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83259) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 15:14:49 devstack cinder-volume[83259]: INFO cinder.volume.flows.manager.create_volume [None req-466500f4-86d4-491b-9d4d-dbe3f8924490 tempest-CreateVolumesFromSourceVolumeTest-1622191458 None] Volume volume-94915b2a-94e2-4d7d-9c16-d1d687f6f99d (94915b2a-94e2-4d7d-9c16-d1d687f6f99d): created successfully Sep 16 15:14:49 devstack cinder-volume[83259]: DEBUG cinder.volume.manager [None req-466500f4-86d4-491b-9d4d-dbe3f8924490 tempest-CreateVolumesFromSourceVolumeTest-1622191458 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (889895c5-61b9-475e-8c78-f72d32875c94) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83259) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 15:14:49 devstack cinder-volume[83259]: DEBUG cinder.volume.manager [None req-466500f4-86d4-491b-9d4d-dbe3f8924490 tempest-CreateVolumesFromSourceVolumeTest-1622191458 None] Flow 'volume_create_manager' (b11a741c-8ec7-4024-99c8-d63471452b4a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83259) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 16 15:14:50 devstack cinder-volume[83259]: INFO cinder.volume.manager [None req-466500f4-86d4-491b-9d4d-dbe3f8924490 tempest-CreateVolumesFromSourceVolumeTest-1622191458 None] Created volume successfully. Sep 16 15:14:51 devstack cinder-volume[83259]: WARNING cinder.volume.volume_utils [None req-96b4f567-6daa-4f6b-bfec-a25bd38ff6cd tempest-CreateVolumesFromSourceVolumeTest-1622191458 None] Volume driver (QuobyteDriver 1.2) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 16 15:14:51 devstack cinder-volume[83259]: DEBUG cinder.volume.flows.manager.create_volume [None req-96b4f567-6daa-4f6b-bfec-a25bd38ff6cd tempest-CreateVolumesFromSourceVolumeTest-1622191458 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#Quobyte'], 'hosts': ['devstack@QuobyteHD#Quobyte']} {{(pid=83259) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1387}} Sep 16 15:14:51 devstack cinder-volume[83259]: DEBUG cinder.volume.manager [None req-96b4f567-6daa-4f6b-bfec-a25bd38ff6cd tempest-CreateVolumesFromSourceVolumeTest-1622191458 None] Flow 'volume_create_manager' (bbdcb268-e0c7-4db3-b811-f95cd70aa14d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83259) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 16 15:14:51 devstack cinder-volume[83259]: DEBUG cinder.volume.manager [None req-96b4f567-6daa-4f6b-bfec-a25bd38ff6cd tempest-CreateVolumesFromSourceVolumeTest-1622191458 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1dbcce3a-7d18-49e3-a736-04b8d2be02f5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83259) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 15:14:52 devstack cinder-volume[83259]: DEBUG cinder.volume.manager [None req-96b4f567-6daa-4f6b-bfec-a25bd38ff6cd tempest-CreateVolumesFromSourceVolumeTest-1622191458 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1dbcce3a-7d18-49e3-a736-04b8d2be02f5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-16T13:14:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-242973984',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#Quobyte',id=6dec902f-7fb2-4a48-acd5-ffd91b801b7e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4ab98dff323744519e2ad981fe746f1a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-16T13:14:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-16T13:14:51Z,use_quota=True,user_id='1f367acea153461e8f7be852130ab0d8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(485ead50-3df8-4d76-8d34-a4db136c980a),volume_type_id=485ead50-3df8-4d76-8d34-a4db136c980a)' {{(pid=83259) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 15:14:52 devstack cinder-volume[83259]: DEBUG cinder.volume.manager [None req-96b4f567-6daa-4f6b-bfec-a25bd38ff6cd tempest-CreateVolumesFromSourceVolumeTest-1622191458 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9c2b99fc-b922-4df5-8a03-5ea3e6e4d41e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83259) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 15:14:52 devstack cinder-volume[83259]: DEBUG cinder.volume.manager [None req-96b4f567-6daa-4f6b-bfec-a25bd38ff6cd tempest-CreateVolumesFromSourceVolumeTest-1622191458 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9c2b99fc-b922-4df5-8a03-5ea3e6e4d41e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83259) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 15:14:52 devstack cinder-volume[83259]: DEBUG cinder.volume.manager [None req-96b4f567-6daa-4f6b-bfec-a25bd38ff6cd tempest-CreateVolumesFromSourceVolumeTest-1622191458 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2afcc1c1-818a-4c6c-8448-d08538189ede) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83259) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 15:14:52 devstack cinder-volume[83259]: DEBUG cinder.volume.manager [None req-96b4f567-6daa-4f6b-bfec-a25bd38ff6cd tempest-CreateVolumesFromSourceVolumeTest-1622191458 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2afcc1c1-818a-4c6c-8448-d08538189ede) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6dec902f-7fb2-4a48-acd5-ffd91b801b7e', 'volume_name': 'volume-6dec902f-7fb2-4a48-acd5-ffd91b801b7e', 'volume_size': 1}' {{(pid=83259) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 15:14:52 devstack cinder-volume[83259]: DEBUG cinder.volume.manager [None req-96b4f567-6daa-4f6b-bfec-a25bd38ff6cd tempest-CreateVolumesFromSourceVolumeTest-1622191458 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fc44e46c-cc4f-4286-abe8-70b668b09a27) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83259) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 15:14:52 devstack cinder-volume[83259]: DEBUG cinder.volume.manager [None req-96b4f567-6daa-4f6b-bfec-a25bd38ff6cd tempest-CreateVolumesFromSourceVolumeTest-1622191458 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fc44e46c-cc4f-4286-abe8-70b668b09a27) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83259) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 15:14:52 devstack cinder-volume[83259]: DEBUG cinder.volume.manager [None req-96b4f567-6daa-4f6b-bfec-a25bd38ff6cd tempest-CreateVolumesFromSourceVolumeTest-1622191458 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (debeffce-ab2f-47c3-8de1-40daa43d324d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83259) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 15:14:52 devstack cinder-volume[83259]: INFO cinder.volume.flows.manager.create_volume [None req-96b4f567-6daa-4f6b-bfec-a25bd38ff6cd tempest-CreateVolumesFromSourceVolumeTest-1622191458 None] Volume 6dec902f-7fb2-4a48-acd5-ffd91b801b7e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6dec902f-7fb2-4a48-acd5-ffd91b801b7e', 'volume_size': 1} Sep 16 15:14:52 devstack cinder-volume[83259]: DEBUG oslo_concurrency.lockutils [None req-96b4f567-6daa-4f6b-bfec-a25bd38ff6cd tempest-CreateVolumesFromSourceVolumeTest-1622191458 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83259) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 16 15:14:52 devstack cinder-volume[83259]: DEBUG oslo_concurrency.lockutils [None req-96b4f567-6daa-4f6b-bfec-a25bd38ff6cd tempest-CreateVolumesFromSourceVolumeTest-1622191458 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.003s {{(pid=83259) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 16 15:14:52 devstack cinder-volume[83259]: DEBUG cinder.volume.drivers.quobyte [None req-96b4f567-6daa-4f6b-bfec-a25bd38ff6cd tempest-CreateVolumesFromSourceVolumeTest-1622191458 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-16T13:14:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-242973984',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#Quobyte',id=6dec902f-7fb2-4a48-acd5-ffd91b801b7e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4ab98dff323744519e2ad981fe746f1a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-16T13:14:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-16T13:14:51Z,use_quota=True,user_id='1f367acea153461e8f7be852130ab0d8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(485ead50-3df8-4d76-8d34-a4db136c980a),volume_type_id=485ead50-3df8-4d76-8d34-a4db136c980a)}" {{(pid=83259) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Sep 16 15:14:52 devstack cinder-volume[83259]: DEBUG cinder.volume.drivers.remotefs [None req-96b4f567-6daa-4f6b-bfec-a25bd38ff6cd tempest-CreateVolumesFromSourceVolumeTest-1622191458 None] Creating volume 6dec902f-7fb2-4a48-acd5-ffd91b801b7e {{(pid=83259) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}} Sep 16 15:14:52 devstack cinder-volume[83259]: DEBUG oslo_concurrency.lockutils [None req-96b4f567-6daa-4f6b-bfec-a25bd38ff6cd tempest-CreateVolumesFromSourceVolumeTest-1622191458 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83259) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 16 15:14:52 devstack cinder-volume[83259]: DEBUG oslo_concurrency.lockutils [None req-96b4f567-6daa-4f6b-bfec-a25bd38ff6cd tempest-CreateVolumesFromSourceVolumeTest-1622191458 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83259) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 16 15:14:52 devstack cinder-volume[83259]: DEBUG cinder.volume.drivers.quobyte [None req-96b4f567-6daa-4f6b-bfec-a25bd38ff6cd tempest-CreateVolumesFromSourceVolumeTest-1622191458 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-61f585ac-f8e2-4d19-a890-7ebc2726cc72': None} {{(pid=83259) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:639}} Sep 16 15:14:52 devstack cinder-volume[83259]: DEBUG cinder.volume.drivers.quobyte [None req-96b4f567-6daa-4f6b-bfec-a25bd38ff6cd tempest-CreateVolumesFromSourceVolumeTest-1622191458 None] Available shares ['10.10.41.181/cinder-vol-61f585ac-f8e2-4d19-a890-7ebc2726cc72'] {{(pid=83259) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:669}} Sep 16 15:14:52 devstack cinder-volume[83259]: DEBUG oslo_concurrency.lockutils [None req-96b4f567-6daa-4f6b-bfec-a25bd38ff6cd tempest-CreateVolumesFromSourceVolumeTest-1622191458 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.023s {{(pid=83259) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 16 15:14:52 devstack cinder-volume[83259]: DEBUG cinder.volume.drivers.quobyte [None req-96b4f567-6daa-4f6b-bfec-a25bd38ff6cd tempest-CreateVolumesFromSourceVolumeTest-1622191458 None] Selected 10.10.41.181/cinder-vol-61f585ac-f8e2-4d19-a890-7ebc2726cc72 as target Quobyte volume. {{(pid=83259) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:690}} Sep 16 15:14:52 devstack cinder-volume[83259]: INFO cinder.volume.drivers.remotefs [None req-96b4f567-6daa-4f6b-bfec-a25bd38ff6cd tempest-CreateVolumesFromSourceVolumeTest-1622191458 None] casted to 10.10.41.181/cinder-vol-61f585ac-f8e2-4d19-a890-7ebc2726cc72 Sep 16 15:14:52 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [None req-96b4f567-6daa-4f6b-bfec-a25bd38ff6cd tempest-CreateVolumesFromSourceVolumeTest-1622191458 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c/volume-6dec902f-7fb2-4a48-acd5-ffd91b801b7e 1073741824 {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 15:14:52 devstack quobyte-client[83286]: System call of process 96705 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 16 15:14:52 devstack quobyte-client[83286]: The server volume:87712ffe-8a69-446d-9ed6-4430c7ee9792@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=87712ffe-8a69-446d-9ed6-4430c7ee9792, inode=127, name=volume-6dec902f-7fb2-4a48-acd5-ffd91b801b7e, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.206), requestorAccessMask=0 Sep 16 15:14:53 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [None req-96b4f567-6daa-4f6b-bfec-a25bd38ff6cd tempest-CreateVolumesFromSourceVolumeTest-1622191458 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c/volume-6dec902f-7fb2-4a48-acd5-ffd91b801b7e 1073741824" returned: 0 in 1.204s {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 15:14:53 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [None req-96b4f567-6daa-4f6b-bfec-a25bd38ff6cd tempest-CreateVolumesFromSourceVolumeTest-1622191458 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c/volume-6dec902f-7fb2-4a48-acd5-ffd91b801b7e {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 15:14:54 devstack cinder-volume[83259]: WARNING cinder.volume.volume_utils [None req-8b25158f-10e3-4bd2-8ed5-60d1cd83b70e tempest-CreateVolumesFromSourceVolumeTest-1622191458 None] Volume driver (QuobyteDriver 1.2) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 16 15:14:54 devstack cinder-volume[83259]: DEBUG cinder.volume.flows.manager.create_volume [None req-8b25158f-10e3-4bd2-8ed5-60d1cd83b70e tempest-CreateVolumesFromSourceVolumeTest-1622191458 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#Quobyte'], 'hosts': ['devstack@QuobyteHD#Quobyte']} {{(pid=83259) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1387}} Sep 16 15:14:54 devstack cinder-volume[83259]: DEBUG cinder.volume.manager [None req-8b25158f-10e3-4bd2-8ed5-60d1cd83b70e tempest-CreateVolumesFromSourceVolumeTest-1622191458 None] Flow 'volume_create_manager' (28779ff9-0bbc-4a5e-bf79-41d045304552) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83259) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 16 15:14:54 devstack cinder-volume[83259]: DEBUG cinder.volume.manager [None req-8b25158f-10e3-4bd2-8ed5-60d1cd83b70e tempest-CreateVolumesFromSourceVolumeTest-1622191458 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f9fe4d9d-86b1-43dc-b8c7-41c7064eade1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83259) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 15:14:54 devstack cinder-volume[83259]: DEBUG cinder.volume.manager [None req-8b25158f-10e3-4bd2-8ed5-60d1cd83b70e tempest-CreateVolumesFromSourceVolumeTest-1622191458 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f9fe4d9d-86b1-43dc-b8c7-41c7064eade1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-16T13:14:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-292444044',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#Quobyte',id=b2a7140a-b6af-4311-8baa-9dfe356a39d8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4ab98dff323744519e2ad981fe746f1a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-16T13:14:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-16T13:14:52Z,use_quota=True,user_id='1f367acea153461e8f7be852130ab0d8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(485ead50-3df8-4d76-8d34-a4db136c980a),volume_type_id=485ead50-3df8-4d76-8d34-a4db136c980a)' {{(pid=83259) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 15:14:54 devstack cinder-volume[83259]: DEBUG cinder.volume.manager [None req-8b25158f-10e3-4bd2-8ed5-60d1cd83b70e tempest-CreateVolumesFromSourceVolumeTest-1622191458 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (791da78c-b0e6-4302-bcb2-cae133c17352) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83259) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 15:14:54 devstack cinder-volume[83259]: DEBUG cinder.volume.manager [None req-8b25158f-10e3-4bd2-8ed5-60d1cd83b70e tempest-CreateVolumesFromSourceVolumeTest-1622191458 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (791da78c-b0e6-4302-bcb2-cae133c17352) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83259) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 15:14:54 devstack cinder-volume[83259]: DEBUG cinder.volume.manager [None req-8b25158f-10e3-4bd2-8ed5-60d1cd83b70e tempest-CreateVolumesFromSourceVolumeTest-1622191458 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (06c8330f-0c10-48b0-817e-25a4f3f36c5a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83259) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 15:14:54 devstack cinder-volume[83259]: DEBUG cinder.volume.manager [None req-8b25158f-10e3-4bd2-8ed5-60d1cd83b70e tempest-CreateVolumesFromSourceVolumeTest-1622191458 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (06c8330f-0c10-48b0-817e-25a4f3f36c5a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b2a7140a-b6af-4311-8baa-9dfe356a39d8', 'volume_name': 'volume-b2a7140a-b6af-4311-8baa-9dfe356a39d8', 'volume_size': 1}' {{(pid=83259) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 15:14:54 devstack cinder-volume[83259]: DEBUG cinder.volume.manager [None req-8b25158f-10e3-4bd2-8ed5-60d1cd83b70e tempest-CreateVolumesFromSourceVolumeTest-1622191458 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b2202ffd-2a00-47f9-ba68-45c812ecd298) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83259) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 15:14:54 devstack cinder-volume[83259]: DEBUG cinder.volume.manager [None req-8b25158f-10e3-4bd2-8ed5-60d1cd83b70e tempest-CreateVolumesFromSourceVolumeTest-1622191458 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b2202ffd-2a00-47f9-ba68-45c812ecd298) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83259) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 15:14:54 devstack cinder-volume[83259]: DEBUG cinder.volume.manager [None req-8b25158f-10e3-4bd2-8ed5-60d1cd83b70e tempest-CreateVolumesFromSourceVolumeTest-1622191458 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7789bb0e-9e6d-43c2-a65f-e8024453006d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83259) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 15:14:54 devstack cinder-volume[83259]: INFO cinder.volume.flows.manager.create_volume [None req-8b25158f-10e3-4bd2-8ed5-60d1cd83b70e tempest-CreateVolumesFromSourceVolumeTest-1622191458 None] Volume b2a7140a-b6af-4311-8baa-9dfe356a39d8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b2a7140a-b6af-4311-8baa-9dfe356a39d8', 'volume_size': 1} Sep 16 15:14:54 devstack cinder-volume[83259]: DEBUG oslo_concurrency.lockutils [None req-8b25158f-10e3-4bd2-8ed5-60d1cd83b70e tempest-CreateVolumesFromSourceVolumeTest-1622191458 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83259) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 16 15:14:54 devstack cinder-volume[83259]: WARNING cinder.volume.volume_utils [None req-2dcb06b2-a85e-4973-be5e-2972ab7a19fd tempest-CreateVolumesFromSourceVolumeTest-1622191458 None] Volume driver (QuobyteDriver 1.2) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 16 15:14:54 devstack cinder-volume[83259]: DEBUG cinder.volume.flows.manager.create_volume [None req-2dcb06b2-a85e-4973-be5e-2972ab7a19fd tempest-CreateVolumesFromSourceVolumeTest-1622191458 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#Quobyte'], 'hosts': ['devstack@QuobyteHD#Quobyte']} {{(pid=83259) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1387}} Sep 16 15:14:54 devstack cinder-volume[83259]: DEBUG cinder.volume.manager [None req-2dcb06b2-a85e-4973-be5e-2972ab7a19fd tempest-CreateVolumesFromSourceVolumeTest-1622191458 None] Flow 'volume_create_manager' (5030260e-d39f-4e14-9844-b972eb88256e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83259) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 16 15:14:54 devstack cinder-volume[83259]: DEBUG cinder.volume.manager [None req-2dcb06b2-a85e-4973-be5e-2972ab7a19fd tempest-CreateVolumesFromSourceVolumeTest-1622191458 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ba4fde0f-0a72-4459-91e6-085cb537a84a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83259) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 15:14:54 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [None req-96b4f567-6daa-4f6b-bfec-a25bd38ff6cd tempest-CreateVolumesFromSourceVolumeTest-1622191458 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c/volume-6dec902f-7fb2-4a48-acd5-ffd91b801b7e" returned: 0 in 1.314s {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 15:14:54 devstack cinder-volume[83259]: DEBUG cinder.volume.manager [None req-2dcb06b2-a85e-4973-be5e-2972ab7a19fd tempest-CreateVolumesFromSourceVolumeTest-1622191458 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ba4fde0f-0a72-4459-91e6-085cb537a84a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-16T13:14:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1733454623',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#Quobyte',id=723c47de-82cc-4d6b-9189-8cc2d570fd8c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4ab98dff323744519e2ad981fe746f1a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-16T13:14:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-16T13:14:53Z,use_quota=True,user_id='1f367acea153461e8f7be852130ab0d8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(485ead50-3df8-4d76-8d34-a4db136c980a),volume_type_id=485ead50-3df8-4d76-8d34-a4db136c980a)' {{(pid=83259) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 15:14:54 devstack cinder-volume[83259]: DEBUG cinder.volume.manager [None req-2dcb06b2-a85e-4973-be5e-2972ab7a19fd tempest-CreateVolumesFromSourceVolumeTest-1622191458 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (95bc01f9-62f2-4cb3-991e-873f2c47e609) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83259) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 15:14:54 devstack cinder-volume[83259]: DEBUG cinder.volume.manager [None req-2dcb06b2-a85e-4973-be5e-2972ab7a19fd tempest-CreateVolumesFromSourceVolumeTest-1622191458 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (95bc01f9-62f2-4cb3-991e-873f2c47e609) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83259) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 15:14:54 devstack cinder-volume[83259]: DEBUG cinder.volume.manager [None req-2dcb06b2-a85e-4973-be5e-2972ab7a19fd tempest-CreateVolumesFromSourceVolumeTest-1622191458 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2404ff02-9c31-4136-a9d1-f0c40e72ab34) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83259) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 15:14:54 devstack cinder-volume[83259]: DEBUG cinder.volume.manager [None req-2dcb06b2-a85e-4973-be5e-2972ab7a19fd tempest-CreateVolumesFromSourceVolumeTest-1622191458 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2404ff02-9c31-4136-a9d1-f0c40e72ab34) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '723c47de-82cc-4d6b-9189-8cc2d570fd8c', 'volume_name': 'volume-723c47de-82cc-4d6b-9189-8cc2d570fd8c', 'volume_size': 1}' {{(pid=83259) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 15:14:54 devstack cinder-volume[83259]: DEBUG cinder.volume.manager [None req-2dcb06b2-a85e-4973-be5e-2972ab7a19fd tempest-CreateVolumesFromSourceVolumeTest-1622191458 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (beead37c-9b37-428e-bdce-33f326f16a23) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83259) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 15:14:54 devstack cinder-volume[83259]: DEBUG cinder.volume.manager [None req-2dcb06b2-a85e-4973-be5e-2972ab7a19fd tempest-CreateVolumesFromSourceVolumeTest-1622191458 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (beead37c-9b37-428e-bdce-33f326f16a23) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83259) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 15:14:54 devstack cinder-volume[83259]: DEBUG cinder.volume.manager [None req-2dcb06b2-a85e-4973-be5e-2972ab7a19fd tempest-CreateVolumesFromSourceVolumeTest-1622191458 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (97302a66-8390-4158-b9ea-63cb6dc082ee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83259) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 15:14:54 devstack cinder-volume[83259]: INFO cinder.volume.flows.manager.create_volume [None req-2dcb06b2-a85e-4973-be5e-2972ab7a19fd tempest-CreateVolumesFromSourceVolumeTest-1622191458 None] Volume 723c47de-82cc-4d6b-9189-8cc2d570fd8c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-723c47de-82cc-4d6b-9189-8cc2d570fd8c', 'volume_size': 1} Sep 16 15:14:54 devstack cinder-volume[83259]: DEBUG oslo_concurrency.lockutils [None req-2dcb06b2-a85e-4973-be5e-2972ab7a19fd tempest-CreateVolumesFromSourceVolumeTest-1622191458 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83259) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 16 15:14:54 devstack cinder-volume[83259]: DEBUG cinder.volume.drivers.quobyte [None req-96b4f567-6daa-4f6b-bfec-a25bd38ff6cd tempest-CreateVolumesFromSourceVolumeTest-1622191458 None] <== create_volume: return (2633ms) {'provider_location': '10.10.41.181/cinder-vol-61f585ac-f8e2-4d19-a890-7ebc2726cc72'} {{(pid=83259) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Sep 16 15:14:54 devstack cinder-volume[83259]: DEBUG oslo_concurrency.lockutils [None req-96b4f567-6daa-4f6b-bfec-a25bd38ff6cd tempest-CreateVolumesFromSourceVolumeTest-1622191458 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.650s {{(pid=83259) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 16 15:14:54 devstack cinder-volume[83259]: DEBUG oslo_concurrency.lockutils [None req-8b25158f-10e3-4bd2-8ed5-60d1cd83b70e tempest-CreateVolumesFromSourceVolumeTest-1622191458 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.166s {{(pid=83259) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 16 15:14:54 devstack cinder-volume[83259]: DEBUG cinder.volume.drivers.quobyte [None req-8b25158f-10e3-4bd2-8ed5-60d1cd83b70e tempest-CreateVolumesFromSourceVolumeTest-1622191458 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-16T13:14:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-292444044',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#Quobyte',id=b2a7140a-b6af-4311-8baa-9dfe356a39d8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4ab98dff323744519e2ad981fe746f1a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-16T13:14:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-16T13:14:52Z,use_quota=True,user_id='1f367acea153461e8f7be852130ab0d8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(485ead50-3df8-4d76-8d34-a4db136c980a),volume_type_id=485ead50-3df8-4d76-8d34-a4db136c980a)}" {{(pid=83259) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Sep 16 15:14:54 devstack cinder-volume[83259]: DEBUG cinder.volume.drivers.remotefs [None req-8b25158f-10e3-4bd2-8ed5-60d1cd83b70e tempest-CreateVolumesFromSourceVolumeTest-1622191458 None] Creating volume b2a7140a-b6af-4311-8baa-9dfe356a39d8 {{(pid=83259) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}} Sep 16 15:14:54 devstack cinder-volume[83259]: DEBUG oslo_concurrency.lockutils [None req-8b25158f-10e3-4bd2-8ed5-60d1cd83b70e tempest-CreateVolumesFromSourceVolumeTest-1622191458 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83259) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 16 15:14:54 devstack cinder-volume[83259]: DEBUG oslo_concurrency.lockutils [None req-8b25158f-10e3-4bd2-8ed5-60d1cd83b70e tempest-CreateVolumesFromSourceVolumeTest-1622191458 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83259) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 16 15:14:54 devstack cinder-volume[83259]: DEBUG cinder.volume.drivers.quobyte [None req-8b25158f-10e3-4bd2-8ed5-60d1cd83b70e tempest-CreateVolumesFromSourceVolumeTest-1622191458 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-61f585ac-f8e2-4d19-a890-7ebc2726cc72': None} {{(pid=83259) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:639}} Sep 16 15:14:54 devstack cinder-volume[83259]: DEBUG cinder.volume.drivers.quobyte [None req-8b25158f-10e3-4bd2-8ed5-60d1cd83b70e tempest-CreateVolumesFromSourceVolumeTest-1622191458 None] Available shares ['10.10.41.181/cinder-vol-61f585ac-f8e2-4d19-a890-7ebc2726cc72'] {{(pid=83259) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:669}} Sep 16 15:14:54 devstack cinder-volume[83259]: DEBUG oslo_concurrency.lockutils [None req-8b25158f-10e3-4bd2-8ed5-60d1cd83b70e tempest-CreateVolumesFromSourceVolumeTest-1622191458 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=83259) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 16 15:14:54 devstack cinder-volume[83259]: DEBUG cinder.volume.drivers.quobyte [None req-8b25158f-10e3-4bd2-8ed5-60d1cd83b70e tempest-CreateVolumesFromSourceVolumeTest-1622191458 None] Selected 10.10.41.181/cinder-vol-61f585ac-f8e2-4d19-a890-7ebc2726cc72 as target Quobyte volume. {{(pid=83259) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:690}} Sep 16 15:14:54 devstack cinder-volume[83259]: INFO cinder.volume.drivers.remotefs [None req-8b25158f-10e3-4bd2-8ed5-60d1cd83b70e tempest-CreateVolumesFromSourceVolumeTest-1622191458 None] casted to 10.10.41.181/cinder-vol-61f585ac-f8e2-4d19-a890-7ebc2726cc72 Sep 16 15:14:54 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [None req-8b25158f-10e3-4bd2-8ed5-60d1cd83b70e tempest-CreateVolumesFromSourceVolumeTest-1622191458 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c/volume-b2a7140a-b6af-4311-8baa-9dfe356a39d8 1073741824 {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 15:14:55 devstack quobyte-client[83286]: System call of process 96710 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 16 15:14:55 devstack quobyte-client[83286]: The server volume:87712ffe-8a69-446d-9ed6-4430c7ee9792@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=87712ffe-8a69-446d-9ed6-4430c7ee9792, inode=128, name=volume-b2a7140a-b6af-4311-8baa-9dfe356a39d8, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.206), requestorAccessMask=0 Sep 16 15:14:55 devstack cinder-volume[83259]: WARNING cinder.volume.volume_utils [None req-b5b1cc42-a570-495a-91df-879af404a38a tempest-CreateVolumesFromSourceVolumeTest-1622191458 None] Volume driver (QuobyteDriver 1.2) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 16 15:14:55 devstack cinder-volume[83259]: DEBUG cinder.volume.flows.manager.create_volume [None req-b5b1cc42-a570-495a-91df-879af404a38a tempest-CreateVolumesFromSourceVolumeTest-1622191458 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#Quobyte'], 'hosts': ['devstack@QuobyteHD#Quobyte']} {{(pid=83259) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1387}} Sep 16 15:14:55 devstack cinder-volume[83259]: DEBUG cinder.volume.manager [None req-b5b1cc42-a570-495a-91df-879af404a38a tempest-CreateVolumesFromSourceVolumeTest-1622191458 None] Flow 'volume_create_manager' (3e31419c-e0a5-4369-bcab-d57aa6faaeb0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83259) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 16 15:14:55 devstack cinder-volume[83259]: DEBUG cinder.volume.manager [None req-b5b1cc42-a570-495a-91df-879af404a38a tempest-CreateVolumesFromSourceVolumeTest-1622191458 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8105e40f-c872-435d-a0da-ce3f46119b54) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83259) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 15:14:55 devstack cinder-volume[83259]: WARNING cinder.volume.volume_utils [None req-74bcbaa5-2808-4f86-9be4-44cad8d8c192 tempest-CreateVolumesFromSourceVolumeTest-1622191458 None] Volume driver (QuobyteDriver 1.2) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 16 15:14:55 devstack cinder-volume[83259]: DEBUG cinder.volume.flows.manager.create_volume [None req-74bcbaa5-2808-4f86-9be4-44cad8d8c192 tempest-CreateVolumesFromSourceVolumeTest-1622191458 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#Quobyte'], 'hosts': ['devstack@QuobyteHD#Quobyte']} {{(pid=83259) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1387}} Sep 16 15:14:55 devstack cinder-volume[83259]: DEBUG cinder.volume.manager [None req-74bcbaa5-2808-4f86-9be4-44cad8d8c192 tempest-CreateVolumesFromSourceVolumeTest-1622191458 None] Flow 'volume_create_manager' (af91389e-e582-4c4f-9b02-7b1a82872fcc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83259) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 16 15:14:55 devstack cinder-volume[83259]: DEBUG cinder.volume.manager [None req-74bcbaa5-2808-4f86-9be4-44cad8d8c192 tempest-CreateVolumesFromSourceVolumeTest-1622191458 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0dc2cbc9-b242-43d4-a12a-31393ed3c0d8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83259) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 15:14:55 devstack cinder-volume[83259]: DEBUG cinder.volume.manager [None req-96b4f567-6daa-4f6b-bfec-a25bd38ff6cd tempest-CreateVolumesFromSourceVolumeTest-1622191458 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (debeffce-ab2f-47c3-8de1-40daa43d324d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6dec902f-7fb2-4a48-acd5-ffd91b801b7e', 'volume_size': 1}' {{(pid=83259) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 15:14:55 devstack cinder-volume[83259]: DEBUG cinder.volume.manager [None req-96b4f567-6daa-4f6b-bfec-a25bd38ff6cd tempest-CreateVolumesFromSourceVolumeTest-1622191458 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (227c503e-3b6d-441b-af03-3a3dd64271e5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83259) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 15:14:55 devstack cinder-volume[83259]: DEBUG cinder.volume.manager [None req-b5b1cc42-a570-495a-91df-879af404a38a tempest-CreateVolumesFromSourceVolumeTest-1622191458 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8105e40f-c872-435d-a0da-ce3f46119b54) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-16T13:14:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-168031180',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#Quobyte',id=b8a6acd8-dc2e-4b1a-ad2f-35dd586f84af,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4ab98dff323744519e2ad981fe746f1a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-16T13:14:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-16T13:14:54Z,use_quota=True,user_id='1f367acea153461e8f7be852130ab0d8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(485ead50-3df8-4d76-8d34-a4db136c980a),volume_type_id=485ead50-3df8-4d76-8d34-a4db136c980a)' {{(pid=83259) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 15:14:55 devstack cinder-volume[83259]: DEBUG cinder.volume.manager [None req-b5b1cc42-a570-495a-91df-879af404a38a tempest-CreateVolumesFromSourceVolumeTest-1622191458 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1f333bab-98c5-4baf-8f01-eee457651a64) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83259) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 15:14:55 devstack cinder-volume[83259]: DEBUG cinder.volume.manager [None req-b5b1cc42-a570-495a-91df-879af404a38a tempest-CreateVolumesFromSourceVolumeTest-1622191458 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1f333bab-98c5-4baf-8f01-eee457651a64) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83259) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 15:14:55 devstack cinder-volume[83259]: DEBUG cinder.volume.manager [None req-b5b1cc42-a570-495a-91df-879af404a38a tempest-CreateVolumesFromSourceVolumeTest-1622191458 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (233f762c-9cc0-45b7-bcef-c42855ab0802) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83259) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 15:14:55 devstack cinder-volume[83259]: DEBUG cinder.volume.manager [None req-b5b1cc42-a570-495a-91df-879af404a38a tempest-CreateVolumesFromSourceVolumeTest-1622191458 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (233f762c-9cc0-45b7-bcef-c42855ab0802) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b8a6acd8-dc2e-4b1a-ad2f-35dd586f84af', 'volume_name': 'volume-b8a6acd8-dc2e-4b1a-ad2f-35dd586f84af', 'volume_size': 1}' {{(pid=83259) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 15:14:55 devstack cinder-volume[83259]: DEBUG cinder.volume.manager [None req-b5b1cc42-a570-495a-91df-879af404a38a tempest-CreateVolumesFromSourceVolumeTest-1622191458 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (73b56966-0730-4e26-9c79-0451a3669836) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83259) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 15:14:55 devstack cinder-volume[83259]: DEBUG cinder.volume.manager [None req-b5b1cc42-a570-495a-91df-879af404a38a tempest-CreateVolumesFromSourceVolumeTest-1622191458 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (73b56966-0730-4e26-9c79-0451a3669836) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83259) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 15:14:55 devstack cinder-volume[83259]: DEBUG cinder.volume.manager [None req-b5b1cc42-a570-495a-91df-879af404a38a tempest-CreateVolumesFromSourceVolumeTest-1622191458 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (05c7e970-932b-4710-9769-28c48650df45) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83259) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 15:14:55 devstack cinder-volume[83259]: INFO cinder.volume.flows.manager.create_volume [None req-b5b1cc42-a570-495a-91df-879af404a38a tempest-CreateVolumesFromSourceVolumeTest-1622191458 None] Volume b8a6acd8-dc2e-4b1a-ad2f-35dd586f84af: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b8a6acd8-dc2e-4b1a-ad2f-35dd586f84af', 'volume_size': 1} Sep 16 15:14:55 devstack cinder-volume[83259]: DEBUG oslo_concurrency.lockutils [None req-b5b1cc42-a570-495a-91df-879af404a38a tempest-CreateVolumesFromSourceVolumeTest-1622191458 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83259) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 16 15:14:55 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [None req-8b25158f-10e3-4bd2-8ed5-60d1cd83b70e tempest-CreateVolumesFromSourceVolumeTest-1622191458 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c/volume-b2a7140a-b6af-4311-8baa-9dfe356a39d8 1073741824" returned: 0 in 1.052s {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 15:14:55 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [None req-8b25158f-10e3-4bd2-8ed5-60d1cd83b70e tempest-CreateVolumesFromSourceVolumeTest-1622191458 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c/volume-b2a7140a-b6af-4311-8baa-9dfe356a39d8 {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 15:14:55 devstack cinder-volume[83259]: INFO cinder.volume.flows.manager.create_volume [None req-96b4f567-6daa-4f6b-bfec-a25bd38ff6cd tempest-CreateVolumesFromSourceVolumeTest-1622191458 None] Volume volume-6dec902f-7fb2-4a48-acd5-ffd91b801b7e (6dec902f-7fb2-4a48-acd5-ffd91b801b7e): created successfully Sep 16 15:14:56 devstack cinder-volume[83259]: DEBUG cinder.volume.manager [None req-96b4f567-6daa-4f6b-bfec-a25bd38ff6cd tempest-CreateVolumesFromSourceVolumeTest-1622191458 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (227c503e-3b6d-441b-af03-3a3dd64271e5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83259) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 15:14:56 devstack cinder-volume[83259]: DEBUG cinder.volume.manager [None req-96b4f567-6daa-4f6b-bfec-a25bd38ff6cd tempest-CreateVolumesFromSourceVolumeTest-1622191458 None] Flow 'volume_create_manager' (bbdcb268-e0c7-4db3-b811-f95cd70aa14d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83259) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 16 15:14:56 devstack cinder-volume[83259]: DEBUG cinder.volume.manager [None req-74bcbaa5-2808-4f86-9be4-44cad8d8c192 tempest-CreateVolumesFromSourceVolumeTest-1622191458 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0dc2cbc9-b242-43d4-a12a-31393ed3c0d8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-16T13:14:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-717264496',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#Quobyte',id=9e33f9a5-5184-4dc4-931c-6dfc990f4dbd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4ab98dff323744519e2ad981fe746f1a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-16T13:14:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-16T13:14:54Z,use_quota=True,user_id='1f367acea153461e8f7be852130ab0d8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(485ead50-3df8-4d76-8d34-a4db136c980a),volume_type_id=485ead50-3df8-4d76-8d34-a4db136c980a)' {{(pid=83259) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 15:14:56 devstack cinder-volume[83259]: DEBUG cinder.volume.manager [None req-74bcbaa5-2808-4f86-9be4-44cad8d8c192 tempest-CreateVolumesFromSourceVolumeTest-1622191458 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (49ac12f0-ec8d-4986-9617-65823eb90bb8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83259) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 15:14:56 devstack cinder-volume[83259]: DEBUG cinder.volume.manager [None req-74bcbaa5-2808-4f86-9be4-44cad8d8c192 tempest-CreateVolumesFromSourceVolumeTest-1622191458 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (49ac12f0-ec8d-4986-9617-65823eb90bb8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83259) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 15:14:56 devstack cinder-volume[83259]: DEBUG cinder.volume.manager [None req-74bcbaa5-2808-4f86-9be4-44cad8d8c192 tempest-CreateVolumesFromSourceVolumeTest-1622191458 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e1582a5d-82d9-4c61-a4ab-9009f7000660) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83259) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 15:14:56 devstack cinder-volume[83259]: DEBUG cinder.volume.manager [None req-74bcbaa5-2808-4f86-9be4-44cad8d8c192 tempest-CreateVolumesFromSourceVolumeTest-1622191458 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e1582a5d-82d9-4c61-a4ab-9009f7000660) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9e33f9a5-5184-4dc4-931c-6dfc990f4dbd', 'volume_name': 'volume-9e33f9a5-5184-4dc4-931c-6dfc990f4dbd', 'volume_size': 1}' {{(pid=83259) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 15:14:56 devstack cinder-volume[83259]: DEBUG cinder.volume.manager [None req-74bcbaa5-2808-4f86-9be4-44cad8d8c192 tempest-CreateVolumesFromSourceVolumeTest-1622191458 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e158c7ab-4eb3-44be-89fb-773793b83c8d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83259) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 15:14:56 devstack cinder-volume[83259]: DEBUG cinder.volume.manager [None req-74bcbaa5-2808-4f86-9be4-44cad8d8c192 tempest-CreateVolumesFromSourceVolumeTest-1622191458 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e158c7ab-4eb3-44be-89fb-773793b83c8d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83259) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 15:14:56 devstack cinder-volume[83259]: DEBUG cinder.volume.manager [None req-74bcbaa5-2808-4f86-9be4-44cad8d8c192 tempest-CreateVolumesFromSourceVolumeTest-1622191458 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3fd4dce4-551e-4a24-9a34-a3c11c4e7e8c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83259) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 15:14:56 devstack cinder-volume[83259]: INFO cinder.volume.flows.manager.create_volume [None req-74bcbaa5-2808-4f86-9be4-44cad8d8c192 tempest-CreateVolumesFromSourceVolumeTest-1622191458 None] Volume 9e33f9a5-5184-4dc4-931c-6dfc990f4dbd: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9e33f9a5-5184-4dc4-931c-6dfc990f4dbd', 'volume_size': 1} Sep 16 15:14:56 devstack cinder-volume[83259]: DEBUG oslo_concurrency.lockutils [None req-74bcbaa5-2808-4f86-9be4-44cad8d8c192 tempest-CreateVolumesFromSourceVolumeTest-1622191458 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83259) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 16 15:14:56 devstack cinder-volume[83259]: INFO cinder.volume.manager [None req-96b4f567-6daa-4f6b-bfec-a25bd38ff6cd tempest-CreateVolumesFromSourceVolumeTest-1622191458 None] Created volume successfully. Sep 16 15:14:56 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [None req-8b25158f-10e3-4bd2-8ed5-60d1cd83b70e tempest-CreateVolumesFromSourceVolumeTest-1622191458 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c/volume-b2a7140a-b6af-4311-8baa-9dfe356a39d8" returned: 0 in 0.554s {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 15:14:56 devstack cinder-volume[83259]: DEBUG cinder.volume.drivers.quobyte [None req-8b25158f-10e3-4bd2-8ed5-60d1cd83b70e tempest-CreateVolumesFromSourceVolumeTest-1622191458 None] <== create_volume: return (1630ms) {'provider_location': '10.10.41.181/cinder-vol-61f585ac-f8e2-4d19-a890-7ebc2726cc72'} {{(pid=83259) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Sep 16 15:14:56 devstack cinder-volume[83259]: DEBUG oslo_concurrency.lockutils [None req-8b25158f-10e3-4bd2-8ed5-60d1cd83b70e tempest-CreateVolumesFromSourceVolumeTest-1622191458 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.640s {{(pid=83259) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 16 15:14:56 devstack cinder-volume[83259]: DEBUG oslo_concurrency.lockutils [None req-2dcb06b2-a85e-4973-be5e-2972ab7a19fd tempest-CreateVolumesFromSourceVolumeTest-1622191458 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.691s {{(pid=83259) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 16 15:14:56 devstack cinder-volume[83259]: DEBUG cinder.volume.drivers.quobyte [None req-2dcb06b2-a85e-4973-be5e-2972ab7a19fd tempest-CreateVolumesFromSourceVolumeTest-1622191458 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-16T13:14:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1733454623',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#Quobyte',id=723c47de-82cc-4d6b-9189-8cc2d570fd8c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4ab98dff323744519e2ad981fe746f1a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-16T13:14:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-16T13:14:53Z,use_quota=True,user_id='1f367acea153461e8f7be852130ab0d8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(485ead50-3df8-4d76-8d34-a4db136c980a),volume_type_id=485ead50-3df8-4d76-8d34-a4db136c980a)}" {{(pid=83259) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Sep 16 15:14:56 devstack cinder-volume[83259]: DEBUG cinder.volume.drivers.remotefs [None req-2dcb06b2-a85e-4973-be5e-2972ab7a19fd tempest-CreateVolumesFromSourceVolumeTest-1622191458 None] Creating volume 723c47de-82cc-4d6b-9189-8cc2d570fd8c {{(pid=83259) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}} Sep 16 15:14:56 devstack cinder-volume[83259]: DEBUG oslo_concurrency.lockutils [None req-2dcb06b2-a85e-4973-be5e-2972ab7a19fd tempest-CreateVolumesFromSourceVolumeTest-1622191458 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83259) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 16 15:14:56 devstack cinder-volume[83259]: DEBUG oslo_concurrency.lockutils [None req-2dcb06b2-a85e-4973-be5e-2972ab7a19fd tempest-CreateVolumesFromSourceVolumeTest-1622191458 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83259) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 16 15:14:56 devstack cinder-volume[83259]: DEBUG cinder.volume.drivers.quobyte [None req-2dcb06b2-a85e-4973-be5e-2972ab7a19fd tempest-CreateVolumesFromSourceVolumeTest-1622191458 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-61f585ac-f8e2-4d19-a890-7ebc2726cc72': None} {{(pid=83259) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:639}} Sep 16 15:14:56 devstack cinder-volume[83259]: DEBUG cinder.volume.drivers.quobyte [None req-2dcb06b2-a85e-4973-be5e-2972ab7a19fd tempest-CreateVolumesFromSourceVolumeTest-1622191458 None] Available shares ['10.10.41.181/cinder-vol-61f585ac-f8e2-4d19-a890-7ebc2726cc72'] {{(pid=83259) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:669}} Sep 16 15:14:56 devstack cinder-volume[83259]: DEBUG oslo_concurrency.lockutils [None req-2dcb06b2-a85e-4973-be5e-2972ab7a19fd tempest-CreateVolumesFromSourceVolumeTest-1622191458 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=83259) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 16 15:14:56 devstack cinder-volume[83259]: DEBUG cinder.volume.drivers.quobyte [None req-2dcb06b2-a85e-4973-be5e-2972ab7a19fd tempest-CreateVolumesFromSourceVolumeTest-1622191458 None] Selected 10.10.41.181/cinder-vol-61f585ac-f8e2-4d19-a890-7ebc2726cc72 as target Quobyte volume. {{(pid=83259) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:690}} Sep 16 15:14:56 devstack cinder-volume[83259]: INFO cinder.volume.drivers.remotefs [None req-2dcb06b2-a85e-4973-be5e-2972ab7a19fd tempest-CreateVolumesFromSourceVolumeTest-1622191458 None] casted to 10.10.41.181/cinder-vol-61f585ac-f8e2-4d19-a890-7ebc2726cc72 Sep 16 15:14:56 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [None req-2dcb06b2-a85e-4973-be5e-2972ab7a19fd tempest-CreateVolumesFromSourceVolumeTest-1622191458 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c/volume-723c47de-82cc-4d6b-9189-8cc2d570fd8c 1073741824 {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 15:14:56 devstack quobyte-client[83286]: System call of process 96714 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 16 15:14:56 devstack quobyte-client[83286]: The server volume:87712ffe-8a69-446d-9ed6-4430c7ee9792@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=87712ffe-8a69-446d-9ed6-4430c7ee9792, inode=129, name=volume-723c47de-82cc-4d6b-9189-8cc2d570fd8c, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.206), requestorAccessMask=0 Sep 16 15:14:57 devstack cinder-volume[83259]: DEBUG cinder.volume.manager [None req-8b25158f-10e3-4bd2-8ed5-60d1cd83b70e tempest-CreateVolumesFromSourceVolumeTest-1622191458 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7789bb0e-9e6d-43c2-a65f-e8024453006d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b2a7140a-b6af-4311-8baa-9dfe356a39d8', 'volume_size': 1}' {{(pid=83259) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 15:14:57 devstack cinder-volume[83259]: DEBUG cinder.volume.manager [None req-8b25158f-10e3-4bd2-8ed5-60d1cd83b70e tempest-CreateVolumesFromSourceVolumeTest-1622191458 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e3be8a95-2aa8-417c-8145-6db6c0cb1cdf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83259) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 15:14:57 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [None req-2dcb06b2-a85e-4973-be5e-2972ab7a19fd tempest-CreateVolumesFromSourceVolumeTest-1622191458 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c/volume-723c47de-82cc-4d6b-9189-8cc2d570fd8c 1073741824" returned: 0 in 0.683s {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 15:14:57 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [None req-2dcb06b2-a85e-4973-be5e-2972ab7a19fd tempest-CreateVolumesFromSourceVolumeTest-1622191458 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c/volume-723c47de-82cc-4d6b-9189-8cc2d570fd8c {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 15:14:57 devstack cinder-volume[83259]: INFO cinder.volume.flows.manager.create_volume [None req-8b25158f-10e3-4bd2-8ed5-60d1cd83b70e tempest-CreateVolumesFromSourceVolumeTest-1622191458 None] Volume volume-b2a7140a-b6af-4311-8baa-9dfe356a39d8 (b2a7140a-b6af-4311-8baa-9dfe356a39d8): created successfully Sep 16 15:14:57 devstack cinder-volume[83259]: DEBUG cinder.volume.manager [None req-8b25158f-10e3-4bd2-8ed5-60d1cd83b70e tempest-CreateVolumesFromSourceVolumeTest-1622191458 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e3be8a95-2aa8-417c-8145-6db6c0cb1cdf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83259) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 15:14:57 devstack cinder-volume[83259]: DEBUG cinder.volume.manager [None req-8b25158f-10e3-4bd2-8ed5-60d1cd83b70e tempest-CreateVolumesFromSourceVolumeTest-1622191458 None] Flow 'volume_create_manager' (28779ff9-0bbc-4a5e-bf79-41d045304552) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83259) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 16 15:14:57 devstack cinder-volume[83259]: INFO cinder.volume.manager [None req-8b25158f-10e3-4bd2-8ed5-60d1cd83b70e tempest-CreateVolumesFromSourceVolumeTest-1622191458 None] Created volume successfully. Sep 16 15:14:57 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [None req-2dcb06b2-a85e-4973-be5e-2972ab7a19fd tempest-CreateVolumesFromSourceVolumeTest-1622191458 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c/volume-723c47de-82cc-4d6b-9189-8cc2d570fd8c" returned: 0 in 0.478s {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 15:14:57 devstack cinder-volume[83259]: DEBUG cinder.volume.drivers.quobyte [None req-2dcb06b2-a85e-4973-be5e-2972ab7a19fd tempest-CreateVolumesFromSourceVolumeTest-1622191458 None] <== create_volume: return (1193ms) {'provider_location': '10.10.41.181/cinder-vol-61f585ac-f8e2-4d19-a890-7ebc2726cc72'} {{(pid=83259) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Sep 16 15:14:57 devstack cinder-volume[83259]: DEBUG oslo_concurrency.lockutils [None req-2dcb06b2-a85e-4973-be5e-2972ab7a19fd tempest-CreateVolumesFromSourceVolumeTest-1622191458 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.207s {{(pid=83259) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 16 15:14:57 devstack cinder-volume[83259]: DEBUG oslo_concurrency.lockutils [None req-b5b1cc42-a570-495a-91df-879af404a38a tempest-CreateVolumesFromSourceVolumeTest-1622191458 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.819s {{(pid=83259) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 16 15:14:57 devstack cinder-volume[83259]: DEBUG cinder.volume.drivers.quobyte [None req-b5b1cc42-a570-495a-91df-879af404a38a tempest-CreateVolumesFromSourceVolumeTest-1622191458 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-16T13:14:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-168031180',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#Quobyte',id=b8a6acd8-dc2e-4b1a-ad2f-35dd586f84af,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4ab98dff323744519e2ad981fe746f1a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-16T13:14:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-16T13:14:54Z,use_quota=True,user_id='1f367acea153461e8f7be852130ab0d8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(485ead50-3df8-4d76-8d34-a4db136c980a),volume_type_id=485ead50-3df8-4d76-8d34-a4db136c980a)}" {{(pid=83259) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Sep 16 15:14:57 devstack cinder-volume[83259]: DEBUG cinder.volume.drivers.remotefs [None req-b5b1cc42-a570-495a-91df-879af404a38a tempest-CreateVolumesFromSourceVolumeTest-1622191458 None] Creating volume b8a6acd8-dc2e-4b1a-ad2f-35dd586f84af {{(pid=83259) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}} Sep 16 15:14:57 devstack cinder-volume[83259]: DEBUG oslo_concurrency.lockutils [None req-b5b1cc42-a570-495a-91df-879af404a38a tempest-CreateVolumesFromSourceVolumeTest-1622191458 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83259) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 16 15:14:57 devstack cinder-volume[83259]: DEBUG oslo_concurrency.lockutils [None req-b5b1cc42-a570-495a-91df-879af404a38a tempest-CreateVolumesFromSourceVolumeTest-1622191458 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.010s {{(pid=83259) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 16 15:14:57 devstack cinder-volume[83259]: DEBUG cinder.volume.drivers.quobyte [None req-b5b1cc42-a570-495a-91df-879af404a38a tempest-CreateVolumesFromSourceVolumeTest-1622191458 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-61f585ac-f8e2-4d19-a890-7ebc2726cc72': None} {{(pid=83259) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:639}} Sep 16 15:14:57 devstack cinder-volume[83259]: DEBUG cinder.volume.drivers.quobyte [None req-b5b1cc42-a570-495a-91df-879af404a38a tempest-CreateVolumesFromSourceVolumeTest-1622191458 None] Available shares ['10.10.41.181/cinder-vol-61f585ac-f8e2-4d19-a890-7ebc2726cc72'] {{(pid=83259) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:669}} Sep 16 15:14:57 devstack cinder-volume[83259]: DEBUG oslo_concurrency.lockutils [None req-b5b1cc42-a570-495a-91df-879af404a38a tempest-CreateVolumesFromSourceVolumeTest-1622191458 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.047s {{(pid=83259) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 16 15:14:57 devstack cinder-volume[83259]: DEBUG cinder.volume.drivers.quobyte [None req-b5b1cc42-a570-495a-91df-879af404a38a tempest-CreateVolumesFromSourceVolumeTest-1622191458 None] Selected 10.10.41.181/cinder-vol-61f585ac-f8e2-4d19-a890-7ebc2726cc72 as target Quobyte volume. {{(pid=83259) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:690}} Sep 16 15:14:57 devstack cinder-volume[83259]: INFO cinder.volume.drivers.remotefs [None req-b5b1cc42-a570-495a-91df-879af404a38a tempest-CreateVolumesFromSourceVolumeTest-1622191458 None] casted to 10.10.41.181/cinder-vol-61f585ac-f8e2-4d19-a890-7ebc2726cc72 Sep 16 15:14:57 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [None req-b5b1cc42-a570-495a-91df-879af404a38a tempest-CreateVolumesFromSourceVolumeTest-1622191458 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c/volume-b8a6acd8-dc2e-4b1a-ad2f-35dd586f84af 1073741824 {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 15:14:58 devstack quobyte-client[83286]: System call of process 96718 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 16 15:14:58 devstack quobyte-client[83286]: The server volume:87712ffe-8a69-446d-9ed6-4430c7ee9792@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=87712ffe-8a69-446d-9ed6-4430c7ee9792, inode=130, name=volume-b8a6acd8-dc2e-4b1a-ad2f-35dd586f84af, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.206), requestorAccessMask=0 Sep 16 15:14:58 devstack cinder-volume[83259]: DEBUG cinder.volume.manager [None req-2dcb06b2-a85e-4973-be5e-2972ab7a19fd tempest-CreateVolumesFromSourceVolumeTest-1622191458 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (97302a66-8390-4158-b9ea-63cb6dc082ee) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-723c47de-82cc-4d6b-9189-8cc2d570fd8c', 'volume_size': 1}' {{(pid=83259) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 15:14:58 devstack cinder-volume[83259]: DEBUG cinder.volume.manager [None req-2dcb06b2-a85e-4973-be5e-2972ab7a19fd tempest-CreateVolumesFromSourceVolumeTest-1622191458 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d333120f-15fd-472b-843b-09faad935c97) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83259) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 15:14:58 devstack cinder-volume[83259]: INFO cinder.volume.flows.manager.create_volume [None req-2dcb06b2-a85e-4973-be5e-2972ab7a19fd tempest-CreateVolumesFromSourceVolumeTest-1622191458 None] Volume volume-723c47de-82cc-4d6b-9189-8cc2d570fd8c (723c47de-82cc-4d6b-9189-8cc2d570fd8c): created successfully Sep 16 15:14:58 devstack cinder-volume[83259]: DEBUG cinder.volume.manager [None req-2dcb06b2-a85e-4973-be5e-2972ab7a19fd tempest-CreateVolumesFromSourceVolumeTest-1622191458 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d333120f-15fd-472b-843b-09faad935c97) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83259) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 15:14:58 devstack cinder-volume[83259]: DEBUG cinder.volume.manager [None req-2dcb06b2-a85e-4973-be5e-2972ab7a19fd tempest-CreateVolumesFromSourceVolumeTest-1622191458 None] Flow 'volume_create_manager' (5030260e-d39f-4e14-9844-b972eb88256e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83259) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 16 15:14:58 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [None req-b5b1cc42-a570-495a-91df-879af404a38a tempest-CreateVolumesFromSourceVolumeTest-1622191458 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c/volume-b8a6acd8-dc2e-4b1a-ad2f-35dd586f84af 1073741824" returned: 0 in 0.675s {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 15:14:58 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [None req-b5b1cc42-a570-495a-91df-879af404a38a tempest-CreateVolumesFromSourceVolumeTest-1622191458 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c/volume-b8a6acd8-dc2e-4b1a-ad2f-35dd586f84af {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 15:14:58 devstack cinder-volume[83259]: INFO cinder.volume.manager [None req-2dcb06b2-a85e-4973-be5e-2972ab7a19fd tempest-CreateVolumesFromSourceVolumeTest-1622191458 None] Created volume successfully. Sep 16 15:14:58 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [None req-b5b1cc42-a570-495a-91df-879af404a38a tempest-CreateVolumesFromSourceVolumeTest-1622191458 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c/volume-b8a6acd8-dc2e-4b1a-ad2f-35dd586f84af" returned: 0 in 0.412s {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 15:14:58 devstack cinder-volume[83259]: DEBUG cinder.volume.drivers.quobyte [None req-b5b1cc42-a570-495a-91df-879af404a38a tempest-CreateVolumesFromSourceVolumeTest-1622191458 None] <== create_volume: return (1178ms) {'provider_location': '10.10.41.181/cinder-vol-61f585ac-f8e2-4d19-a890-7ebc2726cc72'} {{(pid=83259) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Sep 16 15:14:58 devstack cinder-volume[83259]: DEBUG oslo_concurrency.lockutils [None req-b5b1cc42-a570-495a-91df-879af404a38a tempest-CreateVolumesFromSourceVolumeTest-1622191458 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.291s {{(pid=83259) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 16 15:14:58 devstack cinder-volume[83259]: DEBUG oslo_concurrency.lockutils [None req-74bcbaa5-2808-4f86-9be4-44cad8d8c192 tempest-CreateVolumesFromSourceVolumeTest-1622191458 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.633s {{(pid=83259) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 16 15:14:59 devstack cinder-volume[83259]: DEBUG cinder.volume.drivers.quobyte [None req-74bcbaa5-2808-4f86-9be4-44cad8d8c192 tempest-CreateVolumesFromSourceVolumeTest-1622191458 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-16T13:14:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-717264496',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#Quobyte',id=9e33f9a5-5184-4dc4-931c-6dfc990f4dbd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4ab98dff323744519e2ad981fe746f1a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-16T13:14:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-16T13:14:54Z,use_quota=True,user_id='1f367acea153461e8f7be852130ab0d8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(485ead50-3df8-4d76-8d34-a4db136c980a),volume_type_id=485ead50-3df8-4d76-8d34-a4db136c980a)}" {{(pid=83259) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Sep 16 15:14:59 devstack cinder-volume[83259]: DEBUG cinder.volume.drivers.remotefs [None req-74bcbaa5-2808-4f86-9be4-44cad8d8c192 tempest-CreateVolumesFromSourceVolumeTest-1622191458 None] Creating volume 9e33f9a5-5184-4dc4-931c-6dfc990f4dbd {{(pid=83259) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}} Sep 16 15:14:59 devstack cinder-volume[83259]: DEBUG oslo_concurrency.lockutils [None req-74bcbaa5-2808-4f86-9be4-44cad8d8c192 tempest-CreateVolumesFromSourceVolumeTest-1622191458 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83259) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 16 15:14:59 devstack cinder-volume[83259]: DEBUG oslo_concurrency.lockutils [None req-74bcbaa5-2808-4f86-9be4-44cad8d8c192 tempest-CreateVolumesFromSourceVolumeTest-1622191458 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=83259) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 16 15:14:59 devstack cinder-volume[83259]: DEBUG cinder.volume.drivers.quobyte [None req-74bcbaa5-2808-4f86-9be4-44cad8d8c192 tempest-CreateVolumesFromSourceVolumeTest-1622191458 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-61f585ac-f8e2-4d19-a890-7ebc2726cc72': None} {{(pid=83259) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:639}} Sep 16 15:14:59 devstack cinder-volume[83259]: DEBUG cinder.volume.drivers.quobyte [None req-74bcbaa5-2808-4f86-9be4-44cad8d8c192 tempest-CreateVolumesFromSourceVolumeTest-1622191458 None] Available shares ['10.10.41.181/cinder-vol-61f585ac-f8e2-4d19-a890-7ebc2726cc72'] {{(pid=83259) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:669}} Sep 16 15:14:59 devstack cinder-volume[83259]: DEBUG oslo_concurrency.lockutils [None req-74bcbaa5-2808-4f86-9be4-44cad8d8c192 tempest-CreateVolumesFromSourceVolumeTest-1622191458 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=83259) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 16 15:14:59 devstack cinder-volume[83259]: DEBUG cinder.volume.drivers.quobyte [None req-74bcbaa5-2808-4f86-9be4-44cad8d8c192 tempest-CreateVolumesFromSourceVolumeTest-1622191458 None] Selected 10.10.41.181/cinder-vol-61f585ac-f8e2-4d19-a890-7ebc2726cc72 as target Quobyte volume. {{(pid=83259) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:690}} Sep 16 15:14:59 devstack cinder-volume[83259]: INFO cinder.volume.drivers.remotefs [None req-74bcbaa5-2808-4f86-9be4-44cad8d8c192 tempest-CreateVolumesFromSourceVolumeTest-1622191458 None] casted to 10.10.41.181/cinder-vol-61f585ac-f8e2-4d19-a890-7ebc2726cc72 Sep 16 15:14:59 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [None req-74bcbaa5-2808-4f86-9be4-44cad8d8c192 tempest-CreateVolumesFromSourceVolumeTest-1622191458 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c/volume-9e33f9a5-5184-4dc4-931c-6dfc990f4dbd 1073741824 {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 15:14:59 devstack quobyte-client[83286]: The server volume:87712ffe-8a69-446d-9ed6-4430c7ee9792@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=87712ffe-8a69-446d-9ed6-4430c7ee9792, inode=131, name=volume-9e33f9a5-5184-4dc4-931c-6dfc990f4dbd, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.206), requestorAccessMask=0 Sep 16 15:14:59 devstack cinder-volume[83259]: DEBUG cinder.volume.manager [None req-b5b1cc42-a570-495a-91df-879af404a38a tempest-CreateVolumesFromSourceVolumeTest-1622191458 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (05c7e970-932b-4710-9769-28c48650df45) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b8a6acd8-dc2e-4b1a-ad2f-35dd586f84af', 'volume_size': 1}' {{(pid=83259) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 15:14:59 devstack cinder-volume[83259]: DEBUG cinder.volume.manager [None req-b5b1cc42-a570-495a-91df-879af404a38a tempest-CreateVolumesFromSourceVolumeTest-1622191458 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d812e173-3422-4053-b136-70295af49b39) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83259) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 15:14:59 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [None req-74bcbaa5-2808-4f86-9be4-44cad8d8c192 tempest-CreateVolumesFromSourceVolumeTest-1622191458 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c/volume-9e33f9a5-5184-4dc4-931c-6dfc990f4dbd 1073741824" returned: 0 in 0.826s {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 15:14:59 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [None req-74bcbaa5-2808-4f86-9be4-44cad8d8c192 tempest-CreateVolumesFromSourceVolumeTest-1622191458 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c/volume-9e33f9a5-5184-4dc4-931c-6dfc990f4dbd {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 15:15:00 devstack cinder-volume[83259]: INFO cinder.volume.flows.manager.create_volume [None req-b5b1cc42-a570-495a-91df-879af404a38a tempest-CreateVolumesFromSourceVolumeTest-1622191458 None] Volume volume-b8a6acd8-dc2e-4b1a-ad2f-35dd586f84af (b8a6acd8-dc2e-4b1a-ad2f-35dd586f84af): created successfully Sep 16 15:15:00 devstack cinder-volume[83259]: DEBUG cinder.volume.manager [None req-b5b1cc42-a570-495a-91df-879af404a38a tempest-CreateVolumesFromSourceVolumeTest-1622191458 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d812e173-3422-4053-b136-70295af49b39) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83259) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 15:15:00 devstack cinder-volume[83259]: DEBUG cinder.volume.manager [None req-b5b1cc42-a570-495a-91df-879af404a38a tempest-CreateVolumesFromSourceVolumeTest-1622191458 None] Flow 'volume_create_manager' (3e31419c-e0a5-4369-bcab-d57aa6faaeb0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83259) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 16 15:15:00 devstack cinder-volume[83259]: INFO cinder.volume.manager [None req-b5b1cc42-a570-495a-91df-879af404a38a tempest-CreateVolumesFromSourceVolumeTest-1622191458 None] Created volume successfully. Sep 16 15:15:00 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [None req-74bcbaa5-2808-4f86-9be4-44cad8d8c192 tempest-CreateVolumesFromSourceVolumeTest-1622191458 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c/volume-9e33f9a5-5184-4dc4-931c-6dfc990f4dbd" returned: 0 in 0.621s {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 15:15:00 devstack cinder-volume[83259]: DEBUG cinder.volume.drivers.quobyte [None req-74bcbaa5-2808-4f86-9be4-44cad8d8c192 tempest-CreateVolumesFromSourceVolumeTest-1622191458 None] <== create_volume: return (1501ms) {'provider_location': '10.10.41.181/cinder-vol-61f585ac-f8e2-4d19-a890-7ebc2726cc72'} {{(pid=83259) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Sep 16 15:15:00 devstack cinder-volume[83259]: DEBUG oslo_concurrency.lockutils [None req-74bcbaa5-2808-4f86-9be4-44cad8d8c192 tempest-CreateVolumesFromSourceVolumeTest-1622191458 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.531s {{(pid=83259) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 16 15:15:00 devstack cinder-volume[83259]: DEBUG cinder.volume.manager [None req-74bcbaa5-2808-4f86-9be4-44cad8d8c192 tempest-CreateVolumesFromSourceVolumeTest-1622191458 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3fd4dce4-551e-4a24-9a34-a3c11c4e7e8c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9e33f9a5-5184-4dc4-931c-6dfc990f4dbd', 'volume_size': 1}' {{(pid=83259) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 15:15:00 devstack cinder-volume[83259]: DEBUG cinder.volume.manager [None req-74bcbaa5-2808-4f86-9be4-44cad8d8c192 tempest-CreateVolumesFromSourceVolumeTest-1622191458 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7d480764-429e-4c87-b99b-81691184fe0d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83259) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 15:15:00 devstack cinder-volume[83259]: INFO cinder.volume.flows.manager.create_volume [None req-74bcbaa5-2808-4f86-9be4-44cad8d8c192 tempest-CreateVolumesFromSourceVolumeTest-1622191458 None] Volume volume-9e33f9a5-5184-4dc4-931c-6dfc990f4dbd (9e33f9a5-5184-4dc4-931c-6dfc990f4dbd): created successfully Sep 16 15:15:00 devstack cinder-volume[83259]: DEBUG cinder.volume.manager [None req-74bcbaa5-2808-4f86-9be4-44cad8d8c192 tempest-CreateVolumesFromSourceVolumeTest-1622191458 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7d480764-429e-4c87-b99b-81691184fe0d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83259) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 15:15:00 devstack cinder-volume[83259]: DEBUG cinder.volume.manager [None req-74bcbaa5-2808-4f86-9be4-44cad8d8c192 tempest-CreateVolumesFromSourceVolumeTest-1622191458 None] Flow 'volume_create_manager' (af91389e-e582-4c4f-9b02-7b1a82872fcc) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83259) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 16 15:15:00 devstack cinder-volume[83259]: INFO cinder.volume.manager [None req-74bcbaa5-2808-4f86-9be4-44cad8d8c192 tempest-CreateVolumesFromSourceVolumeTest-1622191458 None] Created volume successfully. Sep 16 15:15:01 devstack cinder-volume[83259]: DEBUG cinder.coordination [None req-a42f3bb3-3ad9-4ad1-94f4-5ddb23ed177d tempest-CreateVolumesFromSourceVolumeTest-1622191458 None] Acquiring lock "cinder-9e33f9a5-5184-4dc4-931c-6dfc990f4dbd-delete_volume" by "delete_volume" {{(pid=83259) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 16 15:15:01 devstack cinder-volume[83259]: DEBUG cinder.coordination [None req-a42f3bb3-3ad9-4ad1-94f4-5ddb23ed177d tempest-CreateVolumesFromSourceVolumeTest-1622191458 None] Lock "cinder-9e33f9a5-5184-4dc4-931c-6dfc990f4dbd-delete_volume" acquired by "delete_volume" :: waited 0.094s {{(pid=83259) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 16 15:15:01 devstack cinder-volume[83259]: WARNING cinder.volume.volume_utils [None req-a42f3bb3-3ad9-4ad1-94f4-5ddb23ed177d tempest-CreateVolumesFromSourceVolumeTest-1622191458 None] Volume driver (QuobyteDriver 1.2) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 16 15:15:01 devstack cinder-volume[83259]: DEBUG cinder.coordination [None req-a42f3bb3-3ad9-4ad1-94f4-5ddb23ed177d tempest-CreateVolumesFromSourceVolumeTest-1622191458 None] Acquiring lock "cinder-quobyte-9e33f9a5-5184-4dc4-931c-6dfc990f4dbd" by "delete_volume" {{(pid=83259) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 16 15:15:01 devstack cinder-volume[83259]: DEBUG cinder.coordination [None req-a42f3bb3-3ad9-4ad1-94f4-5ddb23ed177d tempest-CreateVolumesFromSourceVolumeTest-1622191458 None] Lock "cinder-quobyte-9e33f9a5-5184-4dc4-931c-6dfc990f4dbd" acquired by "delete_volume" :: waited 0.016s {{(pid=83259) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 16 15:15:01 devstack cinder-volume[83259]: DEBUG oslo.privsep.daemon [-] privsep: reply[71815590-ce09-4ae6-90cb-304726fc9cc6]: (4, 'qcow2') {{(pid=84312) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 16 15:15:01 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [None req-a42f3bb3-3ad9-4ad1-94f4-5ddb23ed177d tempest-CreateVolumesFromSourceVolumeTest-1622191458 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c/volume-9e33f9a5-5184-4dc4-931c-6dfc990f4dbd {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 15:15:02 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [None req-a42f3bb3-3ad9-4ad1-94f4-5ddb23ed177d tempest-CreateVolumesFromSourceVolumeTest-1622191458 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c/volume-9e33f9a5-5184-4dc4-931c-6dfc990f4dbd" returned: 0 in 0.655s {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 15:15:02 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [None req-a42f3bb3-3ad9-4ad1-94f4-5ddb23ed177d tempest-CreateVolumesFromSourceVolumeTest-1622191458 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c/volume-9e33f9a5-5184-4dc4-931c-6dfc990f4dbd {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 15:15:02 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [None req-a42f3bb3-3ad9-4ad1-94f4-5ddb23ed177d tempest-CreateVolumesFromSourceVolumeTest-1622191458 None] CMD "rm -f /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c/volume-9e33f9a5-5184-4dc4-931c-6dfc990f4dbd" returned: 0 in 0.199s {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 15:15:02 devstack cinder-volume[83259]: DEBUG cinder.coordination [None req-a42f3bb3-3ad9-4ad1-94f4-5ddb23ed177d tempest-CreateVolumesFromSourceVolumeTest-1622191458 None] Lock "cinder-quobyte-9e33f9a5-5184-4dc4-931c-6dfc990f4dbd" released by "delete_volume" :: held 1.173s {{(pid=83259) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 16 15:15:03 devstack cinder-volume[83259]: DEBUG cinder.quota [None req-a42f3bb3-3ad9-4ad1-94f4-5ddb23ed177d tempest-CreateVolumesFromSourceVolumeTest-1622191458 None] Created reservations ['8fe030c3-a337-4c02-9f32-1ae5fb6c826e', '34203932-290f-41f8-880c-3fb5886b6233', '9cd05055-e481-49f6-9bb4-7148bb6b855b', '2f689ee7-c7b7-41cf-9252-256743b54f2d'] {{(pid=83259) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 16 15:15:03 devstack cinder-volume[83259]: DEBUG oslo_concurrency.lockutils [None req-a42f3bb3-3ad9-4ad1-94f4-5ddb23ed177d tempest-CreateVolumesFromSourceVolumeTest-1622191458 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83259) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 16 15:15:03 devstack cinder-volume[83259]: DEBUG oslo_concurrency.lockutils [None req-a42f3bb3-3ad9-4ad1-94f4-5ddb23ed177d tempest-CreateVolumesFromSourceVolumeTest-1622191458 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.005s {{(pid=83259) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 16 15:15:03 devstack cinder-volume[83259]: DEBUG cinder.volume.drivers.quobyte [None req-a42f3bb3-3ad9-4ad1-94f4-5ddb23ed177d tempest-CreateVolumesFromSourceVolumeTest-1622191458 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-61f585ac-f8e2-4d19-a890-7ebc2726cc72': None} {{(pid=83259) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:639}} Sep 16 15:15:03 devstack cinder-volume[83259]: DEBUG cinder.volume.drivers.quobyte [None req-a42f3bb3-3ad9-4ad1-94f4-5ddb23ed177d tempest-CreateVolumesFromSourceVolumeTest-1622191458 None] Available shares ['10.10.41.181/cinder-vol-61f585ac-f8e2-4d19-a890-7ebc2726cc72'] {{(pid=83259) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:669}} Sep 16 15:15:03 devstack cinder-volume[83259]: DEBUG oslo_concurrency.lockutils [None req-a42f3bb3-3ad9-4ad1-94f4-5ddb23ed177d tempest-CreateVolumesFromSourceVolumeTest-1622191458 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=83259) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 16 15:15:03 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [None req-a42f3bb3-3ad9-4ad1-94f4-5ddb23ed177d tempest-CreateVolumesFromSourceVolumeTest-1622191458 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 15:15:03 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [None req-a42f3bb3-3ad9-4ad1-94f4-5ddb23ed177d tempest-CreateVolumesFromSourceVolumeTest-1622191458 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c" returned: 0 in 0.150s {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 15:15:03 devstack cinder-volume[83259]: DEBUG cinder.manager [None req-a42f3bb3-3ad9-4ad1-94f4-5ddb23ed177d tempest-CreateVolumesFromSourceVolumeTest-1622191458 None] Notifying Schedulers of capabilities ... {{(pid=83259) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 16 15:15:03 devstack cinder-volume[83259]: INFO cinder.volume.manager [None req-a42f3bb3-3ad9-4ad1-94f4-5ddb23ed177d tempest-CreateVolumesFromSourceVolumeTest-1622191458 None] Deleted volume successfully. Sep 16 15:15:04 devstack cinder-volume[83259]: DEBUG cinder.coordination [None req-8401ab31-ae16-48f5-9bb1-2d01db10ccb6 tempest-CreateVolumesFromSourceVolumeTest-1622191458 None] Acquiring lock "cinder-b8a6acd8-dc2e-4b1a-ad2f-35dd586f84af-delete_volume" by "delete_volume" {{(pid=83259) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 16 15:15:04 devstack cinder-volume[83259]: DEBUG cinder.coordination [None req-a42f3bb3-3ad9-4ad1-94f4-5ddb23ed177d tempest-CreateVolumesFromSourceVolumeTest-1622191458 None] Lock "cinder-9e33f9a5-5184-4dc4-931c-6dfc990f4dbd-delete_volume" released by "delete_volume" :: held 2.856s {{(pid=83259) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 16 15:15:04 devstack cinder-volume[83259]: DEBUG cinder.coordination [None req-8401ab31-ae16-48f5-9bb1-2d01db10ccb6 tempest-CreateVolumesFromSourceVolumeTest-1622191458 None] Lock "cinder-b8a6acd8-dc2e-4b1a-ad2f-35dd586f84af-delete_volume" acquired by "delete_volume" :: waited 0.110s {{(pid=83259) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 16 15:15:04 devstack cinder-volume[83259]: WARNING cinder.volume.volume_utils [None req-8401ab31-ae16-48f5-9bb1-2d01db10ccb6 tempest-CreateVolumesFromSourceVolumeTest-1622191458 None] Volume driver (QuobyteDriver 1.2) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 16 15:15:04 devstack cinder-volume[83259]: DEBUG cinder.coordination [None req-8401ab31-ae16-48f5-9bb1-2d01db10ccb6 tempest-CreateVolumesFromSourceVolumeTest-1622191458 None] Acquiring lock "cinder-quobyte-b8a6acd8-dc2e-4b1a-ad2f-35dd586f84af" by "delete_volume" {{(pid=83259) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 16 15:15:04 devstack cinder-volume[83259]: DEBUG cinder.coordination [None req-8401ab31-ae16-48f5-9bb1-2d01db10ccb6 tempest-CreateVolumesFromSourceVolumeTest-1622191458 None] Lock "cinder-quobyte-b8a6acd8-dc2e-4b1a-ad2f-35dd586f84af" acquired by "delete_volume" :: waited 0.011s {{(pid=83259) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 16 15:15:04 devstack cinder-volume[83259]: DEBUG oslo.privsep.daemon [-] privsep: reply[2aa468d3-c5e7-4459-a7c7-7252dcd21578]: (4, 'qcow2') {{(pid=84312) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 16 15:15:04 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [None req-8401ab31-ae16-48f5-9bb1-2d01db10ccb6 tempest-CreateVolumesFromSourceVolumeTest-1622191458 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c/volume-b8a6acd8-dc2e-4b1a-ad2f-35dd586f84af {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 15:15:05 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [None req-8401ab31-ae16-48f5-9bb1-2d01db10ccb6 tempest-CreateVolumesFromSourceVolumeTest-1622191458 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c/volume-b8a6acd8-dc2e-4b1a-ad2f-35dd586f84af" returned: 0 in 0.754s {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 15:15:05 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [None req-8401ab31-ae16-48f5-9bb1-2d01db10ccb6 tempest-CreateVolumesFromSourceVolumeTest-1622191458 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c/volume-b8a6acd8-dc2e-4b1a-ad2f-35dd586f84af {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 15:15:05 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [None req-8401ab31-ae16-48f5-9bb1-2d01db10ccb6 tempest-CreateVolumesFromSourceVolumeTest-1622191458 None] CMD "rm -f /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c/volume-b8a6acd8-dc2e-4b1a-ad2f-35dd586f84af" returned: 0 in 0.231s {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 15:15:05 devstack cinder-volume[83259]: DEBUG cinder.coordination [None req-8401ab31-ae16-48f5-9bb1-2d01db10ccb6 tempest-CreateVolumesFromSourceVolumeTest-1622191458 None] Lock "cinder-quobyte-b8a6acd8-dc2e-4b1a-ad2f-35dd586f84af" released by "delete_volume" :: held 1.219s {{(pid=83259) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 16 15:15:06 devstack cinder-volume[83259]: DEBUG cinder.quota [None req-8401ab31-ae16-48f5-9bb1-2d01db10ccb6 tempest-CreateVolumesFromSourceVolumeTest-1622191458 None] Created reservations ['110f9dd1-d5dc-426c-845e-d88eef63cf78', '12b89d2b-86fd-4db1-baca-cbece111f824', 'dffa44ab-c030-4caa-8bdb-2577b9843d7e', '68bf3a14-55fc-446c-aebb-b455bafcc279'] {{(pid=83259) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 16 15:15:06 devstack cinder-volume[83259]: DEBUG oslo_concurrency.lockutils [None req-8401ab31-ae16-48f5-9bb1-2d01db10ccb6 tempest-CreateVolumesFromSourceVolumeTest-1622191458 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83259) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 16 15:15:06 devstack cinder-volume[83259]: DEBUG oslo_concurrency.lockutils [None req-8401ab31-ae16-48f5-9bb1-2d01db10ccb6 tempest-CreateVolumesFromSourceVolumeTest-1622191458 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.005s {{(pid=83259) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 16 15:15:06 devstack cinder-volume[83259]: DEBUG cinder.volume.drivers.quobyte [None req-8401ab31-ae16-48f5-9bb1-2d01db10ccb6 tempest-CreateVolumesFromSourceVolumeTest-1622191458 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-61f585ac-f8e2-4d19-a890-7ebc2726cc72': None} {{(pid=83259) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:639}} Sep 16 15:15:06 devstack cinder-volume[83259]: DEBUG cinder.volume.drivers.quobyte [None req-8401ab31-ae16-48f5-9bb1-2d01db10ccb6 tempest-CreateVolumesFromSourceVolumeTest-1622191458 None] Available shares ['10.10.41.181/cinder-vol-61f585ac-f8e2-4d19-a890-7ebc2726cc72'] {{(pid=83259) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:669}} Sep 16 15:15:06 devstack cinder-volume[83259]: DEBUG oslo_concurrency.lockutils [None req-8401ab31-ae16-48f5-9bb1-2d01db10ccb6 tempest-CreateVolumesFromSourceVolumeTest-1622191458 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.033s {{(pid=83259) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 16 15:15:06 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [None req-8401ab31-ae16-48f5-9bb1-2d01db10ccb6 tempest-CreateVolumesFromSourceVolumeTest-1622191458 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 15:15:07 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [None req-8401ab31-ae16-48f5-9bb1-2d01db10ccb6 tempest-CreateVolumesFromSourceVolumeTest-1622191458 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c" returned: 0 in 0.325s {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 15:15:07 devstack cinder-volume[83259]: DEBUG cinder.manager [None req-8401ab31-ae16-48f5-9bb1-2d01db10ccb6 tempest-CreateVolumesFromSourceVolumeTest-1622191458 None] Notifying Schedulers of capabilities ... {{(pid=83259) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 16 15:15:07 devstack cinder-volume[83259]: INFO cinder.volume.manager [None req-8401ab31-ae16-48f5-9bb1-2d01db10ccb6 tempest-CreateVolumesFromSourceVolumeTest-1622191458 None] Deleted volume successfully. Sep 16 15:15:07 devstack cinder-volume[83259]: DEBUG cinder.coordination [None req-8401ab31-ae16-48f5-9bb1-2d01db10ccb6 tempest-CreateVolumesFromSourceVolumeTest-1622191458 None] Lock "cinder-b8a6acd8-dc2e-4b1a-ad2f-35dd586f84af-delete_volume" released by "delete_volume" :: held 3.253s {{(pid=83259) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 16 15:15:07 devstack cinder-volume[83259]: DEBUG cinder.coordination [None req-4e74efff-ee92-4481-9265-ded5cfcd4cad tempest-CreateVolumesFromSourceVolumeTest-1622191458 None] Acquiring lock "cinder-723c47de-82cc-4d6b-9189-8cc2d570fd8c-delete_volume" by "delete_volume" {{(pid=83259) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 16 15:15:07 devstack cinder-volume[83259]: DEBUG cinder.coordination [None req-4e74efff-ee92-4481-9265-ded5cfcd4cad tempest-CreateVolumesFromSourceVolumeTest-1622191458 None] Lock "cinder-723c47de-82cc-4d6b-9189-8cc2d570fd8c-delete_volume" acquired by "delete_volume" :: waited 0.146s {{(pid=83259) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 16 15:15:08 devstack cinder-volume[83259]: WARNING cinder.volume.volume_utils [None req-4e74efff-ee92-4481-9265-ded5cfcd4cad tempest-CreateVolumesFromSourceVolumeTest-1622191458 None] Volume driver (QuobyteDriver 1.2) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 16 15:15:08 devstack cinder-volume[83259]: DEBUG cinder.coordination [None req-4e74efff-ee92-4481-9265-ded5cfcd4cad tempest-CreateVolumesFromSourceVolumeTest-1622191458 None] Acquiring lock "cinder-quobyte-723c47de-82cc-4d6b-9189-8cc2d570fd8c" by "delete_volume" {{(pid=83259) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 16 15:15:08 devstack cinder-volume[83259]: DEBUG cinder.coordination [None req-4e74efff-ee92-4481-9265-ded5cfcd4cad tempest-CreateVolumesFromSourceVolumeTest-1622191458 None] Lock "cinder-quobyte-723c47de-82cc-4d6b-9189-8cc2d570fd8c" acquired by "delete_volume" :: waited 0.028s {{(pid=83259) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 16 15:15:08 devstack cinder-volume[83259]: DEBUG oslo.privsep.daemon [-] privsep: reply[70f8aab0-38e3-4e0f-b80f-ec488c2adb27]: (4, 'qcow2') {{(pid=84312) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 16 15:15:08 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [None req-4e74efff-ee92-4481-9265-ded5cfcd4cad tempest-CreateVolumesFromSourceVolumeTest-1622191458 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c/volume-723c47de-82cc-4d6b-9189-8cc2d570fd8c {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 15:15:08 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [None req-4e74efff-ee92-4481-9265-ded5cfcd4cad tempest-CreateVolumesFromSourceVolumeTest-1622191458 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c/volume-723c47de-82cc-4d6b-9189-8cc2d570fd8c" returned: 0 in 0.584s {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 15:15:08 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [None req-4e74efff-ee92-4481-9265-ded5cfcd4cad tempest-CreateVolumesFromSourceVolumeTest-1622191458 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c/volume-723c47de-82cc-4d6b-9189-8cc2d570fd8c {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 15:15:09 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [None req-4e74efff-ee92-4481-9265-ded5cfcd4cad tempest-CreateVolumesFromSourceVolumeTest-1622191458 None] CMD "rm -f /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c/volume-723c47de-82cc-4d6b-9189-8cc2d570fd8c" returned: 0 in 0.183s {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 15:15:09 devstack cinder-volume[83259]: DEBUG cinder.coordination [None req-4e74efff-ee92-4481-9265-ded5cfcd4cad tempest-CreateVolumesFromSourceVolumeTest-1622191458 None] Lock "cinder-quobyte-723c47de-82cc-4d6b-9189-8cc2d570fd8c" released by "delete_volume" :: held 1.045s {{(pid=83259) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 16 15:15:09 devstack cinder-volume[83259]: DEBUG cinder.quota [None req-4e74efff-ee92-4481-9265-ded5cfcd4cad tempest-CreateVolumesFromSourceVolumeTest-1622191458 None] Created reservations ['b5f7bd3f-a584-426e-8ed1-e02a0acaf853', '839a3746-66fa-4e53-87b0-add9aa699f8b', '5bff1be1-9378-40f9-a6bd-d55a5d0f3c9a', '3e930401-e34c-4b28-be9f-b5932a95232b'] {{(pid=83259) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 16 15:15:09 devstack cinder-volume[83259]: WARNING cinder.volume.volume_utils [None req-c92cb2c4-816b-42e1-b9b7-37ad443fa979 tempest-TestInstancesWithCinderVolumes-1096446095 None] Volume driver (QuobyteDriver 1.2) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 16 15:15:10 devstack cinder-volume[83259]: DEBUG cinder.volume.flows.manager.create_volume [None req-c92cb2c4-816b-42e1-b9b7-37ad443fa979 tempest-TestInstancesWithCinderVolumes-1096446095 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#Quobyte'], 'hosts': ['devstack@QuobyteHD#Quobyte']} {{(pid=83259) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1387}} Sep 16 15:15:10 devstack cinder-volume[83259]: DEBUG cinder.volume.manager [None req-c92cb2c4-816b-42e1-b9b7-37ad443fa979 tempest-TestInstancesWithCinderVolumes-1096446095 None] Flow 'volume_create_manager' (ff3d48b9-4267-4295-8705-42b975669c1e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83259) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 16 15:15:10 devstack cinder-volume[83259]: DEBUG cinder.volume.manager [None req-c92cb2c4-816b-42e1-b9b7-37ad443fa979 tempest-TestInstancesWithCinderVolumes-1096446095 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (35398984-87f7-4bc7-9344-e287c9dd7b5e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83259) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 15:15:10 devstack cinder-volume[83259]: DEBUG cinder.volume.manager [None req-c92cb2c4-816b-42e1-b9b7-37ad443fa979 tempest-TestInstancesWithCinderVolumes-1096446095 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (35398984-87f7-4bc7-9344-e287c9dd7b5e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-16T13:15:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-1110577882',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#Quobyte',id=3999b191-d35b-4005-b1c8-34819dec9799,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='de0e15312a36448cb4bd348b6865ab9c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-16T13:15:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-16T13:15:10Z,use_quota=True,user_id='c175c709abb142329cb0dd1bfec5e203',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e21c92ee-e129-4a80-9598-d6d1a1530df6),volume_type_id=e21c92ee-e129-4a80-9598-d6d1a1530df6)' {{(pid=83259) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 15:15:10 devstack cinder-volume[83259]: DEBUG cinder.volume.manager [None req-c92cb2c4-816b-42e1-b9b7-37ad443fa979 tempest-TestInstancesWithCinderVolumes-1096446095 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (12c5494a-add7-47be-ac83-6a9919e5ea19) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83259) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 15:15:10 devstack cinder-volume[83259]: DEBUG cinder.volume.manager [None req-c92cb2c4-816b-42e1-b9b7-37ad443fa979 tempest-TestInstancesWithCinderVolumes-1096446095 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (12c5494a-add7-47be-ac83-6a9919e5ea19) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83259) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 15:15:10 devstack cinder-volume[83259]: DEBUG cinder.volume.manager [None req-c92cb2c4-816b-42e1-b9b7-37ad443fa979 tempest-TestInstancesWithCinderVolumes-1096446095 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a08cbbd2-f288-4ef4-a4dc-68e9fd8feea0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83259) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 15:15:10 devstack cinder-volume[83259]: DEBUG cinder.volume.manager [None req-c92cb2c4-816b-42e1-b9b7-37ad443fa979 tempest-TestInstancesWithCinderVolumes-1096446095 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a08cbbd2-f288-4ef4-a4dc-68e9fd8feea0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3999b191-d35b-4005-b1c8-34819dec9799', 'volume_name': 'volume-3999b191-d35b-4005-b1c8-34819dec9799', 'volume_size': 1}' {{(pid=83259) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 15:15:10 devstack cinder-volume[83259]: DEBUG cinder.volume.manager [None req-c92cb2c4-816b-42e1-b9b7-37ad443fa979 tempest-TestInstancesWithCinderVolumes-1096446095 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6af649de-84ca-430b-bb72-460f1b934d85) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83259) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 15:15:10 devstack cinder-volume[83259]: DEBUG cinder.volume.manager [None req-c92cb2c4-816b-42e1-b9b7-37ad443fa979 tempest-TestInstancesWithCinderVolumes-1096446095 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6af649de-84ca-430b-bb72-460f1b934d85) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83259) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 15:15:10 devstack cinder-volume[83259]: DEBUG cinder.volume.manager [None req-c92cb2c4-816b-42e1-b9b7-37ad443fa979 tempest-TestInstancesWithCinderVolumes-1096446095 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (af4756c2-342c-4eb7-a135-538725147a14) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83259) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 15:15:10 devstack cinder-volume[83259]: INFO cinder.volume.flows.manager.create_volume [None req-c92cb2c4-816b-42e1-b9b7-37ad443fa979 tempest-TestInstancesWithCinderVolumes-1096446095 None] Volume 3999b191-d35b-4005-b1c8-34819dec9799: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3999b191-d35b-4005-b1c8-34819dec9799', 'volume_size': 1} Sep 16 15:15:10 devstack cinder-volume[83259]: DEBUG oslo_concurrency.lockutils [None req-c92cb2c4-816b-42e1-b9b7-37ad443fa979 tempest-TestInstancesWithCinderVolumes-1096446095 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83259) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 16 15:15:10 devstack cinder-volume[83259]: DEBUG oslo_concurrency.lockutils [None req-c92cb2c4-816b-42e1-b9b7-37ad443fa979 tempest-TestInstancesWithCinderVolumes-1096446095 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.003s {{(pid=83259) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 16 15:15:10 devstack cinder-volume[83259]: DEBUG cinder.volume.drivers.quobyte [None req-c92cb2c4-816b-42e1-b9b7-37ad443fa979 tempest-TestInstancesWithCinderVolumes-1096446095 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-16T13:15:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-1110577882',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#Quobyte',id=3999b191-d35b-4005-b1c8-34819dec9799,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='de0e15312a36448cb4bd348b6865ab9c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-16T13:15:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-16T13:15:10Z,use_quota=True,user_id='c175c709abb142329cb0dd1bfec5e203',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e21c92ee-e129-4a80-9598-d6d1a1530df6),volume_type_id=e21c92ee-e129-4a80-9598-d6d1a1530df6)}" {{(pid=83259) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Sep 16 15:15:10 devstack cinder-volume[83259]: DEBUG cinder.volume.drivers.remotefs [None req-c92cb2c4-816b-42e1-b9b7-37ad443fa979 tempest-TestInstancesWithCinderVolumes-1096446095 None] Creating volume 3999b191-d35b-4005-b1c8-34819dec9799 {{(pid=83259) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}} Sep 16 15:15:10 devstack cinder-volume[83259]: DEBUG oslo_concurrency.lockutils [None req-c92cb2c4-816b-42e1-b9b7-37ad443fa979 tempest-TestInstancesWithCinderVolumes-1096446095 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83259) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 16 15:15:10 devstack cinder-volume[83259]: DEBUG oslo_concurrency.lockutils [None req-c92cb2c4-816b-42e1-b9b7-37ad443fa979 tempest-TestInstancesWithCinderVolumes-1096446095 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83259) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 16 15:15:10 devstack cinder-volume[83259]: DEBUG cinder.volume.drivers.quobyte [None req-c92cb2c4-816b-42e1-b9b7-37ad443fa979 tempest-TestInstancesWithCinderVolumes-1096446095 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-61f585ac-f8e2-4d19-a890-7ebc2726cc72': None} {{(pid=83259) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:639}} Sep 16 15:15:10 devstack cinder-volume[83259]: DEBUG cinder.volume.drivers.quobyte [None req-c92cb2c4-816b-42e1-b9b7-37ad443fa979 tempest-TestInstancesWithCinderVolumes-1096446095 None] Available shares ['10.10.41.181/cinder-vol-61f585ac-f8e2-4d19-a890-7ebc2726cc72'] {{(pid=83259) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:669}} Sep 16 15:15:10 devstack cinder-volume[83259]: DEBUG oslo_concurrency.lockutils [None req-c92cb2c4-816b-42e1-b9b7-37ad443fa979 tempest-TestInstancesWithCinderVolumes-1096446095 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=83259) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 16 15:15:10 devstack cinder-volume[83259]: DEBUG cinder.volume.drivers.quobyte [None req-c92cb2c4-816b-42e1-b9b7-37ad443fa979 tempest-TestInstancesWithCinderVolumes-1096446095 None] Selected 10.10.41.181/cinder-vol-61f585ac-f8e2-4d19-a890-7ebc2726cc72 as target Quobyte volume. {{(pid=83259) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:690}} Sep 16 15:15:10 devstack cinder-volume[83259]: INFO cinder.volume.drivers.remotefs [None req-c92cb2c4-816b-42e1-b9b7-37ad443fa979 tempest-TestInstancesWithCinderVolumes-1096446095 None] casted to 10.10.41.181/cinder-vol-61f585ac-f8e2-4d19-a890-7ebc2726cc72 Sep 16 15:15:10 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [None req-c92cb2c4-816b-42e1-b9b7-37ad443fa979 tempest-TestInstancesWithCinderVolumes-1096446095 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c/volume-3999b191-d35b-4005-b1c8-34819dec9799 1073741824 {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 15:15:10 devstack quobyte-client[83286]: The server volume:87712ffe-8a69-446d-9ed6-4430c7ee9792@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=87712ffe-8a69-446d-9ed6-4430c7ee9792, inode=132, name=volume-3999b191-d35b-4005-b1c8-34819dec9799, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.206), requestorAccessMask=0 Sep 16 15:15:10 devstack cinder-volume[83259]: DEBUG oslo_concurrency.lockutils [None req-4e74efff-ee92-4481-9265-ded5cfcd4cad tempest-CreateVolumesFromSourceVolumeTest-1622191458 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83259) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 16 15:15:10 devstack cinder-volume[83259]: DEBUG oslo_concurrency.lockutils [None req-4e74efff-ee92-4481-9265-ded5cfcd4cad tempest-CreateVolumesFromSourceVolumeTest-1622191458 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.131s {{(pid=83259) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 16 15:15:10 devstack cinder-volume[83259]: DEBUG cinder.volume.drivers.quobyte [None req-4e74efff-ee92-4481-9265-ded5cfcd4cad tempest-CreateVolumesFromSourceVolumeTest-1622191458 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-61f585ac-f8e2-4d19-a890-7ebc2726cc72': None} {{(pid=83259) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:639}} Sep 16 15:15:10 devstack cinder-volume[83259]: DEBUG cinder.volume.drivers.quobyte [None req-4e74efff-ee92-4481-9265-ded5cfcd4cad tempest-CreateVolumesFromSourceVolumeTest-1622191458 None] Available shares ['10.10.41.181/cinder-vol-61f585ac-f8e2-4d19-a890-7ebc2726cc72'] {{(pid=83259) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:669}} Sep 16 15:15:10 devstack cinder-volume[83259]: DEBUG oslo_concurrency.lockutils [None req-4e74efff-ee92-4481-9265-ded5cfcd4cad tempest-CreateVolumesFromSourceVolumeTest-1622191458 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.060s {{(pid=83259) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 16 15:15:10 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [None req-4e74efff-ee92-4481-9265-ded5cfcd4cad tempest-CreateVolumesFromSourceVolumeTest-1622191458 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 15:15:11 devstack cinder-volume[83259]: DEBUG cinder.coordination [None req-162ccabd-0046-49dc-bd2c-99961f05748f tempest-CreateVolumesFromSourceVolumeTest-1622191458 None] Acquiring lock "cinder-b2a7140a-b6af-4311-8baa-9dfe356a39d8-delete_volume" by "delete_volume" {{(pid=83259) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 16 15:15:11 devstack cinder-volume[83259]: WARNING cinder.volume.volume_utils [None req-362b8905-63ed-469e-8d23-7031c5a936dc tempest-TestInstancesWithCinderVolumes-1096446095 None] Volume driver (QuobyteDriver 1.2) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 16 15:15:11 devstack cinder-volume[83259]: DEBUG cinder.volume.flows.manager.create_volume [None req-362b8905-63ed-469e-8d23-7031c5a936dc tempest-TestInstancesWithCinderVolumes-1096446095 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#Quobyte'], 'hosts': ['devstack@QuobyteHD#Quobyte']} {{(pid=83259) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1387}} Sep 16 15:15:12 devstack cinder-volume[83259]: DEBUG cinder.volume.manager [None req-362b8905-63ed-469e-8d23-7031c5a936dc tempest-TestInstancesWithCinderVolumes-1096446095 None] Flow 'volume_create_manager' (952b944a-56cc-403f-9727-18237bff40e6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83259) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 16 15:15:12 devstack cinder-volume[83259]: DEBUG cinder.volume.manager [None req-362b8905-63ed-469e-8d23-7031c5a936dc tempest-TestInstancesWithCinderVolumes-1096446095 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1ec4d1c7-c17c-4691-80e9-840315a0cf60) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83259) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 15:15:12 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [None req-c92cb2c4-816b-42e1-b9b7-37ad443fa979 tempest-TestInstancesWithCinderVolumes-1096446095 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c/volume-3999b191-d35b-4005-b1c8-34819dec9799 1073741824" returned: 0 in 1.989s {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 15:15:12 devstack cinder-volume[83259]: DEBUG cinder.coordination [None req-162ccabd-0046-49dc-bd2c-99961f05748f tempest-CreateVolumesFromSourceVolumeTest-1622191458 None] Lock "cinder-b2a7140a-b6af-4311-8baa-9dfe356a39d8-delete_volume" acquired by "delete_volume" :: waited 0.875s {{(pid=83259) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 16 15:15:12 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [None req-4e74efff-ee92-4481-9265-ded5cfcd4cad tempest-CreateVolumesFromSourceVolumeTest-1622191458 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c" returned: 0 in 1.367s {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 15:15:12 devstack cinder-volume[83259]: DEBUG cinder.volume.manager [None req-362b8905-63ed-469e-8d23-7031c5a936dc tempest-TestInstancesWithCinderVolumes-1096446095 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1ec4d1c7-c17c-4691-80e9-840315a0cf60) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-16T13:15:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-481088795',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#Quobyte',id=2832e9fc-26a2-4ace-967d-64fcf9d41fb0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='de0e15312a36448cb4bd348b6865ab9c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-16T13:15:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-16T13:15:11Z,use_quota=True,user_id='c175c709abb142329cb0dd1bfec5e203',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(84a37720-c548-4bb5-9da8-02eb8f3b78b9),volume_type_id=84a37720-c548-4bb5-9da8-02eb8f3b78b9)' {{(pid=83259) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 15:15:12 devstack cinder-volume[83259]: DEBUG cinder.volume.manager [None req-362b8905-63ed-469e-8d23-7031c5a936dc tempest-TestInstancesWithCinderVolumes-1096446095 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1f66c2f5-b1a6-4344-b559-ff8c8b67ea41) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83259) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 15:15:12 devstack cinder-volume[83259]: DEBUG cinder.volume.manager [None req-362b8905-63ed-469e-8d23-7031c5a936dc tempest-TestInstancesWithCinderVolumes-1096446095 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1f66c2f5-b1a6-4344-b559-ff8c8b67ea41) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83259) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 15:15:12 devstack cinder-volume[83259]: DEBUG cinder.volume.manager [None req-362b8905-63ed-469e-8d23-7031c5a936dc tempest-TestInstancesWithCinderVolumes-1096446095 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a1e9343f-9642-4ded-90cc-c55b21fccee7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83259) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 15:15:12 devstack cinder-volume[83259]: DEBUG cinder.volume.manager [None req-362b8905-63ed-469e-8d23-7031c5a936dc tempest-TestInstancesWithCinderVolumes-1096446095 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a1e9343f-9642-4ded-90cc-c55b21fccee7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2832e9fc-26a2-4ace-967d-64fcf9d41fb0', 'volume_name': 'volume-2832e9fc-26a2-4ace-967d-64fcf9d41fb0', 'volume_size': 1}' {{(pid=83259) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 15:15:12 devstack cinder-volume[83259]: DEBUG cinder.volume.manager [None req-362b8905-63ed-469e-8d23-7031c5a936dc tempest-TestInstancesWithCinderVolumes-1096446095 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3e3234fc-5c40-42bf-be5a-b64948e360ea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83259) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 15:15:12 devstack cinder-volume[83259]: DEBUG cinder.volume.manager [None req-362b8905-63ed-469e-8d23-7031c5a936dc tempest-TestInstancesWithCinderVolumes-1096446095 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3e3234fc-5c40-42bf-be5a-b64948e360ea) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83259) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 15:15:12 devstack cinder-volume[83259]: DEBUG cinder.volume.manager [None req-362b8905-63ed-469e-8d23-7031c5a936dc tempest-TestInstancesWithCinderVolumes-1096446095 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3e78b174-3764-4a7a-824f-2fb4dd4b608a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83259) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 15:15:12 devstack cinder-volume[83259]: INFO cinder.volume.flows.manager.create_volume [None req-362b8905-63ed-469e-8d23-7031c5a936dc tempest-TestInstancesWithCinderVolumes-1096446095 None] Volume 2832e9fc-26a2-4ace-967d-64fcf9d41fb0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2832e9fc-26a2-4ace-967d-64fcf9d41fb0', 'volume_size': 1} Sep 16 15:15:12 devstack cinder-volume[83259]: DEBUG oslo_concurrency.lockutils [None req-362b8905-63ed-469e-8d23-7031c5a936dc tempest-TestInstancesWithCinderVolumes-1096446095 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83259) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 16 15:15:12 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [None req-c92cb2c4-816b-42e1-b9b7-37ad443fa979 tempest-TestInstancesWithCinderVolumes-1096446095 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c/volume-3999b191-d35b-4005-b1c8-34819dec9799 {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 15:15:12 devstack cinder-volume[83259]: DEBUG cinder.manager [None req-4e74efff-ee92-4481-9265-ded5cfcd4cad tempest-CreateVolumesFromSourceVolumeTest-1622191458 None] Notifying Schedulers of capabilities ... {{(pid=83259) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 16 15:15:12 devstack cinder-volume[83259]: INFO cinder.volume.manager [None req-4e74efff-ee92-4481-9265-ded5cfcd4cad tempest-CreateVolumesFromSourceVolumeTest-1622191458 None] Deleted volume successfully. Sep 16 15:15:12 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [None req-c92cb2c4-816b-42e1-b9b7-37ad443fa979 tempest-TestInstancesWithCinderVolumes-1096446095 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c/volume-3999b191-d35b-4005-b1c8-34819dec9799" returned: 0 in 0.630s {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 15:15:12 devstack cinder-volume[83259]: DEBUG cinder.volume.drivers.quobyte [None req-c92cb2c4-816b-42e1-b9b7-37ad443fa979 tempest-TestInstancesWithCinderVolumes-1096446095 None] <== create_volume: return (2727ms) {'provider_location': '10.10.41.181/cinder-vol-61f585ac-f8e2-4d19-a890-7ebc2726cc72'} {{(pid=83259) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Sep 16 15:15:12 devstack cinder-volume[83259]: DEBUG oslo_concurrency.lockutils [None req-c92cb2c4-816b-42e1-b9b7-37ad443fa979 tempest-TestInstancesWithCinderVolumes-1096446095 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.734s {{(pid=83259) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 16 15:15:12 devstack cinder-volume[83259]: WARNING cinder.volume.volume_utils [None req-95824d49-845b-43aa-96da-bb9689cc20c4 tempest-TestInstancesWithCinderVolumes-1096446095 None] Volume driver (QuobyteDriver 1.2) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 16 15:15:12 devstack cinder-volume[83259]: DEBUG cinder.volume.flows.manager.create_volume [None req-95824d49-845b-43aa-96da-bb9689cc20c4 tempest-TestInstancesWithCinderVolumes-1096446095 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#Quobyte'], 'hosts': ['devstack@QuobyteHD#Quobyte']} {{(pid=83259) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1387}} Sep 16 15:15:13 devstack cinder-volume[83259]: DEBUG cinder.volume.manager [None req-95824d49-845b-43aa-96da-bb9689cc20c4 tempest-TestInstancesWithCinderVolumes-1096446095 None] Flow 'volume_create_manager' (9a025f2e-665f-4289-bbc8-8ca044f2a8a1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83259) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 16 15:15:13 devstack cinder-volume[83259]: DEBUG cinder.volume.manager [None req-95824d49-845b-43aa-96da-bb9689cc20c4 tempest-TestInstancesWithCinderVolumes-1096446095 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (98eaa4b9-5ee8-462a-971e-c1855e537f20) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83259) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 15:15:13 devstack cinder-volume[83259]: WARNING cinder.volume.volume_utils [None req-162ccabd-0046-49dc-bd2c-99961f05748f tempest-CreateVolumesFromSourceVolumeTest-1622191458 None] Volume driver (QuobyteDriver 1.2) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 16 15:15:13 devstack cinder-volume[83259]: DEBUG cinder.coordination [None req-162ccabd-0046-49dc-bd2c-99961f05748f tempest-CreateVolumesFromSourceVolumeTest-1622191458 None] Acquiring lock "cinder-quobyte-b2a7140a-b6af-4311-8baa-9dfe356a39d8" by "delete_volume" {{(pid=83259) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 16 15:15:13 devstack cinder-volume[83259]: DEBUG cinder.coordination [None req-4e74efff-ee92-4481-9265-ded5cfcd4cad tempest-CreateVolumesFromSourceVolumeTest-1622191458 None] Lock "cinder-723c47de-82cc-4d6b-9189-8cc2d570fd8c-delete_volume" released by "delete_volume" :: held 5.156s {{(pid=83259) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 16 15:15:13 devstack cinder-volume[83259]: DEBUG oslo_concurrency.lockutils [None req-362b8905-63ed-469e-8d23-7031c5a936dc tempest-TestInstancesWithCinderVolumes-1096446095 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.805s {{(pid=83259) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 16 15:15:13 devstack cinder-volume[83259]: DEBUG cinder.volume.drivers.quobyte [None req-362b8905-63ed-469e-8d23-7031c5a936dc tempest-TestInstancesWithCinderVolumes-1096446095 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-16T13:15:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-481088795',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#Quobyte',id=2832e9fc-26a2-4ace-967d-64fcf9d41fb0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='de0e15312a36448cb4bd348b6865ab9c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-16T13:15:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-16T13:15:11Z,use_quota=True,user_id='c175c709abb142329cb0dd1bfec5e203',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(84a37720-c548-4bb5-9da8-02eb8f3b78b9),volume_type_id=84a37720-c548-4bb5-9da8-02eb8f3b78b9)}" {{(pid=83259) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Sep 16 15:15:13 devstack cinder-volume[83259]: DEBUG cinder.volume.drivers.remotefs [None req-362b8905-63ed-469e-8d23-7031c5a936dc tempest-TestInstancesWithCinderVolumes-1096446095 None] Creating volume 2832e9fc-26a2-4ace-967d-64fcf9d41fb0 {{(pid=83259) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}} Sep 16 15:15:13 devstack cinder-volume[83259]: DEBUG oslo_concurrency.lockutils [None req-362b8905-63ed-469e-8d23-7031c5a936dc tempest-TestInstancesWithCinderVolumes-1096446095 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83259) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 16 15:15:13 devstack cinder-volume[83259]: DEBUG oslo_concurrency.lockutils [None req-362b8905-63ed-469e-8d23-7031c5a936dc tempest-TestInstancesWithCinderVolumes-1096446095 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83259) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 16 15:15:13 devstack cinder-volume[83259]: DEBUG cinder.volume.drivers.quobyte [None req-362b8905-63ed-469e-8d23-7031c5a936dc tempest-TestInstancesWithCinderVolumes-1096446095 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-61f585ac-f8e2-4d19-a890-7ebc2726cc72': None} {{(pid=83259) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:639}} Sep 16 15:15:13 devstack cinder-volume[83259]: DEBUG cinder.volume.drivers.quobyte [None req-362b8905-63ed-469e-8d23-7031c5a936dc tempest-TestInstancesWithCinderVolumes-1096446095 None] Available shares ['10.10.41.181/cinder-vol-61f585ac-f8e2-4d19-a890-7ebc2726cc72'] {{(pid=83259) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:669}} Sep 16 15:15:13 devstack cinder-volume[83259]: DEBUG oslo_concurrency.lockutils [None req-362b8905-63ed-469e-8d23-7031c5a936dc tempest-TestInstancesWithCinderVolumes-1096446095 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=83259) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 16 15:15:13 devstack cinder-volume[83259]: DEBUG cinder.volume.drivers.quobyte [None req-362b8905-63ed-469e-8d23-7031c5a936dc tempest-TestInstancesWithCinderVolumes-1096446095 None] Selected 10.10.41.181/cinder-vol-61f585ac-f8e2-4d19-a890-7ebc2726cc72 as target Quobyte volume. {{(pid=83259) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:690}} Sep 16 15:15:13 devstack cinder-volume[83259]: INFO cinder.volume.drivers.remotefs [None req-362b8905-63ed-469e-8d23-7031c5a936dc tempest-TestInstancesWithCinderVolumes-1096446095 None] casted to 10.10.41.181/cinder-vol-61f585ac-f8e2-4d19-a890-7ebc2726cc72 Sep 16 15:15:13 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [None req-362b8905-63ed-469e-8d23-7031c5a936dc tempest-TestInstancesWithCinderVolumes-1096446095 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c/volume-2832e9fc-26a2-4ace-967d-64fcf9d41fb0 1073741824 {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 15:15:13 devstack quobyte-client[83286]: The server volume:87712ffe-8a69-446d-9ed6-4430c7ee9792@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=87712ffe-8a69-446d-9ed6-4430c7ee9792, inode=133, name=volume-2832e9fc-26a2-4ace-967d-64fcf9d41fb0, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.206), requestorAccessMask=0 Sep 16 15:15:13 devstack cinder-volume[83259]: DEBUG cinder.volume.manager [None req-95824d49-845b-43aa-96da-bb9689cc20c4 tempest-TestInstancesWithCinderVolumes-1096446095 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (98eaa4b9-5ee8-462a-971e-c1855e537f20) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-16T13:15:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-2045133207',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#Quobyte',id=fe0a6272-f5d7-45de-8211-43dcdab851c8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='de0e15312a36448cb4bd348b6865ab9c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-16T13:15:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-16T13:15:12Z,use_quota=True,user_id='c175c709abb142329cb0dd1bfec5e203',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8c9a1630-c25d-4df1-b70d-4a323efa68a3),volume_type_id=8c9a1630-c25d-4df1-b70d-4a323efa68a3)' {{(pid=83259) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 15:15:13 devstack cinder-volume[83259]: DEBUG cinder.volume.manager [None req-95824d49-845b-43aa-96da-bb9689cc20c4 tempest-TestInstancesWithCinderVolumes-1096446095 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (273ef2c8-4bc7-497d-8009-23748c00ef13) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83259) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 15:15:13 devstack cinder-volume[83259]: DEBUG cinder.volume.manager [None req-95824d49-845b-43aa-96da-bb9689cc20c4 tempest-TestInstancesWithCinderVolumes-1096446095 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (273ef2c8-4bc7-497d-8009-23748c00ef13) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83259) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 15:15:13 devstack cinder-volume[83259]: DEBUG cinder.volume.manager [None req-95824d49-845b-43aa-96da-bb9689cc20c4 tempest-TestInstancesWithCinderVolumes-1096446095 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cadccf36-9a50-4518-b76e-43d068a5784a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83259) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 15:15:13 devstack cinder-volume[83259]: DEBUG cinder.image.glance [None req-95824d49-845b-43aa-96da-bb9689cc20c4 tempest-TestInstancesWithCinderVolumes-1096446095 None] Creating Keystone auth plugin from conf {{(pid=83259) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:128}} Sep 16 15:15:13 devstack cinder-volume[83259]: DEBUG cinder.volume.manager [None req-c92cb2c4-816b-42e1-b9b7-37ad443fa979 tempest-TestInstancesWithCinderVolumes-1096446095 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (af4756c2-342c-4eb7-a135-538725147a14) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3999b191-d35b-4005-b1c8-34819dec9799', 'volume_size': 1}' {{(pid=83259) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 15:15:13 devstack cinder-volume[83259]: DEBUG cinder.volume.manager [None req-c92cb2c4-816b-42e1-b9b7-37ad443fa979 tempest-TestInstancesWithCinderVolumes-1096446095 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c9535e28-8ee4-4ede-bf77-6435b50eeb4e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83259) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 15:15:13 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [None req-362b8905-63ed-469e-8d23-7031c5a936dc tempest-TestInstancesWithCinderVolumes-1096446095 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c/volume-2832e9fc-26a2-4ace-967d-64fcf9d41fb0 1073741824" returned: 0 in 0.679s {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 15:15:13 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [None req-362b8905-63ed-469e-8d23-7031c5a936dc tempest-TestInstancesWithCinderVolumes-1096446095 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c/volume-2832e9fc-26a2-4ace-967d-64fcf9d41fb0 {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 15:15:14 devstack cinder-volume[83259]: DEBUG cinder.coordination [None req-162ccabd-0046-49dc-bd2c-99961f05748f tempest-CreateVolumesFromSourceVolumeTest-1622191458 None] Lock "cinder-quobyte-b2a7140a-b6af-4311-8baa-9dfe356a39d8" acquired by "delete_volume" :: waited 0.903s {{(pid=83259) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 16 15:15:14 devstack cinder-volume[83259]: INFO cinder.volume.flows.manager.create_volume [None req-c92cb2c4-816b-42e1-b9b7-37ad443fa979 tempest-TestInstancesWithCinderVolumes-1096446095 None] Volume volume-3999b191-d35b-4005-b1c8-34819dec9799 (3999b191-d35b-4005-b1c8-34819dec9799): created successfully Sep 16 15:15:14 devstack cinder-volume[83259]: DEBUG cinder.volume.manager [None req-c92cb2c4-816b-42e1-b9b7-37ad443fa979 tempest-TestInstancesWithCinderVolumes-1096446095 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c9535e28-8ee4-4ede-bf77-6435b50eeb4e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83259) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 15:15:14 devstack cinder-volume[83259]: DEBUG cinder.volume.manager [None req-c92cb2c4-816b-42e1-b9b7-37ad443fa979 tempest-TestInstancesWithCinderVolumes-1096446095 None] Flow 'volume_create_manager' (ff3d48b9-4267-4295-8705-42b975669c1e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83259) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 16 15:15:14 devstack cinder-volume[83259]: DEBUG oslo.privsep.daemon [-] privsep: reply[e11a1c47-4036-47ce-820b-552488c386a8]: (4, 'qcow2') {{(pid=84312) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 16 15:15:14 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [None req-162ccabd-0046-49dc-bd2c-99961f05748f tempest-CreateVolumesFromSourceVolumeTest-1622191458 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c/volume-b2a7140a-b6af-4311-8baa-9dfe356a39d8 {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 15:15:14 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [None req-362b8905-63ed-469e-8d23-7031c5a936dc tempest-TestInstancesWithCinderVolumes-1096446095 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c/volume-2832e9fc-26a2-4ace-967d-64fcf9d41fb0" returned: 0 in 0.960s {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 15:15:14 devstack cinder-volume[83259]: INFO cinder.volume.manager [None req-c92cb2c4-816b-42e1-b9b7-37ad443fa979 tempest-TestInstancesWithCinderVolumes-1096446095 None] Created volume successfully. Sep 16 15:15:14 devstack cinder-volume[83259]: DEBUG cinder.volume.drivers.quobyte [None req-362b8905-63ed-469e-8d23-7031c5a936dc tempest-TestInstancesWithCinderVolumes-1096446095 None] <== create_volume: return (1746ms) {'provider_location': '10.10.41.181/cinder-vol-61f585ac-f8e2-4d19-a890-7ebc2726cc72'} {{(pid=83259) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Sep 16 15:15:14 devstack cinder-volume[83259]: DEBUG oslo_concurrency.lockutils [None req-362b8905-63ed-469e-8d23-7031c5a936dc tempest-TestInstancesWithCinderVolumes-1096446095 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.756s {{(pid=83259) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 16 15:15:14 devstack cinder-volume[83259]: DEBUG cinder.volume.manager [None req-362b8905-63ed-469e-8d23-7031c5a936dc tempest-TestInstancesWithCinderVolumes-1096446095 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3e78b174-3764-4a7a-824f-2fb4dd4b608a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2832e9fc-26a2-4ace-967d-64fcf9d41fb0', 'volume_size': 1}' {{(pid=83259) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 15:15:15 devstack cinder-volume[83259]: DEBUG cinder.volume.manager [None req-362b8905-63ed-469e-8d23-7031c5a936dc tempest-TestInstancesWithCinderVolumes-1096446095 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8e1500ff-14e3-4dc8-85f1-041282974129) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83259) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 15:15:15 devstack cinder-volume[83259]: DEBUG cinder.volume.manager [None req-95824d49-845b-43aa-96da-bb9689cc20c4 tempest-TestInstancesWithCinderVolumes-1096446095 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cadccf36-9a50-4518-b76e-43d068a5784a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'fe0a6272-f5d7-45de-8211-43dcdab851c8', 'volume_name': 'volume-fe0a6272-f5d7-45de-8211-43dcdab851c8', 'volume_size': 1, 'image_id': '2ad9fbf6-87ee-42d2-8aa6-f59a2ce6caa6', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/2ad9fbf6-87ee-42d2-8aa6-f59a2ce6caa6', 'metadata': {}}]), 'image_meta': {'name': 'tempest-scenario-img--1800543744', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'private', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'de0e15312a36448cb4bd348b6865ab9c', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '2ad9fbf6-87ee-42d2-8aa6-f59a2ce6caa6', 'created_at': datetime.datetime(2025, 9, 16, 13, 15, 5, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2025, 9, 16, 13, 15, 8, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/2ad9fbf6-87ee-42d2-8aa6-f59a2ce6caa6/file', 'properties': {}}, 'image_service': }' {{(pid=83259) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 15:15:15 devstack cinder-volume[83259]: DEBUG cinder.volume.manager [None req-95824d49-845b-43aa-96da-bb9689cc20c4 tempest-TestInstancesWithCinderVolumes-1096446095 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4b330c55-f936-4a9e-bc53-a882ef753a06) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83259) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 15:15:15 devstack cinder-volume[83259]: DEBUG cinder.volume.manager [None req-95824d49-845b-43aa-96da-bb9689cc20c4 tempest-TestInstancesWithCinderVolumes-1096446095 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4b330c55-f936-4a9e-bc53-a882ef753a06) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83259) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 15:15:15 devstack cinder-volume[83259]: DEBUG cinder.volume.manager [None req-95824d49-845b-43aa-96da-bb9689cc20c4 tempest-TestInstancesWithCinderVolumes-1096446095 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0117ff14-91da-499e-b23b-02ef8d666022) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83259) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 15:15:15 devstack cinder-volume[83259]: INFO cinder.volume.flows.manager.create_volume [None req-95824d49-845b-43aa-96da-bb9689cc20c4 tempest-TestInstancesWithCinderVolumes-1096446095 None] Volume fe0a6272-f5d7-45de-8211-43dcdab851c8: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-fe0a6272-f5d7-45de-8211-43dcdab851c8', 'volume_size': 1, 'image_id': '2ad9fbf6-87ee-42d2-8aa6-f59a2ce6caa6', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/2ad9fbf6-87ee-42d2-8aa6-f59a2ce6caa6', 'metadata': {}}]), 'image_meta': {'name': 'tempest-scenario-img--1800543744', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'private', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'de0e15312a36448cb4bd348b6865ab9c', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '2ad9fbf6-87ee-42d2-8aa6-f59a2ce6caa6', 'created_at': datetime.datetime(2025, 9, 16, 13, 15, 5, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2025, 9, 16, 13, 15, 8, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/2ad9fbf6-87ee-42d2-8aa6-f59a2ce6caa6/file', 'properties': {}}, 'image_service': } Sep 16 15:15:15 devstack cinder-volume[83259]: DEBUG cinder.volume.flows.manager.create_volume [None req-95824d49-845b-43aa-96da-bb9689cc20c4 tempest-TestInstancesWithCinderVolumes-1096446095 None] Cloning fe0a6272-f5d7-45de-8211-43dcdab851c8 from image 2ad9fbf6-87ee-42d2-8aa6-f59a2ce6caa6 at location (None, [{'url': 'file:///opt/stack/data/glance/images/2ad9fbf6-87ee-42d2-8aa6-f59a2ce6caa6', 'metadata': {}}]). {{(pid=83259) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1085}} Sep 16 15:15:15 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [None req-162ccabd-0046-49dc-bd2c-99961f05748f tempest-CreateVolumesFromSourceVolumeTest-1622191458 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c/volume-b2a7140a-b6af-4311-8baa-9dfe356a39d8" returned: 0 in 0.809s {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 15:15:15 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [None req-162ccabd-0046-49dc-bd2c-99961f05748f tempest-CreateVolumesFromSourceVolumeTest-1622191458 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c/volume-b2a7140a-b6af-4311-8baa-9dfe356a39d8 {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 15:15:15 devstack cinder-volume[83259]: INFO cinder.volume.flows.manager.create_volume [None req-362b8905-63ed-469e-8d23-7031c5a936dc tempest-TestInstancesWithCinderVolumes-1096446095 None] Volume volume-2832e9fc-26a2-4ace-967d-64fcf9d41fb0 (2832e9fc-26a2-4ace-967d-64fcf9d41fb0): created successfully Sep 16 15:15:15 devstack cinder-volume[83259]: DEBUG cinder.volume.manager [None req-362b8905-63ed-469e-8d23-7031c5a936dc tempest-TestInstancesWithCinderVolumes-1096446095 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8e1500ff-14e3-4dc8-85f1-041282974129) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83259) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 15:15:15 devstack cinder-volume[83259]: DEBUG cinder.volume.manager [None req-362b8905-63ed-469e-8d23-7031c5a936dc tempest-TestInstancesWithCinderVolumes-1096446095 None] Flow 'volume_create_manager' (952b944a-56cc-403f-9727-18237bff40e6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83259) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 16 15:15:15 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [None req-162ccabd-0046-49dc-bd2c-99961f05748f tempest-CreateVolumesFromSourceVolumeTest-1622191458 None] CMD "rm -f /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c/volume-b2a7140a-b6af-4311-8baa-9dfe356a39d8" returned: 0 in 0.461s {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 15:15:15 devstack cinder-volume[83259]: DEBUG cinder.coordination [None req-162ccabd-0046-49dc-bd2c-99961f05748f tempest-CreateVolumesFromSourceVolumeTest-1622191458 None] Lock "cinder-quobyte-b2a7140a-b6af-4311-8baa-9dfe356a39d8" released by "delete_volume" :: held 1.751s {{(pid=83259) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 16 15:15:15 devstack cinder-volume[83259]: INFO cinder.volume.manager [None req-362b8905-63ed-469e-8d23-7031c5a936dc tempest-TestInstancesWithCinderVolumes-1096446095 None] Created volume successfully. Sep 16 15:15:15 devstack cinder-volume[83259]: DEBUG cinder.quota [None req-162ccabd-0046-49dc-bd2c-99961f05748f tempest-CreateVolumesFromSourceVolumeTest-1622191458 None] Created reservations ['c3822355-bc4d-4a52-b3d5-0dd5f01af28c', 'ef90c778-a09f-4366-943f-e3749bab74bb', '2be2b3f5-d0d6-4512-8783-eaea5bd8ff03', '4e3dec20-ff8f-474f-b38d-b7f762045241'] {{(pid=83259) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 16 15:15:16 devstack cinder-volume[83259]: DEBUG oslo_concurrency.lockutils [None req-162ccabd-0046-49dc-bd2c-99961f05748f tempest-CreateVolumesFromSourceVolumeTest-1622191458 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83259) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 16 15:15:16 devstack cinder-volume[83259]: DEBUG oslo_concurrency.lockutils [None req-162ccabd-0046-49dc-bd2c-99961f05748f tempest-CreateVolumesFromSourceVolumeTest-1622191458 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.005s {{(pid=83259) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 16 15:15:16 devstack cinder-volume[83259]: DEBUG cinder.volume.drivers.quobyte [None req-162ccabd-0046-49dc-bd2c-99961f05748f tempest-CreateVolumesFromSourceVolumeTest-1622191458 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-61f585ac-f8e2-4d19-a890-7ebc2726cc72': None} {{(pid=83259) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:639}} Sep 16 15:15:16 devstack cinder-volume[83259]: DEBUG cinder.volume.drivers.quobyte [None req-162ccabd-0046-49dc-bd2c-99961f05748f tempest-CreateVolumesFromSourceVolumeTest-1622191458 None] Available shares ['10.10.41.181/cinder-vol-61f585ac-f8e2-4d19-a890-7ebc2726cc72'] {{(pid=83259) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:669}} Sep 16 15:15:16 devstack cinder-volume[83259]: DEBUG oslo_concurrency.lockutils [None req-162ccabd-0046-49dc-bd2c-99961f05748f tempest-CreateVolumesFromSourceVolumeTest-1622191458 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=83259) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 16 15:15:16 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [None req-162ccabd-0046-49dc-bd2c-99961f05748f tempest-CreateVolumesFromSourceVolumeTest-1622191458 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 15:15:16 devstack cinder-volume[83259]: DEBUG cinder.coordination [None req-05b23f32-97ff-47f4-9409-0292b7489e95 tempest-CreateVolumesFromSourceVolumeTest-1622191458 None] Acquiring lock "cinder-6dec902f-7fb2-4a48-acd5-ffd91b801b7e-delete_volume" by "delete_volume" {{(pid=83259) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 16 15:15:16 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [None req-162ccabd-0046-49dc-bd2c-99961f05748f tempest-CreateVolumesFromSourceVolumeTest-1622191458 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c" returned: 0 in 0.436s {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 15:15:16 devstack cinder-volume[83259]: DEBUG cinder.manager [None req-162ccabd-0046-49dc-bd2c-99961f05748f tempest-CreateVolumesFromSourceVolumeTest-1622191458 None] Notifying Schedulers of capabilities ... {{(pid=83259) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 16 15:15:16 devstack cinder-volume[83259]: INFO cinder.volume.manager [None req-162ccabd-0046-49dc-bd2c-99961f05748f tempest-CreateVolumesFromSourceVolumeTest-1622191458 None] Deleted volume successfully. Sep 16 15:15:16 devstack cinder-volume[83259]: DEBUG cinder.coordination [None req-05b23f32-97ff-47f4-9409-0292b7489e95 tempest-CreateVolumesFromSourceVolumeTest-1622191458 None] Lock "cinder-6dec902f-7fb2-4a48-acd5-ffd91b801b7e-delete_volume" acquired by "delete_volume" :: waited 0.288s {{(pid=83259) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 16 15:15:16 devstack cinder-volume[83259]: DEBUG cinder.coordination [None req-162ccabd-0046-49dc-bd2c-99961f05748f tempest-CreateVolumesFromSourceVolumeTest-1622191458 None] Lock "cinder-b2a7140a-b6af-4311-8baa-9dfe356a39d8-delete_volume" released by "delete_volume" :: held 4.629s {{(pid=83259) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 16 15:15:16 devstack cinder-volume[83259]: WARNING cinder.volume.volume_utils [None req-05b23f32-97ff-47f4-9409-0292b7489e95 tempest-CreateVolumesFromSourceVolumeTest-1622191458 None] Volume driver (QuobyteDriver 1.2) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 16 15:15:16 devstack cinder-volume[83259]: DEBUG cinder.coordination [None req-05b23f32-97ff-47f4-9409-0292b7489e95 tempest-CreateVolumesFromSourceVolumeTest-1622191458 None] Acquiring lock "cinder-quobyte-6dec902f-7fb2-4a48-acd5-ffd91b801b7e" by "delete_volume" {{(pid=83259) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 16 15:15:17 devstack cinder-volume[83259]: DEBUG cinder.coordination [None req-05b23f32-97ff-47f4-9409-0292b7489e95 tempest-CreateVolumesFromSourceVolumeTest-1622191458 None] Lock "cinder-quobyte-6dec902f-7fb2-4a48-acd5-ffd91b801b7e" acquired by "delete_volume" :: waited 0.018s {{(pid=83259) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 16 15:15:17 devstack cinder-volume[83259]: DEBUG oslo.privsep.daemon [-] privsep: reply[1758b210-71e1-4f7d-9797-ef1c3b97daed]: (4, 'qcow2') {{(pid=84312) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 16 15:15:17 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [None req-05b23f32-97ff-47f4-9409-0292b7489e95 tempest-CreateVolumesFromSourceVolumeTest-1622191458 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c/volume-6dec902f-7fb2-4a48-acd5-ffd91b801b7e {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 15:15:17 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [None req-05b23f32-97ff-47f4-9409-0292b7489e95 tempest-CreateVolumesFromSourceVolumeTest-1622191458 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c/volume-6dec902f-7fb2-4a48-acd5-ffd91b801b7e" returned: 0 in 0.552s {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 15:15:17 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [None req-05b23f32-97ff-47f4-9409-0292b7489e95 tempest-CreateVolumesFromSourceVolumeTest-1622191458 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c/volume-6dec902f-7fb2-4a48-acd5-ffd91b801b7e {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 15:15:17 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [None req-05b23f32-97ff-47f4-9409-0292b7489e95 tempest-CreateVolumesFromSourceVolumeTest-1622191458 None] CMD "rm -f /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c/volume-6dec902f-7fb2-4a48-acd5-ffd91b801b7e" returned: 0 in 0.143s {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 15:15:17 devstack cinder-volume[83259]: DEBUG cinder.coordination [None req-05b23f32-97ff-47f4-9409-0292b7489e95 tempest-CreateVolumesFromSourceVolumeTest-1622191458 None] Lock "cinder-quobyte-6dec902f-7fb2-4a48-acd5-ffd91b801b7e" released by "delete_volume" :: held 0.895s {{(pid=83259) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 16 15:15:18 devstack cinder-volume[83259]: DEBUG cinder.quota [None req-05b23f32-97ff-47f4-9409-0292b7489e95 tempest-CreateVolumesFromSourceVolumeTest-1622191458 None] Created reservations ['7fe9b4d7-6e7e-4e56-a94e-cacceba3cd40', '2b8105c6-c643-42ef-9152-016ffa6aadce', 'b365c195-cc9a-488f-901f-f041cfb28ffb', '87614ac1-1e50-4c14-919e-e16c27eaa865'] {{(pid=83259) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 16 15:15:18 devstack cinder-volume[83259]: DEBUG oslo_concurrency.lockutils [None req-05b23f32-97ff-47f4-9409-0292b7489e95 tempest-CreateVolumesFromSourceVolumeTest-1622191458 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83259) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 16 15:15:18 devstack cinder-volume[83259]: DEBUG oslo_concurrency.lockutils [None req-05b23f32-97ff-47f4-9409-0292b7489e95 tempest-CreateVolumesFromSourceVolumeTest-1622191458 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.006s {{(pid=83259) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 16 15:15:18 devstack cinder-volume[83259]: DEBUG cinder.volume.drivers.quobyte [None req-05b23f32-97ff-47f4-9409-0292b7489e95 tempest-CreateVolumesFromSourceVolumeTest-1622191458 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-61f585ac-f8e2-4d19-a890-7ebc2726cc72': None} {{(pid=83259) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:639}} Sep 16 15:15:18 devstack cinder-volume[83259]: DEBUG cinder.volume.drivers.quobyte [None req-05b23f32-97ff-47f4-9409-0292b7489e95 tempest-CreateVolumesFromSourceVolumeTest-1622191458 None] Available shares ['10.10.41.181/cinder-vol-61f585ac-f8e2-4d19-a890-7ebc2726cc72'] {{(pid=83259) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:669}} Sep 16 15:15:18 devstack cinder-volume[83259]: DEBUG oslo_concurrency.lockutils [None req-05b23f32-97ff-47f4-9409-0292b7489e95 tempest-CreateVolumesFromSourceVolumeTest-1622191458 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=83259) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 16 15:15:18 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [None req-05b23f32-97ff-47f4-9409-0292b7489e95 tempest-CreateVolumesFromSourceVolumeTest-1622191458 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 15:15:18 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [None req-05b23f32-97ff-47f4-9409-0292b7489e95 tempest-CreateVolumesFromSourceVolumeTest-1622191458 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c" returned: 0 in 0.232s {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 15:15:18 devstack cinder-volume[83259]: DEBUG cinder.manager [None req-05b23f32-97ff-47f4-9409-0292b7489e95 tempest-CreateVolumesFromSourceVolumeTest-1622191458 None] Notifying Schedulers of capabilities ... {{(pid=83259) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 16 15:15:18 devstack cinder-volume[83259]: INFO cinder.volume.manager [None req-05b23f32-97ff-47f4-9409-0292b7489e95 tempest-CreateVolumesFromSourceVolumeTest-1622191458 None] Deleted volume successfully. Sep 16 15:15:19 devstack cinder-volume[83259]: DEBUG cinder.coordination [None req-6fef4498-f863-43e0-b62f-568fff53dbc6 tempest-CreateVolumesFromSourceVolumeTest-1622191458 None] Acquiring lock "cinder-94915b2a-94e2-4d7d-9c16-d1d687f6f99d-delete_volume" by "delete_volume" {{(pid=83259) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 16 15:15:19 devstack cinder-volume[83259]: DEBUG cinder.coordination [None req-6fef4498-f863-43e0-b62f-568fff53dbc6 tempest-CreateVolumesFromSourceVolumeTest-1622191458 None] Lock "cinder-94915b2a-94e2-4d7d-9c16-d1d687f6f99d-delete_volume" acquired by "delete_volume" :: waited 0.074s {{(pid=83259) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 16 15:15:19 devstack cinder-volume[83259]: DEBUG cinder.coordination [None req-05b23f32-97ff-47f4-9409-0292b7489e95 tempest-CreateVolumesFromSourceVolumeTest-1622191458 None] Lock "cinder-6dec902f-7fb2-4a48-acd5-ffd91b801b7e-delete_volume" released by "delete_volume" :: held 2.409s {{(pid=83259) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 16 15:15:19 devstack cinder-volume[83259]: WARNING cinder.volume.volume_utils [None req-6fef4498-f863-43e0-b62f-568fff53dbc6 tempest-CreateVolumesFromSourceVolumeTest-1622191458 None] Volume driver (QuobyteDriver 1.2) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 16 15:15:19 devstack cinder-volume[83259]: DEBUG cinder.coordination [None req-6fef4498-f863-43e0-b62f-568fff53dbc6 tempest-CreateVolumesFromSourceVolumeTest-1622191458 None] Acquiring lock "cinder-quobyte-94915b2a-94e2-4d7d-9c16-d1d687f6f99d" by "delete_volume" {{(pid=83259) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 16 15:15:19 devstack cinder-volume[83259]: DEBUG cinder.coordination [None req-6fef4498-f863-43e0-b62f-568fff53dbc6 tempest-CreateVolumesFromSourceVolumeTest-1622191458 None] Lock "cinder-quobyte-94915b2a-94e2-4d7d-9c16-d1d687f6f99d" acquired by "delete_volume" :: waited 0.018s {{(pid=83259) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 16 15:15:19 devstack cinder-volume[83259]: DEBUG oslo.privsep.daemon [-] privsep: reply[c5cfa4f6-d322-4978-b449-516d2dd0c82c]: (4, 'qcow2') {{(pid=84312) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 16 15:15:19 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [None req-6fef4498-f863-43e0-b62f-568fff53dbc6 tempest-CreateVolumesFromSourceVolumeTest-1622191458 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c/volume-94915b2a-94e2-4d7d-9c16-d1d687f6f99d {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 15:15:20 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [None req-6fef4498-f863-43e0-b62f-568fff53dbc6 tempest-CreateVolumesFromSourceVolumeTest-1622191458 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c/volume-94915b2a-94e2-4d7d-9c16-d1d687f6f99d" returned: 0 in 0.474s {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 15:15:20 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [None req-6fef4498-f863-43e0-b62f-568fff53dbc6 tempest-CreateVolumesFromSourceVolumeTest-1622191458 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c/volume-94915b2a-94e2-4d7d-9c16-d1d687f6f99d {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 15:15:20 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [None req-6fef4498-f863-43e0-b62f-568fff53dbc6 tempest-CreateVolumesFromSourceVolumeTest-1622191458 None] CMD "rm -f /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c/volume-94915b2a-94e2-4d7d-9c16-d1d687f6f99d" returned: 0 in 0.152s {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 15:15:20 devstack cinder-volume[83259]: DEBUG cinder.coordination [None req-6fef4498-f863-43e0-b62f-568fff53dbc6 tempest-CreateVolumesFromSourceVolumeTest-1622191458 None] Lock "cinder-quobyte-94915b2a-94e2-4d7d-9c16-d1d687f6f99d" released by "delete_volume" :: held 0.850s {{(pid=83259) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 16 15:15:20 devstack cinder-volume[83259]: DEBUG cinder.quota [None req-6fef4498-f863-43e0-b62f-568fff53dbc6 tempest-CreateVolumesFromSourceVolumeTest-1622191458 None] Created reservations ['5a9d74e6-1dbc-40f4-b792-302748e75e20', '54bce912-b9f5-4f7b-aed2-4c814ab0f8df', 'a863cbb7-abc5-4aac-baf9-f15f5c46ccee', '293cb324-79b4-430f-abda-c6e92205a6ee'] {{(pid=83259) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 16 15:15:20 devstack cinder-volume[83259]: DEBUG oslo_concurrency.lockutils [None req-6fef4498-f863-43e0-b62f-568fff53dbc6 tempest-CreateVolumesFromSourceVolumeTest-1622191458 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83259) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 16 15:15:20 devstack cinder-volume[83259]: DEBUG oslo_concurrency.lockutils [None req-6fef4498-f863-43e0-b62f-568fff53dbc6 tempest-CreateVolumesFromSourceVolumeTest-1622191458 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=83259) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 16 15:15:20 devstack cinder-volume[83259]: DEBUG cinder.volume.drivers.quobyte [None req-6fef4498-f863-43e0-b62f-568fff53dbc6 tempest-CreateVolumesFromSourceVolumeTest-1622191458 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-61f585ac-f8e2-4d19-a890-7ebc2726cc72': None} {{(pid=83259) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:639}} Sep 16 15:15:20 devstack cinder-volume[83259]: DEBUG cinder.volume.drivers.quobyte [None req-6fef4498-f863-43e0-b62f-568fff53dbc6 tempest-CreateVolumesFromSourceVolumeTest-1622191458 None] Available shares ['10.10.41.181/cinder-vol-61f585ac-f8e2-4d19-a890-7ebc2726cc72'] {{(pid=83259) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:669}} Sep 16 15:15:20 devstack cinder-volume[83259]: DEBUG oslo_concurrency.lockutils [None req-6fef4498-f863-43e0-b62f-568fff53dbc6 tempest-CreateVolumesFromSourceVolumeTest-1622191458 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=83259) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 16 15:15:20 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [None req-6fef4498-f863-43e0-b62f-568fff53dbc6 tempest-CreateVolumesFromSourceVolumeTest-1622191458 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 15:15:20 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [None req-6fef4498-f863-43e0-b62f-568fff53dbc6 tempest-CreateVolumesFromSourceVolumeTest-1622191458 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c" returned: 0 in 0.116s {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 15:15:20 devstack cinder-volume[83259]: DEBUG cinder.manager [None req-6fef4498-f863-43e0-b62f-568fff53dbc6 tempest-CreateVolumesFromSourceVolumeTest-1622191458 None] Notifying Schedulers of capabilities ... {{(pid=83259) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 16 15:15:21 devstack cinder-volume[83259]: INFO cinder.volume.manager [None req-6fef4498-f863-43e0-b62f-568fff53dbc6 tempest-CreateVolumesFromSourceVolumeTest-1622191458 None] Deleted volume successfully. Sep 16 15:15:21 devstack cinder-volume[83259]: DEBUG cinder.coordination [None req-6fef4498-f863-43e0-b62f-568fff53dbc6 tempest-CreateVolumesFromSourceVolumeTest-1622191458 None] Lock "cinder-94915b2a-94e2-4d7d-9c16-d1d687f6f99d-delete_volume" released by "delete_volume" :: held 2.113s {{(pid=83259) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 16 15:15:22 devstack cinder-volume[83259]: DEBUG cinder.image.image_utils [None req-95824d49-845b-43aa-96da-bb9689cc20c4 tempest-TestInstancesWithCinderVolumes-1096446095 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_2ad9fbf6-87ee-42d2-8aa6-f59a2ce6caa6_ivejyxw8devstack@QuobyteHD, size 20.69 MB, duration 6.87 sec {{(pid=83259) fetch /opt/stack/cinder/cinder/image/image_utils.py:700}} Sep 16 15:15:22 devstack cinder-volume[83259]: INFO cinder.image.image_utils [None req-95824d49-845b-43aa-96da-bb9689cc20c4 tempest-TestInstancesWithCinderVolumes-1096446095 None] Image download 20.69 MB at 3.01 MB/s Sep 16 15:15:22 devstack cinder-volume[83259]: DEBUG oslo.privsep.daemon [-] privsep: reply[e2f369be-c462-4d4a-a288-6a511d11791d]: (4, 'qcow2') {{(pid=84312) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 16 15:15:22 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [None req-95824d49-845b-43aa-96da-bb9689cc20c4 tempest-TestInstancesWithCinderVolumes-1096446095 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_2ad9fbf6-87ee-42d2-8aa6-f59a2ce6caa6_ivejyxw8devstack@QuobyteHD {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 15:15:22 devstack sudo[96767]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_2ad9fbf6-87ee-42d2-8aa6-f59a2ce6caa6_ivejyxw8devstack@QuobyteHD Sep 16 15:15:22 devstack sudo[96767]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 15:15:24 devstack sudo[96767]: pam_unix(sudo:session): session closed for user root Sep 16 15:15:24 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [None req-95824d49-845b-43aa-96da-bb9689cc20c4 tempest-TestInstancesWithCinderVolumes-1096446095 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_2ad9fbf6-87ee-42d2-8aa6-f59a2ce6caa6_ivejyxw8devstack@QuobyteHD" returned: 0 in 2.631s {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 15:15:24 devstack cinder-volume[83259]: DEBUG cinder.image.image_utils [None req-95824d49-845b-43aa-96da-bb9689cc20c4 tempest-TestInstancesWithCinderVolumes-1096446095 None] Temporary image 2ad9fbf6-87ee-42d2-8aa6-f59a2ce6caa6 is fetched for user c175c709abb142329cb0dd1bfec5e203. {{(pid=83259) fetch /opt/stack/cinder/cinder/image/image_utils.py:1399}} Sep 16 15:15:25 devstack cinder-volume[83259]: DEBUG oslo.privsep.daemon [-] privsep: reply[2a2eb43f-0df5-4666-9c46-b023bdb2dfad]: (4, 'qcow2') {{(pid=84312) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 16 15:15:25 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [None req-95824d49-845b-43aa-96da-bb9689cc20c4 tempest-TestInstancesWithCinderVolumes-1096446095 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_2ad9fbf6-87ee-42d2-8aa6-f59a2ce6caa6_ivejyxw8devstack@QuobyteHD {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 15:15:26 devstack sudo[96773]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_2ad9fbf6-87ee-42d2-8aa6-f59a2ce6caa6_ivejyxw8devstack@QuobyteHD Sep 16 15:15:26 devstack sudo[96773]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 15:15:27 devstack cinder-volume[83259]: WARNING cinder.volume.volume_utils [None req-5ca17990-3389-4694-9145-929e77cc566f tempest-CinderUnicodeTest-1125298232 None] Volume driver (QuobyteDriver 1.2) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 16 15:15:27 devstack cinder-volume[83259]: DEBUG cinder.volume.flows.manager.create_volume [None req-5ca17990-3389-4694-9145-929e77cc566f tempest-CinderUnicodeTest-1125298232 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#Quobyte'], 'hosts': ['devstack@QuobyteHD#Quobyte']} {{(pid=83259) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1387}} Sep 16 15:15:27 devstack cinder-volume[83259]: DEBUG cinder.volume.manager [None req-5ca17990-3389-4694-9145-929e77cc566f tempest-CinderUnicodeTest-1125298232 None] Flow 'volume_create_manager' (bd9cfc41-46b0-4bb4-b349-3f4ecd76017b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83259) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 16 15:15:27 devstack cinder-volume[83259]: DEBUG cinder.volume.manager [None req-5ca17990-3389-4694-9145-929e77cc566f tempest-CinderUnicodeTest-1125298232 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (228696bc-ec7f-48c6-aa4a-c57ef92e682d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83259) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 15:15:27 devstack cinder-volume[83259]: DEBUG cinder.volume.manager [None req-5ca17990-3389-4694-9145-929e77cc566f tempest-CinderUnicodeTest-1125298232 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (228696bc-ec7f-48c6-aa4a-c57ef92e682d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-16T13:15:26Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#Quobyte',id=5c7afb33-bbdf-4a4f-a240-6071d3810533,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f67355a3cedd4e6789e66a6c960a67f6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-16T13:15:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-16T13:15:26Z,use_quota=True,user_id='0d609211cc40478393c02ebf47968807',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(485ead50-3df8-4d76-8d34-a4db136c980a),volume_type_id=485ead50-3df8-4d76-8d34-a4db136c980a)' {{(pid=83259) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 15:15:27 devstack cinder-volume[83259]: DEBUG cinder.volume.manager [None req-5ca17990-3389-4694-9145-929e77cc566f tempest-CinderUnicodeTest-1125298232 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4fc0e819-0898-45d9-a9c4-3b3d907351f0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83259) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 15:15:27 devstack cinder-volume[83259]: DEBUG cinder.volume.manager [None req-5ca17990-3389-4694-9145-929e77cc566f tempest-CinderUnicodeTest-1125298232 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4fc0e819-0898-45d9-a9c4-3b3d907351f0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83259) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 15:15:27 devstack cinder-volume[83259]: DEBUG cinder.volume.manager [None req-5ca17990-3389-4694-9145-929e77cc566f tempest-CinderUnicodeTest-1125298232 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (594131ee-44e8-4edf-803b-c600b2f4c5a5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83259) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 15:15:27 devstack cinder-volume[83259]: DEBUG cinder.volume.manager [None req-5ca17990-3389-4694-9145-929e77cc566f tempest-CinderUnicodeTest-1125298232 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (594131ee-44e8-4edf-803b-c600b2f4c5a5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5c7afb33-bbdf-4a4f-a240-6071d3810533', 'volume_name': 'volume-5c7afb33-bbdf-4a4f-a240-6071d3810533', 'volume_size': 1}' {{(pid=83259) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 15:15:27 devstack cinder-volume[83259]: DEBUG cinder.volume.manager [None req-5ca17990-3389-4694-9145-929e77cc566f tempest-CinderUnicodeTest-1125298232 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bd61b436-76a8-4da9-965f-10f05d237fcd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83259) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 15:15:27 devstack cinder-volume[83259]: DEBUG cinder.volume.manager [None req-5ca17990-3389-4694-9145-929e77cc566f tempest-CinderUnicodeTest-1125298232 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bd61b436-76a8-4da9-965f-10f05d237fcd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83259) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 15:15:27 devstack cinder-volume[83259]: DEBUG cinder.volume.manager [None req-5ca17990-3389-4694-9145-929e77cc566f tempest-CinderUnicodeTest-1125298232 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (21f9978a-b25a-4303-b2b7-be694ae30074) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83259) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 15:15:27 devstack cinder-volume[83259]: INFO cinder.volume.flows.manager.create_volume [None req-5ca17990-3389-4694-9145-929e77cc566f tempest-CinderUnicodeTest-1125298232 None] Volume 5c7afb33-bbdf-4a4f-a240-6071d3810533: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5c7afb33-bbdf-4a4f-a240-6071d3810533', 'volume_size': 1} Sep 16 15:15:27 devstack cinder-volume[83259]: DEBUG oslo_concurrency.lockutils [None req-5ca17990-3389-4694-9145-929e77cc566f tempest-CinderUnicodeTest-1125298232 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83259) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 16 15:15:27 devstack cinder-volume[83259]: DEBUG oslo_concurrency.lockutils [None req-5ca17990-3389-4694-9145-929e77cc566f tempest-CinderUnicodeTest-1125298232 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.004s {{(pid=83259) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 16 15:15:27 devstack cinder-volume[83259]: DEBUG cinder.volume.drivers.quobyte [None req-5ca17990-3389-4694-9145-929e77cc566f tempest-CinderUnicodeTest-1125298232 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-16T13:15:26Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#Quobyte',id=5c7afb33-bbdf-4a4f-a240-6071d3810533,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f67355a3cedd4e6789e66a6c960a67f6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-16T13:15:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-16T13:15:26Z,use_quota=True,user_id='0d609211cc40478393c02ebf47968807',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(485ead50-3df8-4d76-8d34-a4db136c980a),volume_type_id=485ead50-3df8-4d76-8d34-a4db136c980a)}" {{(pid=83259) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Sep 16 15:15:27 devstack cinder-volume[83259]: DEBUG cinder.volume.drivers.remotefs [None req-5ca17990-3389-4694-9145-929e77cc566f tempest-CinderUnicodeTest-1125298232 None] Creating volume 5c7afb33-bbdf-4a4f-a240-6071d3810533 {{(pid=83259) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}} Sep 16 15:15:27 devstack cinder-volume[83259]: DEBUG oslo_concurrency.lockutils [None req-5ca17990-3389-4694-9145-929e77cc566f tempest-CinderUnicodeTest-1125298232 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83259) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 16 15:15:27 devstack cinder-volume[83259]: DEBUG oslo_concurrency.lockutils [None req-5ca17990-3389-4694-9145-929e77cc566f tempest-CinderUnicodeTest-1125298232 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83259) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 16 15:15:27 devstack cinder-volume[83259]: DEBUG cinder.volume.drivers.quobyte [None req-5ca17990-3389-4694-9145-929e77cc566f tempest-CinderUnicodeTest-1125298232 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-61f585ac-f8e2-4d19-a890-7ebc2726cc72': None} {{(pid=83259) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:639}} Sep 16 15:15:27 devstack cinder-volume[83259]: DEBUG cinder.volume.drivers.quobyte [None req-5ca17990-3389-4694-9145-929e77cc566f tempest-CinderUnicodeTest-1125298232 None] Available shares ['10.10.41.181/cinder-vol-61f585ac-f8e2-4d19-a890-7ebc2726cc72'] {{(pid=83259) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:669}} Sep 16 15:15:27 devstack cinder-volume[83259]: DEBUG oslo_concurrency.lockutils [None req-5ca17990-3389-4694-9145-929e77cc566f tempest-CinderUnicodeTest-1125298232 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=83259) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 16 15:15:27 devstack cinder-volume[83259]: DEBUG cinder.volume.drivers.quobyte [None req-5ca17990-3389-4694-9145-929e77cc566f tempest-CinderUnicodeTest-1125298232 None] Selected 10.10.41.181/cinder-vol-61f585ac-f8e2-4d19-a890-7ebc2726cc72 as target Quobyte volume. {{(pid=83259) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:690}} Sep 16 15:15:27 devstack cinder-volume[83259]: INFO cinder.volume.drivers.remotefs [None req-5ca17990-3389-4694-9145-929e77cc566f tempest-CinderUnicodeTest-1125298232 None] casted to 10.10.41.181/cinder-vol-61f585ac-f8e2-4d19-a890-7ebc2726cc72 Sep 16 15:15:27 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [None req-5ca17990-3389-4694-9145-929e77cc566f tempest-CinderUnicodeTest-1125298232 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c/volume-5c7afb33-bbdf-4a4f-a240-6071d3810533 1073741824 {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 15:15:28 devstack quobyte-client[83286]: The server volume:87712ffe-8a69-446d-9ed6-4430c7ee9792@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=87712ffe-8a69-446d-9ed6-4430c7ee9792, inode=134, name=volume-5c7afb33-bbdf-4a4f-a240-6071d3810533, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.206), requestorAccessMask=0 Sep 16 15:15:28 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [None req-5ca17990-3389-4694-9145-929e77cc566f tempest-CinderUnicodeTest-1125298232 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c/volume-5c7afb33-bbdf-4a4f-a240-6071d3810533 1073741824" returned: 0 in 0.678s {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 15:15:28 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [None req-5ca17990-3389-4694-9145-929e77cc566f tempest-CinderUnicodeTest-1125298232 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c/volume-5c7afb33-bbdf-4a4f-a240-6071d3810533 {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 15:15:28 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [None req-5ca17990-3389-4694-9145-929e77cc566f tempest-CinderUnicodeTest-1125298232 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c/volume-5c7afb33-bbdf-4a4f-a240-6071d3810533" returned: 0 in 0.252s {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 15:15:28 devstack cinder-volume[83259]: DEBUG cinder.volume.drivers.quobyte [None req-5ca17990-3389-4694-9145-929e77cc566f tempest-CinderUnicodeTest-1125298232 None] <== create_volume: return (1162ms) {'provider_location': '10.10.41.181/cinder-vol-61f585ac-f8e2-4d19-a890-7ebc2726cc72'} {{(pid=83259) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Sep 16 15:15:29 devstack cinder-volume[83259]: DEBUG oslo_concurrency.lockutils [None req-5ca17990-3389-4694-9145-929e77cc566f tempest-CinderUnicodeTest-1125298232 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.198s {{(pid=83259) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 16 15:15:29 devstack cinder-volume[83259]: DEBUG cinder.volume.manager [None req-5ca17990-3389-4694-9145-929e77cc566f tempest-CinderUnicodeTest-1125298232 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (21f9978a-b25a-4303-b2b7-be694ae30074) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5c7afb33-bbdf-4a4f-a240-6071d3810533', 'volume_size': 1}' {{(pid=83259) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 15:15:29 devstack cinder-volume[83259]: DEBUG cinder.volume.manager [None req-5ca17990-3389-4694-9145-929e77cc566f tempest-CinderUnicodeTest-1125298232 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d18cc836-b4ff-408a-afca-5b4bb10ac5d2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83259) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 15:15:29 devstack cinder-volume[83259]: INFO cinder.volume.flows.manager.create_volume [None req-5ca17990-3389-4694-9145-929e77cc566f tempest-CinderUnicodeTest-1125298232 None] Volume volume-5c7afb33-bbdf-4a4f-a240-6071d3810533 (5c7afb33-bbdf-4a4f-a240-6071d3810533): created successfully Sep 16 15:15:29 devstack cinder-volume[83259]: DEBUG cinder.volume.manager [None req-5ca17990-3389-4694-9145-929e77cc566f tempest-CinderUnicodeTest-1125298232 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d18cc836-b4ff-408a-afca-5b4bb10ac5d2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83259) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 15:15:29 devstack cinder-volume[83259]: DEBUG cinder.volume.manager [None req-5ca17990-3389-4694-9145-929e77cc566f tempest-CinderUnicodeTest-1125298232 None] Flow 'volume_create_manager' (bd9cfc41-46b0-4bb4-b349-3f4ecd76017b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83259) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 16 15:15:30 devstack cinder-volume[83259]: INFO cinder.volume.manager [None req-5ca17990-3389-4694-9145-929e77cc566f tempest-CinderUnicodeTest-1125298232 None] Created volume successfully. Sep 16 15:15:30 devstack sudo[96773]: pam_unix(sudo:session): session closed for user root Sep 16 15:15:30 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [None req-95824d49-845b-43aa-96da-bb9689cc20c4 tempest-TestInstancesWithCinderVolumes-1096446095 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_2ad9fbf6-87ee-42d2-8aa6-f59a2ce6caa6_ivejyxw8devstack@QuobyteHD" returned: 0 in 5.091s {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 15:15:30 devstack cinder-volume[83259]: DEBUG oslo_concurrency.lockutils [None req-95824d49-845b-43aa-96da-bb9689cc20c4 tempest-TestInstancesWithCinderVolumes-1096446095 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83259) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 16 15:15:30 devstack cinder-volume[83259]: DEBUG oslo_concurrency.lockutils [None req-95824d49-845b-43aa-96da-bb9689cc20c4 tempest-TestInstancesWithCinderVolumes-1096446095 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.007s {{(pid=83259) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 16 15:15:30 devstack cinder-volume[83259]: DEBUG cinder.volume.drivers.quobyte [None req-95824d49-845b-43aa-96da-bb9689cc20c4 tempest-TestInstancesWithCinderVolumes-1096446095 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-16T13:15:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-2045133207',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#Quobyte',id=fe0a6272-f5d7-45de-8211-43dcdab851c8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='de0e15312a36448cb4bd348b6865ab9c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-16T13:15:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-16T13:15:12Z,use_quota=True,user_id='c175c709abb142329cb0dd1bfec5e203',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8c9a1630-c25d-4df1-b70d-4a323efa68a3),volume_type_id=8c9a1630-c25d-4df1-b70d-4a323efa68a3)}" {{(pid=83259) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Sep 16 15:15:30 devstack cinder-volume[83259]: DEBUG cinder.volume.drivers.remotefs [None req-95824d49-845b-43aa-96da-bb9689cc20c4 tempest-TestInstancesWithCinderVolumes-1096446095 None] Creating volume fe0a6272-f5d7-45de-8211-43dcdab851c8 {{(pid=83259) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}} Sep 16 15:15:30 devstack cinder-volume[83259]: DEBUG oslo_concurrency.lockutils [None req-95824d49-845b-43aa-96da-bb9689cc20c4 tempest-TestInstancesWithCinderVolumes-1096446095 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83259) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 16 15:15:30 devstack cinder-volume[83259]: DEBUG oslo_concurrency.lockutils [None req-95824d49-845b-43aa-96da-bb9689cc20c4 tempest-TestInstancesWithCinderVolumes-1096446095 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83259) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 16 15:15:30 devstack cinder-volume[83259]: DEBUG cinder.volume.drivers.quobyte [None req-95824d49-845b-43aa-96da-bb9689cc20c4 tempest-TestInstancesWithCinderVolumes-1096446095 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-61f585ac-f8e2-4d19-a890-7ebc2726cc72': None} {{(pid=83259) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:639}} Sep 16 15:15:30 devstack cinder-volume[83259]: DEBUG cinder.volume.drivers.quobyte [None req-95824d49-845b-43aa-96da-bb9689cc20c4 tempest-TestInstancesWithCinderVolumes-1096446095 None] Available shares ['10.10.41.181/cinder-vol-61f585ac-f8e2-4d19-a890-7ebc2726cc72'] {{(pid=83259) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:669}} Sep 16 15:15:30 devstack cinder-volume[83259]: DEBUG oslo_concurrency.lockutils [None req-95824d49-845b-43aa-96da-bb9689cc20c4 tempest-TestInstancesWithCinderVolumes-1096446095 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.025s {{(pid=83259) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 16 15:15:30 devstack cinder-volume[83259]: DEBUG cinder.volume.drivers.quobyte [None req-95824d49-845b-43aa-96da-bb9689cc20c4 tempest-TestInstancesWithCinderVolumes-1096446095 None] Selected 10.10.41.181/cinder-vol-61f585ac-f8e2-4d19-a890-7ebc2726cc72 as target Quobyte volume. {{(pid=83259) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:690}} Sep 16 15:15:30 devstack cinder-volume[83259]: INFO cinder.volume.drivers.remotefs [None req-95824d49-845b-43aa-96da-bb9689cc20c4 tempest-TestInstancesWithCinderVolumes-1096446095 None] casted to 10.10.41.181/cinder-vol-61f585ac-f8e2-4d19-a890-7ebc2726cc72 Sep 16 15:15:30 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [None req-95824d49-845b-43aa-96da-bb9689cc20c4 tempest-TestInstancesWithCinderVolumes-1096446095 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c/volume-fe0a6272-f5d7-45de-8211-43dcdab851c8 1073741824 {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 15:15:30 devstack quobyte-client[83286]: System call of process 96829 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 16 15:15:30 devstack quobyte-client[83286]: The server volume:87712ffe-8a69-446d-9ed6-4430c7ee9792@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=87712ffe-8a69-446d-9ed6-4430c7ee9792, inode=135, name=volume-fe0a6272-f5d7-45de-8211-43dcdab851c8, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.206), requestorAccessMask=0 Sep 16 15:15:31 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [None req-95824d49-845b-43aa-96da-bb9689cc20c4 tempest-TestInstancesWithCinderVolumes-1096446095 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c/volume-fe0a6272-f5d7-45de-8211-43dcdab851c8 1073741824" returned: 0 in 0.582s {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 15:15:31 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [None req-95824d49-845b-43aa-96da-bb9689cc20c4 tempest-TestInstancesWithCinderVolumes-1096446095 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c/volume-fe0a6272-f5d7-45de-8211-43dcdab851c8 {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 15:15:31 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [None req-95824d49-845b-43aa-96da-bb9689cc20c4 tempest-TestInstancesWithCinderVolumes-1096446095 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c/volume-fe0a6272-f5d7-45de-8211-43dcdab851c8" returned: 0 in 0.223s {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 15:15:31 devstack cinder-volume[83259]: DEBUG cinder.volume.drivers.quobyte [None req-95824d49-845b-43aa-96da-bb9689cc20c4 tempest-TestInstancesWithCinderVolumes-1096446095 None] <== create_volume: return (918ms) {'provider_location': '10.10.41.181/cinder-vol-61f585ac-f8e2-4d19-a890-7ebc2726cc72'} {{(pid=83259) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Sep 16 15:15:31 devstack cinder-volume[83259]: DEBUG oslo_concurrency.lockutils [None req-95824d49-845b-43aa-96da-bb9689cc20c4 tempest-TestInstancesWithCinderVolumes-1096446095 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.949s {{(pid=83259) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 16 15:15:31 devstack cinder-volume[83259]: DEBUG cinder.volume.volume_utils [None req-95824d49-845b-43aa-96da-bb9689cc20c4 tempest-TestInstancesWithCinderVolumes-1096446095 None] Attempting download of 2ad9fbf6-87ee-42d2-8aa6-f59a2ce6caa6 ((None, [{'url': 'file:///opt/stack/data/glance/images/2ad9fbf6-87ee-42d2-8aa6-f59a2ce6caa6', 'metadata': {}}])) to volume fe0a6272-f5d7-45de-8211-43dcdab851c8. {{(pid=83259) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1189}} Sep 16 15:15:32 devstack cinder-volume[83259]: DEBUG oslo.privsep.daemon [-] privsep: reply[2a59f94b-cb45-463e-bf00-4249dd668c21]: (4, 'raw') {{(pid=84312) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 16 15:15:32 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [None req-95824d49-845b-43aa-96da-bb9689cc20c4 tempest-TestInstancesWithCinderVolumes-1096446095 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_2ad9fbf6-87ee-42d2-8aa6-f59a2ce6caa6_tvhf9udr {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 15:15:32 devstack cinder-volume[83259]: WARNING cinder.volume.volume_utils [None req-c67e774e-743a-4cda-ad0c-6bbc3c69b3ff tempest-CinderUnicodeTest-1125298232 None] Volume driver (QuobyteDriver 1.2) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 16 15:15:32 devstack cinder-volume[83259]: DEBUG cinder.volume.flows.manager.create_volume [None req-c67e774e-743a-4cda-ad0c-6bbc3c69b3ff tempest-CinderUnicodeTest-1125298232 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#Quobyte'], 'hosts': ['devstack@QuobyteHD#Quobyte']} {{(pid=83259) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1387}} Sep 16 15:15:33 devstack sudo[96838]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_2ad9fbf6-87ee-42d2-8aa6-f59a2ce6caa6_tvhf9udr Sep 16 15:15:33 devstack sudo[96838]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 15:15:33 devstack cinder-volume[83259]: DEBUG cinder.volume.manager [None req-c67e774e-743a-4cda-ad0c-6bbc3c69b3ff tempest-CinderUnicodeTest-1125298232 None] Flow 'volume_create_manager' (4f2bc844-ea3c-4d8d-8aac-9641280f4cca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83259) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 16 15:15:33 devstack cinder-volume[83259]: DEBUG cinder.volume.manager [None req-c67e774e-743a-4cda-ad0c-6bbc3c69b3ff tempest-CinderUnicodeTest-1125298232 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c98f0b0c-dc31-461d-b90e-641226d2ebe6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83259) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 15:15:33 devstack cinder-volume[83259]: DEBUG cinder.volume.manager [None req-c67e774e-743a-4cda-ad0c-6bbc3c69b3ff tempest-CinderUnicodeTest-1125298232 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c98f0b0c-dc31-461d-b90e-641226d2ebe6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-16T13:15:31Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-263990564',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#Quobyte',id=1ef6c1d5-e9cc-468e-8aa2-1000a022e897,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f67355a3cedd4e6789e66a6c960a67f6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-16T13:15:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-16T13:15:32Z,use_quota=True,user_id='0d609211cc40478393c02ebf47968807',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(485ead50-3df8-4d76-8d34-a4db136c980a),volume_type_id=485ead50-3df8-4d76-8d34-a4db136c980a)' {{(pid=83259) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 15:15:33 devstack cinder-volume[83259]: DEBUG cinder.volume.manager [None req-c67e774e-743a-4cda-ad0c-6bbc3c69b3ff tempest-CinderUnicodeTest-1125298232 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e16ceea1-6543-4a26-9b29-82f2d11fc2d5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83259) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 15:15:33 devstack cinder-volume[83259]: DEBUG cinder.volume.manager [None req-c67e774e-743a-4cda-ad0c-6bbc3c69b3ff tempest-CinderUnicodeTest-1125298232 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e16ceea1-6543-4a26-9b29-82f2d11fc2d5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83259) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 15:15:33 devstack cinder-volume[83259]: DEBUG cinder.volume.manager [None req-c67e774e-743a-4cda-ad0c-6bbc3c69b3ff tempest-CinderUnicodeTest-1125298232 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3a40cdec-dd18-415d-aca2-a6ed8fb27923) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83259) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 15:15:33 devstack cinder-volume[83259]: DEBUG cinder.volume.manager [None req-c67e774e-743a-4cda-ad0c-6bbc3c69b3ff tempest-CinderUnicodeTest-1125298232 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3a40cdec-dd18-415d-aca2-a6ed8fb27923) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1ef6c1d5-e9cc-468e-8aa2-1000a022e897', 'volume_name': 'volume-1ef6c1d5-e9cc-468e-8aa2-1000a022e897', 'volume_size': 1}' {{(pid=83259) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 15:15:33 devstack cinder-volume[83259]: DEBUG cinder.volume.manager [None req-c67e774e-743a-4cda-ad0c-6bbc3c69b3ff tempest-CinderUnicodeTest-1125298232 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2112393f-bb71-4e20-abf0-02751d71b01f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83259) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 15:15:33 devstack cinder-volume[83259]: DEBUG cinder.volume.manager [None req-c67e774e-743a-4cda-ad0c-6bbc3c69b3ff tempest-CinderUnicodeTest-1125298232 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2112393f-bb71-4e20-abf0-02751d71b01f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83259) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 15:15:33 devstack cinder-volume[83259]: DEBUG cinder.volume.manager [None req-c67e774e-743a-4cda-ad0c-6bbc3c69b3ff tempest-CinderUnicodeTest-1125298232 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6df4b102-f2b1-4134-b601-ab642ee48050) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83259) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 15:15:33 devstack cinder-volume[83259]: INFO cinder.volume.flows.manager.create_volume [None req-c67e774e-743a-4cda-ad0c-6bbc3c69b3ff tempest-CinderUnicodeTest-1125298232 None] Volume 1ef6c1d5-e9cc-468e-8aa2-1000a022e897: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1ef6c1d5-e9cc-468e-8aa2-1000a022e897', 'volume_size': 1} Sep 16 15:15:33 devstack cinder-volume[83259]: DEBUG oslo_concurrency.lockutils [None req-c67e774e-743a-4cda-ad0c-6bbc3c69b3ff tempest-CinderUnicodeTest-1125298232 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83259) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 16 15:15:33 devstack cinder-volume[83259]: DEBUG oslo_concurrency.lockutils [None req-c67e774e-743a-4cda-ad0c-6bbc3c69b3ff tempest-CinderUnicodeTest-1125298232 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.006s {{(pid=83259) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 16 15:15:33 devstack cinder-volume[83259]: DEBUG cinder.volume.drivers.quobyte [None req-c67e774e-743a-4cda-ad0c-6bbc3c69b3ff tempest-CinderUnicodeTest-1125298232 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-16T13:15:31Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-263990564',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#Quobyte',id=1ef6c1d5-e9cc-468e-8aa2-1000a022e897,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f67355a3cedd4e6789e66a6c960a67f6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-16T13:15:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-16T13:15:32Z,use_quota=True,user_id='0d609211cc40478393c02ebf47968807',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(485ead50-3df8-4d76-8d34-a4db136c980a),volume_type_id=485ead50-3df8-4d76-8d34-a4db136c980a)}" {{(pid=83259) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Sep 16 15:15:33 devstack cinder-volume[83259]: DEBUG cinder.volume.drivers.remotefs [None req-c67e774e-743a-4cda-ad0c-6bbc3c69b3ff tempest-CinderUnicodeTest-1125298232 None] Creating volume 1ef6c1d5-e9cc-468e-8aa2-1000a022e897 {{(pid=83259) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}} Sep 16 15:15:33 devstack cinder-volume[83259]: DEBUG oslo_concurrency.lockutils [None req-c67e774e-743a-4cda-ad0c-6bbc3c69b3ff tempest-CinderUnicodeTest-1125298232 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83259) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 16 15:15:33 devstack cinder-volume[83259]: DEBUG oslo_concurrency.lockutils [None req-c67e774e-743a-4cda-ad0c-6bbc3c69b3ff tempest-CinderUnicodeTest-1125298232 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=83259) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 16 15:15:33 devstack cinder-volume[83259]: DEBUG cinder.volume.drivers.quobyte [None req-c67e774e-743a-4cda-ad0c-6bbc3c69b3ff tempest-CinderUnicodeTest-1125298232 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-61f585ac-f8e2-4d19-a890-7ebc2726cc72': None} {{(pid=83259) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:639}} Sep 16 15:15:33 devstack cinder-volume[83259]: DEBUG cinder.volume.drivers.quobyte [None req-c67e774e-743a-4cda-ad0c-6bbc3c69b3ff tempest-CinderUnicodeTest-1125298232 None] Available shares ['10.10.41.181/cinder-vol-61f585ac-f8e2-4d19-a890-7ebc2726cc72'] {{(pid=83259) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:669}} Sep 16 15:15:33 devstack cinder-volume[83259]: DEBUG oslo_concurrency.lockutils [None req-c67e774e-743a-4cda-ad0c-6bbc3c69b3ff tempest-CinderUnicodeTest-1125298232 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=83259) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 16 15:15:33 devstack cinder-volume[83259]: DEBUG cinder.volume.drivers.quobyte [None req-c67e774e-743a-4cda-ad0c-6bbc3c69b3ff tempest-CinderUnicodeTest-1125298232 None] Selected 10.10.41.181/cinder-vol-61f585ac-f8e2-4d19-a890-7ebc2726cc72 as target Quobyte volume. {{(pid=83259) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:690}} Sep 16 15:15:33 devstack cinder-volume[83259]: INFO cinder.volume.drivers.remotefs [None req-c67e774e-743a-4cda-ad0c-6bbc3c69b3ff tempest-CinderUnicodeTest-1125298232 None] casted to 10.10.41.181/cinder-vol-61f585ac-f8e2-4d19-a890-7ebc2726cc72 Sep 16 15:15:33 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [None req-c67e774e-743a-4cda-ad0c-6bbc3c69b3ff tempest-CinderUnicodeTest-1125298232 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c/volume-1ef6c1d5-e9cc-468e-8aa2-1000a022e897 1073741824 {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 15:15:33 devstack quobyte-client[83286]: System call of process 96848 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 16 15:15:33 devstack quobyte-client[83286]: System call of process 96848 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 16 15:15:33 devstack quobyte-client[83286]: System call of process 96848 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 16 15:15:33 devstack quobyte-client[83286]: The server volume:87712ffe-8a69-446d-9ed6-4430c7ee9792@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=87712ffe-8a69-446d-9ed6-4430c7ee9792, inode=136, name=volume-1ef6c1d5-e9cc-468e-8aa2-1000a022e897, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.206), requestorAccessMask=0 Sep 16 15:15:34 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [None req-c67e774e-743a-4cda-ad0c-6bbc3c69b3ff tempest-CinderUnicodeTest-1125298232 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c/volume-1ef6c1d5-e9cc-468e-8aa2-1000a022e897 1073741824" returned: 0 in 0.718s {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 15:15:34 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [None req-c67e774e-743a-4cda-ad0c-6bbc3c69b3ff tempest-CinderUnicodeTest-1125298232 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c/volume-1ef6c1d5-e9cc-468e-8aa2-1000a022e897 {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 15:15:34 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [None req-c67e774e-743a-4cda-ad0c-6bbc3c69b3ff tempest-CinderUnicodeTest-1125298232 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c/volume-1ef6c1d5-e9cc-468e-8aa2-1000a022e897" returned: 0 in 0.305s {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 15:15:34 devstack cinder-volume[83259]: DEBUG cinder.volume.drivers.quobyte [None req-c67e774e-743a-4cda-ad0c-6bbc3c69b3ff tempest-CinderUnicodeTest-1125298232 None] <== create_volume: return (1278ms) {'provider_location': '10.10.41.181/cinder-vol-61f585ac-f8e2-4d19-a890-7ebc2726cc72'} {{(pid=83259) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Sep 16 15:15:34 devstack cinder-volume[83259]: DEBUG oslo_concurrency.lockutils [None req-c67e774e-743a-4cda-ad0c-6bbc3c69b3ff tempest-CinderUnicodeTest-1125298232 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.303s {{(pid=83259) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 16 15:15:35 devstack cinder-volume[83259]: DEBUG cinder.volume.manager [None req-c67e774e-743a-4cda-ad0c-6bbc3c69b3ff tempest-CinderUnicodeTest-1125298232 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6df4b102-f2b1-4134-b601-ab642ee48050) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1ef6c1d5-e9cc-468e-8aa2-1000a022e897', 'volume_size': 1}' {{(pid=83259) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 15:15:35 devstack cinder-volume[83259]: DEBUG cinder.volume.manager [None req-c67e774e-743a-4cda-ad0c-6bbc3c69b3ff tempest-CinderUnicodeTest-1125298232 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (30131e10-b36c-4c29-9029-bfca821cb0ce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83259) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 15:15:35 devstack cinder-volume[83259]: INFO cinder.volume.flows.manager.create_volume [None req-c67e774e-743a-4cda-ad0c-6bbc3c69b3ff tempest-CinderUnicodeTest-1125298232 None] Volume volume-1ef6c1d5-e9cc-468e-8aa2-1000a022e897 (1ef6c1d5-e9cc-468e-8aa2-1000a022e897): created successfully Sep 16 15:15:35 devstack cinder-volume[83259]: DEBUG cinder.volume.manager [None req-c67e774e-743a-4cda-ad0c-6bbc3c69b3ff tempest-CinderUnicodeTest-1125298232 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (30131e10-b36c-4c29-9029-bfca821cb0ce) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83259) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 15:15:35 devstack cinder-volume[83259]: DEBUG cinder.volume.manager [None req-c67e774e-743a-4cda-ad0c-6bbc3c69b3ff tempest-CinderUnicodeTest-1125298232 None] Flow 'volume_create_manager' (4f2bc844-ea3c-4d8d-8aac-9641280f4cca) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83259) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 16 15:15:35 devstack cinder-volume[83259]: INFO cinder.volume.manager [None req-c67e774e-743a-4cda-ad0c-6bbc3c69b3ff tempest-CinderUnicodeTest-1125298232 None] Created volume successfully. Sep 16 15:15:36 devstack cinder-volume[83259]: WARNING cinder.volume.volume_utils [None req-3943d92d-3833-4090-b2ee-19bb43fedf8e tempest-CinderUnicodeTest-1125298232 None] Volume driver (QuobyteDriver 1.2) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 16 15:15:36 devstack cinder-volume[83259]: DEBUG oslo_concurrency.lockutils [None req-3943d92d-3833-4090-b2ee-19bb43fedf8e tempest-CinderUnicodeTest-1125298232 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=83259) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 16 15:15:36 devstack cinder-volume[83259]: DEBUG oslo_concurrency.lockutils [None req-3943d92d-3833-4090-b2ee-19bb43fedf8e tempest-CinderUnicodeTest-1125298232 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.016s {{(pid=83259) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 16 15:15:36 devstack cinder-volume[83259]: DEBUG cinder.volume.drivers.remotefs [None req-3943d92d-3833-4090-b2ee-19bb43fedf8e tempest-CinderUnicodeTest-1125298232 None] Creating offline snapshot c8c773f7-c507-4664-958f-5daf32c7d681 of volume 1ef6c1d5-e9cc-468e-8aa2-1000a022e897 {{(pid=83259) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1694}} Sep 16 15:15:36 devstack cinder-volume[83259]: DEBUG oslo.privsep.daemon [-] privsep: reply[e30545ff-3d47-4224-ba1d-38986b79fdb6]: (4, 'qcow2') {{(pid=84312) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 16 15:15:36 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [None req-3943d92d-3833-4090-b2ee-19bb43fedf8e tempest-CinderUnicodeTest-1125298232 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c/volume-1ef6c1d5-e9cc-468e-8aa2-1000a022e897 {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 15:15:37 devstack sudo[96838]: pam_unix(sudo:session): session closed for user root Sep 16 15:15:37 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [None req-95824d49-845b-43aa-96da-bb9689cc20c4 tempest-TestInstancesWithCinderVolumes-1096446095 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_2ad9fbf6-87ee-42d2-8aa6-f59a2ce6caa6_tvhf9udr" returned: 0 in 5.244s {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 15:15:37 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [None req-95824d49-845b-43aa-96da-bb9689cc20c4 tempest-TestInstancesWithCinderVolumes-1096446095 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_2ad9fbf6-87ee-42d2-8aa6-f59a2ce6caa6_tvhf9udr {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 15:15:37 devstack quobyte-client[83286]: System call of process 96864 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 16 15:15:37 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [None req-3943d92d-3833-4090-b2ee-19bb43fedf8e tempest-CinderUnicodeTest-1125298232 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c/volume-1ef6c1d5-e9cc-468e-8aa2-1000a022e897" returned: 0 in 0.933s {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 15:15:37 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [None req-3943d92d-3833-4090-b2ee-19bb43fedf8e tempest-CinderUnicodeTest-1125298232 None] Running cmd (subprocess): qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c/volume-1ef6c1d5-e9cc-468e-8aa2-1000a022e897,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c/volume-1ef6c1d5-e9cc-468e-8aa2-1000a022e897.c8c773f7-c507-4664-958f-5daf32c7d681 1G {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 15:15:37 devstack quobyte-client[83286]: The server volume:87712ffe-8a69-446d-9ed6-4430c7ee9792@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=87712ffe-8a69-446d-9ed6-4430c7ee9792, inode=137, name=volume-1ef6c1d5-e9cc-468e-8aa2-1000a022e897.c8c773f7-c507-4664-958f-5daf32c7d681, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.206), requestorAccessMask=0 Sep 16 15:15:37 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [None req-3943d92d-3833-4090-b2ee-19bb43fedf8e tempest-CinderUnicodeTest-1125298232 None] CMD "qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c/volume-1ef6c1d5-e9cc-468e-8aa2-1000a022e897,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c/volume-1ef6c1d5-e9cc-468e-8aa2-1000a022e897.c8c773f7-c507-4664-958f-5daf32c7d681 1G" returned: 0 in 0.330s {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 15:15:37 devstack sudo[96865]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_2ad9fbf6-87ee-42d2-8aa6-f59a2ce6caa6_tvhf9udr Sep 16 15:15:37 devstack sudo[96865]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 15:15:37 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [None req-3943d92d-3833-4090-b2ee-19bb43fedf8e tempest-CinderUnicodeTest-1125298232 None] Running cmd (subprocess): qemu-img rebase -u -b volume-1ef6c1d5-e9cc-468e-8aa2-1000a022e897 -F qcow2 /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c/volume-1ef6c1d5-e9cc-468e-8aa2-1000a022e897.c8c773f7-c507-4664-958f-5daf32c7d681 {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 15:15:38 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [None req-3943d92d-3833-4090-b2ee-19bb43fedf8e tempest-CinderUnicodeTest-1125298232 None] CMD "qemu-img rebase -u -b volume-1ef6c1d5-e9cc-468e-8aa2-1000a022e897 -F qcow2 /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c/volume-1ef6c1d5-e9cc-468e-8aa2-1000a022e897.c8c773f7-c507-4664-958f-5daf32c7d681" returned: 0 in 0.331s {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 15:15:38 devstack cinder-volume[83259]: DEBUG cinder.volume.drivers.remotefs [None req-3943d92d-3833-4090-b2ee-19bb43fedf8e tempest-CinderUnicodeTest-1125298232 None] File path /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c/volume-1ef6c1d5-e9cc-468e-8aa2-1000a022e897.c8c773f7-c507-4664-958f-5daf32c7d681 is being set with permissions: 660 {{(pid=83259) _set_rw_permissions /opt/stack/cinder/cinder/volume/drivers/remotefs.py:492}} Sep 16 15:15:38 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [None req-3943d92d-3833-4090-b2ee-19bb43fedf8e tempest-CinderUnicodeTest-1125298232 None] Running cmd (subprocess): chmod 660 /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c/volume-1ef6c1d5-e9cc-468e-8aa2-1000a022e897.c8c773f7-c507-4664-958f-5daf32c7d681 {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 15:15:38 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [None req-3943d92d-3833-4090-b2ee-19bb43fedf8e tempest-CinderUnicodeTest-1125298232 None] CMD "chmod 660 /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c/volume-1ef6c1d5-e9cc-468e-8aa2-1000a022e897.c8c773f7-c507-4664-958f-5daf32c7d681" returned: 0 in 0.268s {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 15:15:38 devstack cinder-volume[83259]: DEBUG cinder.volume.drivers.remotefs [None req-3943d92d-3833-4090-b2ee-19bb43fedf8e tempest-CinderUnicodeTest-1125298232 None] Setting permissions: /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c/volume-1ef6c1d5-e9cc-468e-8aa2-1000a022e897 -> 1000:1000 {{(pid=83259) _do_create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1584}} Sep 16 15:15:38 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [None req-3943d92d-3833-4090-b2ee-19bb43fedf8e tempest-CinderUnicodeTest-1125298232 None] Running cmd (subprocess): chown --reference=/opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c/volume-1ef6c1d5-e9cc-468e-8aa2-1000a022e897 /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c/volume-1ef6c1d5-e9cc-468e-8aa2-1000a022e897.c8c773f7-c507-4664-958f-5daf32c7d681 {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 15:15:38 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [None req-3943d92d-3833-4090-b2ee-19bb43fedf8e tempest-CinderUnicodeTest-1125298232 None] CMD "chown --reference=/opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c/volume-1ef6c1d5-e9cc-468e-8aa2-1000a022e897 /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c/volume-1ef6c1d5-e9cc-468e-8aa2-1000a022e897.c8c773f7-c507-4664-958f-5daf32c7d681" returned: 0 in 0.167s {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 15:15:38 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [None req-3943d92d-3833-4090-b2ee-19bb43fedf8e tempest-CinderUnicodeTest-1125298232 None] Running cmd (subprocess): truncate -s0 /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c/volume-1ef6c1d5-e9cc-468e-8aa2-1000a022e897.info {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 15:15:39 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [None req-3943d92d-3833-4090-b2ee-19bb43fedf8e tempest-CinderUnicodeTest-1125298232 None] CMD "truncate -s0 /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c/volume-1ef6c1d5-e9cc-468e-8aa2-1000a022e897.info" returned: 0 in 0.138s {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 15:15:39 devstack cinder-volume[83259]: DEBUG cinder.volume.drivers.remotefs [None req-3943d92d-3833-4090-b2ee-19bb43fedf8e tempest-CinderUnicodeTest-1125298232 None] File path /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c/volume-1ef6c1d5-e9cc-468e-8aa2-1000a022e897.info is being set with permissions: 660 {{(pid=83259) _set_rw_permissions /opt/stack/cinder/cinder/volume/drivers/remotefs.py:492}} Sep 16 15:15:39 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [None req-3943d92d-3833-4090-b2ee-19bb43fedf8e tempest-CinderUnicodeTest-1125298232 None] Running cmd (subprocess): chmod 660 /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c/volume-1ef6c1d5-e9cc-468e-8aa2-1000a022e897.info {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 15:15:39 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [None req-3943d92d-3833-4090-b2ee-19bb43fedf8e tempest-CinderUnicodeTest-1125298232 None] CMD "chmod 660 /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c/volume-1ef6c1d5-e9cc-468e-8aa2-1000a022e897.info" returned: 0 in 0.115s {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 15:15:39 devstack cinder-volume[83259]: DEBUG oslo_concurrency.lockutils [None req-3943d92d-3833-4090-b2ee-19bb43fedf8e tempest-CinderUnicodeTest-1125298232 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.979s {{(pid=83259) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 16 15:15:39 devstack cinder-volume[83259]: INFO cinder.volume.manager [None req-3943d92d-3833-4090-b2ee-19bb43fedf8e tempest-CinderUnicodeTest-1125298232 None] Create snapshot completed successfully Sep 16 15:15:40 devstack sudo[96865]: pam_unix(sudo:session): session closed for user root Sep 16 15:15:40 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [None req-95824d49-845b-43aa-96da-bb9689cc20c4 tempest-TestInstancesWithCinderVolumes-1096446095 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_2ad9fbf6-87ee-42d2-8aa6-f59a2ce6caa6_tvhf9udr" returned: 1 in 2.954s {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 15:15:40 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [None req-95824d49-845b-43aa-96da-bb9689cc20c4 tempest-TestInstancesWithCinderVolumes-1096446095 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_2ad9fbf6-87ee-42d2-8aa6-f59a2ce6caa6_tvhf9udr' failed. Not Retrying. {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:423}} Sep 16 15:15:40 devstack cinder-volume[83259]: DEBUG oslo.privsep.daemon [-] privsep: reply[1a5210ec-ca20-4793-a545-3b8fc109396b]: (4, 'qcow2') {{(pid=84312) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 16 15:15:40 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [None req-95824d49-845b-43aa-96da-bb9689cc20c4 tempest-TestInstancesWithCinderVolumes-1096446095 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_2ad9fbf6-87ee-42d2-8aa6-f59a2ce6caa6_ivejyxw8devstack@QuobyteHD {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 15:15:40 devstack cinder-volume[83259]: DEBUG cinder.coordination [None req-29ed45df-80ae-469a-af84-7586975c109d tempest-CinderUnicodeTest-1125298232 None] Acquiring lock "cinder-c8c773f7-c507-4664-958f-5daf32c7d681-delete_snapshot" by "delete_snapshot" {{(pid=83259) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 16 15:15:41 devstack cinder-volume[83259]: DEBUG cinder.coordination [None req-29ed45df-80ae-469a-af84-7586975c109d tempest-CinderUnicodeTest-1125298232 None] Lock "cinder-c8c773f7-c507-4664-958f-5daf32c7d681-delete_snapshot" acquired by "delete_snapshot" :: waited 0.142s {{(pid=83259) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 16 15:15:41 devstack cinder-volume[83259]: WARNING cinder.volume.volume_utils [None req-29ed45df-80ae-469a-af84-7586975c109d tempest-CinderUnicodeTest-1125298232 None] Volume driver (QuobyteDriver 1.2) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 16 15:15:41 devstack cinder-volume[83259]: DEBUG cinder.coordination [None req-29ed45df-80ae-469a-af84-7586975c109d tempest-CinderUnicodeTest-1125298232 None] Acquiring lock "cinder-quobyte-1ef6c1d5-e9cc-468e-8aa2-1000a022e897" by "delete_snapshot" {{(pid=83259) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 16 15:15:41 devstack cinder-volume[83259]: DEBUG cinder.coordination [None req-29ed45df-80ae-469a-af84-7586975c109d tempest-CinderUnicodeTest-1125298232 None] Lock "cinder-quobyte-1ef6c1d5-e9cc-468e-8aa2-1000a022e897" acquired by "delete_snapshot" :: waited 0.016s {{(pid=83259) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 16 15:15:41 devstack cinder-volume[83259]: DEBUG cinder.coordination [None req-29ed45df-80ae-469a-af84-7586975c109d tempest-CinderUnicodeTest-1125298232 None] Acquiring lock "cinder-quobyte-c8c773f7-c507-4664-958f-5daf32c7d681" by "_delete_snapshot" {{(pid=83259) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 16 15:15:41 devstack cinder-volume[83259]: DEBUG cinder.coordination [None req-29ed45df-80ae-469a-af84-7586975c109d tempest-CinderUnicodeTest-1125298232 None] Lock "cinder-quobyte-c8c773f7-c507-4664-958f-5daf32c7d681" acquired by "_delete_snapshot" :: waited 0.033s {{(pid=83259) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 16 15:15:41 devstack cinder-volume[83259]: DEBUG cinder.volume.drivers.remotefs [None req-29ed45df-80ae-469a-af84-7586975c109d tempest-CinderUnicodeTest-1125298232 None] Deleting offline snapshot c8c773f7-c507-4664-958f-5daf32c7d681 of volume 1ef6c1d5-e9cc-468e-8aa2-1000a022e897 {{(pid=83259) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1278}} Sep 16 15:15:41 devstack cinder-volume[83259]: DEBUG cinder.volume.drivers.remotefs [None req-29ed45df-80ae-469a-af84-7586975c109d tempest-CinderUnicodeTest-1125298232 None] snapshot_file for this snap is: volume-1ef6c1d5-e9cc-468e-8aa2-1000a022e897.c8c773f7-c507-4664-958f-5daf32c7d681 {{(pid=83259) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1307}} Sep 16 15:15:41 devstack sudo[96890]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_2ad9fbf6-87ee-42d2-8aa6-f59a2ce6caa6_ivejyxw8devstack@QuobyteHD Sep 16 15:15:41 devstack sudo[96890]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 15:15:41 devstack cinder-volume[83259]: DEBUG oslo.privsep.daemon [-] privsep: reply[c3ba6ebb-5094-48c9-b2dc-e792f1eef08b]: (4, 'qcow2') {{(pid=84312) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 16 15:15:41 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [None req-29ed45df-80ae-469a-af84-7586975c109d tempest-CinderUnicodeTest-1125298232 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c/volume-1ef6c1d5-e9cc-468e-8aa2-1000a022e897.c8c773f7-c507-4664-958f-5daf32c7d681 {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 15:15:41 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [None req-29ed45df-80ae-469a-af84-7586975c109d tempest-CinderUnicodeTest-1125298232 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c/volume-1ef6c1d5-e9cc-468e-8aa2-1000a022e897.c8c773f7-c507-4664-958f-5daf32c7d681" returned: 0 in 0.686s {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 15:15:41 devstack cinder-volume[83259]: DEBUG cinder.volume.drivers.remotefs [None req-29ed45df-80ae-469a-af84-7586975c109d tempest-CinderUnicodeTest-1125298232 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-1ef6c1d5-e9cc-468e-8aa2-1000a022e897(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83259) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:886}} Sep 16 15:15:42 devstack cinder-volume[83259]: DEBUG oslo.privsep.daemon [-] privsep: reply[403eaddc-ecf6-46eb-a7e8-b928f87e6106]: (4, 'qcow2') {{(pid=84312) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 16 15:15:42 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [None req-29ed45df-80ae-469a-af84-7586975c109d tempest-CinderUnicodeTest-1125298232 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c/volume-1ef6c1d5-e9cc-468e-8aa2-1000a022e897 {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 15:15:42 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [None req-29ed45df-80ae-469a-af84-7586975c109d tempest-CinderUnicodeTest-1125298232 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c/volume-1ef6c1d5-e9cc-468e-8aa2-1000a022e897" returned: 0 in 0.580s {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 15:15:42 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [None req-29ed45df-80ae-469a-af84-7586975c109d tempest-CinderUnicodeTest-1125298232 None] Running cmd (subprocess): qemu-img commit -d /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c/volume-1ef6c1d5-e9cc-468e-8aa2-1000a022e897.c8c773f7-c507-4664-958f-5daf32c7d681 {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 15:15:43 devstack quobyte-client[83286]: System call of process 96913 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 16 15:15:43 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [None req-29ed45df-80ae-469a-af84-7586975c109d tempest-CinderUnicodeTest-1125298232 None] CMD "qemu-img commit -d /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c/volume-1ef6c1d5-e9cc-468e-8aa2-1000a022e897.c8c773f7-c507-4664-958f-5daf32c7d681" returned: 0 in 0.951s {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 15:15:43 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [None req-29ed45df-80ae-469a-af84-7586975c109d tempest-CinderUnicodeTest-1125298232 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c/volume-1ef6c1d5-e9cc-468e-8aa2-1000a022e897.c8c773f7-c507-4664-958f-5daf32c7d681 {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 15:15:44 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [None req-29ed45df-80ae-469a-af84-7586975c109d tempest-CinderUnicodeTest-1125298232 None] CMD "rm -f /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c/volume-1ef6c1d5-e9cc-468e-8aa2-1000a022e897.c8c773f7-c507-4664-958f-5daf32c7d681" returned: 0 in 0.422s {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 15:15:44 devstack cinder-volume[83259]: DEBUG cinder.coordination [None req-29ed45df-80ae-469a-af84-7586975c109d tempest-CinderUnicodeTest-1125298232 None] Lock "cinder-quobyte-c8c773f7-c507-4664-958f-5daf32c7d681" released by "_delete_snapshot" :: held 3.364s {{(pid=83259) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 16 15:15:44 devstack cinder-volume[83259]: DEBUG cinder.coordination [None req-29ed45df-80ae-469a-af84-7586975c109d tempest-CinderUnicodeTest-1125298232 None] Lock "cinder-quobyte-1ef6c1d5-e9cc-468e-8aa2-1000a022e897" released by "delete_snapshot" :: held 3.415s {{(pid=83259) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 16 15:15:44 devstack cinder-volume[83259]: DEBUG dbcounter [-] [83259] Writing DB stats cinder:UPDATE=80,cinder:SELECT=45,cinder:DELETE=10,cinder:INSERT=17 {{(pid=83259) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Sep 16 15:15:45 devstack cinder-volume[83259]: DEBUG dbcounter [-] [83259] Writing DB stats cinder:SELECT=44,cinder:UPDATE=61,cinder:DELETE=7,cinder:INSERT=8 {{(pid=83259) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Sep 16 15:15:45 devstack cinder-volume[83259]: DEBUG cinder.quota [None req-29ed45df-80ae-469a-af84-7586975c109d tempest-CinderUnicodeTest-1125298232 None] Created reservations ['7d8f0e0d-981b-4f86-9843-132666beb29d', 'f6b6a6b1-aaa7-4904-a41e-876993138a56', 'dc7709b8-324d-417f-818d-590c87300956', '701f80d6-9dc8-4ccc-9dc6-3862c44b8a50'] {{(pid=83259) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 16 15:15:45 devstack sudo[96890]: pam_unix(sudo:session): session closed for user root Sep 16 15:15:45 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [None req-95824d49-845b-43aa-96da-bb9689cc20c4 tempest-TestInstancesWithCinderVolumes-1096446095 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_2ad9fbf6-87ee-42d2-8aa6-f59a2ce6caa6_ivejyxw8devstack@QuobyteHD" returned: 0 in 5.453s {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 15:15:45 devstack cinder-volume[83259]: DEBUG cinder.image.image_utils [None req-95824d49-845b-43aa-96da-bb9689cc20c4 tempest-TestInstancesWithCinderVolumes-1096446095 None] 2ad9fbf6-87ee-42d2-8aa6-f59a2ce6caa6 was qcow2, converting to qcow2 {{(pid=83259) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1088}} Sep 16 15:15:45 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [None req-95824d49-845b-43aa-96da-bb9689cc20c4 tempest-TestInstancesWithCinderVolumes-1096446095 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_2ad9fbf6-87ee-42d2-8aa6-f59a2ce6caa6_ivejyxw8devstack@QuobyteHD /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c/volume-fe0a6272-f5d7-45de-8211-43dcdab851c8 {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 15:15:46 devstack sudo[96967]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_2ad9fbf6-87ee-42d2-8aa6-f59a2ce6caa6_ivejyxw8devstack@QuobyteHD /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c/volume-fe0a6272-f5d7-45de-8211-43dcdab851c8 Sep 16 15:15:46 devstack sudo[96967]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 15:15:46 devstack cinder-volume[83259]: DEBUG oslo_service.periodic_task [None req-050ec8a1-6ffd-499d-95ad-d548a84437e2 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=83259) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} Sep 16 15:15:46 devstack cinder-volume[83259]: DEBUG oslo_concurrency.lockutils [None req-050ec8a1-6ffd-499d-95ad-d548a84437e2 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83259) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 16 15:15:46 devstack cinder-volume[83259]: DEBUG oslo_concurrency.lockutils [None req-050ec8a1-6ffd-499d-95ad-d548a84437e2 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.027s {{(pid=83259) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 16 15:15:46 devstack cinder-volume[83259]: DEBUG cinder.volume.drivers.quobyte [None req-050ec8a1-6ffd-499d-95ad-d548a84437e2 None None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-61f585ac-f8e2-4d19-a890-7ebc2726cc72': None} {{(pid=83259) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:639}} Sep 16 15:15:46 devstack cinder-volume[83259]: DEBUG cinder.volume.drivers.quobyte [None req-050ec8a1-6ffd-499d-95ad-d548a84437e2 None None] Available shares ['10.10.41.181/cinder-vol-61f585ac-f8e2-4d19-a890-7ebc2726cc72'] {{(pid=83259) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:669}} Sep 16 15:15:46 devstack cinder-volume[83259]: DEBUG oslo_concurrency.lockutils [None req-050ec8a1-6ffd-499d-95ad-d548a84437e2 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.056s {{(pid=83259) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 16 15:15:46 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [None req-050ec8a1-6ffd-499d-95ad-d548a84437e2 None None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 15:15:47 devstack cinder-volume[83259]: DEBUG cinder.coordination [None req-2ded4ed6-84b9-4cbe-88f2-6877e082f942 tempest-CinderUnicodeTest-1125298232 None] Acquiring lock "cinder-1ef6c1d5-e9cc-468e-8aa2-1000a022e897-delete_volume" by "delete_volume" {{(pid=83259) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 16 15:15:47 devstack cinder-volume[83259]: INFO cinder.volume.manager [None req-29ed45df-80ae-469a-af84-7586975c109d tempest-CinderUnicodeTest-1125298232 None] Delete snapshot completed successfully. Sep 16 15:15:47 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [None req-050ec8a1-6ffd-499d-95ad-d548a84437e2 None None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c" returned: 0 in 0.850s {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 15:15:47 devstack cinder-volume[83259]: DEBUG cinder.manager [None req-050ec8a1-6ffd-499d-95ad-d548a84437e2 None None] Notifying Schedulers of capabilities ... {{(pid=83259) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 16 15:15:47 devstack cinder-volume[83259]: DEBUG cinder.coordination [None req-2ded4ed6-84b9-4cbe-88f2-6877e082f942 tempest-CinderUnicodeTest-1125298232 None] Lock "cinder-1ef6c1d5-e9cc-468e-8aa2-1000a022e897-delete_volume" acquired by "delete_volume" :: waited 0.257s {{(pid=83259) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 16 15:15:47 devstack cinder-volume[83259]: DEBUG cinder.coordination [None req-29ed45df-80ae-469a-af84-7586975c109d tempest-CinderUnicodeTest-1125298232 None] Lock "cinder-c8c773f7-c507-4664-958f-5daf32c7d681-delete_snapshot" released by "delete_snapshot" :: held 6.576s {{(pid=83259) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 16 15:15:47 devstack cinder-volume[83259]: WARNING cinder.volume.volume_utils [None req-2ded4ed6-84b9-4cbe-88f2-6877e082f942 tempest-CinderUnicodeTest-1125298232 None] Volume driver (QuobyteDriver 1.2) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 16 15:15:47 devstack cinder-volume[83259]: DEBUG cinder.coordination [None req-2ded4ed6-84b9-4cbe-88f2-6877e082f942 tempest-CinderUnicodeTest-1125298232 None] Acquiring lock "cinder-quobyte-1ef6c1d5-e9cc-468e-8aa2-1000a022e897" by "delete_volume" {{(pid=83259) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 16 15:15:47 devstack cinder-volume[83259]: DEBUG cinder.coordination [None req-2ded4ed6-84b9-4cbe-88f2-6877e082f942 tempest-CinderUnicodeTest-1125298232 None] Lock "cinder-quobyte-1ef6c1d5-e9cc-468e-8aa2-1000a022e897" acquired by "delete_volume" :: waited 0.047s {{(pid=83259) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 16 15:15:48 devstack cinder-volume[83259]: DEBUG oslo.privsep.daemon [-] privsep: reply[3bfaeb1e-09ea-4482-a54b-53e510f7fbac]: (4, 'qcow2') {{(pid=84312) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 16 15:15:48 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [None req-2ded4ed6-84b9-4cbe-88f2-6877e082f942 tempest-CinderUnicodeTest-1125298232 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c/volume-1ef6c1d5-e9cc-468e-8aa2-1000a022e897 {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 15:15:49 devstack quobyte-client[83286]: System call of process 96976 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 16 15:15:49 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [None req-2ded4ed6-84b9-4cbe-88f2-6877e082f942 tempest-CinderUnicodeTest-1125298232 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c/volume-1ef6c1d5-e9cc-468e-8aa2-1000a022e897" returned: 0 in 1.297s {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 15:15:49 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [None req-2ded4ed6-84b9-4cbe-88f2-6877e082f942 tempest-CinderUnicodeTest-1125298232 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c/volume-1ef6c1d5-e9cc-468e-8aa2-1000a022e897 {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 15:15:49 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [None req-2ded4ed6-84b9-4cbe-88f2-6877e082f942 tempest-CinderUnicodeTest-1125298232 None] CMD "rm -f /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c/volume-1ef6c1d5-e9cc-468e-8aa2-1000a022e897" returned: 0 in 0.231s {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 15:15:49 devstack cinder-volume[83259]: DEBUG cinder.coordination [None req-2ded4ed6-84b9-4cbe-88f2-6877e082f942 tempest-CinderUnicodeTest-1125298232 None] Lock "cinder-quobyte-1ef6c1d5-e9cc-468e-8aa2-1000a022e897" released by "delete_volume" :: held 1.933s {{(pid=83259) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 16 15:15:50 devstack cinder-volume[83259]: DEBUG cinder.quota [None req-2ded4ed6-84b9-4cbe-88f2-6877e082f942 tempest-CinderUnicodeTest-1125298232 None] Created reservations ['a1038d45-910e-46f3-a5dd-b6754674c75a', '698714b2-bb34-4055-afbd-c5d069e4a157', 'bbf76984-1697-46ee-9d92-af0cd972c232', 'dc5a8793-bf11-43d1-bd0f-5d337dbcef68'] {{(pid=83259) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 16 15:15:50 devstack cinder-volume[83259]: DEBUG oslo_concurrency.lockutils [None req-2ded4ed6-84b9-4cbe-88f2-6877e082f942 tempest-CinderUnicodeTest-1125298232 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83259) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 16 15:15:50 devstack cinder-volume[83259]: DEBUG oslo_concurrency.lockutils [None req-2ded4ed6-84b9-4cbe-88f2-6877e082f942 tempest-CinderUnicodeTest-1125298232 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.005s {{(pid=83259) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 16 15:15:50 devstack cinder-volume[83259]: DEBUG cinder.volume.drivers.quobyte [None req-2ded4ed6-84b9-4cbe-88f2-6877e082f942 tempest-CinderUnicodeTest-1125298232 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-61f585ac-f8e2-4d19-a890-7ebc2726cc72': None} {{(pid=83259) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:639}} Sep 16 15:15:50 devstack cinder-volume[83259]: DEBUG cinder.volume.drivers.quobyte [None req-2ded4ed6-84b9-4cbe-88f2-6877e082f942 tempest-CinderUnicodeTest-1125298232 None] Available shares ['10.10.41.181/cinder-vol-61f585ac-f8e2-4d19-a890-7ebc2726cc72'] {{(pid=83259) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:669}} Sep 16 15:15:50 devstack cinder-volume[83259]: DEBUG oslo_concurrency.lockutils [None req-2ded4ed6-84b9-4cbe-88f2-6877e082f942 tempest-CinderUnicodeTest-1125298232 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.023s {{(pid=83259) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 16 15:15:50 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [None req-2ded4ed6-84b9-4cbe-88f2-6877e082f942 tempest-CinderUnicodeTest-1125298232 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 15:15:50 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [None req-2ded4ed6-84b9-4cbe-88f2-6877e082f942 tempest-CinderUnicodeTest-1125298232 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c" returned: 0 in 0.093s {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 15:15:50 devstack cinder-volume[83259]: DEBUG cinder.manager [None req-2ded4ed6-84b9-4cbe-88f2-6877e082f942 tempest-CinderUnicodeTest-1125298232 None] Notifying Schedulers of capabilities ... {{(pid=83259) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 16 15:15:50 devstack cinder-volume[83259]: INFO cinder.volume.manager [None req-2ded4ed6-84b9-4cbe-88f2-6877e082f942 tempest-CinderUnicodeTest-1125298232 None] Deleted volume successfully. Sep 16 15:15:51 devstack cinder-volume[83259]: DEBUG cinder.coordination [None req-2ded4ed6-84b9-4cbe-88f2-6877e082f942 tempest-CinderUnicodeTest-1125298232 None] Lock "cinder-1ef6c1d5-e9cc-468e-8aa2-1000a022e897-delete_volume" released by "delete_volume" :: held 3.544s {{(pid=83259) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 16 15:15:51 devstack sudo[96967]: pam_unix(sudo:session): session closed for user root Sep 16 15:15:51 devstack cinder-volume[83259]: DEBUG cinder.coordination [None req-8f702382-9d07-40d5-8a4d-067cd92da0cc tempest-CinderUnicodeTest-1125298232 None] Acquiring lock "cinder-5c7afb33-bbdf-4a4f-a240-6071d3810533-delete_volume" by "delete_volume" {{(pid=83259) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 16 15:15:51 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [None req-95824d49-845b-43aa-96da-bb9689cc20c4 tempest-TestInstancesWithCinderVolumes-1096446095 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_2ad9fbf6-87ee-42d2-8aa6-f59a2ce6caa6_ivejyxw8devstack@QuobyteHD /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c/volume-fe0a6272-f5d7-45de-8211-43dcdab851c8" returned: 0 in 5.699s {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 15:15:51 devstack cinder-volume[83259]: DEBUG cinder.image.image_utils [None req-95824d49-845b-43aa-96da-bb9689cc20c4 tempest-TestInstancesWithCinderVolumes-1096446095 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_2ad9fbf6-87ee-42d2-8aa6-f59a2ce6caa6_ivejyxw8devstack@QuobyteHD, size 112.00 MB, duration 5.72 sec, destination /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c/volume-fe0a6272-f5d7-45de-8211-43dcdab851c8 {{(pid=83259) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:501}} Sep 16 15:15:51 devstack cinder-volume[83259]: INFO cinder.image.image_utils [None req-95824d49-845b-43aa-96da-bb9689cc20c4 tempest-TestInstancesWithCinderVolumes-1096446095 None] Converted 112.00 MB image at 19.57 MB/s Sep 16 15:15:51 devstack cinder-volume[83259]: DEBUG cinder.coordination [None req-8f702382-9d07-40d5-8a4d-067cd92da0cc tempest-CinderUnicodeTest-1125298232 None] Lock "cinder-5c7afb33-bbdf-4a4f-a240-6071d3810533-delete_volume" acquired by "delete_volume" :: waited 0.053s {{(pid=83259) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 16 15:15:51 devstack cinder-volume[83259]: DEBUG oslo.privsep.daemon [-] privsep: reply[87f38ebe-5331-4be3-9f19-d174c90f3d84]: (4, 'qcow2') {{(pid=84312) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 16 15:15:51 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [None req-95824d49-845b-43aa-96da-bb9689cc20c4 tempest-TestInstancesWithCinderVolumes-1096446095 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c/volume-fe0a6272-f5d7-45de-8211-43dcdab851c8 {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 15:15:52 devstack quobyte-client[83286]: System call of process 96998 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 16 15:15:52 devstack cinder-volume[83259]: WARNING cinder.volume.volume_utils [None req-8f702382-9d07-40d5-8a4d-067cd92da0cc tempest-CinderUnicodeTest-1125298232 None] Volume driver (QuobyteDriver 1.2) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 16 15:15:52 devstack cinder-volume[83259]: DEBUG cinder.coordination [None req-8f702382-9d07-40d5-8a4d-067cd92da0cc tempest-CinderUnicodeTest-1125298232 None] Acquiring lock "cinder-quobyte-5c7afb33-bbdf-4a4f-a240-6071d3810533" by "delete_volume" {{(pid=83259) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 16 15:15:52 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [None req-95824d49-845b-43aa-96da-bb9689cc20c4 tempest-TestInstancesWithCinderVolumes-1096446095 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c/volume-fe0a6272-f5d7-45de-8211-43dcdab851c8" returned: 0 in 0.774s {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 15:15:52 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [None req-95824d49-845b-43aa-96da-bb9689cc20c4 tempest-TestInstancesWithCinderVolumes-1096446095 None] Running cmd (subprocess): qemu-img resize /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c/volume-fe0a6272-f5d7-45de-8211-43dcdab851c8 1G {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 15:15:52 devstack quobyte-client[83286]: System call of process 97001 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 16 15:15:52 devstack cinder-volume[83259]: DEBUG cinder.coordination [None req-8f702382-9d07-40d5-8a4d-067cd92da0cc tempest-CinderUnicodeTest-1125298232 None] Lock "cinder-quobyte-5c7afb33-bbdf-4a4f-a240-6071d3810533" acquired by "delete_volume" :: waited 0.284s {{(pid=83259) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 16 15:15:52 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [None req-95824d49-845b-43aa-96da-bb9689cc20c4 tempest-TestInstancesWithCinderVolumes-1096446095 None] CMD "qemu-img resize /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c/volume-fe0a6272-f5d7-45de-8211-43dcdab851c8 1G" returned: 0 in 0.311s {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 15:15:52 devstack cinder-volume[83259]: DEBUG cinder.volume.volume_utils [None req-95824d49-845b-43aa-96da-bb9689cc20c4 tempest-TestInstancesWithCinderVolumes-1096446095 None] Downloaded image 2ad9fbf6-87ee-42d2-8aa6-f59a2ce6caa6 ((None, [{'url': 'file:///opt/stack/data/glance/images/2ad9fbf6-87ee-42d2-8aa6-f59a2ce6caa6', 'metadata': {}}])) to volume fe0a6272-f5d7-45de-8211-43dcdab851c8 successfully. {{(pid=83259) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1234}} Sep 16 15:15:52 devstack cinder-volume[83259]: DEBUG cinder.image.image_utils [None req-95824d49-845b-43aa-96da-bb9689cc20c4 tempest-TestInstancesWithCinderVolumes-1096446095 None] Temporary image 2ad9fbf6-87ee-42d2-8aa6-f59a2ce6caa6 for user c175c709abb142329cb0dd1bfec5e203 is deleted. {{(pid=83259) fetch /opt/stack/cinder/cinder/image/image_utils.py:1403}} Sep 16 15:15:52 devstack cinder-volume[83259]: DEBUG cinder.volume.volume_utils [None req-95824d49-845b-43aa-96da-bb9689cc20c4 tempest-TestInstancesWithCinderVolumes-1096446095 None] Marking volume fe0a6272-f5d7-45de-8211-43dcdab851c8 as bootable. {{(pid=83259) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1138}} Sep 16 15:15:52 devstack cinder-volume[83259]: DEBUG oslo.privsep.daemon [-] privsep: reply[5cd78a8a-f613-4d78-9c58-b20092c62919]: (4, 'qcow2') {{(pid=84312) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 16 15:15:52 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [None req-8f702382-9d07-40d5-8a4d-067cd92da0cc tempest-CinderUnicodeTest-1125298232 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c/volume-5c7afb33-bbdf-4a4f-a240-6071d3810533 {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 15:15:53 devstack cinder-volume[83259]: DEBUG cinder.volume.flows.manager.create_volume [None req-95824d49-845b-43aa-96da-bb9689cc20c4 tempest-TestInstancesWithCinderVolumes-1096446095 None] Copying metadata from image 2ad9fbf6-87ee-42d2-8aa6-f59a2ce6caa6 to fe0a6272-f5d7-45de-8211-43dcdab851c8. {{(pid=83259) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Sep 16 15:15:53 devstack cinder-volume[83259]: DEBUG cinder.volume.flows.manager.create_volume [None req-95824d49-845b-43aa-96da-bb9689cc20c4 tempest-TestInstancesWithCinderVolumes-1096446095 None] Creating volume glance metadata for volume fe0a6272-f5d7-45de-8211-43dcdab851c8 backed by image 2ad9fbf6-87ee-42d2-8aa6-f59a2ce6caa6 with: {'image_id': '2ad9fbf6-87ee-42d2-8aa6-f59a2ce6caa6', 'image_name': 'tempest-scenario-img--1800543744', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=83259) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Sep 16 15:15:54 devstack cinder-volume[83259]: DEBUG cinder.volume.manager [None req-95824d49-845b-43aa-96da-bb9689cc20c4 tempest-TestInstancesWithCinderVolumes-1096446095 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0117ff14-91da-499e-b23b-02ef8d666022) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-fe0a6272-f5d7-45de-8211-43dcdab851c8', 'volume_size': 1, 'image_id': '2ad9fbf6-87ee-42d2-8aa6-f59a2ce6caa6', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/2ad9fbf6-87ee-42d2-8aa6-f59a2ce6caa6', 'metadata': {}}]), 'image_meta': {'name': 'tempest-scenario-img--1800543744', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'private', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'de0e15312a36448cb4bd348b6865ab9c', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '2ad9fbf6-87ee-42d2-8aa6-f59a2ce6caa6', 'created_at': datetime.datetime(2025, 9, 16, 13, 15, 5, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2025, 9, 16, 13, 15, 8, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/2ad9fbf6-87ee-42d2-8aa6-f59a2ce6caa6/file', 'properties': {}}, 'image_service': }' {{(pid=83259) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 15:15:54 devstack cinder-volume[83259]: DEBUG cinder.volume.manager [None req-95824d49-845b-43aa-96da-bb9689cc20c4 tempest-TestInstancesWithCinderVolumes-1096446095 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (02c1aac0-e408-4288-bc0f-b0369bf8950d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83259) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 15:15:54 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [None req-8f702382-9d07-40d5-8a4d-067cd92da0cc tempest-CinderUnicodeTest-1125298232 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c/volume-5c7afb33-bbdf-4a4f-a240-6071d3810533" returned: 0 in 1.203s {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 15:15:54 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [None req-8f702382-9d07-40d5-8a4d-067cd92da0cc tempest-CinderUnicodeTest-1125298232 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c/volume-5c7afb33-bbdf-4a4f-a240-6071d3810533 {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 15:15:54 devstack cinder-volume[83259]: INFO cinder.volume.flows.manager.create_volume [None req-95824d49-845b-43aa-96da-bb9689cc20c4 tempest-TestInstancesWithCinderVolumes-1096446095 None] Volume volume-fe0a6272-f5d7-45de-8211-43dcdab851c8 (fe0a6272-f5d7-45de-8211-43dcdab851c8): created successfully Sep 16 15:15:54 devstack cinder-volume[83259]: DEBUG cinder.volume.manager [None req-95824d49-845b-43aa-96da-bb9689cc20c4 tempest-TestInstancesWithCinderVolumes-1096446095 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (02c1aac0-e408-4288-bc0f-b0369bf8950d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83259) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 15:15:54 devstack cinder-volume[83259]: DEBUG cinder.volume.manager [None req-95824d49-845b-43aa-96da-bb9689cc20c4 tempest-TestInstancesWithCinderVolumes-1096446095 None] Flow 'volume_create_manager' (9a025f2e-665f-4289-bbc8-8ca044f2a8a1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83259) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 16 15:15:55 devstack cinder-volume[83259]: INFO cinder.volume.manager [None req-95824d49-845b-43aa-96da-bb9689cc20c4 tempest-TestInstancesWithCinderVolumes-1096446095 None] Created volume successfully. Sep 16 15:15:55 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [None req-8f702382-9d07-40d5-8a4d-067cd92da0cc tempest-CinderUnicodeTest-1125298232 None] CMD "rm -f /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c/volume-5c7afb33-bbdf-4a4f-a240-6071d3810533" returned: 0 in 1.279s {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 15:15:55 devstack cinder-volume[83259]: DEBUG cinder.coordination [None req-8f702382-9d07-40d5-8a4d-067cd92da0cc tempest-CinderUnicodeTest-1125298232 None] Lock "cinder-quobyte-5c7afb33-bbdf-4a4f-a240-6071d3810533" released by "delete_volume" :: held 3.068s {{(pid=83259) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 16 15:15:56 devstack cinder-volume[83259]: WARNING cinder.volume.volume_utils [None req-0854624c-4edd-4c0c-8ac4-a9737f6068ae tempest-TestMinimumBasicScenario-992444150 None] Volume driver (QuobyteDriver 1.2) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 16 15:15:56 devstack cinder-volume[83259]: DEBUG cinder.volume.flows.manager.create_volume [None req-0854624c-4edd-4c0c-8ac4-a9737f6068ae tempest-TestMinimumBasicScenario-992444150 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#Quobyte'], 'hosts': ['devstack@QuobyteHD#Quobyte']} {{(pid=83259) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1387}} Sep 16 15:15:56 devstack cinder-volume[83259]: DEBUG cinder.volume.manager [None req-0854624c-4edd-4c0c-8ac4-a9737f6068ae tempest-TestMinimumBasicScenario-992444150 None] Flow 'volume_create_manager' (a59e2ff2-f300-47b6-a7a4-38f8bf989bb7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83259) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 16 15:15:56 devstack cinder-volume[83259]: DEBUG cinder.volume.manager [None req-0854624c-4edd-4c0c-8ac4-a9737f6068ae tempest-TestMinimumBasicScenario-992444150 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (138a9882-615c-4183-abf4-4fd555ee6163) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83259) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 15:15:56 devstack cinder-volume[83259]: DEBUG cinder.volume.manager [None req-0854624c-4edd-4c0c-8ac4-a9737f6068ae tempest-TestMinimumBasicScenario-992444150 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (138a9882-615c-4183-abf4-4fd555ee6163) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-16T13:15:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestMinimumBasicScenario-volume-977574868',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#Quobyte',id=e25d09e4-9bd9-44b1-8f67-a8826c7cf123,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='004774d3bd0c4316a1b0a557ebb8d00a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-16T13:15:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-16T13:15:56Z,use_quota=True,user_id='60ca601d77b84e23b1fbe9264a0deff9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(485ead50-3df8-4d76-8d34-a4db136c980a),volume_type_id=485ead50-3df8-4d76-8d34-a4db136c980a)' {{(pid=83259) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 15:15:56 devstack cinder-volume[83259]: DEBUG cinder.volume.manager [None req-0854624c-4edd-4c0c-8ac4-a9737f6068ae tempest-TestMinimumBasicScenario-992444150 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (093ad669-e5f0-4740-b234-1ccf03493d99) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83259) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 15:15:56 devstack cinder-volume[83259]: DEBUG cinder.volume.manager [None req-0854624c-4edd-4c0c-8ac4-a9737f6068ae tempest-TestMinimumBasicScenario-992444150 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (093ad669-e5f0-4740-b234-1ccf03493d99) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83259) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 15:15:56 devstack cinder-volume[83259]: DEBUG cinder.volume.manager [None req-0854624c-4edd-4c0c-8ac4-a9737f6068ae tempest-TestMinimumBasicScenario-992444150 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (57692881-3040-4463-9653-fc9b4cf0de5d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83259) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 15:15:56 devstack cinder-volume[83259]: DEBUG cinder.volume.manager [None req-0854624c-4edd-4c0c-8ac4-a9737f6068ae tempest-TestMinimumBasicScenario-992444150 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (57692881-3040-4463-9653-fc9b4cf0de5d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e25d09e4-9bd9-44b1-8f67-a8826c7cf123', 'volume_name': 'volume-e25d09e4-9bd9-44b1-8f67-a8826c7cf123', 'volume_size': 1}' {{(pid=83259) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 15:15:56 devstack cinder-volume[83259]: DEBUG cinder.volume.manager [None req-0854624c-4edd-4c0c-8ac4-a9737f6068ae tempest-TestMinimumBasicScenario-992444150 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cf89f308-cb44-4bf7-a680-b6b0625898f1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83259) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 15:15:56 devstack cinder-volume[83259]: DEBUG cinder.volume.manager [None req-0854624c-4edd-4c0c-8ac4-a9737f6068ae tempest-TestMinimumBasicScenario-992444150 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cf89f308-cb44-4bf7-a680-b6b0625898f1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83259) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 15:15:56 devstack cinder-volume[83259]: DEBUG cinder.volume.manager [None req-0854624c-4edd-4c0c-8ac4-a9737f6068ae tempest-TestMinimumBasicScenario-992444150 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (221685a9-0e0b-4e9c-ba5d-cac900a0c15b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83259) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 15:15:56 devstack cinder-volume[83259]: INFO cinder.volume.flows.manager.create_volume [None req-0854624c-4edd-4c0c-8ac4-a9737f6068ae tempest-TestMinimumBasicScenario-992444150 None] Volume e25d09e4-9bd9-44b1-8f67-a8826c7cf123: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e25d09e4-9bd9-44b1-8f67-a8826c7cf123', 'volume_size': 1} Sep 16 15:15:56 devstack cinder-volume[83259]: DEBUG oslo_concurrency.lockutils [None req-0854624c-4edd-4c0c-8ac4-a9737f6068ae tempest-TestMinimumBasicScenario-992444150 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83259) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 16 15:15:56 devstack cinder-volume[83259]: DEBUG oslo_concurrency.lockutils [None req-0854624c-4edd-4c0c-8ac4-a9737f6068ae tempest-TestMinimumBasicScenario-992444150 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.003s {{(pid=83259) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 16 15:15:56 devstack cinder-volume[83259]: DEBUG cinder.volume.drivers.quobyte [None req-0854624c-4edd-4c0c-8ac4-a9737f6068ae tempest-TestMinimumBasicScenario-992444150 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-16T13:15:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestMinimumBasicScenario-volume-977574868',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#Quobyte',id=e25d09e4-9bd9-44b1-8f67-a8826c7cf123,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='004774d3bd0c4316a1b0a557ebb8d00a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-16T13:15:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-16T13:15:56Z,use_quota=True,user_id='60ca601d77b84e23b1fbe9264a0deff9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(485ead50-3df8-4d76-8d34-a4db136c980a),volume_type_id=485ead50-3df8-4d76-8d34-a4db136c980a)}" {{(pid=83259) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Sep 16 15:15:56 devstack cinder-volume[83259]: DEBUG cinder.volume.drivers.remotefs [None req-0854624c-4edd-4c0c-8ac4-a9737f6068ae tempest-TestMinimumBasicScenario-992444150 None] Creating volume e25d09e4-9bd9-44b1-8f67-a8826c7cf123 {{(pid=83259) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}} Sep 16 15:15:56 devstack cinder-volume[83259]: DEBUG oslo_concurrency.lockutils [None req-0854624c-4edd-4c0c-8ac4-a9737f6068ae tempest-TestMinimumBasicScenario-992444150 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83259) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 16 15:15:56 devstack cinder-volume[83259]: DEBUG oslo_concurrency.lockutils [None req-0854624c-4edd-4c0c-8ac4-a9737f6068ae tempest-TestMinimumBasicScenario-992444150 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83259) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 16 15:15:56 devstack cinder-volume[83259]: DEBUG cinder.volume.drivers.quobyte [None req-0854624c-4edd-4c0c-8ac4-a9737f6068ae tempest-TestMinimumBasicScenario-992444150 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-61f585ac-f8e2-4d19-a890-7ebc2726cc72': None} {{(pid=83259) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:639}} Sep 16 15:15:56 devstack cinder-volume[83259]: DEBUG cinder.volume.drivers.quobyte [None req-0854624c-4edd-4c0c-8ac4-a9737f6068ae tempest-TestMinimumBasicScenario-992444150 None] Available shares ['10.10.41.181/cinder-vol-61f585ac-f8e2-4d19-a890-7ebc2726cc72'] {{(pid=83259) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:669}} Sep 16 15:15:56 devstack cinder-volume[83259]: DEBUG oslo_concurrency.lockutils [None req-0854624c-4edd-4c0c-8ac4-a9737f6068ae tempest-TestMinimumBasicScenario-992444150 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.021s {{(pid=83259) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 16 15:15:56 devstack cinder-volume[83259]: DEBUG cinder.volume.drivers.quobyte [None req-0854624c-4edd-4c0c-8ac4-a9737f6068ae tempest-TestMinimumBasicScenario-992444150 None] Selected 10.10.41.181/cinder-vol-61f585ac-f8e2-4d19-a890-7ebc2726cc72 as target Quobyte volume. {{(pid=83259) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:690}} Sep 16 15:15:56 devstack cinder-volume[83259]: INFO cinder.volume.drivers.remotefs [None req-0854624c-4edd-4c0c-8ac4-a9737f6068ae tempest-TestMinimumBasicScenario-992444150 None] casted to 10.10.41.181/cinder-vol-61f585ac-f8e2-4d19-a890-7ebc2726cc72 Sep 16 15:15:56 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [None req-0854624c-4edd-4c0c-8ac4-a9737f6068ae tempest-TestMinimumBasicScenario-992444150 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c/volume-e25d09e4-9bd9-44b1-8f67-a8826c7cf123 1073741824 {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 15:15:56 devstack quobyte-client[83286]: System call of process 97010 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 16 15:15:56 devstack quobyte-client[83286]: The server volume:87712ffe-8a69-446d-9ed6-4430c7ee9792@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=87712ffe-8a69-446d-9ed6-4430c7ee9792, inode=139, name=volume-e25d09e4-9bd9-44b1-8f67-a8826c7cf123, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.206), requestorAccessMask=0 Sep 16 15:15:56 devstack cinder-volume[83259]: DEBUG cinder.quota [None req-8f702382-9d07-40d5-8a4d-067cd92da0cc tempest-CinderUnicodeTest-1125298232 None] Created reservations ['21c3b804-578a-4596-8795-3f2706d73587', 'da9b357d-ff22-4512-ac62-eaf54ead91e6', '3e044742-bd47-4171-b4de-66cfdd8cc1c5', '73e2a1f7-d493-474d-b427-9c3b3cc38604'] {{(pid=83259) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 16 15:15:57 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [None req-0854624c-4edd-4c0c-8ac4-a9737f6068ae tempest-TestMinimumBasicScenario-992444150 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c/volume-e25d09e4-9bd9-44b1-8f67-a8826c7cf123 1073741824" returned: 0 in 0.789s {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 15:15:57 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [None req-0854624c-4edd-4c0c-8ac4-a9737f6068ae tempest-TestMinimumBasicScenario-992444150 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c/volume-e25d09e4-9bd9-44b1-8f67-a8826c7cf123 {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 15:15:57 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [None req-0854624c-4edd-4c0c-8ac4-a9737f6068ae tempest-TestMinimumBasicScenario-992444150 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c/volume-e25d09e4-9bd9-44b1-8f67-a8826c7cf123" returned: 0 in 0.598s {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 15:15:57 devstack cinder-volume[83259]: DEBUG cinder.volume.drivers.quobyte [None req-0854624c-4edd-4c0c-8ac4-a9737f6068ae tempest-TestMinimumBasicScenario-992444150 None] <== create_volume: return (1496ms) {'provider_location': '10.10.41.181/cinder-vol-61f585ac-f8e2-4d19-a890-7ebc2726cc72'} {{(pid=83259) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Sep 16 15:15:57 devstack cinder-volume[83259]: DEBUG oslo_concurrency.lockutils [None req-0854624c-4edd-4c0c-8ac4-a9737f6068ae tempest-TestMinimumBasicScenario-992444150 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.530s {{(pid=83259) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 16 15:15:58 devstack cinder-volume[83259]: DEBUG cinder.volume.manager [None req-0854624c-4edd-4c0c-8ac4-a9737f6068ae tempest-TestMinimumBasicScenario-992444150 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (221685a9-0e0b-4e9c-ba5d-cac900a0c15b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e25d09e4-9bd9-44b1-8f67-a8826c7cf123', 'volume_size': 1}' {{(pid=83259) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 15:15:58 devstack cinder-volume[83259]: DEBUG cinder.volume.manager [None req-0854624c-4edd-4c0c-8ac4-a9737f6068ae tempest-TestMinimumBasicScenario-992444150 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4e05ea0f-5b42-4f8f-b300-b4f681c83b5b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83259) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 15:15:58 devstack cinder-volume[83259]: INFO cinder.volume.flows.manager.create_volume [None req-0854624c-4edd-4c0c-8ac4-a9737f6068ae tempest-TestMinimumBasicScenario-992444150 None] Volume volume-e25d09e4-9bd9-44b1-8f67-a8826c7cf123 (e25d09e4-9bd9-44b1-8f67-a8826c7cf123): created successfully Sep 16 15:15:58 devstack cinder-volume[83259]: DEBUG cinder.volume.manager [None req-0854624c-4edd-4c0c-8ac4-a9737f6068ae tempest-TestMinimumBasicScenario-992444150 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4e05ea0f-5b42-4f8f-b300-b4f681c83b5b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83259) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 15:15:58 devstack cinder-volume[83259]: DEBUG cinder.volume.manager [None req-0854624c-4edd-4c0c-8ac4-a9737f6068ae tempest-TestMinimumBasicScenario-992444150 None] Flow 'volume_create_manager' (a59e2ff2-f300-47b6-a7a4-38f8bf989bb7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83259) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 16 15:15:58 devstack cinder-volume[83259]: INFO cinder.volume.manager [None req-0854624c-4edd-4c0c-8ac4-a9737f6068ae tempest-TestMinimumBasicScenario-992444150 None] Created volume successfully. Sep 16 15:15:58 devstack cinder-volume[83259]: DEBUG oslo_concurrency.lockutils [None req-8f702382-9d07-40d5-8a4d-067cd92da0cc tempest-CinderUnicodeTest-1125298232 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83259) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 16 15:15:58 devstack cinder-volume[83259]: DEBUG oslo_concurrency.lockutils [None req-8f702382-9d07-40d5-8a4d-067cd92da0cc tempest-CinderUnicodeTest-1125298232 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=83259) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 16 15:15:58 devstack cinder-volume[83259]: DEBUG cinder.volume.drivers.quobyte [None req-8f702382-9d07-40d5-8a4d-067cd92da0cc tempest-CinderUnicodeTest-1125298232 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-61f585ac-f8e2-4d19-a890-7ebc2726cc72': None} {{(pid=83259) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:639}} Sep 16 15:15:58 devstack cinder-volume[83259]: DEBUG cinder.volume.drivers.quobyte [None req-8f702382-9d07-40d5-8a4d-067cd92da0cc tempest-CinderUnicodeTest-1125298232 None] Available shares ['10.10.41.181/cinder-vol-61f585ac-f8e2-4d19-a890-7ebc2726cc72'] {{(pid=83259) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:669}} Sep 16 15:15:58 devstack cinder-volume[83259]: DEBUG oslo_concurrency.lockutils [None req-8f702382-9d07-40d5-8a4d-067cd92da0cc tempest-CinderUnicodeTest-1125298232 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=83259) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 16 15:15:58 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [None req-8f702382-9d07-40d5-8a4d-067cd92da0cc tempest-CinderUnicodeTest-1125298232 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 15:15:59 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [None req-8f702382-9d07-40d5-8a4d-067cd92da0cc tempest-CinderUnicodeTest-1125298232 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c" returned: 0 in 0.898s {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 15:15:59 devstack cinder-volume[83259]: DEBUG cinder.manager [None req-8f702382-9d07-40d5-8a4d-067cd92da0cc tempest-CinderUnicodeTest-1125298232 None] Notifying Schedulers of capabilities ... {{(pid=83259) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 16 15:15:59 devstack cinder-volume[83259]: INFO cinder.volume.manager [None req-8f702382-9d07-40d5-8a4d-067cd92da0cc tempest-CinderUnicodeTest-1125298232 None] Deleted volume successfully. Sep 16 15:16:00 devstack cinder-volume[83259]: DEBUG cinder.coordination [None req-8f702382-9d07-40d5-8a4d-067cd92da0cc tempest-CinderUnicodeTest-1125298232 None] Lock "cinder-5c7afb33-bbdf-4a4f-a240-6071d3810533-delete_volume" released by "delete_volume" :: held 8.710s {{(pid=83259) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 16 15:16:05 devstack cinder-volume[83259]: DEBUG oslo_concurrency.lockutils [req-b7289ece-38d9-4ee2-98fd-2d3929dc4f43 req-4a104615-cb6e-4957-abd5-002921493d9c tempest-TestMinimumBasicScenario-992444150 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=83259) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 16 15:16:05 devstack cinder-volume[83259]: DEBUG oslo_concurrency.lockutils [req-b7289ece-38d9-4ee2-98fd-2d3929dc4f43 req-4a104615-cb6e-4957-abd5-002921493d9c tempest-TestMinimumBasicScenario-992444150 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.004s {{(pid=83259) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 16 15:16:05 devstack cinder-volume[83259]: DEBUG oslo.privsep.daemon [-] privsep: reply[da688fe7-26c3-4d90-9514-af3ab82ef1a3]: (4, 'qcow2') {{(pid=84312) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 16 15:16:05 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [req-b7289ece-38d9-4ee2-98fd-2d3929dc4f43 req-4a104615-cb6e-4957-abd5-002921493d9c tempest-TestMinimumBasicScenario-992444150 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c/volume-e25d09e4-9bd9-44b1-8f67-a8826c7cf123 {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 15:16:06 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [req-b7289ece-38d9-4ee2-98fd-2d3929dc4f43 req-4a104615-cb6e-4957-abd5-002921493d9c tempest-TestMinimumBasicScenario-992444150 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c/volume-e25d09e4-9bd9-44b1-8f67-a8826c7cf123" returned: 0 in 0.694s {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 15:16:06 devstack cinder-volume[83259]: DEBUG oslo_concurrency.lockutils [req-b7289ece-38d9-4ee2-98fd-2d3929dc4f43 req-4a104615-cb6e-4957-abd5-002921493d9c tempest-TestMinimumBasicScenario-992444150 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.945s {{(pid=83259) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 16 15:16:07 devstack cinder-volume[83259]: DEBUG cinder.volume.manager [req-b7289ece-38d9-4ee2-98fd-2d3929dc4f43 req-4a104615-cb6e-4957-abd5-002921493d9c tempest-TestMinimumBasicScenario-992444150 None] Connection info returned from driver {'export': '10.10.41.181/cinder-vol-61f585ac-f8e2-4d19-a890-7ebc2726cc72', 'name': 'volume-e25d09e4-9bd9-44b1-8f67-a8826c7cf123', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '9373c329-5064-4c3e-bf24-dca0c26d5789', 'enforce_multipath': True} {{(pid=83259) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4891}} Sep 16 15:16:07 devstack cinder-volume[83259]: WARNING cinder.volume.volume_utils [req-b7289ece-38d9-4ee2-98fd-2d3929dc4f43 req-4a104615-cb6e-4957-abd5-002921493d9c tempest-TestMinimumBasicScenario-992444150 None] Volume driver (QuobyteDriver 1.2) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 16 15:16:07 devstack cinder-volume[83259]: INFO cinder.volume.manager [req-b7289ece-38d9-4ee2-98fd-2d3929dc4f43 req-4a104615-cb6e-4957-abd5-002921493d9c tempest-TestMinimumBasicScenario-992444150 None] attachment_update completed successfully. Sep 16 15:16:13 devstack cinder-volume[83259]: DEBUG oslo_concurrency.lockutils [req-21edd8f6-424a-4f48-94c0-e6dc0eeea1aa req-b6c6b824-925f-4f50-8b8d-120b44b1d9d0 tempest-TestInstancesWithCinderVolumes-1096446095 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=83259) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 16 15:16:13 devstack cinder-volume[83259]: DEBUG oslo_concurrency.lockutils [req-21edd8f6-424a-4f48-94c0-e6dc0eeea1aa req-b6c6b824-925f-4f50-8b8d-120b44b1d9d0 tempest-TestInstancesWithCinderVolumes-1096446095 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.005s {{(pid=83259) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 16 15:16:13 devstack cinder-volume[83259]: DEBUG oslo.privsep.daemon [-] privsep: reply[5a93c05e-3c20-46d8-8f58-682eadb97348]: (4, 'qcow2') {{(pid=84312) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 16 15:16:13 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [req-21edd8f6-424a-4f48-94c0-e6dc0eeea1aa req-b6c6b824-925f-4f50-8b8d-120b44b1d9d0 tempest-TestInstancesWithCinderVolumes-1096446095 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c/volume-fe0a6272-f5d7-45de-8211-43dcdab851c8 {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 15:16:14 devstack quobyte-client[83286]: System call of process 97423 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 16 15:16:14 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [req-21edd8f6-424a-4f48-94c0-e6dc0eeea1aa req-b6c6b824-925f-4f50-8b8d-120b44b1d9d0 tempest-TestInstancesWithCinderVolumes-1096446095 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c/volume-fe0a6272-f5d7-45de-8211-43dcdab851c8" returned: 0 in 1.484s {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 15:16:14 devstack cinder-volume[83259]: DEBUG oslo_concurrency.lockutils [req-21edd8f6-424a-4f48-94c0-e6dc0eeea1aa req-b6c6b824-925f-4f50-8b8d-120b44b1d9d0 tempest-TestInstancesWithCinderVolumes-1096446095 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 1.732s {{(pid=83259) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 16 15:16:15 devstack cinder-volume[83259]: DEBUG cinder.volume.manager [req-21edd8f6-424a-4f48-94c0-e6dc0eeea1aa req-b6c6b824-925f-4f50-8b8d-120b44b1d9d0 tempest-TestInstancesWithCinderVolumes-1096446095 None] Connection info returned from driver {'export': '10.10.41.181/cinder-vol-61f585ac-f8e2-4d19-a890-7ebc2726cc72', 'name': 'volume-fe0a6272-f5d7-45de-8211-43dcdab851c8', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'c86f5b85-0124-456d-8a7b-92aad793a7b8', 'enforce_multipath': True} {{(pid=83259) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4891}} Sep 16 15:16:15 devstack cinder-volume[83259]: WARNING cinder.volume.volume_utils [req-21edd8f6-424a-4f48-94c0-e6dc0eeea1aa req-b6c6b824-925f-4f50-8b8d-120b44b1d9d0 tempest-TestInstancesWithCinderVolumes-1096446095 None] Volume driver (QuobyteDriver 1.2) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 16 15:16:15 devstack cinder-volume[83259]: INFO cinder.volume.manager [req-21edd8f6-424a-4f48-94c0-e6dc0eeea1aa req-b6c6b824-925f-4f50-8b8d-120b44b1d9d0 tempest-TestInstancesWithCinderVolumes-1096446095 None] attachment_update completed successfully. Sep 16 15:16:25 devstack cinder-volume[83259]: DEBUG dbcounter [-] [83259] Writing DB stats cinder:SELECT=30,cinder:INSERT=7,cinder:UPDATE=30,cinder:DELETE=2 {{(pid=83259) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Sep 16 15:16:25 devstack cinder-volume[83259]: DEBUG dbcounter [-] [83259] Writing DB stats cinder:INSERT=13,cinder:UPDATE=28,cinder:SELECT=31,cinder:DELETE=2 {{(pid=83259) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Sep 16 15:16:46 devstack cinder-volume[83259]: DEBUG oslo_service.periodic_task [None req-050ec8a1-6ffd-499d-95ad-d548a84437e2 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=83259) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} Sep 16 15:16:46 devstack cinder-volume[83259]: DEBUG oslo_concurrency.lockutils [None req-050ec8a1-6ffd-499d-95ad-d548a84437e2 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83259) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 16 15:16:46 devstack cinder-volume[83259]: DEBUG oslo_concurrency.lockutils [None req-050ec8a1-6ffd-499d-95ad-d548a84437e2 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.017s {{(pid=83259) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 16 15:16:46 devstack cinder-volume[83259]: DEBUG cinder.volume.drivers.quobyte [None req-050ec8a1-6ffd-499d-95ad-d548a84437e2 None None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-61f585ac-f8e2-4d19-a890-7ebc2726cc72': None} {{(pid=83259) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:639}} Sep 16 15:16:46 devstack cinder-volume[83259]: DEBUG cinder.volume.drivers.quobyte [None req-050ec8a1-6ffd-499d-95ad-d548a84437e2 None None] Available shares ['10.10.41.181/cinder-vol-61f585ac-f8e2-4d19-a890-7ebc2726cc72'] {{(pid=83259) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:669}} Sep 16 15:16:46 devstack cinder-volume[83259]: DEBUG oslo_concurrency.lockutils [None req-050ec8a1-6ffd-499d-95ad-d548a84437e2 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.067s {{(pid=83259) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 16 15:16:46 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [None req-050ec8a1-6ffd-499d-95ad-d548a84437e2 None None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 15:16:47 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [None req-050ec8a1-6ffd-499d-95ad-d548a84437e2 None None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c" returned: 0 in 0.500s {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 15:16:47 devstack cinder-volume[83259]: DEBUG cinder.manager [None req-050ec8a1-6ffd-499d-95ad-d548a84437e2 None None] Notifying Schedulers of capabilities ... {{(pid=83259) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 16 15:16:52 devstack cinder-volume[83259]: WARNING cinder.volume.volume_utils [None req-e0213ae0-43c9-4686-b1e7-ac8967c18d41 tempest-SnapshotDependencyTests-1171685469 None] Volume driver (QuobyteDriver 1.2) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 16 15:16:52 devstack cinder-volume[83259]: DEBUG cinder.volume.flows.manager.create_volume [None req-e0213ae0-43c9-4686-b1e7-ac8967c18d41 tempest-SnapshotDependencyTests-1171685469 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#Quobyte'], 'hosts': ['devstack@QuobyteHD#Quobyte']} {{(pid=83259) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1387}} Sep 16 15:16:52 devstack cinder-volume[83259]: DEBUG cinder.volume.manager [None req-e0213ae0-43c9-4686-b1e7-ac8967c18d41 tempest-SnapshotDependencyTests-1171685469 None] Flow 'volume_create_manager' (a90d6532-7865-4fb9-a40d-a53052c5b336) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83259) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 16 15:16:52 devstack cinder-volume[83259]: DEBUG cinder.volume.manager [None req-e0213ae0-43c9-4686-b1e7-ac8967c18d41 tempest-SnapshotDependencyTests-1171685469 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7e78aa18-89d1-40c2-923c-0fb8f50c9a15) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83259) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 15:16:52 devstack cinder-volume[83259]: DEBUG cinder.volume.manager [None req-e0213ae0-43c9-4686-b1e7-ac8967c18d41 tempest-SnapshotDependencyTests-1171685469 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7e78aa18-89d1-40c2-923c-0fb8f50c9a15) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-16T13:16:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-774296297',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#Quobyte',id=2e3bf701-1ad0-4a3e-8cd0-5e0b2d1ab994,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2238e9dd515f49799ea4a5f1e480eb42',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-16T13:16:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-16T13:16:52Z,use_quota=True,user_id='1094aa0bf92a4f7d8a14114a50890b47',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(485ead50-3df8-4d76-8d34-a4db136c980a),volume_type_id=485ead50-3df8-4d76-8d34-a4db136c980a)' {{(pid=83259) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 15:16:52 devstack cinder-volume[83259]: DEBUG cinder.volume.manager [None req-e0213ae0-43c9-4686-b1e7-ac8967c18d41 tempest-SnapshotDependencyTests-1171685469 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0a970c11-df69-4298-9072-8f44f2022caa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83259) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 15:16:52 devstack cinder-volume[83259]: DEBUG cinder.volume.manager [None req-e0213ae0-43c9-4686-b1e7-ac8967c18d41 tempest-SnapshotDependencyTests-1171685469 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0a970c11-df69-4298-9072-8f44f2022caa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83259) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 15:16:52 devstack cinder-volume[83259]: DEBUG cinder.volume.manager [None req-e0213ae0-43c9-4686-b1e7-ac8967c18d41 tempest-SnapshotDependencyTests-1171685469 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a709676c-6305-4e0a-a0de-20bdfd356836) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83259) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 15:16:52 devstack cinder-volume[83259]: DEBUG cinder.volume.manager [None req-e0213ae0-43c9-4686-b1e7-ac8967c18d41 tempest-SnapshotDependencyTests-1171685469 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a709676c-6305-4e0a-a0de-20bdfd356836) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2e3bf701-1ad0-4a3e-8cd0-5e0b2d1ab994', 'volume_name': 'volume-2e3bf701-1ad0-4a3e-8cd0-5e0b2d1ab994', 'volume_size': 1}' {{(pid=83259) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 15:16:52 devstack cinder-volume[83259]: DEBUG cinder.volume.manager [None req-e0213ae0-43c9-4686-b1e7-ac8967c18d41 tempest-SnapshotDependencyTests-1171685469 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b935c77a-1197-44ae-b20d-a02f12bf8693) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83259) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 15:16:52 devstack cinder-volume[83259]: DEBUG cinder.volume.manager [None req-e0213ae0-43c9-4686-b1e7-ac8967c18d41 tempest-SnapshotDependencyTests-1171685469 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b935c77a-1197-44ae-b20d-a02f12bf8693) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83259) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 15:16:52 devstack cinder-volume[83259]: DEBUG cinder.volume.manager [None req-e0213ae0-43c9-4686-b1e7-ac8967c18d41 tempest-SnapshotDependencyTests-1171685469 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d8e4ba61-601e-4b3f-afa2-aaa9b3198409) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83259) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 15:16:52 devstack cinder-volume[83259]: INFO cinder.volume.flows.manager.create_volume [None req-e0213ae0-43c9-4686-b1e7-ac8967c18d41 tempest-SnapshotDependencyTests-1171685469 None] Volume 2e3bf701-1ad0-4a3e-8cd0-5e0b2d1ab994: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2e3bf701-1ad0-4a3e-8cd0-5e0b2d1ab994', 'volume_size': 1} Sep 16 15:16:52 devstack cinder-volume[83259]: DEBUG oslo_concurrency.lockutils [None req-e0213ae0-43c9-4686-b1e7-ac8967c18d41 tempest-SnapshotDependencyTests-1171685469 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83259) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 16 15:16:52 devstack cinder-volume[83259]: DEBUG oslo_concurrency.lockutils [None req-e0213ae0-43c9-4686-b1e7-ac8967c18d41 tempest-SnapshotDependencyTests-1171685469 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.003s {{(pid=83259) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 16 15:16:52 devstack cinder-volume[83259]: DEBUG cinder.volume.drivers.quobyte [None req-e0213ae0-43c9-4686-b1e7-ac8967c18d41 tempest-SnapshotDependencyTests-1171685469 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-16T13:16:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-774296297',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#Quobyte',id=2e3bf701-1ad0-4a3e-8cd0-5e0b2d1ab994,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2238e9dd515f49799ea4a5f1e480eb42',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-16T13:16:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-16T13:16:52Z,use_quota=True,user_id='1094aa0bf92a4f7d8a14114a50890b47',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(485ead50-3df8-4d76-8d34-a4db136c980a),volume_type_id=485ead50-3df8-4d76-8d34-a4db136c980a)}" {{(pid=83259) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Sep 16 15:16:52 devstack cinder-volume[83259]: DEBUG cinder.volume.drivers.remotefs [None req-e0213ae0-43c9-4686-b1e7-ac8967c18d41 tempest-SnapshotDependencyTests-1171685469 None] Creating volume 2e3bf701-1ad0-4a3e-8cd0-5e0b2d1ab994 {{(pid=83259) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}} Sep 16 15:16:52 devstack cinder-volume[83259]: DEBUG oslo_concurrency.lockutils [None req-e0213ae0-43c9-4686-b1e7-ac8967c18d41 tempest-SnapshotDependencyTests-1171685469 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83259) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 16 15:16:52 devstack cinder-volume[83259]: DEBUG oslo_concurrency.lockutils [None req-e0213ae0-43c9-4686-b1e7-ac8967c18d41 tempest-SnapshotDependencyTests-1171685469 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83259) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 16 15:16:52 devstack cinder-volume[83259]: DEBUG cinder.volume.drivers.quobyte [None req-e0213ae0-43c9-4686-b1e7-ac8967c18d41 tempest-SnapshotDependencyTests-1171685469 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-61f585ac-f8e2-4d19-a890-7ebc2726cc72': None} {{(pid=83259) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:639}} Sep 16 15:16:52 devstack cinder-volume[83259]: DEBUG cinder.volume.drivers.quobyte [None req-e0213ae0-43c9-4686-b1e7-ac8967c18d41 tempest-SnapshotDependencyTests-1171685469 None] Available shares ['10.10.41.181/cinder-vol-61f585ac-f8e2-4d19-a890-7ebc2726cc72'] {{(pid=83259) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:669}} Sep 16 15:16:52 devstack cinder-volume[83259]: DEBUG oslo_concurrency.lockutils [None req-e0213ae0-43c9-4686-b1e7-ac8967c18d41 tempest-SnapshotDependencyTests-1171685469 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=83259) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 16 15:16:52 devstack cinder-volume[83259]: DEBUG cinder.volume.drivers.quobyte [None req-e0213ae0-43c9-4686-b1e7-ac8967c18d41 tempest-SnapshotDependencyTests-1171685469 None] Selected 10.10.41.181/cinder-vol-61f585ac-f8e2-4d19-a890-7ebc2726cc72 as target Quobyte volume. {{(pid=83259) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:690}} Sep 16 15:16:52 devstack cinder-volume[83259]: INFO cinder.volume.drivers.remotefs [None req-e0213ae0-43c9-4686-b1e7-ac8967c18d41 tempest-SnapshotDependencyTests-1171685469 None] casted to 10.10.41.181/cinder-vol-61f585ac-f8e2-4d19-a890-7ebc2726cc72 Sep 16 15:16:52 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [None req-e0213ae0-43c9-4686-b1e7-ac8967c18d41 tempest-SnapshotDependencyTests-1171685469 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c/volume-2e3bf701-1ad0-4a3e-8cd0-5e0b2d1ab994 1073741824 {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 15:16:53 devstack quobyte-client[83286]: The server volume:87712ffe-8a69-446d-9ed6-4430c7ee9792@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=87712ffe-8a69-446d-9ed6-4430c7ee9792, inode=140, name=volume-2e3bf701-1ad0-4a3e-8cd0-5e0b2d1ab994, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.206), requestorAccessMask=0 Sep 16 15:16:53 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [None req-e0213ae0-43c9-4686-b1e7-ac8967c18d41 tempest-SnapshotDependencyTests-1171685469 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c/volume-2e3bf701-1ad0-4a3e-8cd0-5e0b2d1ab994 1073741824" returned: 0 in 0.866s {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 15:16:53 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [None req-e0213ae0-43c9-4686-b1e7-ac8967c18d41 tempest-SnapshotDependencyTests-1171685469 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c/volume-2e3bf701-1ad0-4a3e-8cd0-5e0b2d1ab994 {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 15:16:55 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [None req-e0213ae0-43c9-4686-b1e7-ac8967c18d41 tempest-SnapshotDependencyTests-1171685469 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c/volume-2e3bf701-1ad0-4a3e-8cd0-5e0b2d1ab994" returned: 0 in 1.344s {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 15:16:55 devstack cinder-volume[83259]: DEBUG cinder.volume.drivers.quobyte [None req-e0213ae0-43c9-4686-b1e7-ac8967c18d41 tempest-SnapshotDependencyTests-1171685469 None] <== create_volume: return (2442ms) {'provider_location': '10.10.41.181/cinder-vol-61f585ac-f8e2-4d19-a890-7ebc2726cc72'} {{(pid=83259) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Sep 16 15:16:55 devstack cinder-volume[83259]: DEBUG oslo_concurrency.lockutils [None req-e0213ae0-43c9-4686-b1e7-ac8967c18d41 tempest-SnapshotDependencyTests-1171685469 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.465s {{(pid=83259) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 16 15:16:55 devstack cinder-volume[83259]: DEBUG cinder.volume.manager [None req-e0213ae0-43c9-4686-b1e7-ac8967c18d41 tempest-SnapshotDependencyTests-1171685469 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d8e4ba61-601e-4b3f-afa2-aaa9b3198409) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2e3bf701-1ad0-4a3e-8cd0-5e0b2d1ab994', 'volume_size': 1}' {{(pid=83259) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 15:16:55 devstack cinder-volume[83259]: DEBUG cinder.volume.manager [None req-e0213ae0-43c9-4686-b1e7-ac8967c18d41 tempest-SnapshotDependencyTests-1171685469 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5d3ef6d6-037a-459f-a04b-6f33742f5911) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83259) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 15:16:55 devstack cinder-volume[83259]: INFO cinder.volume.flows.manager.create_volume [None req-e0213ae0-43c9-4686-b1e7-ac8967c18d41 tempest-SnapshotDependencyTests-1171685469 None] Volume volume-2e3bf701-1ad0-4a3e-8cd0-5e0b2d1ab994 (2e3bf701-1ad0-4a3e-8cd0-5e0b2d1ab994): created successfully Sep 16 15:16:55 devstack cinder-volume[83259]: DEBUG cinder.volume.manager [None req-e0213ae0-43c9-4686-b1e7-ac8967c18d41 tempest-SnapshotDependencyTests-1171685469 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5d3ef6d6-037a-459f-a04b-6f33742f5911) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83259) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 15:16:55 devstack cinder-volume[83259]: DEBUG cinder.volume.manager [None req-e0213ae0-43c9-4686-b1e7-ac8967c18d41 tempest-SnapshotDependencyTests-1171685469 None] Flow 'volume_create_manager' (a90d6532-7865-4fb9-a40d-a53052c5b336) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83259) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 16 15:16:56 devstack cinder-volume[83259]: INFO cinder.volume.manager [None req-e0213ae0-43c9-4686-b1e7-ac8967c18d41 tempest-SnapshotDependencyTests-1171685469 None] Created volume successfully. Sep 16 15:16:57 devstack cinder-volume[83259]: WARNING cinder.volume.volume_utils [None req-99319b3e-150a-48f7-b4fe-3f28a69640a6 tempest-SnapshotDependencyTests-1171685469 None] Volume driver (QuobyteDriver 1.2) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 16 15:16:57 devstack cinder-volume[83259]: DEBUG oslo_concurrency.lockutils [None req-99319b3e-150a-48f7-b4fe-3f28a69640a6 tempest-SnapshotDependencyTests-1171685469 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=83259) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 16 15:16:57 devstack cinder-volume[83259]: DEBUG oslo_concurrency.lockutils [None req-99319b3e-150a-48f7-b4fe-3f28a69640a6 tempest-SnapshotDependencyTests-1171685469 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.015s {{(pid=83259) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 16 15:16:57 devstack cinder-volume[83259]: DEBUG cinder.volume.drivers.remotefs [None req-99319b3e-150a-48f7-b4fe-3f28a69640a6 tempest-SnapshotDependencyTests-1171685469 None] Creating offline snapshot 1c91f4e2-ca82-47d3-ac70-5525dd1af9bf of volume 2e3bf701-1ad0-4a3e-8cd0-5e0b2d1ab994 {{(pid=83259) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1694}} Sep 16 15:16:57 devstack cinder-volume[83259]: DEBUG oslo.privsep.daemon [-] privsep: reply[0aa2127f-2ec1-4567-97ba-f3844ed78115]: (4, 'qcow2') {{(pid=84312) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 16 15:16:57 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [None req-99319b3e-150a-48f7-b4fe-3f28a69640a6 tempest-SnapshotDependencyTests-1171685469 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c/volume-2e3bf701-1ad0-4a3e-8cd0-5e0b2d1ab994 {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 15:16:59 devstack quobyte-client[83286]: System call of process 97663 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 16 15:16:59 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [None req-99319b3e-150a-48f7-b4fe-3f28a69640a6 tempest-SnapshotDependencyTests-1171685469 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c/volume-2e3bf701-1ad0-4a3e-8cd0-5e0b2d1ab994" returned: 0 in 1.539s {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 15:16:59 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [None req-99319b3e-150a-48f7-b4fe-3f28a69640a6 tempest-SnapshotDependencyTests-1171685469 None] Running cmd (subprocess): qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c/volume-2e3bf701-1ad0-4a3e-8cd0-5e0b2d1ab994,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c/volume-2e3bf701-1ad0-4a3e-8cd0-5e0b2d1ab994.1c91f4e2-ca82-47d3-ac70-5525dd1af9bf 1G {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 15:16:59 devstack quobyte-client[83286]: System call of process 97666 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 16 15:16:59 devstack quobyte-client[83286]: The server volume:87712ffe-8a69-446d-9ed6-4430c7ee9792@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=87712ffe-8a69-446d-9ed6-4430c7ee9792, inode=141, name=volume-2e3bf701-1ad0-4a3e-8cd0-5e0b2d1ab994.1c91f4e2-ca82-47d3-ac70-5525dd1af9bf, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.206), requestorAccessMask=0 Sep 16 15:17:00 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [None req-99319b3e-150a-48f7-b4fe-3f28a69640a6 tempest-SnapshotDependencyTests-1171685469 None] CMD "qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c/volume-2e3bf701-1ad0-4a3e-8cd0-5e0b2d1ab994,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c/volume-2e3bf701-1ad0-4a3e-8cd0-5e0b2d1ab994.1c91f4e2-ca82-47d3-ac70-5525dd1af9bf 1G" returned: 0 in 0.674s {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 15:17:00 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [None req-99319b3e-150a-48f7-b4fe-3f28a69640a6 tempest-SnapshotDependencyTests-1171685469 None] Running cmd (subprocess): qemu-img rebase -u -b volume-2e3bf701-1ad0-4a3e-8cd0-5e0b2d1ab994 -F qcow2 /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c/volume-2e3bf701-1ad0-4a3e-8cd0-5e0b2d1ab994.1c91f4e2-ca82-47d3-ac70-5525dd1af9bf {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 15:17:00 devstack quobyte-client[83286]: System call of process 97669 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 16 15:17:00 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [None req-99319b3e-150a-48f7-b4fe-3f28a69640a6 tempest-SnapshotDependencyTests-1171685469 None] CMD "qemu-img rebase -u -b volume-2e3bf701-1ad0-4a3e-8cd0-5e0b2d1ab994 -F qcow2 /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c/volume-2e3bf701-1ad0-4a3e-8cd0-5e0b2d1ab994.1c91f4e2-ca82-47d3-ac70-5525dd1af9bf" returned: 0 in 0.378s {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 15:17:00 devstack cinder-volume[83259]: DEBUG cinder.volume.drivers.remotefs [None req-99319b3e-150a-48f7-b4fe-3f28a69640a6 tempest-SnapshotDependencyTests-1171685469 None] File path /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c/volume-2e3bf701-1ad0-4a3e-8cd0-5e0b2d1ab994.1c91f4e2-ca82-47d3-ac70-5525dd1af9bf is being set with permissions: 660 {{(pid=83259) _set_rw_permissions /opt/stack/cinder/cinder/volume/drivers/remotefs.py:492}} Sep 16 15:17:00 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [None req-99319b3e-150a-48f7-b4fe-3f28a69640a6 tempest-SnapshotDependencyTests-1171685469 None] Running cmd (subprocess): chmod 660 /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c/volume-2e3bf701-1ad0-4a3e-8cd0-5e0b2d1ab994.1c91f4e2-ca82-47d3-ac70-5525dd1af9bf {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 15:17:01 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [None req-99319b3e-150a-48f7-b4fe-3f28a69640a6 tempest-SnapshotDependencyTests-1171685469 None] CMD "chmod 660 /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c/volume-2e3bf701-1ad0-4a3e-8cd0-5e0b2d1ab994.1c91f4e2-ca82-47d3-ac70-5525dd1af9bf" returned: 0 in 0.315s {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 15:17:01 devstack cinder-volume[83259]: DEBUG cinder.volume.drivers.remotefs [None req-99319b3e-150a-48f7-b4fe-3f28a69640a6 tempest-SnapshotDependencyTests-1171685469 None] Setting permissions: /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c/volume-2e3bf701-1ad0-4a3e-8cd0-5e0b2d1ab994 -> 1000:1000 {{(pid=83259) _do_create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1584}} Sep 16 15:17:01 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [None req-99319b3e-150a-48f7-b4fe-3f28a69640a6 tempest-SnapshotDependencyTests-1171685469 None] Running cmd (subprocess): chown --reference=/opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c/volume-2e3bf701-1ad0-4a3e-8cd0-5e0b2d1ab994 /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c/volume-2e3bf701-1ad0-4a3e-8cd0-5e0b2d1ab994.1c91f4e2-ca82-47d3-ac70-5525dd1af9bf {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 15:17:01 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [None req-99319b3e-150a-48f7-b4fe-3f28a69640a6 tempest-SnapshotDependencyTests-1171685469 None] CMD "chown --reference=/opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c/volume-2e3bf701-1ad0-4a3e-8cd0-5e0b2d1ab994 /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c/volume-2e3bf701-1ad0-4a3e-8cd0-5e0b2d1ab994.1c91f4e2-ca82-47d3-ac70-5525dd1af9bf" returned: 0 in 0.270s {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 15:17:01 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [None req-99319b3e-150a-48f7-b4fe-3f28a69640a6 tempest-SnapshotDependencyTests-1171685469 None] Running cmd (subprocess): truncate -s0 /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c/volume-2e3bf701-1ad0-4a3e-8cd0-5e0b2d1ab994.info {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 15:17:02 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [None req-99319b3e-150a-48f7-b4fe-3f28a69640a6 tempest-SnapshotDependencyTests-1171685469 None] CMD "truncate -s0 /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c/volume-2e3bf701-1ad0-4a3e-8cd0-5e0b2d1ab994.info" returned: 0 in 0.362s {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 15:17:02 devstack cinder-volume[83259]: DEBUG cinder.volume.drivers.remotefs [None req-99319b3e-150a-48f7-b4fe-3f28a69640a6 tempest-SnapshotDependencyTests-1171685469 None] File path /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c/volume-2e3bf701-1ad0-4a3e-8cd0-5e0b2d1ab994.info is being set with permissions: 660 {{(pid=83259) _set_rw_permissions /opt/stack/cinder/cinder/volume/drivers/remotefs.py:492}} Sep 16 15:17:02 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [None req-99319b3e-150a-48f7-b4fe-3f28a69640a6 tempest-SnapshotDependencyTests-1171685469 None] Running cmd (subprocess): chmod 660 /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c/volume-2e3bf701-1ad0-4a3e-8cd0-5e0b2d1ab994.info {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 15:17:02 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [None req-99319b3e-150a-48f7-b4fe-3f28a69640a6 tempest-SnapshotDependencyTests-1171685469 None] CMD "chmod 660 /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c/volume-2e3bf701-1ad0-4a3e-8cd0-5e0b2d1ab994.info" returned: 0 in 0.224s {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 15:17:02 devstack cinder-volume[83259]: DEBUG oslo_concurrency.lockutils [None req-99319b3e-150a-48f7-b4fe-3f28a69640a6 tempest-SnapshotDependencyTests-1171685469 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.760s {{(pid=83259) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 16 15:17:03 devstack cinder-volume[83259]: INFO cinder.volume.manager [None req-99319b3e-150a-48f7-b4fe-3f28a69640a6 tempest-SnapshotDependencyTests-1171685469 None] Create snapshot completed successfully Sep 16 15:17:06 devstack cinder-volume[83259]: WARNING cinder.volume.volume_utils [None req-c92e8358-bf6e-4ebe-9470-600c6cb3c5a0 tempest-SnapshotDependencyTests-1171685469 None] Volume driver (QuobyteDriver 1.2) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 16 15:17:06 devstack cinder-volume[83259]: DEBUG cinder.volume.flows.manager.create_volume [None req-c92e8358-bf6e-4ebe-9470-600c6cb3c5a0 tempest-SnapshotDependencyTests-1171685469 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#Quobyte'], 'hosts': ['devstack@QuobyteHD#Quobyte']} {{(pid=83259) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1387}} Sep 16 15:17:06 devstack cinder-volume[83259]: DEBUG cinder.volume.manager [None req-c92e8358-bf6e-4ebe-9470-600c6cb3c5a0 tempest-SnapshotDependencyTests-1171685469 None] Flow 'volume_create_manager' (97cc33aa-4da5-4e3f-b2f4-8859eb95cfd1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83259) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 16 15:17:07 devstack cinder-volume[83259]: DEBUG cinder.volume.manager [None req-c92e8358-bf6e-4ebe-9470-600c6cb3c5a0 tempest-SnapshotDependencyTests-1171685469 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fa4f34e4-18ad-4ce1-a9bb-6dfaf99377be) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83259) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 15:17:07 devstack cinder-volume[83259]: DEBUG cinder.volume.manager [None req-c92e8358-bf6e-4ebe-9470-600c6cb3c5a0 tempest-SnapshotDependencyTests-1171685469 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fa4f34e4-18ad-4ce1-a9bb-6dfaf99377be) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-16T13:17:05Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#Quobyte',id=e7e3f80e-658e-437d-a631-063e9b97821e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2238e9dd515f49799ea4a5f1e480eb42',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-16T13:17:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=1c91f4e2-ca82-47d3-ac70-5525dd1af9bf,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-16T13:17:06Z,use_quota=True,user_id='1094aa0bf92a4f7d8a14114a50890b47',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(485ead50-3df8-4d76-8d34-a4db136c980a),volume_type_id=485ead50-3df8-4d76-8d34-a4db136c980a)' {{(pid=83259) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 15:17:07 devstack cinder-volume[83259]: DEBUG cinder.volume.manager [None req-c92e8358-bf6e-4ebe-9470-600c6cb3c5a0 tempest-SnapshotDependencyTests-1171685469 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (28ef8063-2ebb-413a-996d-63d1b04d7f36) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83259) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 15:17:07 devstack cinder-volume[83259]: DEBUG cinder.volume.manager [None req-c92e8358-bf6e-4ebe-9470-600c6cb3c5a0 tempest-SnapshotDependencyTests-1171685469 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (28ef8063-2ebb-413a-996d-63d1b04d7f36) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83259) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 15:17:07 devstack cinder-volume[83259]: DEBUG cinder.volume.manager [None req-c92e8358-bf6e-4ebe-9470-600c6cb3c5a0 tempest-SnapshotDependencyTests-1171685469 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (66d033b8-3be1-4d5d-bb7d-6bf97c98d9e2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83259) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 15:17:07 devstack cinder-volume[83259]: DEBUG cinder.volume.manager [None req-c92e8358-bf6e-4ebe-9470-600c6cb3c5a0 tempest-SnapshotDependencyTests-1171685469 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (66d033b8-3be1-4d5d-bb7d-6bf97c98d9e2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': 'e7e3f80e-658e-437d-a631-063e9b97821e', 'volume_name': 'volume-e7e3f80e-658e-437d-a631-063e9b97821e', 'volume_size': 1, 'snapshot_id': '1c91f4e2-ca82-47d3-ac70-5525dd1af9bf'}' {{(pid=83259) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 15:17:07 devstack cinder-volume[83259]: DEBUG cinder.volume.manager [None req-c92e8358-bf6e-4ebe-9470-600c6cb3c5a0 tempest-SnapshotDependencyTests-1171685469 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6423aabe-4f39-4192-9cb7-7536eca3ac66) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83259) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 15:17:07 devstack cinder-volume[83259]: DEBUG cinder.volume.manager [None req-c92e8358-bf6e-4ebe-9470-600c6cb3c5a0 tempest-SnapshotDependencyTests-1171685469 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6423aabe-4f39-4192-9cb7-7536eca3ac66) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83259) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 15:17:07 devstack cinder-volume[83259]: DEBUG cinder.volume.manager [None req-c92e8358-bf6e-4ebe-9470-600c6cb3c5a0 tempest-SnapshotDependencyTests-1171685469 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (952b1c4f-0e45-4524-89e3-f2ff4902e1f2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83259) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 15:17:07 devstack cinder-volume[83259]: INFO cinder.volume.flows.manager.create_volume [None req-c92e8358-bf6e-4ebe-9470-600c6cb3c5a0 tempest-SnapshotDependencyTests-1171685469 None] Volume e7e3f80e-658e-437d-a631-063e9b97821e: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-e7e3f80e-658e-437d-a631-063e9b97821e', 'volume_size': 1, 'snapshot_id': '1c91f4e2-ca82-47d3-ac70-5525dd1af9bf'} Sep 16 15:17:07 devstack cinder-volume[83259]: DEBUG oslo_concurrency.lockutils [None req-c92e8358-bf6e-4ebe-9470-600c6cb3c5a0 tempest-SnapshotDependencyTests-1171685469 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=83259) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 16 15:17:07 devstack cinder-volume[83259]: DEBUG oslo_concurrency.lockutils [None req-c92e8358-bf6e-4ebe-9470-600c6cb3c5a0 tempest-SnapshotDependencyTests-1171685469 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.003s {{(pid=83259) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 16 15:17:07 devstack cinder-volume[83259]: DEBUG cinder.coordination [None req-c92e8358-bf6e-4ebe-9470-600c6cb3c5a0 tempest-SnapshotDependencyTests-1171685469 None] Acquiring lock "cinder-quobyte-1c91f4e2-ca82-47d3-ac70-5525dd1af9bf-e7e3f80e-658e-437d-a631-063e9b97821e" by "_create_volume_from_snapshot" {{(pid=83259) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 16 15:17:07 devstack cinder-volume[83259]: DEBUG cinder.coordination [None req-c92e8358-bf6e-4ebe-9470-600c6cb3c5a0 tempest-SnapshotDependencyTests-1171685469 None] Lock "cinder-quobyte-1c91f4e2-ca82-47d3-ac70-5525dd1af9bf-e7e3f80e-658e-437d-a631-063e9b97821e" acquired by "_create_volume_from_snapshot" :: waited 0.042s {{(pid=83259) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 16 15:17:07 devstack cinder-volume[83259]: DEBUG cinder.volume.drivers.quobyte [None req-c92e8358-bf6e-4ebe-9470-600c6cb3c5a0 tempest-SnapshotDependencyTests-1171685469 None] Creating volume e7e3f80e-658e-437d-a631-063e9b97821e from snapshot 1c91f4e2-ca82-47d3-ac70-5525dd1af9bf {{(pid=83259) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:361}} Sep 16 15:17:07 devstack cinder-volume[83259]: DEBUG oslo_concurrency.lockutils [None req-c92e8358-bf6e-4ebe-9470-600c6cb3c5a0 tempest-SnapshotDependencyTests-1171685469 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83259) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 16 15:17:07 devstack cinder-volume[83259]: DEBUG oslo_concurrency.lockutils [None req-c92e8358-bf6e-4ebe-9470-600c6cb3c5a0 tempest-SnapshotDependencyTests-1171685469 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83259) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 16 15:17:07 devstack cinder-volume[83259]: DEBUG cinder.volume.drivers.quobyte [None req-c92e8358-bf6e-4ebe-9470-600c6cb3c5a0 tempest-SnapshotDependencyTests-1171685469 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-61f585ac-f8e2-4d19-a890-7ebc2726cc72': None} {{(pid=83259) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:639}} Sep 16 15:17:07 devstack cinder-volume[83259]: DEBUG cinder.volume.drivers.quobyte [None req-c92e8358-bf6e-4ebe-9470-600c6cb3c5a0 tempest-SnapshotDependencyTests-1171685469 None] Available shares ['10.10.41.181/cinder-vol-61f585ac-f8e2-4d19-a890-7ebc2726cc72'] {{(pid=83259) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:669}} Sep 16 15:17:07 devstack cinder-volume[83259]: DEBUG oslo_concurrency.lockutils [None req-c92e8358-bf6e-4ebe-9470-600c6cb3c5a0 tempest-SnapshotDependencyTests-1171685469 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=83259) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 16 15:17:07 devstack cinder-volume[83259]: DEBUG cinder.volume.drivers.quobyte [None req-c92e8358-bf6e-4ebe-9470-600c6cb3c5a0 tempest-SnapshotDependencyTests-1171685469 None] Selected 10.10.41.181/cinder-vol-61f585ac-f8e2-4d19-a890-7ebc2726cc72 as target Quobyte volume. {{(pid=83259) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:690}} Sep 16 15:17:07 devstack cinder-volume[83259]: DEBUG cinder.coordination [None req-c92e8358-bf6e-4ebe-9470-600c6cb3c5a0 tempest-SnapshotDependencyTests-1171685469 None] Acquiring lock "cinder-quobyte-e7e3f80e-658e-437d-a631-063e9b97821e" by "_copy_volume_from_snapshot" {{(pid=83259) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 16 15:17:07 devstack cinder-volume[83259]: DEBUG cinder.coordination [None req-c92e8358-bf6e-4ebe-9470-600c6cb3c5a0 tempest-SnapshotDependencyTests-1171685469 None] Lock "cinder-quobyte-e7e3f80e-658e-437d-a631-063e9b97821e" acquired by "_copy_volume_from_snapshot" :: waited 0.032s {{(pid=83259) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 16 15:17:07 devstack cinder-volume[83259]: DEBUG cinder.volume.drivers.quobyte [None req-c92e8358-bf6e-4ebe-9470-600c6cb3c5a0 tempest-SnapshotDependencyTests-1171685469 None] snapshot: 1c91f4e2-ca82-47d3-ac70-5525dd1af9bf, volume: e7e3f80e-658e-437d-a631-063e9b97821e, {{(pid=83259) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:406}} Sep 16 15:17:07 devstack cinder-volume[83259]: DEBUG oslo_concurrency.lockutils [None req-c92e8358-bf6e-4ebe-9470-600c6cb3c5a0 tempest-SnapshotDependencyTests-1171685469 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83259) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 16 15:17:07 devstack cinder-volume[83259]: DEBUG oslo_concurrency.lockutils [None req-c92e8358-bf6e-4ebe-9470-600c6cb3c5a0 tempest-SnapshotDependencyTests-1171685469 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=83259) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 16 15:17:07 devstack cinder-volume[83259]: DEBUG cinder.volume.drivers.quobyte [None req-c92e8358-bf6e-4ebe-9470-600c6cb3c5a0 tempest-SnapshotDependencyTests-1171685469 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-61f585ac-f8e2-4d19-a890-7ebc2726cc72': None} {{(pid=83259) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:639}} Sep 16 15:17:07 devstack cinder-volume[83259]: DEBUG cinder.volume.drivers.quobyte [None req-c92e8358-bf6e-4ebe-9470-600c6cb3c5a0 tempest-SnapshotDependencyTests-1171685469 None] Available shares ['10.10.41.181/cinder-vol-61f585ac-f8e2-4d19-a890-7ebc2726cc72'] {{(pid=83259) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:669}} Sep 16 15:17:07 devstack cinder-volume[83259]: DEBUG oslo_concurrency.lockutils [None req-c92e8358-bf6e-4ebe-9470-600c6cb3c5a0 tempest-SnapshotDependencyTests-1171685469 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=83259) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 16 15:17:07 devstack cinder-volume[83259]: DEBUG oslo.privsep.daemon [-] privsep: reply[49cc0137-1f80-44f8-8c27-f88e69da260b]: (4, 'qcow2') {{(pid=84312) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 16 15:17:07 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [None req-c92e8358-bf6e-4ebe-9470-600c6cb3c5a0 tempest-SnapshotDependencyTests-1171685469 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c/volume-2e3bf701-1ad0-4a3e-8cd0-5e0b2d1ab994.1c91f4e2-ca82-47d3-ac70-5525dd1af9bf {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 15:17:08 devstack quobyte-client[83286]: System call of process 97684 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 16 15:17:08 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [None req-c92e8358-bf6e-4ebe-9470-600c6cb3c5a0 tempest-SnapshotDependencyTests-1171685469 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c/volume-2e3bf701-1ad0-4a3e-8cd0-5e0b2d1ab994.1c91f4e2-ca82-47d3-ac70-5525dd1af9bf" returned: 0 in 1.027s {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 15:17:08 devstack cinder-volume[83259]: DEBUG cinder.volume.drivers.remotefs [None req-c92e8358-bf6e-4ebe-9470-600c6cb3c5a0 tempest-SnapshotDependencyTests-1171685469 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-2e3bf701-1ad0-4a3e-8cd0-5e0b2d1ab994(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83259) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:886}} Sep 16 15:17:08 devstack cinder-volume[83259]: DEBUG cinder.volume.drivers.quobyte [None req-c92e8358-bf6e-4ebe-9470-600c6cb3c5a0 tempest-SnapshotDependencyTests-1171685469 None] will copy from snapshot at /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c/volume-2e3bf701-1ad0-4a3e-8cd0-5e0b2d1ab994 {{(pid=83259) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:425}} Sep 16 15:17:08 devstack cinder-volume[83259]: DEBUG cinder.volume.drivers.quobyte [None req-c92e8358-bf6e-4ebe-9470-600c6cb3c5a0 tempest-SnapshotDependencyTests-1171685469 None] Creating direct copy from snapshot {{(pid=83259) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:433}} Sep 16 15:17:08 devstack cinder-volume[83259]: DEBUG oslo.privsep.daemon [-] privsep: reply[31a1fe29-751a-46a7-ba72-c5104c6a956a]: (4, 'qcow2') {{(pid=84312) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 16 15:17:08 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [None req-c92e8358-bf6e-4ebe-9470-600c6cb3c5a0 tempest-SnapshotDependencyTests-1171685469 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c/volume-2e3bf701-1ad0-4a3e-8cd0-5e0b2d1ab994 {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 15:17:09 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [None req-c92e8358-bf6e-4ebe-9470-600c6cb3c5a0 tempest-SnapshotDependencyTests-1171685469 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c/volume-2e3bf701-1ad0-4a3e-8cd0-5e0b2d1ab994" returned: 0 in 0.541s {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 15:17:09 devstack cinder-volume[83259]: DEBUG cinder.utils [None req-c92e8358-bf6e-4ebe-9470-600c6cb3c5a0 tempest-SnapshotDependencyTests-1171685469 None] Path /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c/volume-e7e3f80e-658e-437d-a631-063e9b97821e not found in is_blk_device check {{(pid=83259) is_blk_device /opt/stack/cinder/cinder/utils.py:591}} Sep 16 15:17:09 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [None req-c92e8358-bf6e-4ebe-9470-600c6cb3c5a0 tempest-SnapshotDependencyTests-1171685469 None] Running cmd (subprocess): qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c/volume-2e3bf701-1ad0-4a3e-8cd0-5e0b2d1ab994 /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c/volume-e7e3f80e-658e-437d-a631-063e9b97821e {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 15:17:09 devstack quobyte-client[83286]: The server volume:87712ffe-8a69-446d-9ed6-4430c7ee9792@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=87712ffe-8a69-446d-9ed6-4430c7ee9792, inode=143, name=volume-e7e3f80e-658e-437d-a631-063e9b97821e, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.206), requestorAccessMask=0 Sep 16 15:17:17 devstack cinder-volume[83259]: DEBUG dbcounter [-] [83259] Writing DB stats cinder:SELECT=5,cinder:UPDATE=4 {{(pid=83259) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Sep 16 15:17:17 devstack cinder-volume[83259]: DEBUG dbcounter [-] [83259] Writing DB stats cinder:UPDATE=3,cinder:DELETE=2,cinder:SELECT=4 {{(pid=83259) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Sep 16 15:17:20 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [None req-c92e8358-bf6e-4ebe-9470-600c6cb3c5a0 tempest-SnapshotDependencyTests-1171685469 None] CMD "qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c/volume-2e3bf701-1ad0-4a3e-8cd0-5e0b2d1ab994 /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c/volume-e7e3f80e-658e-437d-a631-063e9b97821e" returned: 0 in 11.203s {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 15:17:20 devstack cinder-volume[83259]: DEBUG oslo.privsep.daemon [-] privsep: reply[76372550-917c-430c-a810-1901e38f846c]: (4, 'qcow2') {{(pid=84312) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 16 15:17:20 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [None req-c92e8358-bf6e-4ebe-9470-600c6cb3c5a0 tempest-SnapshotDependencyTests-1171685469 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c/volume-2e3bf701-1ad0-4a3e-8cd0-5e0b2d1ab994 {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 15:17:22 devstack quobyte-client[83286]: System call of process 97778 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 16 15:17:23 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [None req-c92e8358-bf6e-4ebe-9470-600c6cb3c5a0 tempest-SnapshotDependencyTests-1171685469 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c/volume-2e3bf701-1ad0-4a3e-8cd0-5e0b2d1ab994" returned: 0 in 2.697s {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 15:17:23 devstack cinder-volume[83259]: DEBUG cinder.image.image_utils [None req-c92e8358-bf6e-4ebe-9470-600c6cb3c5a0 tempest-SnapshotDependencyTests-1171685469 None] Image conversion details: src /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c/volume-2e3bf701-1ad0-4a3e-8cd0-5e0b2d1ab994, size 1024.00 MB, duration 11.24 sec, destination /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c/volume-e7e3f80e-658e-437d-a631-063e9b97821e {{(pid=83259) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:501}} Sep 16 15:17:23 devstack cinder-volume[83259]: INFO cinder.image.image_utils [None req-c92e8358-bf6e-4ebe-9470-600c6cb3c5a0 tempest-SnapshotDependencyTests-1171685469 None] Converted 1024.00 MB image at 91.12 MB/s Sep 16 15:17:23 devstack cinder-volume[83259]: DEBUG cinder.volume.drivers.remotefs [None req-c92e8358-bf6e-4ebe-9470-600c6cb3c5a0 tempest-SnapshotDependencyTests-1171685469 None] File path /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c/volume-e7e3f80e-658e-437d-a631-063e9b97821e is being set with permissions: 660 {{(pid=83259) _set_rw_permissions /opt/stack/cinder/cinder/volume/drivers/remotefs.py:492}} Sep 16 15:17:23 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [None req-c92e8358-bf6e-4ebe-9470-600c6cb3c5a0 tempest-SnapshotDependencyTests-1171685469 None] Running cmd (subprocess): chmod 660 /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c/volume-e7e3f80e-658e-437d-a631-063e9b97821e {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 15:17:23 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [None req-c92e8358-bf6e-4ebe-9470-600c6cb3c5a0 tempest-SnapshotDependencyTests-1171685469 None] CMD "chmod 660 /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c/volume-e7e3f80e-658e-437d-a631-063e9b97821e" returned: 0 in 0.271s {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 15:17:24 devstack cinder-volume[83259]: DEBUG cinder.coordination [None req-c92e8358-bf6e-4ebe-9470-600c6cb3c5a0 tempest-SnapshotDependencyTests-1171685469 None] Lock "cinder-quobyte-e7e3f80e-658e-437d-a631-063e9b97821e" released by "_copy_volume_from_snapshot" :: held 16.721s {{(pid=83259) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 16 15:17:24 devstack cinder-volume[83259]: DEBUG cinder.coordination [None req-c92e8358-bf6e-4ebe-9470-600c6cb3c5a0 tempest-SnapshotDependencyTests-1171685469 None] Lock "cinder-quobyte-1c91f4e2-ca82-47d3-ac70-5525dd1af9bf-e7e3f80e-658e-437d-a631-063e9b97821e" released by "_create_volume_from_snapshot" :: held 16.854s {{(pid=83259) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 16 15:17:24 devstack cinder-volume[83259]: DEBUG oslo_concurrency.lockutils [None req-c92e8358-bf6e-4ebe-9470-600c6cb3c5a0 tempest-SnapshotDependencyTests-1171685469 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 16.931s {{(pid=83259) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 16 15:17:25 devstack cinder-volume[83259]: DEBUG cinder.volume.manager [None req-c92e8358-bf6e-4ebe-9470-600c6cb3c5a0 tempest-SnapshotDependencyTests-1171685469 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (952b1c4f-0e45-4524-89e3-f2ff4902e1f2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e7e3f80e-658e-437d-a631-063e9b97821e', 'volume_size': 1, 'snapshot_id': '1c91f4e2-ca82-47d3-ac70-5525dd1af9bf'}' {{(pid=83259) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 15:17:25 devstack cinder-volume[83259]: DEBUG cinder.volume.manager [None req-c92e8358-bf6e-4ebe-9470-600c6cb3c5a0 tempest-SnapshotDependencyTests-1171685469 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f208d5d3-de9d-4670-9a87-ce6c1fe2dab9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83259) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 15:17:25 devstack cinder-volume[83259]: INFO cinder.volume.flows.manager.create_volume [None req-c92e8358-bf6e-4ebe-9470-600c6cb3c5a0 tempest-SnapshotDependencyTests-1171685469 None] Volume volume-e7e3f80e-658e-437d-a631-063e9b97821e (e7e3f80e-658e-437d-a631-063e9b97821e): created successfully Sep 16 15:17:25 devstack cinder-volume[83259]: DEBUG cinder.volume.manager [None req-c92e8358-bf6e-4ebe-9470-600c6cb3c5a0 tempest-SnapshotDependencyTests-1171685469 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f208d5d3-de9d-4670-9a87-ce6c1fe2dab9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83259) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 15:17:25 devstack cinder-volume[83259]: DEBUG cinder.volume.manager [None req-c92e8358-bf6e-4ebe-9470-600c6cb3c5a0 tempest-SnapshotDependencyTests-1171685469 None] Flow 'volume_create_manager' (97cc33aa-4da5-4e3f-b2f4-8859eb95cfd1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83259) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 16 15:17:25 devstack cinder-volume[83259]: INFO cinder.volume.manager [None req-c92e8358-bf6e-4ebe-9470-600c6cb3c5a0 tempest-SnapshotDependencyTests-1171685469 None] Created volume successfully. Sep 16 15:17:27 devstack cinder-volume[83259]: DEBUG cinder.coordination [None req-d7455640-c667-4526-923e-06f72258a169 tempest-SnapshotDependencyTests-1171685469 None] Acquiring lock "cinder-1c91f4e2-ca82-47d3-ac70-5525dd1af9bf-delete_snapshot" by "delete_snapshot" {{(pid=83259) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 16 15:17:27 devstack cinder-volume[83259]: DEBUG cinder.coordination [None req-d7455640-c667-4526-923e-06f72258a169 tempest-SnapshotDependencyTests-1171685469 None] Lock "cinder-1c91f4e2-ca82-47d3-ac70-5525dd1af9bf-delete_snapshot" acquired by "delete_snapshot" :: waited 0.070s {{(pid=83259) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 16 15:17:27 devstack cinder-volume[83259]: WARNING cinder.volume.volume_utils [None req-d7455640-c667-4526-923e-06f72258a169 tempest-SnapshotDependencyTests-1171685469 None] Volume driver (QuobyteDriver 1.2) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 16 15:17:27 devstack cinder-volume[83259]: DEBUG cinder.coordination [None req-d7455640-c667-4526-923e-06f72258a169 tempest-SnapshotDependencyTests-1171685469 None] Acquiring lock "cinder-quobyte-2e3bf701-1ad0-4a3e-8cd0-5e0b2d1ab994" by "delete_snapshot" {{(pid=83259) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 16 15:17:27 devstack cinder-volume[83259]: DEBUG cinder.coordination [None req-d7455640-c667-4526-923e-06f72258a169 tempest-SnapshotDependencyTests-1171685469 None] Lock "cinder-quobyte-2e3bf701-1ad0-4a3e-8cd0-5e0b2d1ab994" acquired by "delete_snapshot" :: waited 0.028s {{(pid=83259) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 16 15:17:27 devstack cinder-volume[83259]: DEBUG cinder.coordination [None req-d7455640-c667-4526-923e-06f72258a169 tempest-SnapshotDependencyTests-1171685469 None] Acquiring lock "cinder-quobyte-1c91f4e2-ca82-47d3-ac70-5525dd1af9bf" by "_delete_snapshot" {{(pid=83259) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 16 15:17:27 devstack cinder-volume[83259]: DEBUG cinder.coordination [None req-d7455640-c667-4526-923e-06f72258a169 tempest-SnapshotDependencyTests-1171685469 None] Lock "cinder-quobyte-1c91f4e2-ca82-47d3-ac70-5525dd1af9bf" acquired by "_delete_snapshot" :: waited 0.037s {{(pid=83259) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 16 15:17:27 devstack cinder-volume[83259]: DEBUG cinder.volume.drivers.remotefs [None req-d7455640-c667-4526-923e-06f72258a169 tempest-SnapshotDependencyTests-1171685469 None] Deleting offline snapshot 1c91f4e2-ca82-47d3-ac70-5525dd1af9bf of volume 2e3bf701-1ad0-4a3e-8cd0-5e0b2d1ab994 {{(pid=83259) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1278}} Sep 16 15:17:27 devstack cinder-volume[83259]: DEBUG cinder.volume.drivers.remotefs [None req-d7455640-c667-4526-923e-06f72258a169 tempest-SnapshotDependencyTests-1171685469 None] snapshot_file for this snap is: volume-2e3bf701-1ad0-4a3e-8cd0-5e0b2d1ab994.1c91f4e2-ca82-47d3-ac70-5525dd1af9bf {{(pid=83259) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1307}} Sep 16 15:17:27 devstack cinder-volume[83259]: DEBUG oslo.privsep.daemon [-] privsep: reply[8959fa4c-a582-4a0e-bfac-dd93a2f0d785]: (4, 'qcow2') {{(pid=84312) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 16 15:17:27 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [None req-d7455640-c667-4526-923e-06f72258a169 tempest-SnapshotDependencyTests-1171685469 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c/volume-2e3bf701-1ad0-4a3e-8cd0-5e0b2d1ab994.1c91f4e2-ca82-47d3-ac70-5525dd1af9bf {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 15:17:28 devstack quobyte-client[83286]: System call of process 97828 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 16 15:17:28 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [None req-d7455640-c667-4526-923e-06f72258a169 tempest-SnapshotDependencyTests-1171685469 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c/volume-2e3bf701-1ad0-4a3e-8cd0-5e0b2d1ab994.1c91f4e2-ca82-47d3-ac70-5525dd1af9bf" returned: 0 in 0.846s {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 15:17:28 devstack cinder-volume[83259]: DEBUG cinder.volume.drivers.remotefs [None req-d7455640-c667-4526-923e-06f72258a169 tempest-SnapshotDependencyTests-1171685469 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-2e3bf701-1ad0-4a3e-8cd0-5e0b2d1ab994(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83259) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:886}} Sep 16 15:17:28 devstack cinder-volume[83259]: DEBUG oslo.privsep.daemon [-] privsep: reply[7978769c-ebdb-4aa7-8a02-f946af1a9c34]: (4, 'qcow2') {{(pid=84312) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 16 15:17:28 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [None req-d7455640-c667-4526-923e-06f72258a169 tempest-SnapshotDependencyTests-1171685469 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c/volume-2e3bf701-1ad0-4a3e-8cd0-5e0b2d1ab994 {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 15:17:28 devstack quobyte-client[83286]: System call of process 97837 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 16 15:17:29 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [None req-d7455640-c667-4526-923e-06f72258a169 tempest-SnapshotDependencyTests-1171685469 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c/volume-2e3bf701-1ad0-4a3e-8cd0-5e0b2d1ab994" returned: 0 in 0.648s {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 15:17:29 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [None req-d7455640-c667-4526-923e-06f72258a169 tempest-SnapshotDependencyTests-1171685469 None] Running cmd (subprocess): qemu-img commit -d /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c/volume-2e3bf701-1ad0-4a3e-8cd0-5e0b2d1ab994.1c91f4e2-ca82-47d3-ac70-5525dd1af9bf {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 15:17:29 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [None req-d7455640-c667-4526-923e-06f72258a169 tempest-SnapshotDependencyTests-1171685469 None] CMD "qemu-img commit -d /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c/volume-2e3bf701-1ad0-4a3e-8cd0-5e0b2d1ab994.1c91f4e2-ca82-47d3-ac70-5525dd1af9bf" returned: 0 in 0.372s {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 15:17:29 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [None req-d7455640-c667-4526-923e-06f72258a169 tempest-SnapshotDependencyTests-1171685469 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c/volume-2e3bf701-1ad0-4a3e-8cd0-5e0b2d1ab994.1c91f4e2-ca82-47d3-ac70-5525dd1af9bf {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 15:17:29 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [None req-d7455640-c667-4526-923e-06f72258a169 tempest-SnapshotDependencyTests-1171685469 None] CMD "rm -f /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c/volume-2e3bf701-1ad0-4a3e-8cd0-5e0b2d1ab994.1c91f4e2-ca82-47d3-ac70-5525dd1af9bf" returned: 0 in 0.240s {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 15:17:29 devstack cinder-volume[83259]: DEBUG cinder.coordination [None req-d7455640-c667-4526-923e-06f72258a169 tempest-SnapshotDependencyTests-1171685469 None] Lock "cinder-quobyte-1c91f4e2-ca82-47d3-ac70-5525dd1af9bf" released by "_delete_snapshot" :: held 2.716s {{(pid=83259) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 16 15:17:29 devstack cinder-volume[83259]: DEBUG cinder.coordination [None req-d7455640-c667-4526-923e-06f72258a169 tempest-SnapshotDependencyTests-1171685469 None] Lock "cinder-quobyte-2e3bf701-1ad0-4a3e-8cd0-5e0b2d1ab994" released by "delete_snapshot" :: held 2.768s {{(pid=83259) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 16 15:17:30 devstack cinder-volume[83259]: DEBUG cinder.quota [None req-d7455640-c667-4526-923e-06f72258a169 tempest-SnapshotDependencyTests-1171685469 None] Created reservations ['fc30afdd-60ab-4074-b270-70b11d76d0e2', '3220ca55-ed5d-47b9-81ce-755272760f2b', '25c40c0e-22b7-433b-af76-b95dc99616c6', 'aed05a64-c069-40d1-a0bf-aaa1cfd62c88'] {{(pid=83259) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 16 15:17:31 devstack cinder-volume[83259]: INFO cinder.volume.manager [None req-d7455640-c667-4526-923e-06f72258a169 tempest-SnapshotDependencyTests-1171685469 None] Delete snapshot completed successfully. Sep 16 15:17:31 devstack cinder-volume[83259]: DEBUG cinder.coordination [None req-d7455640-c667-4526-923e-06f72258a169 tempest-SnapshotDependencyTests-1171685469 None] Lock "cinder-1c91f4e2-ca82-47d3-ac70-5525dd1af9bf-delete_snapshot" released by "delete_snapshot" :: held 3.932s {{(pid=83259) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 16 15:17:31 devstack cinder-volume[83259]: DEBUG cinder.coordination [None req-1b720314-7ee2-4579-97bd-75698bfe388f tempest-SnapshotDependencyTests-1171685469 None] Acquiring lock "cinder-2e3bf701-1ad0-4a3e-8cd0-5e0b2d1ab994-delete_volume" by "delete_volume" {{(pid=83259) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 16 15:17:31 devstack cinder-volume[83259]: DEBUG cinder.coordination [None req-1b720314-7ee2-4579-97bd-75698bfe388f tempest-SnapshotDependencyTests-1171685469 None] Lock "cinder-2e3bf701-1ad0-4a3e-8cd0-5e0b2d1ab994-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=83259) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 16 15:17:31 devstack cinder-volume[83259]: WARNING cinder.volume.volume_utils [None req-1b720314-7ee2-4579-97bd-75698bfe388f tempest-SnapshotDependencyTests-1171685469 None] Volume driver (QuobyteDriver 1.2) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 16 15:17:31 devstack cinder-volume[83259]: DEBUG cinder.coordination [None req-1b720314-7ee2-4579-97bd-75698bfe388f tempest-SnapshotDependencyTests-1171685469 None] Acquiring lock "cinder-quobyte-2e3bf701-1ad0-4a3e-8cd0-5e0b2d1ab994" by "delete_volume" {{(pid=83259) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 16 15:17:31 devstack cinder-volume[83259]: DEBUG cinder.coordination [None req-1b720314-7ee2-4579-97bd-75698bfe388f tempest-SnapshotDependencyTests-1171685469 None] Lock "cinder-quobyte-2e3bf701-1ad0-4a3e-8cd0-5e0b2d1ab994" acquired by "delete_volume" :: waited 0.013s {{(pid=83259) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 16 15:17:31 devstack cinder-volume[83259]: DEBUG oslo.privsep.daemon [-] privsep: reply[f6791be2-b305-4e3f-8aff-f8b3e7764a23]: (4, 'qcow2') {{(pid=84312) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 16 15:17:31 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [None req-1b720314-7ee2-4579-97bd-75698bfe388f tempest-SnapshotDependencyTests-1171685469 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c/volume-2e3bf701-1ad0-4a3e-8cd0-5e0b2d1ab994 {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 15:17:32 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [None req-1b720314-7ee2-4579-97bd-75698bfe388f tempest-SnapshotDependencyTests-1171685469 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c/volume-2e3bf701-1ad0-4a3e-8cd0-5e0b2d1ab994" returned: 0 in 0.410s {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 15:17:32 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [None req-1b720314-7ee2-4579-97bd-75698bfe388f tempest-SnapshotDependencyTests-1171685469 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c/volume-2e3bf701-1ad0-4a3e-8cd0-5e0b2d1ab994 {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 15:17:32 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [None req-1b720314-7ee2-4579-97bd-75698bfe388f tempest-SnapshotDependencyTests-1171685469 None] CMD "rm -f /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c/volume-2e3bf701-1ad0-4a3e-8cd0-5e0b2d1ab994" returned: 0 in 0.160s {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 15:17:32 devstack cinder-volume[83259]: DEBUG cinder.coordination [None req-1b720314-7ee2-4579-97bd-75698bfe388f tempest-SnapshotDependencyTests-1171685469 None] Lock "cinder-quobyte-2e3bf701-1ad0-4a3e-8cd0-5e0b2d1ab994" released by "delete_volume" :: held 0.770s {{(pid=83259) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 16 15:17:32 devstack cinder-volume[83259]: DEBUG cinder.quota [None req-1b720314-7ee2-4579-97bd-75698bfe388f tempest-SnapshotDependencyTests-1171685469 None] Created reservations ['a62a53e5-eabe-4785-9cf5-f66e970663d7', 'a71d6853-2bd7-41ba-af15-549aba7c9b5f', '0333515b-011a-40d6-8e74-7c8f0d115e67', '20407796-5a0a-404e-9915-e7abf3d99e5c'] {{(pid=83259) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 16 15:17:32 devstack cinder-volume[83259]: DEBUG oslo_concurrency.lockutils [None req-1b720314-7ee2-4579-97bd-75698bfe388f tempest-SnapshotDependencyTests-1171685469 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83259) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 16 15:17:32 devstack cinder-volume[83259]: DEBUG oslo_concurrency.lockutils [None req-1b720314-7ee2-4579-97bd-75698bfe388f tempest-SnapshotDependencyTests-1171685469 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=83259) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 16 15:17:32 devstack cinder-volume[83259]: DEBUG cinder.volume.drivers.quobyte [None req-1b720314-7ee2-4579-97bd-75698bfe388f tempest-SnapshotDependencyTests-1171685469 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-61f585ac-f8e2-4d19-a890-7ebc2726cc72': None} {{(pid=83259) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:639}} Sep 16 15:17:32 devstack cinder-volume[83259]: DEBUG cinder.volume.drivers.quobyte [None req-1b720314-7ee2-4579-97bd-75698bfe388f tempest-SnapshotDependencyTests-1171685469 None] Available shares ['10.10.41.181/cinder-vol-61f585ac-f8e2-4d19-a890-7ebc2726cc72'] {{(pid=83259) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:669}} Sep 16 15:17:32 devstack cinder-volume[83259]: DEBUG oslo_concurrency.lockutils [None req-1b720314-7ee2-4579-97bd-75698bfe388f tempest-SnapshotDependencyTests-1171685469 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=83259) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 16 15:17:32 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [None req-1b720314-7ee2-4579-97bd-75698bfe388f tempest-SnapshotDependencyTests-1171685469 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 15:17:33 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [None req-1b720314-7ee2-4579-97bd-75698bfe388f tempest-SnapshotDependencyTests-1171685469 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c" returned: 0 in 0.121s {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 15:17:33 devstack cinder-volume[83259]: DEBUG cinder.manager [None req-1b720314-7ee2-4579-97bd-75698bfe388f tempest-SnapshotDependencyTests-1171685469 None] Notifying Schedulers of capabilities ... {{(pid=83259) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 16 15:17:33 devstack cinder-volume[83259]: INFO cinder.volume.manager [None req-1b720314-7ee2-4579-97bd-75698bfe388f tempest-SnapshotDependencyTests-1171685469 None] Deleted volume successfully. Sep 16 15:17:33 devstack cinder-volume[83259]: DEBUG cinder.coordination [None req-1b720314-7ee2-4579-97bd-75698bfe388f tempest-SnapshotDependencyTests-1171685469 None] Lock "cinder-2e3bf701-1ad0-4a3e-8cd0-5e0b2d1ab994-delete_volume" released by "delete_volume" :: held 1.699s {{(pid=83259) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 16 15:17:33 devstack cinder-volume[83259]: DEBUG cinder.coordination [None req-a7bac68b-efad-492e-bf05-790d27a209f2 tempest-SnapshotDependencyTests-1171685469 None] Acquiring lock "cinder-e7e3f80e-658e-437d-a631-063e9b97821e-delete_volume" by "delete_volume" {{(pid=83259) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 16 15:17:33 devstack cinder-volume[83259]: DEBUG cinder.coordination [None req-a7bac68b-efad-492e-bf05-790d27a209f2 tempest-SnapshotDependencyTests-1171685469 None] Lock "cinder-e7e3f80e-658e-437d-a631-063e9b97821e-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=83259) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 16 15:17:33 devstack cinder-volume[83259]: WARNING cinder.volume.volume_utils [None req-a7bac68b-efad-492e-bf05-790d27a209f2 tempest-SnapshotDependencyTests-1171685469 None] Volume driver (QuobyteDriver 1.2) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 16 15:17:34 devstack cinder-volume[83259]: DEBUG cinder.coordination [None req-a7bac68b-efad-492e-bf05-790d27a209f2 tempest-SnapshotDependencyTests-1171685469 None] Acquiring lock "cinder-quobyte-e7e3f80e-658e-437d-a631-063e9b97821e" by "delete_volume" {{(pid=83259) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 16 15:17:34 devstack cinder-volume[83259]: DEBUG cinder.coordination [None req-a7bac68b-efad-492e-bf05-790d27a209f2 tempest-SnapshotDependencyTests-1171685469 None] Lock "cinder-quobyte-e7e3f80e-658e-437d-a631-063e9b97821e" acquired by "delete_volume" :: waited 0.011s {{(pid=83259) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 16 15:17:34 devstack cinder-volume[83259]: DEBUG oslo.privsep.daemon [-] privsep: reply[9981270d-8f88-4666-bd01-1b632a7347e3]: (4, 'qcow2') {{(pid=84312) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 16 15:17:34 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [None req-a7bac68b-efad-492e-bf05-790d27a209f2 tempest-SnapshotDependencyTests-1171685469 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c/volume-e7e3f80e-658e-437d-a631-063e9b97821e {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 15:17:34 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [None req-a7bac68b-efad-492e-bf05-790d27a209f2 tempest-SnapshotDependencyTests-1171685469 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c/volume-e7e3f80e-658e-437d-a631-063e9b97821e" returned: 0 in 0.425s {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 15:17:34 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [None req-a7bac68b-efad-492e-bf05-790d27a209f2 tempest-SnapshotDependencyTests-1171685469 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c/volume-e7e3f80e-658e-437d-a631-063e9b97821e {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 15:17:34 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [None req-a7bac68b-efad-492e-bf05-790d27a209f2 tempest-SnapshotDependencyTests-1171685469 None] CMD "rm -f /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c/volume-e7e3f80e-658e-437d-a631-063e9b97821e" returned: 0 in 0.107s {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 15:17:34 devstack cinder-volume[83259]: DEBUG cinder.coordination [None req-a7bac68b-efad-492e-bf05-790d27a209f2 tempest-SnapshotDependencyTests-1171685469 None] Lock "cinder-quobyte-e7e3f80e-658e-437d-a631-063e9b97821e" released by "delete_volume" :: held 0.720s {{(pid=83259) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 16 15:17:35 devstack cinder-volume[83259]: DEBUG cinder.quota [None req-a7bac68b-efad-492e-bf05-790d27a209f2 tempest-SnapshotDependencyTests-1171685469 None] Created reservations ['15dc937c-43d3-40a9-bb59-6d779182a9fd', '79fdc5de-ae84-4337-b165-cc0e16c530f0', '6063f7b0-0c74-482a-a3ec-82071d3ffcea', '1d802894-d3ad-49da-9372-ca21d6f641bc'] {{(pid=83259) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 16 15:17:35 devstack cinder-volume[83259]: DEBUG oslo_concurrency.lockutils [None req-a7bac68b-efad-492e-bf05-790d27a209f2 tempest-SnapshotDependencyTests-1171685469 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83259) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 16 15:17:35 devstack cinder-volume[83259]: DEBUG oslo_concurrency.lockutils [None req-a7bac68b-efad-492e-bf05-790d27a209f2 tempest-SnapshotDependencyTests-1171685469 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=83259) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 16 15:17:35 devstack cinder-volume[83259]: DEBUG cinder.volume.drivers.quobyte [None req-a7bac68b-efad-492e-bf05-790d27a209f2 tempest-SnapshotDependencyTests-1171685469 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-61f585ac-f8e2-4d19-a890-7ebc2726cc72': None} {{(pid=83259) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:639}} Sep 16 15:17:35 devstack cinder-volume[83259]: DEBUG cinder.volume.drivers.quobyte [None req-a7bac68b-efad-492e-bf05-790d27a209f2 tempest-SnapshotDependencyTests-1171685469 None] Available shares ['10.10.41.181/cinder-vol-61f585ac-f8e2-4d19-a890-7ebc2726cc72'] {{(pid=83259) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:669}} Sep 16 15:17:35 devstack cinder-volume[83259]: DEBUG oslo_concurrency.lockutils [None req-a7bac68b-efad-492e-bf05-790d27a209f2 tempest-SnapshotDependencyTests-1171685469 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=83259) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 16 15:17:35 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [None req-a7bac68b-efad-492e-bf05-790d27a209f2 tempest-SnapshotDependencyTests-1171685469 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 15:17:35 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [None req-a7bac68b-efad-492e-bf05-790d27a209f2 tempest-SnapshotDependencyTests-1171685469 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c" returned: 0 in 0.093s {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 15:17:35 devstack cinder-volume[83259]: DEBUG cinder.manager [None req-a7bac68b-efad-492e-bf05-790d27a209f2 tempest-SnapshotDependencyTests-1171685469 None] Notifying Schedulers of capabilities ... {{(pid=83259) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 16 15:17:35 devstack cinder-volume[83259]: INFO cinder.volume.manager [None req-a7bac68b-efad-492e-bf05-790d27a209f2 tempest-SnapshotDependencyTests-1171685469 None] Deleted volume successfully. Sep 16 15:17:35 devstack cinder-volume[83259]: DEBUG cinder.coordination [None req-a7bac68b-efad-492e-bf05-790d27a209f2 tempest-SnapshotDependencyTests-1171685469 None] Lock "cinder-e7e3f80e-658e-437d-a631-063e9b97821e-delete_volume" released by "delete_volume" :: held 1.745s {{(pid=83259) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 16 15:17:45 devstack cinder-volume[83259]: DEBUG dbcounter [-] [83259] Writing DB stats cinder:SELECT=15,cinder:UPDATE=17,cinder:DELETE=1,cinder:INSERT=7 {{(pid=83259) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Sep 16 15:17:45 devstack cinder-volume[83259]: DEBUG dbcounter [-] [83259] Writing DB stats cinder:UPDATE=29,cinder:SELECT=15,cinder:INSERT=5,cinder:DELETE=2 {{(pid=83259) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Sep 16 15:17:46 devstack cinder-volume[83259]: DEBUG oslo_service.periodic_task [None req-050ec8a1-6ffd-499d-95ad-d548a84437e2 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=83259) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} Sep 16 15:17:46 devstack cinder-volume[83259]: DEBUG oslo_concurrency.lockutils [None req-050ec8a1-6ffd-499d-95ad-d548a84437e2 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83259) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 16 15:17:46 devstack cinder-volume[83259]: DEBUG oslo_concurrency.lockutils [None req-050ec8a1-6ffd-499d-95ad-d548a84437e2 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83259) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 16 15:17:46 devstack cinder-volume[83259]: DEBUG cinder.volume.drivers.quobyte [None req-050ec8a1-6ffd-499d-95ad-d548a84437e2 None None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-61f585ac-f8e2-4d19-a890-7ebc2726cc72': None} {{(pid=83259) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:639}} Sep 16 15:17:46 devstack cinder-volume[83259]: DEBUG cinder.volume.drivers.quobyte [None req-050ec8a1-6ffd-499d-95ad-d548a84437e2 None None] Available shares ['10.10.41.181/cinder-vol-61f585ac-f8e2-4d19-a890-7ebc2726cc72'] {{(pid=83259) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:669}} Sep 16 15:17:46 devstack cinder-volume[83259]: DEBUG oslo_concurrency.lockutils [None req-050ec8a1-6ffd-499d-95ad-d548a84437e2 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=83259) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 16 15:17:46 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [None req-050ec8a1-6ffd-499d-95ad-d548a84437e2 None None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 15:17:46 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [None req-050ec8a1-6ffd-499d-95ad-d548a84437e2 None None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c" returned: 0 in 0.122s {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 15:17:46 devstack cinder-volume[83259]: DEBUG cinder.manager [None req-050ec8a1-6ffd-499d-95ad-d548a84437e2 None None] Notifying Schedulers of capabilities ... {{(pid=83259) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 16 15:18:10 devstack cinder-volume[83259]: DEBUG dbcounter [-] [83259] Writing DB stats cinder:SELECT=1 {{(pid=83259) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Sep 16 15:18:10 devstack cinder-volume[83259]: DEBUG dbcounter [-] [83259] Writing DB stats cinder:UPDATE=1 {{(pid=83259) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Sep 16 15:18:11 devstack cinder-volume[83259]: DEBUG oslo_concurrency.lockutils [req-88df6ab0-3ce3-4ef5-9e3f-37df4b2a4897 req-a39a6123-5aee-4087-8170-dcd3a2305daf tempest-TestInstancesWithCinderVolumes-1096446095 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=83259) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 16 15:18:11 devstack cinder-volume[83259]: DEBUG oslo_concurrency.lockutils [req-88df6ab0-3ce3-4ef5-9e3f-37df4b2a4897 req-a39a6123-5aee-4087-8170-dcd3a2305daf tempest-TestInstancesWithCinderVolumes-1096446095 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.004s {{(pid=83259) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 16 15:18:11 devstack cinder-volume[83259]: DEBUG oslo.privsep.daemon [-] privsep: reply[8fd6dd72-f2f8-4eef-b706-bda501f9b7fd]: (4, 'qcow2') {{(pid=84312) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 16 15:18:11 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [req-88df6ab0-3ce3-4ef5-9e3f-37df4b2a4897 req-a39a6123-5aee-4087-8170-dcd3a2305daf tempest-TestInstancesWithCinderVolumes-1096446095 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c/volume-3999b191-d35b-4005-b1c8-34819dec9799 {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 15:18:11 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [req-88df6ab0-3ce3-4ef5-9e3f-37df4b2a4897 req-a39a6123-5aee-4087-8170-dcd3a2305daf tempest-TestInstancesWithCinderVolumes-1096446095 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c/volume-3999b191-d35b-4005-b1c8-34819dec9799" returned: 0 in 0.419s {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 15:18:12 devstack cinder-volume[83259]: DEBUG oslo_concurrency.lockutils [req-88df6ab0-3ce3-4ef5-9e3f-37df4b2a4897 req-a39a6123-5aee-4087-8170-dcd3a2305daf tempest-TestInstancesWithCinderVolumes-1096446095 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.476s {{(pid=83259) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 16 15:18:12 devstack cinder-volume[83259]: DEBUG cinder.volume.manager [req-88df6ab0-3ce3-4ef5-9e3f-37df4b2a4897 req-a39a6123-5aee-4087-8170-dcd3a2305daf tempest-TestInstancesWithCinderVolumes-1096446095 None] Connection info returned from driver {'export': '10.10.41.181/cinder-vol-61f585ac-f8e2-4d19-a890-7ebc2726cc72', 'name': 'volume-3999b191-d35b-4005-b1c8-34819dec9799', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '58f3428e-901a-408e-b011-ac09e6c5007b', 'enforce_multipath': True} {{(pid=83259) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4891}} Sep 16 15:18:12 devstack cinder-volume[83259]: WARNING cinder.volume.volume_utils [req-88df6ab0-3ce3-4ef5-9e3f-37df4b2a4897 req-a39a6123-5aee-4087-8170-dcd3a2305daf tempest-TestInstancesWithCinderVolumes-1096446095 None] Volume driver (QuobyteDriver 1.2) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 16 15:18:12 devstack cinder-volume[83259]: INFO cinder.volume.manager [req-88df6ab0-3ce3-4ef5-9e3f-37df4b2a4897 req-a39a6123-5aee-4087-8170-dcd3a2305daf tempest-TestInstancesWithCinderVolumes-1096446095 None] attachment_update completed successfully. Sep 16 15:18:22 devstack cinder-volume[83259]: DEBUG dbcounter [-] [83259] Writing DB stats cinder:SELECT=5,cinder:UPDATE=1 {{(pid=83259) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Sep 16 15:18:22 devstack cinder-volume[83259]: DEBUG dbcounter [-] [83259] Writing DB stats cinder:SELECT=6,cinder:UPDATE=2 {{(pid=83259) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Sep 16 15:18:22 devstack cinder-volume[83259]: DEBUG oslo_concurrency.lockutils [req-9dd3b4bb-66de-4b63-9a6b-0dbc98a24881 req-f290152a-099c-462a-b2c6-3e22fe3883cd tempest-TestInstancesWithCinderVolumes-1096446095 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=83259) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 16 15:18:22 devstack cinder-volume[83259]: DEBUG oslo_concurrency.lockutils [req-9dd3b4bb-66de-4b63-9a6b-0dbc98a24881 req-f290152a-099c-462a-b2c6-3e22fe3883cd tempest-TestInstancesWithCinderVolumes-1096446095 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.003s {{(pid=83259) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 16 15:18:22 devstack cinder-volume[83259]: DEBUG oslo.privsep.daemon [-] privsep: reply[4a446f86-6d9e-4670-8048-78b618da87ef]: (4, 'qcow2') {{(pid=84312) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 16 15:18:22 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [req-9dd3b4bb-66de-4b63-9a6b-0dbc98a24881 req-f290152a-099c-462a-b2c6-3e22fe3883cd tempest-TestInstancesWithCinderVolumes-1096446095 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c/volume-2832e9fc-26a2-4ace-967d-64fcf9d41fb0 {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 15:18:23 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [req-9dd3b4bb-66de-4b63-9a6b-0dbc98a24881 req-f290152a-099c-462a-b2c6-3e22fe3883cd tempest-TestInstancesWithCinderVolumes-1096446095 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c/volume-2832e9fc-26a2-4ace-967d-64fcf9d41fb0" returned: 0 in 0.467s {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 15:18:23 devstack cinder-volume[83259]: DEBUG oslo_concurrency.lockutils [req-9dd3b4bb-66de-4b63-9a6b-0dbc98a24881 req-f290152a-099c-462a-b2c6-3e22fe3883cd tempest-TestInstancesWithCinderVolumes-1096446095 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.529s {{(pid=83259) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 16 15:18:23 devstack cinder-volume[83259]: DEBUG cinder.volume.manager [req-9dd3b4bb-66de-4b63-9a6b-0dbc98a24881 req-f290152a-099c-462a-b2c6-3e22fe3883cd tempest-TestInstancesWithCinderVolumes-1096446095 None] Connection info returned from driver {'export': '10.10.41.181/cinder-vol-61f585ac-f8e2-4d19-a890-7ebc2726cc72', 'name': 'volume-2832e9fc-26a2-4ace-967d-64fcf9d41fb0', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'e82747aa-449d-4810-b055-9cf8db154800', 'enforce_multipath': True} {{(pid=83259) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4891}} Sep 16 15:18:23 devstack cinder-volume[83259]: WARNING cinder.volume.volume_utils [req-9dd3b4bb-66de-4b63-9a6b-0dbc98a24881 req-f290152a-099c-462a-b2c6-3e22fe3883cd tempest-TestInstancesWithCinderVolumes-1096446095 None] Volume driver (QuobyteDriver 1.2) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 16 15:18:23 devstack cinder-volume[83259]: INFO cinder.volume.manager [req-9dd3b4bb-66de-4b63-9a6b-0dbc98a24881 req-f290152a-099c-462a-b2c6-3e22fe3883cd tempest-TestInstancesWithCinderVolumes-1096446095 None] attachment_update completed successfully. Sep 16 15:18:33 devstack cinder-volume[83259]: DEBUG dbcounter [-] [83259] Writing DB stats cinder:SELECT=4,cinder:UPDATE=1 {{(pid=83259) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Sep 16 15:18:33 devstack cinder-volume[83259]: DEBUG dbcounter [-] [83259] Writing DB stats cinder:SELECT=7,cinder:UPDATE=2 {{(pid=83259) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Sep 16 15:18:46 devstack cinder-volume[83259]: DEBUG oslo_service.periodic_task [None req-050ec8a1-6ffd-499d-95ad-d548a84437e2 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=83259) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} Sep 16 15:18:46 devstack cinder-volume[83259]: DEBUG oslo_concurrency.lockutils [None req-050ec8a1-6ffd-499d-95ad-d548a84437e2 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83259) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 16 15:18:46 devstack cinder-volume[83259]: DEBUG oslo_concurrency.lockutils [None req-050ec8a1-6ffd-499d-95ad-d548a84437e2 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=83259) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 16 15:18:46 devstack cinder-volume[83259]: DEBUG cinder.volume.drivers.quobyte [None req-050ec8a1-6ffd-499d-95ad-d548a84437e2 None None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-61f585ac-f8e2-4d19-a890-7ebc2726cc72': None} {{(pid=83259) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:639}} Sep 16 15:18:46 devstack cinder-volume[83259]: DEBUG cinder.volume.drivers.quobyte [None req-050ec8a1-6ffd-499d-95ad-d548a84437e2 None None] Available shares ['10.10.41.181/cinder-vol-61f585ac-f8e2-4d19-a890-7ebc2726cc72'] {{(pid=83259) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:669}} Sep 16 15:18:46 devstack cinder-volume[83259]: DEBUG oslo_concurrency.lockutils [None req-050ec8a1-6ffd-499d-95ad-d548a84437e2 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=83259) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 16 15:18:46 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [None req-050ec8a1-6ffd-499d-95ad-d548a84437e2 None None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 15:18:46 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [None req-050ec8a1-6ffd-499d-95ad-d548a84437e2 None None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c" returned: 0 in 0.084s {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 15:18:46 devstack cinder-volume[83259]: DEBUG cinder.manager [None req-050ec8a1-6ffd-499d-95ad-d548a84437e2 None None] Notifying Schedulers of capabilities ... {{(pid=83259) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 16 15:18:58 devstack cinder-volume[83259]: WARNING cinder.volume.volume_utils [req-1429df14-572c-480a-b929-6be9c29e9ad6 req-c8cd0a07-7d34-49de-ac86-17339b7dbe36 tempest-TestInstancesWithCinderVolumes-1096446095 None] Volume driver (QuobyteDriver 1.2) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 16 15:18:59 devstack cinder-volume[83259]: WARNING cinder.volume.volume_utils [req-1429df14-572c-480a-b929-6be9c29e9ad6 req-c8cd0a07-7d34-49de-ac86-17339b7dbe36 tempest-TestInstancesWithCinderVolumes-1096446095 None] Volume driver (QuobyteDriver 1.2) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 16 15:18:59 devstack cinder-volume[83259]: INFO cinder.volume.manager [req-1429df14-572c-480a-b929-6be9c29e9ad6 req-c8cd0a07-7d34-49de-ac86-17339b7dbe36 tempest-TestInstancesWithCinderVolumes-1096446095 None] Terminate volume connection completed successfully. Sep 16 15:18:59 devstack cinder-volume[83259]: DEBUG cinder.volume.manager [req-1429df14-572c-480a-b929-6be9c29e9ad6 req-c8cd0a07-7d34-49de-ac86-17339b7dbe36 tempest-TestInstancesWithCinderVolumes-1096446095 None] Deleting attachment 58f3428e-901a-408e-b011-ac09e6c5007b. {{(pid=83259) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5022}} Sep 16 15:18:59 devstack cinder-volume[83259]: WARNING cinder.volume.volume_utils [req-299714e8-d73e-47c1-ab40-6404da7fe95d req-fbf4a92f-056a-41ca-8aa2-277823c75d40 tempest-TestMinimumBasicScenario-992444150 None] Volume driver (QuobyteDriver 1.2) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 16 15:18:59 devstack cinder-volume[83259]: WARNING cinder.volume.volume_utils [req-299714e8-d73e-47c1-ab40-6404da7fe95d req-fbf4a92f-056a-41ca-8aa2-277823c75d40 tempest-TestMinimumBasicScenario-992444150 None] Volume driver (QuobyteDriver 1.2) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 16 15:18:59 devstack cinder-volume[83259]: INFO cinder.volume.manager [req-299714e8-d73e-47c1-ab40-6404da7fe95d req-fbf4a92f-056a-41ca-8aa2-277823c75d40 tempest-TestMinimumBasicScenario-992444150 None] Terminate volume connection completed successfully. Sep 16 15:18:59 devstack cinder-volume[83259]: DEBUG cinder.volume.manager [req-299714e8-d73e-47c1-ab40-6404da7fe95d req-fbf4a92f-056a-41ca-8aa2-277823c75d40 tempest-TestMinimumBasicScenario-992444150 None] Deleting attachment 9373c329-5064-4c3e-bf24-dca0c26d5789. {{(pid=83259) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5022}} Sep 16 15:19:00 devstack cinder-volume[83259]: DEBUG cinder.coordination [None req-e6b00ae3-7200-4986-8cd7-084de3abc2fd tempest-TestInstancesWithCinderVolumes-1096446095 None] Acquiring lock "cinder-3999b191-d35b-4005-b1c8-34819dec9799-delete_volume" by "delete_volume" {{(pid=83259) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 16 15:19:00 devstack cinder-volume[83259]: DEBUG cinder.coordination [None req-e6b00ae3-7200-4986-8cd7-084de3abc2fd tempest-TestInstancesWithCinderVolumes-1096446095 None] Lock "cinder-3999b191-d35b-4005-b1c8-34819dec9799-delete_volume" acquired by "delete_volume" :: waited 0.035s {{(pid=83259) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 16 15:19:00 devstack cinder-volume[83259]: WARNING cinder.volume.volume_utils [None req-e6b00ae3-7200-4986-8cd7-084de3abc2fd tempest-TestInstancesWithCinderVolumes-1096446095 None] Volume driver (QuobyteDriver 1.2) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 16 15:19:00 devstack cinder-volume[83259]: DEBUG cinder.coordination [None req-e6b00ae3-7200-4986-8cd7-084de3abc2fd tempest-TestInstancesWithCinderVolumes-1096446095 None] Acquiring lock "cinder-quobyte-3999b191-d35b-4005-b1c8-34819dec9799" by "delete_volume" {{(pid=83259) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 16 15:19:00 devstack cinder-volume[83259]: DEBUG cinder.coordination [None req-e6b00ae3-7200-4986-8cd7-084de3abc2fd tempest-TestInstancesWithCinderVolumes-1096446095 None] Lock "cinder-quobyte-3999b191-d35b-4005-b1c8-34819dec9799" acquired by "delete_volume" :: waited 0.015s {{(pid=83259) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 16 15:19:00 devstack cinder-volume[83259]: DEBUG oslo.privsep.daemon [-] privsep: reply[69cef58e-2ab9-471e-bdd2-0309aba7326f]: (4, 'qcow2') {{(pid=84312) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 16 15:19:00 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [None req-e6b00ae3-7200-4986-8cd7-084de3abc2fd tempest-TestInstancesWithCinderVolumes-1096446095 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c/volume-3999b191-d35b-4005-b1c8-34819dec9799 {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 15:19:00 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [None req-e6b00ae3-7200-4986-8cd7-084de3abc2fd tempest-TestInstancesWithCinderVolumes-1096446095 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c/volume-3999b191-d35b-4005-b1c8-34819dec9799" returned: 0 in 0.525s {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 15:19:00 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [None req-e6b00ae3-7200-4986-8cd7-084de3abc2fd tempest-TestInstancesWithCinderVolumes-1096446095 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c/volume-3999b191-d35b-4005-b1c8-34819dec9799 {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 15:19:01 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [None req-e6b00ae3-7200-4986-8cd7-084de3abc2fd tempest-TestInstancesWithCinderVolumes-1096446095 None] CMD "rm -f /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c/volume-3999b191-d35b-4005-b1c8-34819dec9799" returned: 0 in 0.093s {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 15:19:01 devstack cinder-volume[83259]: DEBUG cinder.coordination [None req-e6b00ae3-7200-4986-8cd7-084de3abc2fd tempest-TestInstancesWithCinderVolumes-1096446095 None] Lock "cinder-quobyte-3999b191-d35b-4005-b1c8-34819dec9799" released by "delete_volume" :: held 0.798s {{(pid=83259) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 16 15:19:01 devstack cinder-volume[83259]: WARNING cinder.quota [None req-e6b00ae3-7200-4986-8cd7-084de3abc2fd tempest-TestInstancesWithCinderVolumes-1096446095 None] Deprecated: Default quota for resource: volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-2053997083-285117701 is set by the default quota flag: quota_volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-2053997083-285117701, it is now deprecated. Please use the default quota class for default quota. Sep 16 15:19:01 devstack cinder-volume[83259]: WARNING cinder.quota [None req-e6b00ae3-7200-4986-8cd7-084de3abc2fd tempest-TestInstancesWithCinderVolumes-1096446095 None] Deprecated: Default quota for resource: gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-2053997083-285117701 is set by the default quota flag: quota_gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-2053997083-285117701, it is now deprecated. Please use the default quota class for default quota. Sep 16 15:19:01 devstack cinder-volume[83259]: DEBUG cinder.quota [None req-e6b00ae3-7200-4986-8cd7-084de3abc2fd tempest-TestInstancesWithCinderVolumes-1096446095 None] Created reservations ['4728441d-3742-48ce-bd40-ef1ccd35f0a9', 'ac0fbf2b-7ff2-44de-a1cb-069efa61f4bb', '9565ff78-2d7d-49cb-8088-179e5dffb229', '40464ed3-1fe3-4c00-9279-63dbeff15bfe'] {{(pid=83259) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 16 15:19:01 devstack cinder-volume[83259]: DEBUG cinder.coordination [None req-5af950b8-749c-4b69-af5f-dc40ddeb09f9 tempest-TestMinimumBasicScenario-992444150 None] Acquiring lock "cinder-e25d09e4-9bd9-44b1-8f67-a8826c7cf123-delete_volume" by "delete_volume" {{(pid=83259) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 16 15:19:01 devstack cinder-volume[83259]: DEBUG cinder.coordination [None req-5af950b8-749c-4b69-af5f-dc40ddeb09f9 tempest-TestMinimumBasicScenario-992444150 None] Lock "cinder-e25d09e4-9bd9-44b1-8f67-a8826c7cf123-delete_volume" acquired by "delete_volume" :: waited 0.047s {{(pid=83259) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 16 15:19:01 devstack cinder-volume[83259]: DEBUG oslo_concurrency.lockutils [None req-e6b00ae3-7200-4986-8cd7-084de3abc2fd tempest-TestInstancesWithCinderVolumes-1096446095 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83259) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 16 15:19:01 devstack cinder-volume[83259]: DEBUG oslo_concurrency.lockutils [None req-e6b00ae3-7200-4986-8cd7-084de3abc2fd tempest-TestInstancesWithCinderVolumes-1096446095 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=83259) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 16 15:19:01 devstack cinder-volume[83259]: DEBUG cinder.volume.drivers.quobyte [None req-e6b00ae3-7200-4986-8cd7-084de3abc2fd tempest-TestInstancesWithCinderVolumes-1096446095 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-61f585ac-f8e2-4d19-a890-7ebc2726cc72': None} {{(pid=83259) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:639}} Sep 16 15:19:01 devstack cinder-volume[83259]: DEBUG cinder.volume.drivers.quobyte [None req-e6b00ae3-7200-4986-8cd7-084de3abc2fd tempest-TestInstancesWithCinderVolumes-1096446095 None] Available shares ['10.10.41.181/cinder-vol-61f585ac-f8e2-4d19-a890-7ebc2726cc72'] {{(pid=83259) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:669}} Sep 16 15:19:01 devstack cinder-volume[83259]: DEBUG oslo_concurrency.lockutils [None req-e6b00ae3-7200-4986-8cd7-084de3abc2fd tempest-TestInstancesWithCinderVolumes-1096446095 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.021s {{(pid=83259) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 16 15:19:01 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [None req-e6b00ae3-7200-4986-8cd7-084de3abc2fd tempest-TestInstancesWithCinderVolumes-1096446095 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 15:19:02 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [None req-e6b00ae3-7200-4986-8cd7-084de3abc2fd tempest-TestInstancesWithCinderVolumes-1096446095 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c" returned: 0 in 0.341s {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 15:19:02 devstack cinder-volume[83259]: DEBUG cinder.manager [None req-e6b00ae3-7200-4986-8cd7-084de3abc2fd tempest-TestInstancesWithCinderVolumes-1096446095 None] Notifying Schedulers of capabilities ... {{(pid=83259) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 16 15:19:02 devstack cinder-volume[83259]: INFO cinder.volume.manager [None req-e6b00ae3-7200-4986-8cd7-084de3abc2fd tempest-TestInstancesWithCinderVolumes-1096446095 None] Deleted volume successfully. Sep 16 15:19:02 devstack cinder-volume[83259]: WARNING cinder.volume.volume_utils [None req-5af950b8-749c-4b69-af5f-dc40ddeb09f9 tempest-TestMinimumBasicScenario-992444150 None] Volume driver (QuobyteDriver 1.2) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 16 15:19:02 devstack cinder-volume[83259]: DEBUG cinder.coordination [None req-5af950b8-749c-4b69-af5f-dc40ddeb09f9 tempest-TestMinimumBasicScenario-992444150 None] Acquiring lock "cinder-quobyte-e25d09e4-9bd9-44b1-8f67-a8826c7cf123" by "delete_volume" {{(pid=83259) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 16 15:19:02 devstack cinder-volume[83259]: DEBUG cinder.coordination [None req-5af950b8-749c-4b69-af5f-dc40ddeb09f9 tempest-TestMinimumBasicScenario-992444150 None] Lock "cinder-quobyte-e25d09e4-9bd9-44b1-8f67-a8826c7cf123" acquired by "delete_volume" :: waited 0.064s {{(pid=83259) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 16 15:19:02 devstack cinder-volume[83259]: DEBUG cinder.coordination [None req-e6b00ae3-7200-4986-8cd7-084de3abc2fd tempest-TestInstancesWithCinderVolumes-1096446095 None] Lock "cinder-3999b191-d35b-4005-b1c8-34819dec9799-delete_volume" released by "delete_volume" :: held 2.142s {{(pid=83259) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 16 15:19:02 devstack cinder-volume[83259]: DEBUG oslo.privsep.daemon [-] privsep: reply[afc3780c-7ab7-4496-bf4c-9c001adfa346]: (4, 'qcow2') {{(pid=84312) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 16 15:19:02 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [None req-5af950b8-749c-4b69-af5f-dc40ddeb09f9 tempest-TestMinimumBasicScenario-992444150 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c/volume-e25d09e4-9bd9-44b1-8f67-a8826c7cf123 {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 15:19:02 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [None req-5af950b8-749c-4b69-af5f-dc40ddeb09f9 tempest-TestMinimumBasicScenario-992444150 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c/volume-e25d09e4-9bd9-44b1-8f67-a8826c7cf123" returned: 0 in 0.466s {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 15:19:02 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [None req-5af950b8-749c-4b69-af5f-dc40ddeb09f9 tempest-TestMinimumBasicScenario-992444150 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c/volume-e25d09e4-9bd9-44b1-8f67-a8826c7cf123 {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 15:19:03 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [None req-5af950b8-749c-4b69-af5f-dc40ddeb09f9 tempest-TestMinimumBasicScenario-992444150 None] CMD "rm -f /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c/volume-e25d09e4-9bd9-44b1-8f67-a8826c7cf123" returned: 0 in 0.140s {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 15:19:03 devstack cinder-volume[83259]: DEBUG cinder.coordination [None req-5af950b8-749c-4b69-af5f-dc40ddeb09f9 tempest-TestMinimumBasicScenario-992444150 None] Lock "cinder-quobyte-e25d09e4-9bd9-44b1-8f67-a8826c7cf123" released by "delete_volume" :: held 0.814s {{(pid=83259) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 16 15:19:04 devstack cinder-volume[83259]: DEBUG cinder.quota [None req-5af950b8-749c-4b69-af5f-dc40ddeb09f9 tempest-TestMinimumBasicScenario-992444150 None] Created reservations ['371e07e1-c3b2-4a3f-8065-c8deb3987184', '7c85b74e-9aac-4be5-b429-6a73b7b68438', '33170e89-b9a3-48fe-b10f-c541db7edd9e', '70d81728-4ff5-46eb-8096-0dbbd4a07b64'] {{(pid=83259) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 16 15:19:04 devstack cinder-volume[83259]: DEBUG oslo_concurrency.lockutils [None req-5af950b8-749c-4b69-af5f-dc40ddeb09f9 tempest-TestMinimumBasicScenario-992444150 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83259) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 16 15:19:04 devstack cinder-volume[83259]: DEBUG oslo_concurrency.lockutils [None req-5af950b8-749c-4b69-af5f-dc40ddeb09f9 tempest-TestMinimumBasicScenario-992444150 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=83259) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 16 15:19:04 devstack cinder-volume[83259]: DEBUG cinder.volume.drivers.quobyte [None req-5af950b8-749c-4b69-af5f-dc40ddeb09f9 tempest-TestMinimumBasicScenario-992444150 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-61f585ac-f8e2-4d19-a890-7ebc2726cc72': None} {{(pid=83259) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:639}} Sep 16 15:19:04 devstack cinder-volume[83259]: DEBUG cinder.volume.drivers.quobyte [None req-5af950b8-749c-4b69-af5f-dc40ddeb09f9 tempest-TestMinimumBasicScenario-992444150 None] Available shares ['10.10.41.181/cinder-vol-61f585ac-f8e2-4d19-a890-7ebc2726cc72'] {{(pid=83259) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:669}} Sep 16 15:19:04 devstack cinder-volume[83259]: DEBUG oslo_concurrency.lockutils [None req-5af950b8-749c-4b69-af5f-dc40ddeb09f9 tempest-TestMinimumBasicScenario-992444150 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=83259) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 16 15:19:04 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [None req-5af950b8-749c-4b69-af5f-dc40ddeb09f9 tempest-TestMinimumBasicScenario-992444150 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 15:19:04 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [None req-5af950b8-749c-4b69-af5f-dc40ddeb09f9 tempest-TestMinimumBasicScenario-992444150 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c" returned: 0 in 0.094s {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 15:19:04 devstack cinder-volume[83259]: DEBUG cinder.manager [None req-5af950b8-749c-4b69-af5f-dc40ddeb09f9 tempest-TestMinimumBasicScenario-992444150 None] Notifying Schedulers of capabilities ... {{(pid=83259) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 16 15:19:04 devstack cinder-volume[83259]: INFO cinder.volume.manager [None req-5af950b8-749c-4b69-af5f-dc40ddeb09f9 tempest-TestMinimumBasicScenario-992444150 None] Deleted volume successfully. Sep 16 15:19:04 devstack cinder-volume[83259]: DEBUG cinder.coordination [None req-5af950b8-749c-4b69-af5f-dc40ddeb09f9 tempest-TestMinimumBasicScenario-992444150 None] Lock "cinder-e25d09e4-9bd9-44b1-8f67-a8826c7cf123-delete_volume" released by "delete_volume" :: held 3.045s {{(pid=83259) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 16 15:19:14 devstack cinder-volume[83259]: DEBUG dbcounter [-] [83259] Writing DB stats cinder:SELECT=13,cinder:INSERT=2,cinder:UPDATE=22 {{(pid=83259) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Sep 16 15:19:14 devstack cinder-volume[83259]: DEBUG dbcounter [-] [83259] Writing DB stats cinder:SELECT=11,cinder:UPDATE=10,cinder:INSERT=6,cinder:DELETE=2 {{(pid=83259) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Sep 16 15:19:30 devstack cinder-volume[83259]: WARNING cinder.volume.volume_utils [req-9d8848d7-ea02-43a3-ad58-09110652f857 req-dc6b50bb-0a56-41de-b54b-f707a640e232 tempest-TestInstancesWithCinderVolumes-1096446095 None] Volume driver (QuobyteDriver 1.2) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 16 15:19:30 devstack cinder-volume[83259]: WARNING cinder.volume.volume_utils [req-9d8848d7-ea02-43a3-ad58-09110652f857 req-dc6b50bb-0a56-41de-b54b-f707a640e232 tempest-TestInstancesWithCinderVolumes-1096446095 None] Volume driver (QuobyteDriver 1.2) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 16 15:19:30 devstack cinder-volume[83259]: INFO cinder.volume.manager [req-9d8848d7-ea02-43a3-ad58-09110652f857 req-dc6b50bb-0a56-41de-b54b-f707a640e232 tempest-TestInstancesWithCinderVolumes-1096446095 None] Terminate volume connection completed successfully. Sep 16 15:19:30 devstack cinder-volume[83259]: DEBUG cinder.volume.manager [req-9d8848d7-ea02-43a3-ad58-09110652f857 req-dc6b50bb-0a56-41de-b54b-f707a640e232 tempest-TestInstancesWithCinderVolumes-1096446095 None] Deleting attachment e82747aa-449d-4810-b055-9cf8db154800. {{(pid=83259) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5022}} Sep 16 15:19:31 devstack cinder-volume[83259]: DEBUG cinder.coordination [None req-6d6b329f-7c4a-4e7f-a4e0-418c51ad694f tempest-TestInstancesWithCinderVolumes-1096446095 None] Acquiring lock "cinder-2832e9fc-26a2-4ace-967d-64fcf9d41fb0-delete_volume" by "delete_volume" {{(pid=83259) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 16 15:19:31 devstack cinder-volume[83259]: DEBUG cinder.coordination [None req-6d6b329f-7c4a-4e7f-a4e0-418c51ad694f tempest-TestInstancesWithCinderVolumes-1096446095 None] Lock "cinder-2832e9fc-26a2-4ace-967d-64fcf9d41fb0-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=83259) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 16 15:19:31 devstack cinder-volume[83259]: WARNING cinder.volume.volume_utils [None req-6d6b329f-7c4a-4e7f-a4e0-418c51ad694f tempest-TestInstancesWithCinderVolumes-1096446095 None] Volume driver (QuobyteDriver 1.2) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 16 15:19:31 devstack cinder-volume[83259]: DEBUG cinder.coordination [None req-6d6b329f-7c4a-4e7f-a4e0-418c51ad694f tempest-TestInstancesWithCinderVolumes-1096446095 None] Acquiring lock "cinder-quobyte-2832e9fc-26a2-4ace-967d-64fcf9d41fb0" by "delete_volume" {{(pid=83259) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 16 15:19:31 devstack cinder-volume[83259]: DEBUG cinder.coordination [None req-6d6b329f-7c4a-4e7f-a4e0-418c51ad694f tempest-TestInstancesWithCinderVolumes-1096446095 None] Lock "cinder-quobyte-2832e9fc-26a2-4ace-967d-64fcf9d41fb0" acquired by "delete_volume" :: waited 0.013s {{(pid=83259) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 16 15:19:31 devstack cinder-volume[83259]: DEBUG oslo.privsep.daemon [-] privsep: reply[bbea8f16-72d1-4248-bcd5-f24360dfe245]: (4, 'qcow2') {{(pid=84312) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 16 15:19:31 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [None req-6d6b329f-7c4a-4e7f-a4e0-418c51ad694f tempest-TestInstancesWithCinderVolumes-1096446095 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c/volume-2832e9fc-26a2-4ace-967d-64fcf9d41fb0 {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 15:19:32 devstack quobyte-client[83286]: System call of process 98230 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 16 15:19:32 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [None req-6d6b329f-7c4a-4e7f-a4e0-418c51ad694f tempest-TestInstancesWithCinderVolumes-1096446095 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c/volume-2832e9fc-26a2-4ace-967d-64fcf9d41fb0" returned: 0 in 0.825s {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 15:19:32 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [None req-6d6b329f-7c4a-4e7f-a4e0-418c51ad694f tempest-TestInstancesWithCinderVolumes-1096446095 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c/volume-2832e9fc-26a2-4ace-967d-64fcf9d41fb0 {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 15:19:33 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [None req-6d6b329f-7c4a-4e7f-a4e0-418c51ad694f tempest-TestInstancesWithCinderVolumes-1096446095 None] CMD "rm -f /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c/volume-2832e9fc-26a2-4ace-967d-64fcf9d41fb0" returned: 0 in 0.303s {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 15:19:33 devstack cinder-volume[83259]: DEBUG cinder.coordination [None req-6d6b329f-7c4a-4e7f-a4e0-418c51ad694f tempest-TestInstancesWithCinderVolumes-1096446095 None] Lock "cinder-quobyte-2832e9fc-26a2-4ace-967d-64fcf9d41fb0" released by "delete_volume" :: held 1.535s {{(pid=83259) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 16 15:19:33 devstack cinder-volume[83259]: WARNING cinder.quota [None req-6d6b329f-7c4a-4e7f-a4e0-418c51ad694f tempest-TestInstancesWithCinderVolumes-1096446095 None] Deprecated: Default quota for resource: volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1483947356-584484227 is set by the default quota flag: quota_volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1483947356-584484227, it is now deprecated. Please use the default quota class for default quota. Sep 16 15:19:33 devstack cinder-volume[83259]: WARNING cinder.quota [None req-6d6b329f-7c4a-4e7f-a4e0-418c51ad694f tempest-TestInstancesWithCinderVolumes-1096446095 None] Deprecated: Default quota for resource: gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1483947356-584484227 is set by the default quota flag: quota_gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1483947356-584484227, it is now deprecated. Please use the default quota class for default quota. Sep 16 15:19:33 devstack cinder-volume[83259]: DEBUG cinder.quota [None req-6d6b329f-7c4a-4e7f-a4e0-418c51ad694f tempest-TestInstancesWithCinderVolumes-1096446095 None] Created reservations ['0a7412f2-fa0a-4040-b2cd-9c7da4d281c1', '4e659f12-2dc5-40f4-b6b3-e9ca5386b10b', 'a0f957eb-c1bb-4e22-804d-badde9a15838', '832777db-9af2-41e3-942f-c41049ca02de'] {{(pid=83259) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 16 15:19:33 devstack cinder-volume[83259]: DEBUG oslo_concurrency.lockutils [None req-6d6b329f-7c4a-4e7f-a4e0-418c51ad694f tempest-TestInstancesWithCinderVolumes-1096446095 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83259) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 16 15:19:33 devstack cinder-volume[83259]: DEBUG oslo_concurrency.lockutils [None req-6d6b329f-7c4a-4e7f-a4e0-418c51ad694f tempest-TestInstancesWithCinderVolumes-1096446095 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.006s {{(pid=83259) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 16 15:19:33 devstack cinder-volume[83259]: DEBUG cinder.volume.drivers.quobyte [None req-6d6b329f-7c4a-4e7f-a4e0-418c51ad694f tempest-TestInstancesWithCinderVolumes-1096446095 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-61f585ac-f8e2-4d19-a890-7ebc2726cc72': None} {{(pid=83259) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:639}} Sep 16 15:19:33 devstack cinder-volume[83259]: DEBUG cinder.volume.drivers.quobyte [None req-6d6b329f-7c4a-4e7f-a4e0-418c51ad694f tempest-TestInstancesWithCinderVolumes-1096446095 None] Available shares ['10.10.41.181/cinder-vol-61f585ac-f8e2-4d19-a890-7ebc2726cc72'] {{(pid=83259) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:669}} Sep 16 15:19:33 devstack cinder-volume[83259]: DEBUG oslo_concurrency.lockutils [None req-6d6b329f-7c4a-4e7f-a4e0-418c51ad694f tempest-TestInstancesWithCinderVolumes-1096446095 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=83259) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 16 15:19:33 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [None req-6d6b329f-7c4a-4e7f-a4e0-418c51ad694f tempest-TestInstancesWithCinderVolumes-1096446095 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 15:19:34 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [None req-6d6b329f-7c4a-4e7f-a4e0-418c51ad694f tempest-TestInstancesWithCinderVolumes-1096446095 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c" returned: 0 in 0.162s {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 15:19:34 devstack cinder-volume[83259]: DEBUG cinder.manager [None req-6d6b329f-7c4a-4e7f-a4e0-418c51ad694f tempest-TestInstancesWithCinderVolumes-1096446095 None] Notifying Schedulers of capabilities ... {{(pid=83259) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 16 15:19:34 devstack cinder-volume[83259]: INFO cinder.volume.manager [None req-6d6b329f-7c4a-4e7f-a4e0-418c51ad694f tempest-TestInstancesWithCinderVolumes-1096446095 None] Deleted volume successfully. Sep 16 15:19:34 devstack cinder-volume[83259]: DEBUG cinder.coordination [None req-6d6b329f-7c4a-4e7f-a4e0-418c51ad694f tempest-TestInstancesWithCinderVolumes-1096446095 None] Lock "cinder-2832e9fc-26a2-4ace-967d-64fcf9d41fb0-delete_volume" released by "delete_volume" :: held 2.721s {{(pid=83259) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 16 15:19:43 devstack cinder-volume[83259]: WARNING cinder.volume.volume_utils [req-e57f1e56-4af1-45bb-867c-52929c7dcb50 req-113cee50-8dbb-44af-8e5c-b1ff3f18e077 tempest-TestInstancesWithCinderVolumes-1096446095 None] Volume driver (QuobyteDriver 1.2) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 16 15:19:43 devstack cinder-volume[83259]: WARNING cinder.volume.volume_utils [req-e57f1e56-4af1-45bb-867c-52929c7dcb50 req-113cee50-8dbb-44af-8e5c-b1ff3f18e077 tempest-TestInstancesWithCinderVolumes-1096446095 None] Volume driver (QuobyteDriver 1.2) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 16 15:19:43 devstack cinder-volume[83259]: INFO cinder.volume.manager [req-e57f1e56-4af1-45bb-867c-52929c7dcb50 req-113cee50-8dbb-44af-8e5c-b1ff3f18e077 tempest-TestInstancesWithCinderVolumes-1096446095 None] Terminate volume connection completed successfully. Sep 16 15:19:43 devstack cinder-volume[83259]: DEBUG cinder.volume.manager [req-e57f1e56-4af1-45bb-867c-52929c7dcb50 req-113cee50-8dbb-44af-8e5c-b1ff3f18e077 tempest-TestInstancesWithCinderVolumes-1096446095 None] Deleting attachment c86f5b85-0124-456d-8a7b-92aad793a7b8. {{(pid=83259) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5022}} Sep 16 15:19:46 devstack cinder-volume[83259]: DEBUG oslo_service.periodic_task [None req-050ec8a1-6ffd-499d-95ad-d548a84437e2 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=83259) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} Sep 16 15:19:46 devstack cinder-volume[83259]: DEBUG oslo_concurrency.lockutils [None req-050ec8a1-6ffd-499d-95ad-d548a84437e2 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83259) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 16 15:19:46 devstack cinder-volume[83259]: DEBUG oslo_concurrency.lockutils [None req-050ec8a1-6ffd-499d-95ad-d548a84437e2 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83259) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 16 15:19:46 devstack cinder-volume[83259]: DEBUG cinder.volume.drivers.quobyte [None req-050ec8a1-6ffd-499d-95ad-d548a84437e2 None None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-61f585ac-f8e2-4d19-a890-7ebc2726cc72': None} {{(pid=83259) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:639}} Sep 16 15:19:46 devstack cinder-volume[83259]: DEBUG cinder.volume.drivers.quobyte [None req-050ec8a1-6ffd-499d-95ad-d548a84437e2 None None] Available shares ['10.10.41.181/cinder-vol-61f585ac-f8e2-4d19-a890-7ebc2726cc72'] {{(pid=83259) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:669}} Sep 16 15:19:46 devstack cinder-volume[83259]: DEBUG oslo_concurrency.lockutils [None req-050ec8a1-6ffd-499d-95ad-d548a84437e2 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=83259) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 16 15:19:46 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [None req-050ec8a1-6ffd-499d-95ad-d548a84437e2 None None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 15:19:46 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [None req-050ec8a1-6ffd-499d-95ad-d548a84437e2 None None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c" returned: 0 in 0.114s {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 15:19:46 devstack cinder-volume[83259]: DEBUG cinder.manager [None req-050ec8a1-6ffd-499d-95ad-d548a84437e2 None None] Notifying Schedulers of capabilities ... {{(pid=83259) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 16 15:19:48 devstack cinder-volume[83259]: DEBUG cinder.coordination [None req-fe3b9a6e-4fa7-4abd-b5f0-c792b66d385c tempest-TestInstancesWithCinderVolumes-1096446095 None] Acquiring lock "cinder-fe0a6272-f5d7-45de-8211-43dcdab851c8-delete_volume" by "delete_volume" {{(pid=83259) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 16 15:19:48 devstack cinder-volume[83259]: DEBUG cinder.coordination [None req-fe3b9a6e-4fa7-4abd-b5f0-c792b66d385c tempest-TestInstancesWithCinderVolumes-1096446095 None] Lock "cinder-fe0a6272-f5d7-45de-8211-43dcdab851c8-delete_volume" acquired by "delete_volume" :: waited 0.092s {{(pid=83259) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 16 15:19:48 devstack cinder-volume[83259]: WARNING cinder.volume.volume_utils [None req-fe3b9a6e-4fa7-4abd-b5f0-c792b66d385c tempest-TestInstancesWithCinderVolumes-1096446095 None] Volume driver (QuobyteDriver 1.2) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 16 15:19:48 devstack cinder-volume[83259]: DEBUG cinder.coordination [None req-fe3b9a6e-4fa7-4abd-b5f0-c792b66d385c tempest-TestInstancesWithCinderVolumes-1096446095 None] Acquiring lock "cinder-quobyte-fe0a6272-f5d7-45de-8211-43dcdab851c8" by "delete_volume" {{(pid=83259) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 16 15:19:48 devstack cinder-volume[83259]: DEBUG cinder.coordination [None req-fe3b9a6e-4fa7-4abd-b5f0-c792b66d385c tempest-TestInstancesWithCinderVolumes-1096446095 None] Lock "cinder-quobyte-fe0a6272-f5d7-45de-8211-43dcdab851c8" acquired by "delete_volume" :: waited 0.012s {{(pid=83259) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 16 15:19:48 devstack cinder-volume[83259]: DEBUG oslo.privsep.daemon [-] privsep: reply[d8202e82-fee6-4b26-884c-db3691e04fb2]: (4, 'qcow2') {{(pid=84312) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 16 15:19:48 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [None req-fe3b9a6e-4fa7-4abd-b5f0-c792b66d385c tempest-TestInstancesWithCinderVolumes-1096446095 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c/volume-fe0a6272-f5d7-45de-8211-43dcdab851c8 {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 15:19:49 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [None req-fe3b9a6e-4fa7-4abd-b5f0-c792b66d385c tempest-TestInstancesWithCinderVolumes-1096446095 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c/volume-fe0a6272-f5d7-45de-8211-43dcdab851c8" returned: 0 in 0.560s {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 15:19:49 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [None req-fe3b9a6e-4fa7-4abd-b5f0-c792b66d385c tempest-TestInstancesWithCinderVolumes-1096446095 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c/volume-fe0a6272-f5d7-45de-8211-43dcdab851c8 {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 15:19:49 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [None req-fe3b9a6e-4fa7-4abd-b5f0-c792b66d385c tempest-TestInstancesWithCinderVolumes-1096446095 None] CMD "rm -f /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c/volume-fe0a6272-f5d7-45de-8211-43dcdab851c8" returned: 0 in 0.107s {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 15:19:49 devstack cinder-volume[83259]: DEBUG cinder.coordination [None req-fe3b9a6e-4fa7-4abd-b5f0-c792b66d385c tempest-TestInstancesWithCinderVolumes-1096446095 None] Lock "cinder-quobyte-fe0a6272-f5d7-45de-8211-43dcdab851c8" released by "delete_volume" :: held 0.862s {{(pid=83259) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 16 15:19:49 devstack cinder-volume[83259]: WARNING cinder.quota [None req-fe3b9a6e-4fa7-4abd-b5f0-c792b66d385c tempest-TestInstancesWithCinderVolumes-1096446095 None] Deprecated: Default quota for resource: volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-221683375-1335269040 is set by the default quota flag: quota_volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-221683375-1335269040, it is now deprecated. Please use the default quota class for default quota. Sep 16 15:19:49 devstack cinder-volume[83259]: WARNING cinder.quota [None req-fe3b9a6e-4fa7-4abd-b5f0-c792b66d385c tempest-TestInstancesWithCinderVolumes-1096446095 None] Deprecated: Default quota for resource: gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-221683375-1335269040 is set by the default quota flag: quota_gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-221683375-1335269040, it is now deprecated. Please use the default quota class for default quota. Sep 16 15:19:49 devstack cinder-volume[83259]: DEBUG cinder.quota [None req-fe3b9a6e-4fa7-4abd-b5f0-c792b66d385c tempest-TestInstancesWithCinderVolumes-1096446095 None] Created reservations ['c74e1658-9827-4430-8b8d-af5656818e5b', '73b6607a-dad9-4049-a655-77976cf98d17', '95b7da86-0975-4407-882e-a595f3722ae3', '3c0a0ca4-4803-41a9-a2a8-4b05f34265a4'] {{(pid=83259) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 16 15:19:49 devstack cinder-volume[83259]: DEBUG oslo_concurrency.lockutils [None req-fe3b9a6e-4fa7-4abd-b5f0-c792b66d385c tempest-TestInstancesWithCinderVolumes-1096446095 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83259) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 16 15:19:49 devstack cinder-volume[83259]: DEBUG oslo_concurrency.lockutils [None req-fe3b9a6e-4fa7-4abd-b5f0-c792b66d385c tempest-TestInstancesWithCinderVolumes-1096446095 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=83259) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 16 15:19:49 devstack cinder-volume[83259]: DEBUG cinder.volume.drivers.quobyte [None req-fe3b9a6e-4fa7-4abd-b5f0-c792b66d385c tempest-TestInstancesWithCinderVolumes-1096446095 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-61f585ac-f8e2-4d19-a890-7ebc2726cc72': None} {{(pid=83259) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:639}} Sep 16 15:19:49 devstack cinder-volume[83259]: DEBUG cinder.volume.drivers.quobyte [None req-fe3b9a6e-4fa7-4abd-b5f0-c792b66d385c tempest-TestInstancesWithCinderVolumes-1096446095 None] Available shares ['10.10.41.181/cinder-vol-61f585ac-f8e2-4d19-a890-7ebc2726cc72'] {{(pid=83259) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:669}} Sep 16 15:19:49 devstack cinder-volume[83259]: DEBUG oslo_concurrency.lockutils [None req-fe3b9a6e-4fa7-4abd-b5f0-c792b66d385c tempest-TestInstancesWithCinderVolumes-1096446095 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=83259) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 16 15:19:49 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [None req-fe3b9a6e-4fa7-4abd-b5f0-c792b66d385c tempest-TestInstancesWithCinderVolumes-1096446095 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 15:19:49 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [None req-fe3b9a6e-4fa7-4abd-b5f0-c792b66d385c tempest-TestInstancesWithCinderVolumes-1096446095 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c" returned: 0 in 0.099s {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 15:19:49 devstack cinder-volume[83259]: DEBUG cinder.manager [None req-fe3b9a6e-4fa7-4abd-b5f0-c792b66d385c tempest-TestInstancesWithCinderVolumes-1096446095 None] Notifying Schedulers of capabilities ... {{(pid=83259) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 16 15:19:49 devstack cinder-volume[83259]: INFO cinder.volume.manager [None req-fe3b9a6e-4fa7-4abd-b5f0-c792b66d385c tempest-TestInstancesWithCinderVolumes-1096446095 None] Deleted volume successfully. Sep 16 15:19:50 devstack cinder-volume[83259]: DEBUG cinder.coordination [None req-fe3b9a6e-4fa7-4abd-b5f0-c792b66d385c tempest-TestInstancesWithCinderVolumes-1096446095 None] Lock "cinder-fe0a6272-f5d7-45de-8211-43dcdab851c8-delete_volume" released by "delete_volume" :: held 1.964s {{(pid=83259) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 16 15:19:59 devstack cinder-volume[83259]: DEBUG dbcounter [-] [83259] Writing DB stats cinder:SELECT=9,cinder:UPDATE=20,cinder:INSERT=4 {{(pid=83259) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Sep 16 15:20:00 devstack cinder-volume[83259]: DEBUG dbcounter [-] [83259] Writing DB stats cinder:SELECT=15,cinder:UPDATE=12,cinder:DELETE=2,cinder:INSERT=4 {{(pid=83259) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Sep 16 15:20:04 devstack cinder-volume[83259]: WARNING cinder.volume.volume_utils [None req-faca3645-9264-4eb5-9750-fc6cbf06b6b4 tempest-TestShelveInstance-483969706 None] Volume driver (QuobyteDriver 1.2) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 16 15:20:04 devstack cinder-volume[83259]: DEBUG cinder.volume.flows.manager.create_volume [None req-faca3645-9264-4eb5-9750-fc6cbf06b6b4 tempest-TestShelveInstance-483969706 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#Quobyte'], 'hosts': ['devstack@QuobyteHD#Quobyte']} {{(pid=83259) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1387}} Sep 16 15:20:04 devstack cinder-volume[83259]: DEBUG cinder.volume.manager [None req-faca3645-9264-4eb5-9750-fc6cbf06b6b4 tempest-TestShelveInstance-483969706 None] Flow 'volume_create_manager' (9df5b034-2b1d-4262-9cb0-769055759536) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83259) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 16 15:20:04 devstack cinder-volume[83259]: DEBUG cinder.volume.manager [None req-faca3645-9264-4eb5-9750-fc6cbf06b6b4 tempest-TestShelveInstance-483969706 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a540fcef-9e73-4a02-a4af-25a6366de1ec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83259) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 15:20:04 devstack cinder-volume[83259]: DEBUG cinder.volume.manager [None req-faca3645-9264-4eb5-9750-fc6cbf06b6b4 tempest-TestShelveInstance-483969706 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a540fcef-9e73-4a02-a4af-25a6366de1ec) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-16T13:20:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-tempest.common.compute-volume-1475420216',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#Quobyte',id=74e00629-871f-4a7b-8cdf-24d129636423,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b70a1a61a61e4452903eb9d3b6f62b08',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-16T13:20:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-16T13:20:04Z,use_quota=True,user_id='21291f7b829d48628cb894c277f21498',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(485ead50-3df8-4d76-8d34-a4db136c980a),volume_type_id=485ead50-3df8-4d76-8d34-a4db136c980a)' {{(pid=83259) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 15:20:04 devstack cinder-volume[83259]: DEBUG cinder.volume.manager [None req-faca3645-9264-4eb5-9750-fc6cbf06b6b4 tempest-TestShelveInstance-483969706 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5927f6ef-ee6b-45a1-946a-e964e0a90e1f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83259) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 15:20:04 devstack cinder-volume[83259]: DEBUG cinder.volume.manager [None req-faca3645-9264-4eb5-9750-fc6cbf06b6b4 tempest-TestShelveInstance-483969706 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5927f6ef-ee6b-45a1-946a-e964e0a90e1f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83259) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 15:20:04 devstack cinder-volume[83259]: DEBUG cinder.volume.manager [None req-faca3645-9264-4eb5-9750-fc6cbf06b6b4 tempest-TestShelveInstance-483969706 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7a7da9cc-719e-4eac-8f78-9e5843164948) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83259) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 15:20:04 devstack cinder-volume[83259]: DEBUG cinder.image.glance [None req-faca3645-9264-4eb5-9750-fc6cbf06b6b4 tempest-TestShelveInstance-483969706 None] Creating Keystone auth plugin from conf {{(pid=83259) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:128}} Sep 16 15:20:04 devstack cinder-volume[83259]: DEBUG cinder.volume.manager [None req-faca3645-9264-4eb5-9750-fc6cbf06b6b4 tempest-TestShelveInstance-483969706 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7a7da9cc-719e-4eac-8f78-9e5843164948) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '74e00629-871f-4a7b-8cdf-24d129636423', 'volume_name': 'volume-74e00629-871f-4a7b-8cdf-24d129636423', 'volume_size': 1, 'image_id': '7786237f-0aff-46c8-bcd0-3b9486a0637a', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/7786237f-0aff-46c8-bcd0-3b9486a0637a', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '97738b7ffcbe49cbaad0099563a58435', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '7786237f-0aff-46c8-bcd0-3b9486a0637a', 'created_at': datetime.datetime(2025, 9, 16, 12, 35, 41, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2025, 9, 16, 12, 35, 42, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/7786237f-0aff-46c8-bcd0-3b9486a0637a/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=83259) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 15:20:04 devstack cinder-volume[83259]: DEBUG cinder.volume.manager [None req-faca3645-9264-4eb5-9750-fc6cbf06b6b4 tempest-TestShelveInstance-483969706 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (490bc01d-72e3-4193-8060-72582fac813e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83259) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 15:20:04 devstack cinder-volume[83259]: DEBUG cinder.volume.manager [None req-faca3645-9264-4eb5-9750-fc6cbf06b6b4 tempest-TestShelveInstance-483969706 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (490bc01d-72e3-4193-8060-72582fac813e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83259) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 15:20:04 devstack cinder-volume[83259]: DEBUG cinder.volume.manager [None req-faca3645-9264-4eb5-9750-fc6cbf06b6b4 tempest-TestShelveInstance-483969706 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cfcacc5d-4e57-4101-9166-f2f632eda65c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83259) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 15:20:04 devstack cinder-volume[83259]: INFO cinder.volume.flows.manager.create_volume [None req-faca3645-9264-4eb5-9750-fc6cbf06b6b4 tempest-TestShelveInstance-483969706 None] Volume 74e00629-871f-4a7b-8cdf-24d129636423: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-74e00629-871f-4a7b-8cdf-24d129636423', 'volume_size': 1, 'image_id': '7786237f-0aff-46c8-bcd0-3b9486a0637a', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/7786237f-0aff-46c8-bcd0-3b9486a0637a', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '97738b7ffcbe49cbaad0099563a58435', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '7786237f-0aff-46c8-bcd0-3b9486a0637a', 'created_at': datetime.datetime(2025, 9, 16, 12, 35, 41, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2025, 9, 16, 12, 35, 42, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/7786237f-0aff-46c8-bcd0-3b9486a0637a/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Sep 16 15:20:04 devstack cinder-volume[83259]: DEBUG cinder.volume.flows.manager.create_volume [None req-faca3645-9264-4eb5-9750-fc6cbf06b6b4 tempest-TestShelveInstance-483969706 None] Cloning 74e00629-871f-4a7b-8cdf-24d129636423 from image 7786237f-0aff-46c8-bcd0-3b9486a0637a at location (None, [{'url': 'file:///opt/stack/data/glance/images/7786237f-0aff-46c8-bcd0-3b9486a0637a', 'metadata': {}}]). {{(pid=83259) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1085}} Sep 16 15:20:05 devstack cinder-volume[83259]: DEBUG cinder.image.image_utils [None req-faca3645-9264-4eb5-9750-fc6cbf06b6b4 tempest-TestShelveInstance-483969706 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_7786237f-0aff-46c8-bcd0-3b9486a0637a_vz884x8zdevstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=83259) fetch /opt/stack/cinder/cinder/image/image_utils.py:700}} Sep 16 15:20:05 devstack cinder-volume[83259]: INFO cinder.image.image_utils [None req-faca3645-9264-4eb5-9750-fc6cbf06b6b4 tempest-TestShelveInstance-483969706 None] Image download 20.69 MB at 20.69 MB/s Sep 16 15:20:05 devstack cinder-volume[83259]: DEBUG oslo.privsep.daemon [-] privsep: reply[b49339e2-a5b8-47c0-8a4b-b09a152e98c1]: (4, 'qcow2') {{(pid=84312) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 16 15:20:05 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [None req-faca3645-9264-4eb5-9750-fc6cbf06b6b4 tempest-TestShelveInstance-483969706 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_7786237f-0aff-46c8-bcd0-3b9486a0637a_vz884x8zdevstack@QuobyteHD {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 15:20:05 devstack sudo[98334]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_7786237f-0aff-46c8-bcd0-3b9486a0637a_vz884x8zdevstack@QuobyteHD Sep 16 15:20:05 devstack sudo[98334]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 15:20:07 devstack sudo[98334]: pam_unix(sudo:session): session closed for user root Sep 16 15:20:07 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [None req-faca3645-9264-4eb5-9750-fc6cbf06b6b4 tempest-TestShelveInstance-483969706 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_7786237f-0aff-46c8-bcd0-3b9486a0637a_vz884x8zdevstack@QuobyteHD" returned: 0 in 2.713s {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 15:20:08 devstack cinder-volume[83259]: DEBUG cinder.image.image_utils [None req-faca3645-9264-4eb5-9750-fc6cbf06b6b4 tempest-TestShelveInstance-483969706 None] Temporary image 7786237f-0aff-46c8-bcd0-3b9486a0637a is fetched for user 21291f7b829d48628cb894c277f21498. {{(pid=83259) fetch /opt/stack/cinder/cinder/image/image_utils.py:1399}} Sep 16 15:20:08 devstack cinder-volume[83259]: DEBUG oslo.privsep.daemon [-] privsep: reply[a8f7809d-c832-4ca8-acb9-81a1f2d634c5]: (4, 'qcow2') {{(pid=84312) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 16 15:20:08 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [None req-faca3645-9264-4eb5-9750-fc6cbf06b6b4 tempest-TestShelveInstance-483969706 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_7786237f-0aff-46c8-bcd0-3b9486a0637a_vz884x8zdevstack@QuobyteHD {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 15:20:08 devstack sudo[98340]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_7786237f-0aff-46c8-bcd0-3b9486a0637a_vz884x8zdevstack@QuobyteHD Sep 16 15:20:08 devstack sudo[98340]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 15:20:10 devstack sudo[98340]: pam_unix(sudo:session): session closed for user root Sep 16 15:20:11 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [None req-faca3645-9264-4eb5-9750-fc6cbf06b6b4 tempest-TestShelveInstance-483969706 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_7786237f-0aff-46c8-bcd0-3b9486a0637a_vz884x8zdevstack@QuobyteHD" returned: 0 in 2.568s {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 15:20:11 devstack cinder-volume[83259]: DEBUG oslo_concurrency.lockutils [None req-faca3645-9264-4eb5-9750-fc6cbf06b6b4 tempest-TestShelveInstance-483969706 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83259) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 16 15:20:11 devstack cinder-volume[83259]: DEBUG oslo_concurrency.lockutils [None req-faca3645-9264-4eb5-9750-fc6cbf06b6b4 tempest-TestShelveInstance-483969706 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.006s {{(pid=83259) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 16 15:20:11 devstack cinder-volume[83259]: DEBUG cinder.volume.drivers.quobyte [None req-faca3645-9264-4eb5-9750-fc6cbf06b6b4 tempest-TestShelveInstance-483969706 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-16T13:20:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-tempest.common.compute-volume-1475420216',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#Quobyte',id=74e00629-871f-4a7b-8cdf-24d129636423,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b70a1a61a61e4452903eb9d3b6f62b08',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-16T13:20:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-16T13:20:04Z,use_quota=True,user_id='21291f7b829d48628cb894c277f21498',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(485ead50-3df8-4d76-8d34-a4db136c980a),volume_type_id=485ead50-3df8-4d76-8d34-a4db136c980a)}" {{(pid=83259) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Sep 16 15:20:11 devstack cinder-volume[83259]: DEBUG cinder.volume.drivers.remotefs [None req-faca3645-9264-4eb5-9750-fc6cbf06b6b4 tempest-TestShelveInstance-483969706 None] Creating volume 74e00629-871f-4a7b-8cdf-24d129636423 {{(pid=83259) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}} Sep 16 15:20:11 devstack cinder-volume[83259]: DEBUG oslo_concurrency.lockutils [None req-faca3645-9264-4eb5-9750-fc6cbf06b6b4 tempest-TestShelveInstance-483969706 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83259) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 16 15:20:11 devstack cinder-volume[83259]: DEBUG oslo_concurrency.lockutils [None req-faca3645-9264-4eb5-9750-fc6cbf06b6b4 tempest-TestShelveInstance-483969706 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83259) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 16 15:20:11 devstack cinder-volume[83259]: DEBUG cinder.volume.drivers.quobyte [None req-faca3645-9264-4eb5-9750-fc6cbf06b6b4 tempest-TestShelveInstance-483969706 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-61f585ac-f8e2-4d19-a890-7ebc2726cc72': None} {{(pid=83259) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:639}} Sep 16 15:20:11 devstack cinder-volume[83259]: DEBUG cinder.volume.drivers.quobyte [None req-faca3645-9264-4eb5-9750-fc6cbf06b6b4 tempest-TestShelveInstance-483969706 None] Available shares ['10.10.41.181/cinder-vol-61f585ac-f8e2-4d19-a890-7ebc2726cc72'] {{(pid=83259) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:669}} Sep 16 15:20:11 devstack cinder-volume[83259]: DEBUG oslo_concurrency.lockutils [None req-faca3645-9264-4eb5-9750-fc6cbf06b6b4 tempest-TestShelveInstance-483969706 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.025s {{(pid=83259) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 16 15:20:11 devstack cinder-volume[83259]: DEBUG cinder.volume.drivers.quobyte [None req-faca3645-9264-4eb5-9750-fc6cbf06b6b4 tempest-TestShelveInstance-483969706 None] Selected 10.10.41.181/cinder-vol-61f585ac-f8e2-4d19-a890-7ebc2726cc72 as target Quobyte volume. {{(pid=83259) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:690}} Sep 16 15:20:11 devstack cinder-volume[83259]: INFO cinder.volume.drivers.remotefs [None req-faca3645-9264-4eb5-9750-fc6cbf06b6b4 tempest-TestShelveInstance-483969706 None] casted to 10.10.41.181/cinder-vol-61f585ac-f8e2-4d19-a890-7ebc2726cc72 Sep 16 15:20:11 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [None req-faca3645-9264-4eb5-9750-fc6cbf06b6b4 tempest-TestShelveInstance-483969706 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c/volume-74e00629-871f-4a7b-8cdf-24d129636423 1073741824 {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 15:20:11 devstack quobyte-client[83286]: The server volume:87712ffe-8a69-446d-9ed6-4430c7ee9792@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=87712ffe-8a69-446d-9ed6-4430c7ee9792, inode=144, name=volume-74e00629-871f-4a7b-8cdf-24d129636423, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.206), requestorAccessMask=0 Sep 16 15:20:11 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [None req-faca3645-9264-4eb5-9750-fc6cbf06b6b4 tempest-TestShelveInstance-483969706 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c/volume-74e00629-871f-4a7b-8cdf-24d129636423 1073741824" returned: 0 in 0.345s {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 15:20:11 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [None req-faca3645-9264-4eb5-9750-fc6cbf06b6b4 tempest-TestShelveInstance-483969706 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c/volume-74e00629-871f-4a7b-8cdf-24d129636423 {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 15:20:11 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [None req-faca3645-9264-4eb5-9750-fc6cbf06b6b4 tempest-TestShelveInstance-483969706 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c/volume-74e00629-871f-4a7b-8cdf-24d129636423" returned: 0 in 0.096s {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 15:20:11 devstack cinder-volume[83259]: DEBUG cinder.volume.drivers.quobyte [None req-faca3645-9264-4eb5-9750-fc6cbf06b6b4 tempest-TestShelveInstance-483969706 None] <== create_volume: return (542ms) {'provider_location': '10.10.41.181/cinder-vol-61f585ac-f8e2-4d19-a890-7ebc2726cc72'} {{(pid=83259) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Sep 16 15:20:11 devstack cinder-volume[83259]: DEBUG oslo_concurrency.lockutils [None req-faca3645-9264-4eb5-9750-fc6cbf06b6b4 tempest-TestShelveInstance-483969706 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.575s {{(pid=83259) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 16 15:20:11 devstack cinder-volume[83259]: DEBUG cinder.volume.volume_utils [None req-faca3645-9264-4eb5-9750-fc6cbf06b6b4 tempest-TestShelveInstance-483969706 None] Attempting download of 7786237f-0aff-46c8-bcd0-3b9486a0637a ((None, [{'url': 'file:///opt/stack/data/glance/images/7786237f-0aff-46c8-bcd0-3b9486a0637a', 'metadata': {}}])) to volume 74e00629-871f-4a7b-8cdf-24d129636423. {{(pid=83259) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1189}} Sep 16 15:20:11 devstack cinder-volume[83259]: DEBUG oslo.privsep.daemon [-] privsep: reply[0e4614d1-0740-4528-b253-3cf85420b16e]: (4, 'raw') {{(pid=84312) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 16 15:20:12 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [None req-faca3645-9264-4eb5-9750-fc6cbf06b6b4 tempest-TestShelveInstance-483969706 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_7786237f-0aff-46c8-bcd0-3b9486a0637a_ta3kk661 {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 15:20:12 devstack sudo[98350]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_7786237f-0aff-46c8-bcd0-3b9486a0637a_ta3kk661 Sep 16 15:20:12 devstack sudo[98350]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 15:20:14 devstack sudo[98350]: pam_unix(sudo:session): session closed for user root Sep 16 15:20:14 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [None req-faca3645-9264-4eb5-9750-fc6cbf06b6b4 tempest-TestShelveInstance-483969706 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_7786237f-0aff-46c8-bcd0-3b9486a0637a_ta3kk661" returned: 0 in 2.404s {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 15:20:14 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [None req-faca3645-9264-4eb5-9750-fc6cbf06b6b4 tempest-TestShelveInstance-483969706 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_7786237f-0aff-46c8-bcd0-3b9486a0637a_ta3kk661 {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 15:20:14 devstack sudo[98354]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_7786237f-0aff-46c8-bcd0-3b9486a0637a_ta3kk661 Sep 16 15:20:14 devstack sudo[98354]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 15:20:16 devstack sudo[98354]: pam_unix(sudo:session): session closed for user root Sep 16 15:20:16 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [None req-faca3645-9264-4eb5-9750-fc6cbf06b6b4 tempest-TestShelveInstance-483969706 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_7786237f-0aff-46c8-bcd0-3b9486a0637a_ta3kk661" returned: 1 in 1.899s {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 15:20:16 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [None req-faca3645-9264-4eb5-9750-fc6cbf06b6b4 tempest-TestShelveInstance-483969706 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_7786237f-0aff-46c8-bcd0-3b9486a0637a_ta3kk661' failed. Not Retrying. {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:423}} Sep 16 15:20:16 devstack cinder-volume[83259]: DEBUG oslo.privsep.daemon [-] privsep: reply[936cb60b-7ee9-43a7-8cdb-438ab1d87780]: (4, 'qcow2') {{(pid=84312) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 16 15:20:16 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [None req-faca3645-9264-4eb5-9750-fc6cbf06b6b4 tempest-TestShelveInstance-483969706 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_7786237f-0aff-46c8-bcd0-3b9486a0637a_vz884x8zdevstack@QuobyteHD {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 15:20:16 devstack sudo[98359]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_7786237f-0aff-46c8-bcd0-3b9486a0637a_vz884x8zdevstack@QuobyteHD Sep 16 15:20:16 devstack sudo[98359]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 15:20:18 devstack sudo[98359]: pam_unix(sudo:session): session closed for user root Sep 16 15:20:18 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [None req-faca3645-9264-4eb5-9750-fc6cbf06b6b4 tempest-TestShelveInstance-483969706 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_7786237f-0aff-46c8-bcd0-3b9486a0637a_vz884x8zdevstack@QuobyteHD" returned: 0 in 1.855s {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 15:20:18 devstack cinder-volume[83259]: DEBUG cinder.image.image_utils [None req-faca3645-9264-4eb5-9750-fc6cbf06b6b4 tempest-TestShelveInstance-483969706 None] 7786237f-0aff-46c8-bcd0-3b9486a0637a was qcow2, converting to qcow2 {{(pid=83259) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1088}} Sep 16 15:20:18 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [None req-faca3645-9264-4eb5-9750-fc6cbf06b6b4 tempest-TestShelveInstance-483969706 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_7786237f-0aff-46c8-bcd0-3b9486a0637a_vz884x8zdevstack@QuobyteHD /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c/volume-74e00629-871f-4a7b-8cdf-24d129636423 {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 15:20:18 devstack sudo[98364]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_7786237f-0aff-46c8-bcd0-3b9486a0637a_vz884x8zdevstack@QuobyteHD /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c/volume-74e00629-871f-4a7b-8cdf-24d129636423 Sep 16 15:20:18 devstack sudo[98364]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 15:20:20 devstack sudo[98364]: pam_unix(sudo:session): session closed for user root Sep 16 15:20:21 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [None req-faca3645-9264-4eb5-9750-fc6cbf06b6b4 tempest-TestShelveInstance-483969706 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_7786237f-0aff-46c8-bcd0-3b9486a0637a_vz884x8zdevstack@QuobyteHD /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c/volume-74e00629-871f-4a7b-8cdf-24d129636423" returned: 0 in 2.708s {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 15:20:21 devstack cinder-volume[83259]: DEBUG cinder.image.image_utils [None req-faca3645-9264-4eb5-9750-fc6cbf06b6b4 tempest-TestShelveInstance-483969706 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_7786237f-0aff-46c8-bcd0-3b9486a0637a_vz884x8zdevstack@QuobyteHD, size 112.00 MB, duration 2.74 sec, destination /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c/volume-74e00629-871f-4a7b-8cdf-24d129636423 {{(pid=83259) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:501}} Sep 16 15:20:21 devstack cinder-volume[83259]: INFO cinder.image.image_utils [None req-faca3645-9264-4eb5-9750-fc6cbf06b6b4 tempest-TestShelveInstance-483969706 None] Converted 112.00 MB image at 40.90 MB/s Sep 16 15:20:21 devstack cinder-volume[83259]: DEBUG oslo.privsep.daemon [-] privsep: reply[802d8944-fa4b-49a8-bbeb-bd69c5c0e1b4]: (4, 'qcow2') {{(pid=84312) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 16 15:20:21 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [None req-faca3645-9264-4eb5-9750-fc6cbf06b6b4 tempest-TestShelveInstance-483969706 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c/volume-74e00629-871f-4a7b-8cdf-24d129636423 {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 15:20:21 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [None req-faca3645-9264-4eb5-9750-fc6cbf06b6b4 tempest-TestShelveInstance-483969706 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c/volume-74e00629-871f-4a7b-8cdf-24d129636423" returned: 0 in 0.419s {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 15:20:21 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [None req-faca3645-9264-4eb5-9750-fc6cbf06b6b4 tempest-TestShelveInstance-483969706 None] Running cmd (subprocess): qemu-img resize /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c/volume-74e00629-871f-4a7b-8cdf-24d129636423 1G {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 15:20:21 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [None req-faca3645-9264-4eb5-9750-fc6cbf06b6b4 tempest-TestShelveInstance-483969706 None] CMD "qemu-img resize /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c/volume-74e00629-871f-4a7b-8cdf-24d129636423 1G" returned: 0 in 0.225s {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 15:20:21 devstack cinder-volume[83259]: DEBUG cinder.volume.volume_utils [None req-faca3645-9264-4eb5-9750-fc6cbf06b6b4 tempest-TestShelveInstance-483969706 None] Downloaded image 7786237f-0aff-46c8-bcd0-3b9486a0637a ((None, [{'url': 'file:///opt/stack/data/glance/images/7786237f-0aff-46c8-bcd0-3b9486a0637a', 'metadata': {}}])) to volume 74e00629-871f-4a7b-8cdf-24d129636423 successfully. {{(pid=83259) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1234}} Sep 16 15:20:21 devstack cinder-volume[83259]: DEBUG cinder.image.image_utils [None req-faca3645-9264-4eb5-9750-fc6cbf06b6b4 tempest-TestShelveInstance-483969706 None] Temporary image 7786237f-0aff-46c8-bcd0-3b9486a0637a for user 21291f7b829d48628cb894c277f21498 is deleted. {{(pid=83259) fetch /opt/stack/cinder/cinder/image/image_utils.py:1403}} Sep 16 15:20:21 devstack cinder-volume[83259]: DEBUG cinder.volume.volume_utils [None req-faca3645-9264-4eb5-9750-fc6cbf06b6b4 tempest-TestShelveInstance-483969706 None] Marking volume 74e00629-871f-4a7b-8cdf-24d129636423 as bootable. {{(pid=83259) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1138}} Sep 16 15:20:21 devstack cinder-volume[83259]: DEBUG dbcounter [-] [83259] Writing DB stats cinder:SELECT=3,cinder:UPDATE=3 {{(pid=83259) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Sep 16 15:20:21 devstack cinder-volume[83259]: DEBUG dbcounter [-] [83259] Writing DB stats cinder:SELECT=2,cinder:INSERT=1,cinder:UPDATE=1 {{(pid=83259) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Sep 16 15:20:22 devstack cinder-volume[83259]: DEBUG cinder.volume.flows.manager.create_volume [None req-faca3645-9264-4eb5-9750-fc6cbf06b6b4 tempest-TestShelveInstance-483969706 None] Copying metadata from image 7786237f-0aff-46c8-bcd0-3b9486a0637a to 74e00629-871f-4a7b-8cdf-24d129636423. {{(pid=83259) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Sep 16 15:20:22 devstack cinder-volume[83259]: DEBUG cinder.volume.flows.manager.create_volume [None req-faca3645-9264-4eb5-9750-fc6cbf06b6b4 tempest-TestShelveInstance-483969706 None] Creating volume glance metadata for volume 74e00629-871f-4a7b-8cdf-24d129636423 backed by image 7786237f-0aff-46c8-bcd0-3b9486a0637a with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': '7786237f-0aff-46c8-bcd0-3b9486a0637a', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=83259) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Sep 16 15:20:22 devstack cinder-volume[83259]: DEBUG cinder.volume.manager [None req-faca3645-9264-4eb5-9750-fc6cbf06b6b4 tempest-TestShelveInstance-483969706 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cfcacc5d-4e57-4101-9166-f2f632eda65c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-74e00629-871f-4a7b-8cdf-24d129636423', 'volume_size': 1, 'image_id': '7786237f-0aff-46c8-bcd0-3b9486a0637a', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/7786237f-0aff-46c8-bcd0-3b9486a0637a', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '97738b7ffcbe49cbaad0099563a58435', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '7786237f-0aff-46c8-bcd0-3b9486a0637a', 'created_at': datetime.datetime(2025, 9, 16, 12, 35, 41, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2025, 9, 16, 12, 35, 42, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/7786237f-0aff-46c8-bcd0-3b9486a0637a/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=83259) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 15:20:22 devstack cinder-volume[83259]: DEBUG cinder.volume.manager [None req-faca3645-9264-4eb5-9750-fc6cbf06b6b4 tempest-TestShelveInstance-483969706 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (379b7c1c-d0bd-47d0-9268-7fef1e24548a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83259) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 15:20:22 devstack cinder-volume[83259]: INFO cinder.volume.flows.manager.create_volume [None req-faca3645-9264-4eb5-9750-fc6cbf06b6b4 tempest-TestShelveInstance-483969706 None] Volume volume-74e00629-871f-4a7b-8cdf-24d129636423 (74e00629-871f-4a7b-8cdf-24d129636423): created successfully Sep 16 15:20:22 devstack cinder-volume[83259]: DEBUG cinder.volume.manager [None req-faca3645-9264-4eb5-9750-fc6cbf06b6b4 tempest-TestShelveInstance-483969706 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (379b7c1c-d0bd-47d0-9268-7fef1e24548a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83259) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 15:20:22 devstack cinder-volume[83259]: DEBUG cinder.volume.manager [None req-faca3645-9264-4eb5-9750-fc6cbf06b6b4 tempest-TestShelveInstance-483969706 None] Flow 'volume_create_manager' (9df5b034-2b1d-4262-9cb0-769055759536) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83259) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 16 15:20:22 devstack cinder-volume[83259]: INFO cinder.volume.manager [None req-faca3645-9264-4eb5-9750-fc6cbf06b6b4 tempest-TestShelveInstance-483969706 None] Created volume successfully. Sep 16 15:20:31 devstack cinder-volume[83259]: DEBUG oslo_concurrency.lockutils [req-25ba9e6c-4908-4395-9419-1e19b6ede7bc req-bdcc1471-c600-49dd-8b67-caf4ce46e950 tempest-TestShelveInstance-483969706 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=83259) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 16 15:20:31 devstack cinder-volume[83259]: DEBUG oslo_concurrency.lockutils [req-25ba9e6c-4908-4395-9419-1e19b6ede7bc req-bdcc1471-c600-49dd-8b67-caf4ce46e950 tempest-TestShelveInstance-483969706 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.003s {{(pid=83259) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 16 15:20:31 devstack cinder-volume[83259]: DEBUG oslo.privsep.daemon [-] privsep: reply[ddc3d1d7-a04d-4d99-99b5-9a1f0072d7e7]: (4, 'qcow2') {{(pid=84312) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 16 15:20:31 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [req-25ba9e6c-4908-4395-9419-1e19b6ede7bc req-bdcc1471-c600-49dd-8b67-caf4ce46e950 tempest-TestShelveInstance-483969706 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c/volume-74e00629-871f-4a7b-8cdf-24d129636423 {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 15:20:31 devstack quobyte-client[83286]: System call of process 98395 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 16 15:20:31 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [req-25ba9e6c-4908-4395-9419-1e19b6ede7bc req-bdcc1471-c600-49dd-8b67-caf4ce46e950 tempest-TestShelveInstance-483969706 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c/volume-74e00629-871f-4a7b-8cdf-24d129636423" returned: 0 in 0.502s {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 15:20:31 devstack cinder-volume[83259]: DEBUG oslo_concurrency.lockutils [req-25ba9e6c-4908-4395-9419-1e19b6ede7bc req-bdcc1471-c600-49dd-8b67-caf4ce46e950 tempest-TestShelveInstance-483969706 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.575s {{(pid=83259) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 16 15:20:32 devstack cinder-volume[83259]: DEBUG cinder.volume.manager [req-25ba9e6c-4908-4395-9419-1e19b6ede7bc req-bdcc1471-c600-49dd-8b67-caf4ce46e950 tempest-TestShelveInstance-483969706 None] Connection info returned from driver {'export': '10.10.41.181/cinder-vol-61f585ac-f8e2-4d19-a890-7ebc2726cc72', 'name': 'volume-74e00629-871f-4a7b-8cdf-24d129636423', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '86f2e5c0-65a5-428c-85a2-39f518a958c8', 'enforce_multipath': True} {{(pid=83259) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4891}} Sep 16 15:20:32 devstack cinder-volume[83259]: WARNING cinder.volume.volume_utils [req-25ba9e6c-4908-4395-9419-1e19b6ede7bc req-bdcc1471-c600-49dd-8b67-caf4ce46e950 tempest-TestShelveInstance-483969706 None] Volume driver (QuobyteDriver 1.2) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 16 15:20:32 devstack cinder-volume[83259]: INFO cinder.volume.manager [req-25ba9e6c-4908-4395-9419-1e19b6ede7bc req-bdcc1471-c600-49dd-8b67-caf4ce46e950 tempest-TestShelveInstance-483969706 None] attachment_update completed successfully. Sep 16 15:20:42 devstack cinder-volume[83259]: DEBUG dbcounter [-] [83259] Writing DB stats cinder:DELETE=1,cinder:SELECT=3,cinder:UPDATE=3 {{(pid=83259) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Sep 16 15:20:42 devstack cinder-volume[83259]: DEBUG dbcounter [-] [83259] Writing DB stats cinder:UPDATE=4,cinder:SELECT=21,cinder:INSERT=12 {{(pid=83259) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Sep 16 15:20:46 devstack cinder-volume[83259]: DEBUG oslo_service.periodic_task [None req-050ec8a1-6ffd-499d-95ad-d548a84437e2 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=83259) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} Sep 16 15:20:46 devstack cinder-volume[83259]: DEBUG oslo_concurrency.lockutils [None req-050ec8a1-6ffd-499d-95ad-d548a84437e2 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83259) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 16 15:20:46 devstack cinder-volume[83259]: DEBUG oslo_concurrency.lockutils [None req-050ec8a1-6ffd-499d-95ad-d548a84437e2 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83259) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 16 15:20:46 devstack cinder-volume[83259]: DEBUG cinder.volume.drivers.quobyte [None req-050ec8a1-6ffd-499d-95ad-d548a84437e2 None None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-61f585ac-f8e2-4d19-a890-7ebc2726cc72': None} {{(pid=83259) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:639}} Sep 16 15:20:46 devstack cinder-volume[83259]: DEBUG cinder.volume.drivers.quobyte [None req-050ec8a1-6ffd-499d-95ad-d548a84437e2 None None] Available shares ['10.10.41.181/cinder-vol-61f585ac-f8e2-4d19-a890-7ebc2726cc72'] {{(pid=83259) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:669}} Sep 16 15:20:46 devstack cinder-volume[83259]: DEBUG oslo_concurrency.lockutils [None req-050ec8a1-6ffd-499d-95ad-d548a84437e2 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.022s {{(pid=83259) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 16 15:20:46 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [None req-050ec8a1-6ffd-499d-95ad-d548a84437e2 None None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 15:20:46 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [None req-050ec8a1-6ffd-499d-95ad-d548a84437e2 None None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c" returned: 0 in 0.158s {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 15:20:46 devstack cinder-volume[83259]: DEBUG cinder.manager [None req-050ec8a1-6ffd-499d-95ad-d548a84437e2 None None] Notifying Schedulers of capabilities ... {{(pid=83259) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 16 15:21:46 devstack cinder-volume[83259]: DEBUG oslo_service.periodic_task [None req-050ec8a1-6ffd-499d-95ad-d548a84437e2 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=83259) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} Sep 16 15:21:46 devstack cinder-volume[83259]: DEBUG oslo_concurrency.lockutils [None req-050ec8a1-6ffd-499d-95ad-d548a84437e2 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83259) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 16 15:21:46 devstack cinder-volume[83259]: DEBUG oslo_concurrency.lockutils [None req-050ec8a1-6ffd-499d-95ad-d548a84437e2 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.005s {{(pid=83259) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 16 15:21:46 devstack cinder-volume[83259]: DEBUG cinder.volume.drivers.quobyte [None req-050ec8a1-6ffd-499d-95ad-d548a84437e2 None None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-61f585ac-f8e2-4d19-a890-7ebc2726cc72': None} {{(pid=83259) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:639}} Sep 16 15:21:46 devstack cinder-volume[83259]: DEBUG cinder.volume.drivers.quobyte [None req-050ec8a1-6ffd-499d-95ad-d548a84437e2 None None] Available shares ['10.10.41.181/cinder-vol-61f585ac-f8e2-4d19-a890-7ebc2726cc72'] {{(pid=83259) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:669}} Sep 16 15:21:46 devstack cinder-volume[83259]: DEBUG oslo_concurrency.lockutils [None req-050ec8a1-6ffd-499d-95ad-d548a84437e2 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=83259) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 16 15:21:46 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [None req-050ec8a1-6ffd-499d-95ad-d548a84437e2 None None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 15:21:46 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [None req-050ec8a1-6ffd-499d-95ad-d548a84437e2 None None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c" returned: 0 in 0.078s {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 15:21:46 devstack cinder-volume[83259]: DEBUG cinder.manager [None req-050ec8a1-6ffd-499d-95ad-d548a84437e2 None None] Notifying Schedulers of capabilities ... {{(pid=83259) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 16 15:22:04 devstack cinder-volume[83259]: WARNING cinder.volume.volume_utils [req-6fe9279f-1849-4b63-b9ae-e275fed4e1f4 req-7d3ee371-1c16-49cc-9006-f9b3fd6924b4 tempest-TestShelveInstance-483969706 None] Volume driver (QuobyteDriver 1.2) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 16 15:22:04 devstack cinder-volume[83259]: WARNING cinder.volume.volume_utils [req-6fe9279f-1849-4b63-b9ae-e275fed4e1f4 req-7d3ee371-1c16-49cc-9006-f9b3fd6924b4 tempest-TestShelveInstance-483969706 None] Volume driver (QuobyteDriver 1.2) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 16 15:22:04 devstack cinder-volume[83259]: INFO cinder.volume.manager [req-6fe9279f-1849-4b63-b9ae-e275fed4e1f4 req-7d3ee371-1c16-49cc-9006-f9b3fd6924b4 tempest-TestShelveInstance-483969706 None] Terminate volume connection completed successfully. Sep 16 15:22:04 devstack cinder-volume[83259]: DEBUG cinder.volume.manager [req-6fe9279f-1849-4b63-b9ae-e275fed4e1f4 req-7d3ee371-1c16-49cc-9006-f9b3fd6924b4 tempest-TestShelveInstance-483969706 None] Deleting attachment 86f2e5c0-65a5-428c-85a2-39f518a958c8. {{(pid=83259) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5022}} Sep 16 15:22:10 devstack cinder-volume[83259]: DEBUG oslo_concurrency.lockutils [req-f2e09ea3-9ed2-4301-8523-3c5b3b24e153 req-3bfc6f08-2884-42f0-906d-51f765646941 tempest-TestShelveInstance-483969706 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=83259) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 16 15:22:10 devstack cinder-volume[83259]: DEBUG oslo_concurrency.lockutils [req-f2e09ea3-9ed2-4301-8523-3c5b3b24e153 req-3bfc6f08-2884-42f0-906d-51f765646941 tempest-TestShelveInstance-483969706 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.003s {{(pid=83259) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 16 15:22:10 devstack cinder-volume[83259]: DEBUG oslo.privsep.daemon [-] privsep: reply[4c78938e-370b-41af-b0ee-4d7dc0c14e41]: (4, 'qcow2') {{(pid=84312) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 16 15:22:10 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [req-f2e09ea3-9ed2-4301-8523-3c5b3b24e153 req-3bfc6f08-2884-42f0-906d-51f765646941 tempest-TestShelveInstance-483969706 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c/volume-74e00629-871f-4a7b-8cdf-24d129636423 {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 15:22:10 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [req-f2e09ea3-9ed2-4301-8523-3c5b3b24e153 req-3bfc6f08-2884-42f0-906d-51f765646941 tempest-TestShelveInstance-483969706 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c/volume-74e00629-871f-4a7b-8cdf-24d129636423" returned: 0 in 0.483s {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 15:22:10 devstack cinder-volume[83259]: DEBUG oslo_concurrency.lockutils [req-f2e09ea3-9ed2-4301-8523-3c5b3b24e153 req-3bfc6f08-2884-42f0-906d-51f765646941 tempest-TestShelveInstance-483969706 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.551s {{(pid=83259) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 16 15:22:11 devstack cinder-volume[83259]: DEBUG cinder.volume.manager [req-f2e09ea3-9ed2-4301-8523-3c5b3b24e153 req-3bfc6f08-2884-42f0-906d-51f765646941 tempest-TestShelveInstance-483969706 None] Connection info returned from driver {'export': '10.10.41.181/cinder-vol-61f585ac-f8e2-4d19-a890-7ebc2726cc72', 'name': 'volume-74e00629-871f-4a7b-8cdf-24d129636423', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '719c2491-b71b-4f22-8706-290cf5fd722f', 'enforce_multipath': True} {{(pid=83259) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4891}} Sep 16 15:22:11 devstack cinder-volume[83259]: WARNING cinder.volume.volume_utils [req-f2e09ea3-9ed2-4301-8523-3c5b3b24e153 req-3bfc6f08-2884-42f0-906d-51f765646941 tempest-TestShelveInstance-483969706 None] Volume driver (QuobyteDriver 1.2) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 16 15:22:11 devstack cinder-volume[83259]: INFO cinder.volume.manager [req-f2e09ea3-9ed2-4301-8523-3c5b3b24e153 req-3bfc6f08-2884-42f0-906d-51f765646941 tempest-TestShelveInstance-483969706 None] attachment_update completed successfully. Sep 16 15:22:21 devstack cinder-volume[83259]: DEBUG dbcounter [-] [83259] Writing DB stats cinder:SELECT=7,cinder:UPDATE=3 {{(pid=83259) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Sep 16 15:22:21 devstack cinder-volume[83259]: DEBUG dbcounter [-] [83259] Writing DB stats cinder:SELECT=7,cinder:UPDATE=1 {{(pid=83259) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Sep 16 15:22:46 devstack cinder-volume[83259]: DEBUG oslo_service.periodic_task [None req-050ec8a1-6ffd-499d-95ad-d548a84437e2 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=83259) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} Sep 16 15:22:46 devstack cinder-volume[83259]: DEBUG oslo_concurrency.lockutils [None req-050ec8a1-6ffd-499d-95ad-d548a84437e2 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83259) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 16 15:22:46 devstack cinder-volume[83259]: DEBUG oslo_concurrency.lockutils [None req-050ec8a1-6ffd-499d-95ad-d548a84437e2 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83259) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 16 15:22:46 devstack cinder-volume[83259]: DEBUG cinder.volume.drivers.quobyte [None req-050ec8a1-6ffd-499d-95ad-d548a84437e2 None None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-61f585ac-f8e2-4d19-a890-7ebc2726cc72': None} {{(pid=83259) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:639}} Sep 16 15:22:46 devstack cinder-volume[83259]: DEBUG cinder.volume.drivers.quobyte [None req-050ec8a1-6ffd-499d-95ad-d548a84437e2 None None] Available shares ['10.10.41.181/cinder-vol-61f585ac-f8e2-4d19-a890-7ebc2726cc72'] {{(pid=83259) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:669}} Sep 16 15:22:46 devstack cinder-volume[83259]: DEBUG oslo_concurrency.lockutils [None req-050ec8a1-6ffd-499d-95ad-d548a84437e2 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=83259) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 16 15:22:46 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [None req-050ec8a1-6ffd-499d-95ad-d548a84437e2 None None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 15:22:46 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [None req-050ec8a1-6ffd-499d-95ad-d548a84437e2 None None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c" returned: 0 in 0.100s {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 15:22:46 devstack cinder-volume[83259]: DEBUG cinder.manager [None req-050ec8a1-6ffd-499d-95ad-d548a84437e2 None None] Notifying Schedulers of capabilities ... {{(pid=83259) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 16 15:23:43 devstack cinder-volume[83259]: WARNING cinder.volume.volume_utils [req-c146bc9e-6733-473b-9e89-ed0a57ddbf1f req-823b5982-0534-4616-b0e6-5776eecec1e3 tempest-TestShelveInstance-483969706 None] Volume driver (QuobyteDriver 1.2) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 16 15:23:43 devstack cinder-volume[83259]: WARNING cinder.volume.volume_utils [req-c146bc9e-6733-473b-9e89-ed0a57ddbf1f req-823b5982-0534-4616-b0e6-5776eecec1e3 tempest-TestShelveInstance-483969706 None] Volume driver (QuobyteDriver 1.2) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 16 15:23:43 devstack cinder-volume[83259]: INFO cinder.volume.manager [req-c146bc9e-6733-473b-9e89-ed0a57ddbf1f req-823b5982-0534-4616-b0e6-5776eecec1e3 tempest-TestShelveInstance-483969706 None] Terminate volume connection completed successfully. Sep 16 15:23:43 devstack cinder-volume[83259]: DEBUG cinder.volume.manager [req-c146bc9e-6733-473b-9e89-ed0a57ddbf1f req-823b5982-0534-4616-b0e6-5776eecec1e3 tempest-TestShelveInstance-483969706 None] Deleting attachment 719c2491-b71b-4f22-8706-290cf5fd722f. {{(pid=83259) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5022}} Sep 16 15:23:44 devstack cinder-volume[83259]: DEBUG cinder.coordination [req-c146bc9e-6733-473b-9e89-ed0a57ddbf1f req-b044c92e-1c83-4354-9d86-da879cad7c56 tempest-TestShelveInstance-483969706 None] Acquiring lock "cinder-74e00629-871f-4a7b-8cdf-24d129636423-delete_volume" by "delete_volume" {{(pid=83259) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 16 15:23:44 devstack cinder-volume[83259]: DEBUG cinder.coordination [req-c146bc9e-6733-473b-9e89-ed0a57ddbf1f req-b044c92e-1c83-4354-9d86-da879cad7c56 tempest-TestShelveInstance-483969706 None] Lock "cinder-74e00629-871f-4a7b-8cdf-24d129636423-delete_volume" acquired by "delete_volume" :: waited 0.040s {{(pid=83259) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 16 15:23:44 devstack cinder-volume[83259]: WARNING cinder.volume.volume_utils [req-c146bc9e-6733-473b-9e89-ed0a57ddbf1f req-b044c92e-1c83-4354-9d86-da879cad7c56 tempest-TestShelveInstance-483969706 None] Volume driver (QuobyteDriver 1.2) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 16 15:23:44 devstack cinder-volume[83259]: DEBUG cinder.coordination [req-c146bc9e-6733-473b-9e89-ed0a57ddbf1f req-b044c92e-1c83-4354-9d86-da879cad7c56 tempest-TestShelveInstance-483969706 None] Acquiring lock "cinder-quobyte-74e00629-871f-4a7b-8cdf-24d129636423" by "delete_volume" {{(pid=83259) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 16 15:23:44 devstack cinder-volume[83259]: DEBUG cinder.coordination [req-c146bc9e-6733-473b-9e89-ed0a57ddbf1f req-b044c92e-1c83-4354-9d86-da879cad7c56 tempest-TestShelveInstance-483969706 None] Lock "cinder-quobyte-74e00629-871f-4a7b-8cdf-24d129636423" acquired by "delete_volume" :: waited 0.014s {{(pid=83259) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 16 15:23:44 devstack cinder-volume[83259]: DEBUG oslo.privsep.daemon [-] privsep: reply[5bf0bc67-b979-46a2-a074-ec16985a52c1]: (4, 'qcow2') {{(pid=84312) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 16 15:23:44 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [req-c146bc9e-6733-473b-9e89-ed0a57ddbf1f req-b044c92e-1c83-4354-9d86-da879cad7c56 tempest-TestShelveInstance-483969706 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c/volume-74e00629-871f-4a7b-8cdf-24d129636423 {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 15:23:45 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [req-c146bc9e-6733-473b-9e89-ed0a57ddbf1f req-b044c92e-1c83-4354-9d86-da879cad7c56 tempest-TestShelveInstance-483969706 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c/volume-74e00629-871f-4a7b-8cdf-24d129636423" returned: 0 in 0.520s {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 15:23:45 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [req-c146bc9e-6733-473b-9e89-ed0a57ddbf1f req-b044c92e-1c83-4354-9d86-da879cad7c56 tempest-TestShelveInstance-483969706 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c/volume-74e00629-871f-4a7b-8cdf-24d129636423 {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 15:23:45 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [req-c146bc9e-6733-473b-9e89-ed0a57ddbf1f req-b044c92e-1c83-4354-9d86-da879cad7c56 tempest-TestShelveInstance-483969706 None] CMD "rm -f /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c/volume-74e00629-871f-4a7b-8cdf-24d129636423" returned: 0 in 0.117s {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 15:23:45 devstack cinder-volume[83259]: DEBUG cinder.coordination [req-c146bc9e-6733-473b-9e89-ed0a57ddbf1f req-b044c92e-1c83-4354-9d86-da879cad7c56 tempest-TestShelveInstance-483969706 None] Lock "cinder-quobyte-74e00629-871f-4a7b-8cdf-24d129636423" released by "delete_volume" :: held 0.823s {{(pid=83259) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 16 15:23:45 devstack cinder-volume[83259]: DEBUG cinder.quota [req-c146bc9e-6733-473b-9e89-ed0a57ddbf1f req-b044c92e-1c83-4354-9d86-da879cad7c56 tempest-TestShelveInstance-483969706 None] Created reservations ['8b8dc535-f6e8-4f93-8d28-f25bf17188a7', 'a75db41f-3553-4f42-9f5f-abff87e43240', '6acb20f9-53e1-43b3-839d-256f55901b54', 'c37f842a-5df5-41d2-a635-c5c4c1f5c65d'] {{(pid=83259) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 16 15:23:45 devstack cinder-volume[83259]: DEBUG oslo_concurrency.lockutils [req-c146bc9e-6733-473b-9e89-ed0a57ddbf1f req-b044c92e-1c83-4354-9d86-da879cad7c56 tempest-TestShelveInstance-483969706 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83259) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 16 15:23:45 devstack cinder-volume[83259]: DEBUG oslo_concurrency.lockutils [req-c146bc9e-6733-473b-9e89-ed0a57ddbf1f req-b044c92e-1c83-4354-9d86-da879cad7c56 tempest-TestShelveInstance-483969706 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=83259) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 16 15:23:45 devstack cinder-volume[83259]: DEBUG cinder.volume.drivers.quobyte [req-c146bc9e-6733-473b-9e89-ed0a57ddbf1f req-b044c92e-1c83-4354-9d86-da879cad7c56 tempest-TestShelveInstance-483969706 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-61f585ac-f8e2-4d19-a890-7ebc2726cc72': None} {{(pid=83259) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:639}} Sep 16 15:23:45 devstack cinder-volume[83259]: DEBUG cinder.volume.drivers.quobyte [req-c146bc9e-6733-473b-9e89-ed0a57ddbf1f req-b044c92e-1c83-4354-9d86-da879cad7c56 tempest-TestShelveInstance-483969706 None] Available shares ['10.10.41.181/cinder-vol-61f585ac-f8e2-4d19-a890-7ebc2726cc72'] {{(pid=83259) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:669}} Sep 16 15:23:45 devstack cinder-volume[83259]: DEBUG oslo_concurrency.lockutils [req-c146bc9e-6733-473b-9e89-ed0a57ddbf1f req-b044c92e-1c83-4354-9d86-da879cad7c56 tempest-TestShelveInstance-483969706 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=83259) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 16 15:23:45 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [req-c146bc9e-6733-473b-9e89-ed0a57ddbf1f req-b044c92e-1c83-4354-9d86-da879cad7c56 tempest-TestShelveInstance-483969706 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 15:23:45 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [req-c146bc9e-6733-473b-9e89-ed0a57ddbf1f req-b044c92e-1c83-4354-9d86-da879cad7c56 tempest-TestShelveInstance-483969706 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c" returned: 0 in 0.103s {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 15:23:45 devstack cinder-volume[83259]: DEBUG cinder.manager [req-c146bc9e-6733-473b-9e89-ed0a57ddbf1f req-b044c92e-1c83-4354-9d86-da879cad7c56 tempest-TestShelveInstance-483969706 None] Notifying Schedulers of capabilities ... {{(pid=83259) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 16 15:23:46 devstack cinder-volume[83259]: INFO cinder.volume.manager [req-c146bc9e-6733-473b-9e89-ed0a57ddbf1f req-b044c92e-1c83-4354-9d86-da879cad7c56 tempest-TestShelveInstance-483969706 None] Deleted volume successfully. Sep 16 15:23:46 devstack cinder-volume[83259]: DEBUG cinder.coordination [req-c146bc9e-6733-473b-9e89-ed0a57ddbf1f req-b044c92e-1c83-4354-9d86-da879cad7c56 tempest-TestShelveInstance-483969706 None] Lock "cinder-74e00629-871f-4a7b-8cdf-24d129636423-delete_volume" released by "delete_volume" :: held 1.962s {{(pid=83259) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 16 15:23:46 devstack cinder-volume[83259]: DEBUG oslo_service.periodic_task [None req-050ec8a1-6ffd-499d-95ad-d548a84437e2 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=83259) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} Sep 16 15:23:46 devstack cinder-volume[83259]: DEBUG oslo_concurrency.lockutils [None req-050ec8a1-6ffd-499d-95ad-d548a84437e2 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83259) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 16 15:23:46 devstack cinder-volume[83259]: DEBUG oslo_concurrency.lockutils [None req-050ec8a1-6ffd-499d-95ad-d548a84437e2 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83259) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 16 15:23:46 devstack cinder-volume[83259]: DEBUG cinder.volume.drivers.quobyte [None req-050ec8a1-6ffd-499d-95ad-d548a84437e2 None None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-61f585ac-f8e2-4d19-a890-7ebc2726cc72': None} {{(pid=83259) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:639}} Sep 16 15:23:46 devstack cinder-volume[83259]: DEBUG cinder.volume.drivers.quobyte [None req-050ec8a1-6ffd-499d-95ad-d548a84437e2 None None] Available shares ['10.10.41.181/cinder-vol-61f585ac-f8e2-4d19-a890-7ebc2726cc72'] {{(pid=83259) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:669}} Sep 16 15:23:46 devstack cinder-volume[83259]: DEBUG oslo_concurrency.lockutils [None req-050ec8a1-6ffd-499d-95ad-d548a84437e2 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=83259) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 16 15:23:46 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [None req-050ec8a1-6ffd-499d-95ad-d548a84437e2 None None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 15:23:46 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [None req-050ec8a1-6ffd-499d-95ad-d548a84437e2 None None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c" returned: 0 in 0.111s {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 15:23:46 devstack cinder-volume[83259]: DEBUG cinder.manager [None req-050ec8a1-6ffd-499d-95ad-d548a84437e2 None None] Notifying Schedulers of capabilities ... {{(pid=83259) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 16 15:23:55 devstack cinder-volume[83259]: DEBUG dbcounter [-] [83259] Writing DB stats cinder:SELECT=8,cinder:UPDATE=15,cinder:INSERT=4 {{(pid=83259) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Sep 16 15:23:56 devstack cinder-volume[83259]: DEBUG dbcounter [-] [83259] Writing DB stats cinder:SELECT=4,cinder:UPDATE=1,cinder:DELETE=1 {{(pid=83259) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Sep 16 15:24:08 devstack cinder-volume[83259]: WARNING cinder.volume.volume_utils [None req-05626c7c-beb1-45a9-8979-0b4c86ad14a0 tempest-VolumeImageDependencyTests-668319046 None] Volume driver (QuobyteDriver 1.2) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 16 15:24:08 devstack cinder-volume[83259]: DEBUG cinder.volume.flows.manager.create_volume [None req-05626c7c-beb1-45a9-8979-0b4c86ad14a0 tempest-VolumeImageDependencyTests-668319046 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#Quobyte'], 'hosts': ['devstack@QuobyteHD#Quobyte']} {{(pid=83259) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1387}} Sep 16 15:24:08 devstack cinder-volume[83259]: DEBUG cinder.volume.manager [None req-05626c7c-beb1-45a9-8979-0b4c86ad14a0 tempest-VolumeImageDependencyTests-668319046 None] Flow 'volume_create_manager' (340add4a-13f6-4991-aa85-4226f6c102a5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83259) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 16 15:24:08 devstack cinder-volume[83259]: DEBUG cinder.volume.manager [None req-05626c7c-beb1-45a9-8979-0b4c86ad14a0 tempest-VolumeImageDependencyTests-668319046 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a6a178c8-2cf9-417a-912d-c1796220508d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83259) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 15:24:08 devstack cinder-volume[83259]: DEBUG cinder.volume.manager [None req-05626c7c-beb1-45a9-8979-0b4c86ad14a0 tempest-VolumeImageDependencyTests-668319046 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a6a178c8-2cf9-417a-912d-c1796220508d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-16T13:24:08Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#Quobyte',id=f71438f5-1674-407b-b3fd-937a0dfe70ea,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d116159dd3fa4f8c934e5abbfcd2c617',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-16T13:24:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-16T13:24:09Z,use_quota=True,user_id='2e67a7848a2f4fd28b6e24b36445fce1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(485ead50-3df8-4d76-8d34-a4db136c980a),volume_type_id=485ead50-3df8-4d76-8d34-a4db136c980a)' {{(pid=83259) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 15:24:08 devstack cinder-volume[83259]: DEBUG cinder.volume.manager [None req-05626c7c-beb1-45a9-8979-0b4c86ad14a0 tempest-VolumeImageDependencyTests-668319046 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e0958539-108c-483a-9ada-d79c04252b3b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83259) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 15:24:08 devstack cinder-volume[83259]: DEBUG cinder.volume.manager [None req-05626c7c-beb1-45a9-8979-0b4c86ad14a0 tempest-VolumeImageDependencyTests-668319046 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e0958539-108c-483a-9ada-d79c04252b3b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83259) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 15:24:08 devstack cinder-volume[83259]: DEBUG cinder.volume.manager [None req-05626c7c-beb1-45a9-8979-0b4c86ad14a0 tempest-VolumeImageDependencyTests-668319046 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e3134d0b-53b3-4575-8b00-da384eb161da) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83259) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 15:24:08 devstack cinder-volume[83259]: DEBUG cinder.image.glance [None req-05626c7c-beb1-45a9-8979-0b4c86ad14a0 tempest-VolumeImageDependencyTests-668319046 None] Creating Keystone auth plugin from conf {{(pid=83259) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:128}} Sep 16 15:24:09 devstack cinder-volume[83259]: DEBUG cinder.volume.manager [None req-05626c7c-beb1-45a9-8979-0b4c86ad14a0 tempest-VolumeImageDependencyTests-668319046 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e3134d0b-53b3-4575-8b00-da384eb161da) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'f71438f5-1674-407b-b3fd-937a0dfe70ea', 'volume_name': 'volume-f71438f5-1674-407b-b3fd-937a0dfe70ea', 'volume_size': 1, 'image_id': 'f17be5a1-9772-4c46-bd96-f3a7b78e2376', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/f17be5a1-9772-4c46-bd96-f3a7b78e2376', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '86fafb2a011dfe3d545129cde577739a', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'd116159dd3fa4f8c934e5abbfcd2c617', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '036e06b3ae7043c2e5467ae0c1fea028139861305c52111f013a877bfb70c27685e0452230252776009ba6e713fa0094088ec172ae589f13eeda88ad072221a4', 'id': 'f17be5a1-9772-4c46-bd96-f3a7b78e2376', 'created_at': datetime.datetime(2025, 9, 16, 13, 24, 7, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2025, 9, 16, 13, 24, 8, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/f17be5a1-9772-4c46-bd96-f3a7b78e2376/file', 'properties': {}}, 'image_service': }' {{(pid=83259) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 15:24:09 devstack cinder-volume[83259]: DEBUG cinder.volume.manager [None req-05626c7c-beb1-45a9-8979-0b4c86ad14a0 tempest-VolumeImageDependencyTests-668319046 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b7f99144-e835-4f34-aa04-8cdc2f15d186) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83259) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 15:24:09 devstack cinder-volume[83259]: DEBUG cinder.volume.manager [None req-05626c7c-beb1-45a9-8979-0b4c86ad14a0 tempest-VolumeImageDependencyTests-668319046 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b7f99144-e835-4f34-aa04-8cdc2f15d186) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83259) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 15:24:09 devstack cinder-volume[83259]: DEBUG cinder.volume.manager [None req-05626c7c-beb1-45a9-8979-0b4c86ad14a0 tempest-VolumeImageDependencyTests-668319046 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (beb0b87c-7993-48ef-812b-aa79b0add083) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83259) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 15:24:09 devstack cinder-volume[83259]: INFO cinder.volume.flows.manager.create_volume [None req-05626c7c-beb1-45a9-8979-0b4c86ad14a0 tempest-VolumeImageDependencyTests-668319046 None] Volume f71438f5-1674-407b-b3fd-937a0dfe70ea: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-f71438f5-1674-407b-b3fd-937a0dfe70ea', 'volume_size': 1, 'image_id': 'f17be5a1-9772-4c46-bd96-f3a7b78e2376', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/f17be5a1-9772-4c46-bd96-f3a7b78e2376', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '86fafb2a011dfe3d545129cde577739a', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'd116159dd3fa4f8c934e5abbfcd2c617', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '036e06b3ae7043c2e5467ae0c1fea028139861305c52111f013a877bfb70c27685e0452230252776009ba6e713fa0094088ec172ae589f13eeda88ad072221a4', 'id': 'f17be5a1-9772-4c46-bd96-f3a7b78e2376', 'created_at': datetime.datetime(2025, 9, 16, 13, 24, 7, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2025, 9, 16, 13, 24, 8, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/f17be5a1-9772-4c46-bd96-f3a7b78e2376/file', 'properties': {}}, 'image_service': } Sep 16 15:24:09 devstack cinder-volume[83259]: DEBUG cinder.volume.flows.manager.create_volume [None req-05626c7c-beb1-45a9-8979-0b4c86ad14a0 tempest-VolumeImageDependencyTests-668319046 None] Cloning f71438f5-1674-407b-b3fd-937a0dfe70ea from image f17be5a1-9772-4c46-bd96-f3a7b78e2376 at location (None, [{'url': 'file:///opt/stack/data/glance/images/f17be5a1-9772-4c46-bd96-f3a7b78e2376', 'metadata': {}}]). {{(pid=83259) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1085}} Sep 16 15:24:09 devstack cinder-volume[83259]: DEBUG cinder.image.image_utils [None req-05626c7c-beb1-45a9-8979-0b4c86ad14a0 tempest-VolumeImageDependencyTests-668319046 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_f17be5a1-9772-4c46-bd96-f3a7b78e2376_c0c4zqsddevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec {{(pid=83259) fetch /opt/stack/cinder/cinder/image/image_utils.py:700}} Sep 16 15:24:09 devstack cinder-volume[83259]: INFO cinder.image.image_utils [None req-05626c7c-beb1-45a9-8979-0b4c86ad14a0 tempest-VolumeImageDependencyTests-668319046 None] Image download 0.00 MB at 0.00 MB/s Sep 16 15:24:09 devstack cinder-volume[83259]: DEBUG oslo.privsep.daemon [-] privsep: reply[70d1fba5-2d3d-42a3-a95c-ec1cee5376d6]: (4, 'raw') {{(pid=84312) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 16 15:24:09 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [None req-05626c7c-beb1-45a9-8979-0b4c86ad14a0 tempest-VolumeImageDependencyTests-668319046 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_f17be5a1-9772-4c46-bd96-f3a7b78e2376_c0c4zqsddevstack@QuobyteHD {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 15:24:09 devstack sudo[99804]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_f17be5a1-9772-4c46-bd96-f3a7b78e2376_c0c4zqsddevstack@QuobyteHD Sep 16 15:24:09 devstack sudo[99804]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 15:24:11 devstack sudo[99804]: pam_unix(sudo:session): session closed for user root Sep 16 15:24:11 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [None req-05626c7c-beb1-45a9-8979-0b4c86ad14a0 tempest-VolumeImageDependencyTests-668319046 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_f17be5a1-9772-4c46-bd96-f3a7b78e2376_c0c4zqsddevstack@QuobyteHD" returned: 0 in 2.006s {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 15:24:11 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [None req-05626c7c-beb1-45a9-8979-0b4c86ad14a0 tempest-VolumeImageDependencyTests-668319046 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_f17be5a1-9772-4c46-bd96-f3a7b78e2376_c0c4zqsddevstack@QuobyteHD {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 15:24:11 devstack sudo[99808]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_f17be5a1-9772-4c46-bd96-f3a7b78e2376_c0c4zqsddevstack@QuobyteHD Sep 16 15:24:11 devstack sudo[99808]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 15:24:13 devstack sudo[99808]: pam_unix(sudo:session): session closed for user root Sep 16 15:24:13 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [None req-05626c7c-beb1-45a9-8979-0b4c86ad14a0 tempest-VolumeImageDependencyTests-668319046 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_f17be5a1-9772-4c46-bd96-f3a7b78e2376_c0c4zqsddevstack@QuobyteHD" returned: 1 in 1.965s {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 15:24:13 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [None req-05626c7c-beb1-45a9-8979-0b4c86ad14a0 tempest-VolumeImageDependencyTests-668319046 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_f17be5a1-9772-4c46-bd96-f3a7b78e2376_c0c4zqsddevstack@QuobyteHD' failed. Not Retrying. {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:423}} Sep 16 15:24:13 devstack cinder-volume[83259]: DEBUG cinder.image.image_utils [None req-05626c7c-beb1-45a9-8979-0b4c86ad14a0 tempest-VolumeImageDependencyTests-668319046 None] Temporary image f17be5a1-9772-4c46-bd96-f3a7b78e2376 is fetched for user 2e67a7848a2f4fd28b6e24b36445fce1. {{(pid=83259) fetch /opt/stack/cinder/cinder/image/image_utils.py:1399}} Sep 16 15:24:13 devstack cinder-volume[83259]: DEBUG oslo.privsep.daemon [-] privsep: reply[2dcbebbc-9586-484a-93c8-47d936c00a2d]: (4, 'raw') {{(pid=84312) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 16 15:24:13 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [None req-05626c7c-beb1-45a9-8979-0b4c86ad14a0 tempest-VolumeImageDependencyTests-668319046 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_f17be5a1-9772-4c46-bd96-f3a7b78e2376_c0c4zqsddevstack@QuobyteHD {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 15:24:13 devstack sudo[99813]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_f17be5a1-9772-4c46-bd96-f3a7b78e2376_c0c4zqsddevstack@QuobyteHD Sep 16 15:24:13 devstack sudo[99813]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 15:24:15 devstack sudo[99813]: pam_unix(sudo:session): session closed for user root Sep 16 15:24:15 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [None req-05626c7c-beb1-45a9-8979-0b4c86ad14a0 tempest-VolumeImageDependencyTests-668319046 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_f17be5a1-9772-4c46-bd96-f3a7b78e2376_c0c4zqsddevstack@QuobyteHD" returned: 0 in 1.933s {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 15:24:15 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [None req-05626c7c-beb1-45a9-8979-0b4c86ad14a0 tempest-VolumeImageDependencyTests-668319046 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_f17be5a1-9772-4c46-bd96-f3a7b78e2376_c0c4zqsddevstack@QuobyteHD {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 15:24:15 devstack sudo[99818]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_f17be5a1-9772-4c46-bd96-f3a7b78e2376_c0c4zqsddevstack@QuobyteHD Sep 16 15:24:15 devstack sudo[99818]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 15:24:17 devstack sudo[99818]: pam_unix(sudo:session): session closed for user root Sep 16 15:24:17 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [None req-05626c7c-beb1-45a9-8979-0b4c86ad14a0 tempest-VolumeImageDependencyTests-668319046 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_f17be5a1-9772-4c46-bd96-f3a7b78e2376_c0c4zqsddevstack@QuobyteHD" returned: 1 in 1.983s {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 15:24:17 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [None req-05626c7c-beb1-45a9-8979-0b4c86ad14a0 tempest-VolumeImageDependencyTests-668319046 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_f17be5a1-9772-4c46-bd96-f3a7b78e2376_c0c4zqsddevstack@QuobyteHD' failed. Not Retrying. {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:423}} Sep 16 15:24:17 devstack cinder-volume[83259]: DEBUG oslo_concurrency.lockutils [None req-05626c7c-beb1-45a9-8979-0b4c86ad14a0 tempest-VolumeImageDependencyTests-668319046 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83259) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 16 15:24:17 devstack cinder-volume[83259]: DEBUG oslo_concurrency.lockutils [None req-05626c7c-beb1-45a9-8979-0b4c86ad14a0 tempest-VolumeImageDependencyTests-668319046 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.007s {{(pid=83259) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 16 15:24:17 devstack cinder-volume[83259]: DEBUG cinder.volume.drivers.quobyte [None req-05626c7c-beb1-45a9-8979-0b4c86ad14a0 tempest-VolumeImageDependencyTests-668319046 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-16T13:24:08Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#Quobyte',id=f71438f5-1674-407b-b3fd-937a0dfe70ea,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d116159dd3fa4f8c934e5abbfcd2c617',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-16T13:24:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-16T13:24:09Z,use_quota=True,user_id='2e67a7848a2f4fd28b6e24b36445fce1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(485ead50-3df8-4d76-8d34-a4db136c980a),volume_type_id=485ead50-3df8-4d76-8d34-a4db136c980a)}" {{(pid=83259) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Sep 16 15:24:17 devstack cinder-volume[83259]: DEBUG cinder.volume.drivers.remotefs [None req-05626c7c-beb1-45a9-8979-0b4c86ad14a0 tempest-VolumeImageDependencyTests-668319046 None] Creating volume f71438f5-1674-407b-b3fd-937a0dfe70ea {{(pid=83259) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}} Sep 16 15:24:17 devstack cinder-volume[83259]: DEBUG oslo_concurrency.lockutils [None req-05626c7c-beb1-45a9-8979-0b4c86ad14a0 tempest-VolumeImageDependencyTests-668319046 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83259) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 16 15:24:17 devstack cinder-volume[83259]: DEBUG oslo_concurrency.lockutils [None req-05626c7c-beb1-45a9-8979-0b4c86ad14a0 tempest-VolumeImageDependencyTests-668319046 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83259) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 16 15:24:17 devstack cinder-volume[83259]: DEBUG cinder.volume.drivers.quobyte [None req-05626c7c-beb1-45a9-8979-0b4c86ad14a0 tempest-VolumeImageDependencyTests-668319046 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-61f585ac-f8e2-4d19-a890-7ebc2726cc72': None} {{(pid=83259) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:639}} Sep 16 15:24:17 devstack cinder-volume[83259]: DEBUG cinder.volume.drivers.quobyte [None req-05626c7c-beb1-45a9-8979-0b4c86ad14a0 tempest-VolumeImageDependencyTests-668319046 None] Available shares ['10.10.41.181/cinder-vol-61f585ac-f8e2-4d19-a890-7ebc2726cc72'] {{(pid=83259) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:669}} Sep 16 15:24:17 devstack cinder-volume[83259]: DEBUG oslo_concurrency.lockutils [None req-05626c7c-beb1-45a9-8979-0b4c86ad14a0 tempest-VolumeImageDependencyTests-668319046 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.030s {{(pid=83259) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 16 15:24:17 devstack cinder-volume[83259]: DEBUG cinder.volume.drivers.quobyte [None req-05626c7c-beb1-45a9-8979-0b4c86ad14a0 tempest-VolumeImageDependencyTests-668319046 None] Selected 10.10.41.181/cinder-vol-61f585ac-f8e2-4d19-a890-7ebc2726cc72 as target Quobyte volume. {{(pid=83259) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:690}} Sep 16 15:24:17 devstack cinder-volume[83259]: INFO cinder.volume.drivers.remotefs [None req-05626c7c-beb1-45a9-8979-0b4c86ad14a0 tempest-VolumeImageDependencyTests-668319046 None] casted to 10.10.41.181/cinder-vol-61f585ac-f8e2-4d19-a890-7ebc2726cc72 Sep 16 15:24:17 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [None req-05626c7c-beb1-45a9-8979-0b4c86ad14a0 tempest-VolumeImageDependencyTests-668319046 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c/volume-f71438f5-1674-407b-b3fd-937a0dfe70ea 1073741824 {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 15:24:17 devstack quobyte-client[83286]: The server volume:87712ffe-8a69-446d-9ed6-4430c7ee9792@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=87712ffe-8a69-446d-9ed6-4430c7ee9792, inode=145, name=volume-f71438f5-1674-407b-b3fd-937a0dfe70ea, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.206), requestorAccessMask=0 Sep 16 15:24:18 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [None req-05626c7c-beb1-45a9-8979-0b4c86ad14a0 tempest-VolumeImageDependencyTests-668319046 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c/volume-f71438f5-1674-407b-b3fd-937a0dfe70ea 1073741824" returned: 0 in 0.397s {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 15:24:18 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [None req-05626c7c-beb1-45a9-8979-0b4c86ad14a0 tempest-VolumeImageDependencyTests-668319046 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c/volume-f71438f5-1674-407b-b3fd-937a0dfe70ea {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 15:24:18 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [None req-05626c7c-beb1-45a9-8979-0b4c86ad14a0 tempest-VolumeImageDependencyTests-668319046 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c/volume-f71438f5-1674-407b-b3fd-937a0dfe70ea" returned: 0 in 0.092s {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 15:24:18 devstack cinder-volume[83259]: DEBUG cinder.volume.drivers.quobyte [None req-05626c7c-beb1-45a9-8979-0b4c86ad14a0 tempest-VolumeImageDependencyTests-668319046 None] <== create_volume: return (586ms) {'provider_location': '10.10.41.181/cinder-vol-61f585ac-f8e2-4d19-a890-7ebc2726cc72'} {{(pid=83259) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Sep 16 15:24:18 devstack cinder-volume[83259]: DEBUG oslo_concurrency.lockutils [None req-05626c7c-beb1-45a9-8979-0b4c86ad14a0 tempest-VolumeImageDependencyTests-668319046 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.627s {{(pid=83259) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 16 15:24:18 devstack cinder-volume[83259]: DEBUG cinder.volume.volume_utils [None req-05626c7c-beb1-45a9-8979-0b4c86ad14a0 tempest-VolumeImageDependencyTests-668319046 None] Attempting download of f17be5a1-9772-4c46-bd96-f3a7b78e2376 ((None, [{'url': 'file:///opt/stack/data/glance/images/f17be5a1-9772-4c46-bd96-f3a7b78e2376', 'metadata': {}}])) to volume f71438f5-1674-407b-b3fd-937a0dfe70ea. {{(pid=83259) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1189}} Sep 16 15:24:18 devstack cinder-volume[83259]: DEBUG oslo.privsep.daemon [-] privsep: reply[0720a4de-216e-4e6c-b30a-0571bda6b614]: (4, 'raw') {{(pid=84312) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 16 15:24:18 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [None req-05626c7c-beb1-45a9-8979-0b4c86ad14a0 tempest-VolumeImageDependencyTests-668319046 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_f17be5a1-9772-4c46-bd96-f3a7b78e2376_h4wkcpfw {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 15:24:18 devstack sudo[99827]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_f17be5a1-9772-4c46-bd96-f3a7b78e2376_h4wkcpfw Sep 16 15:24:18 devstack sudo[99827]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 15:24:20 devstack sudo[99827]: pam_unix(sudo:session): session closed for user root Sep 16 15:24:20 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [None req-05626c7c-beb1-45a9-8979-0b4c86ad14a0 tempest-VolumeImageDependencyTests-668319046 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_f17be5a1-9772-4c46-bd96-f3a7b78e2376_h4wkcpfw" returned: 0 in 1.966s {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 15:24:20 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [None req-05626c7c-beb1-45a9-8979-0b4c86ad14a0 tempest-VolumeImageDependencyTests-668319046 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_f17be5a1-9772-4c46-bd96-f3a7b78e2376_h4wkcpfw {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 15:24:20 devstack sudo[99831]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_f17be5a1-9772-4c46-bd96-f3a7b78e2376_h4wkcpfw Sep 16 15:24:20 devstack sudo[99831]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 15:24:22 devstack sudo[99831]: pam_unix(sudo:session): session closed for user root Sep 16 15:24:22 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [None req-05626c7c-beb1-45a9-8979-0b4c86ad14a0 tempest-VolumeImageDependencyTests-668319046 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_f17be5a1-9772-4c46-bd96-f3a7b78e2376_h4wkcpfw" returned: 1 in 1.933s {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 15:24:22 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [None req-05626c7c-beb1-45a9-8979-0b4c86ad14a0 tempest-VolumeImageDependencyTests-668319046 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_f17be5a1-9772-4c46-bd96-f3a7b78e2376_h4wkcpfw' failed. Not Retrying. {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:423}} Sep 16 15:24:22 devstack cinder-volume[83259]: DEBUG oslo.privsep.daemon [-] privsep: reply[341ed999-a4f0-4bd2-8f74-af3d8b435467]: (4, 'raw') {{(pid=84312) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 16 15:24:22 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [None req-05626c7c-beb1-45a9-8979-0b4c86ad14a0 tempest-VolumeImageDependencyTests-668319046 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_f17be5a1-9772-4c46-bd96-f3a7b78e2376_c0c4zqsddevstack@QuobyteHD {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 15:24:22 devstack sudo[99835]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_f17be5a1-9772-4c46-bd96-f3a7b78e2376_c0c4zqsddevstack@QuobyteHD Sep 16 15:24:22 devstack sudo[99835]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 15:24:23 devstack cinder-volume[83259]: DEBUG dbcounter [-] [83259] Writing DB stats cinder:UPDATE=1,cinder:SELECT=2,cinder:INSERT=1 {{(pid=83259) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Sep 16 15:24:24 devstack sudo[99835]: pam_unix(sudo:session): session closed for user root Sep 16 15:24:24 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [None req-05626c7c-beb1-45a9-8979-0b4c86ad14a0 tempest-VolumeImageDependencyTests-668319046 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_f17be5a1-9772-4c46-bd96-f3a7b78e2376_c0c4zqsddevstack@QuobyteHD" returned: 0 in 2.002s {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 15:24:24 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [None req-05626c7c-beb1-45a9-8979-0b4c86ad14a0 tempest-VolumeImageDependencyTests-668319046 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_f17be5a1-9772-4c46-bd96-f3a7b78e2376_c0c4zqsddevstack@QuobyteHD {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 15:24:24 devstack sudo[99839]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_f17be5a1-9772-4c46-bd96-f3a7b78e2376_c0c4zqsddevstack@QuobyteHD Sep 16 15:24:24 devstack sudo[99839]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 15:24:26 devstack sudo[99839]: pam_unix(sudo:session): session closed for user root Sep 16 15:24:26 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [None req-05626c7c-beb1-45a9-8979-0b4c86ad14a0 tempest-VolumeImageDependencyTests-668319046 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_f17be5a1-9772-4c46-bd96-f3a7b78e2376_c0c4zqsddevstack@QuobyteHD" returned: 1 in 2.004s {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 15:24:26 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [None req-05626c7c-beb1-45a9-8979-0b4c86ad14a0 tempest-VolumeImageDependencyTests-668319046 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_f17be5a1-9772-4c46-bd96-f3a7b78e2376_c0c4zqsddevstack@QuobyteHD' failed. Not Retrying. {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:423}} Sep 16 15:24:26 devstack cinder-volume[83259]: DEBUG cinder.image.image_utils [None req-05626c7c-beb1-45a9-8979-0b4c86ad14a0 tempest-VolumeImageDependencyTests-668319046 None] f17be5a1-9772-4c46-bd96-f3a7b78e2376 was raw, converting to qcow2 {{(pid=83259) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1088}} Sep 16 15:24:26 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [None req-05626c7c-beb1-45a9-8979-0b4c86ad14a0 tempest-VolumeImageDependencyTests-668319046 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_f17be5a1-9772-4c46-bd96-f3a7b78e2376_c0c4zqsddevstack@QuobyteHD /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c/volume-f71438f5-1674-407b-b3fd-937a0dfe70ea {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 15:24:26 devstack sudo[99845]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_f17be5a1-9772-4c46-bd96-f3a7b78e2376_c0c4zqsddevstack@QuobyteHD /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c/volume-f71438f5-1674-407b-b3fd-937a0dfe70ea Sep 16 15:24:26 devstack sudo[99845]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 15:24:28 devstack cinder-volume[83259]: DEBUG dbcounter [-] [83259] Writing DB stats cinder:SELECT=3,cinder:UPDATE=3 {{(pid=83259) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Sep 16 15:24:28 devstack sudo[99845]: pam_unix(sudo:session): session closed for user root Sep 16 15:24:28 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [None req-05626c7c-beb1-45a9-8979-0b4c86ad14a0 tempest-VolumeImageDependencyTests-668319046 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_f17be5a1-9772-4c46-bd96-f3a7b78e2376_c0c4zqsddevstack@QuobyteHD /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c/volume-f71438f5-1674-407b-b3fd-937a0dfe70ea" returned: 0 in 1.875s {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 15:24:28 devstack cinder-volume[83259]: DEBUG cinder.image.image_utils [None req-05626c7c-beb1-45a9-8979-0b4c86ad14a0 tempest-VolumeImageDependencyTests-668319046 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_f17be5a1-9772-4c46-bd96-f3a7b78e2376_c0c4zqsddevstack@QuobyteHD, size 0.00 MB, duration 1.89 sec, destination /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c/volume-f71438f5-1674-407b-b3fd-937a0dfe70ea {{(pid=83259) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:501}} Sep 16 15:24:28 devstack cinder-volume[83259]: INFO cinder.image.image_utils [None req-05626c7c-beb1-45a9-8979-0b4c86ad14a0 tempest-VolumeImageDependencyTests-668319046 None] Converted 0.00 MB image at 0.00 MB/s Sep 16 15:24:28 devstack cinder-volume[83259]: DEBUG oslo.privsep.daemon [-] privsep: reply[a1cbe589-9928-4c08-9357-f24ac604ebf3]: (4, 'qcow2') {{(pid=84312) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 16 15:24:28 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [None req-05626c7c-beb1-45a9-8979-0b4c86ad14a0 tempest-VolumeImageDependencyTests-668319046 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c/volume-f71438f5-1674-407b-b3fd-937a0dfe70ea {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 15:24:28 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [None req-05626c7c-beb1-45a9-8979-0b4c86ad14a0 tempest-VolumeImageDependencyTests-668319046 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c/volume-f71438f5-1674-407b-b3fd-937a0dfe70ea" returned: 0 in 0.380s {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 15:24:28 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [None req-05626c7c-beb1-45a9-8979-0b4c86ad14a0 tempest-VolumeImageDependencyTests-668319046 None] Running cmd (subprocess): qemu-img resize /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c/volume-f71438f5-1674-407b-b3fd-937a0dfe70ea 1G {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 15:24:29 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [None req-05626c7c-beb1-45a9-8979-0b4c86ad14a0 tempest-VolumeImageDependencyTests-668319046 None] CMD "qemu-img resize /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c/volume-f71438f5-1674-407b-b3fd-937a0dfe70ea 1G" returned: 0 in 0.163s {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 15:24:29 devstack cinder-volume[83259]: DEBUG cinder.volume.volume_utils [None req-05626c7c-beb1-45a9-8979-0b4c86ad14a0 tempest-VolumeImageDependencyTests-668319046 None] Downloaded image f17be5a1-9772-4c46-bd96-f3a7b78e2376 ((None, [{'url': 'file:///opt/stack/data/glance/images/f17be5a1-9772-4c46-bd96-f3a7b78e2376', 'metadata': {}}])) to volume f71438f5-1674-407b-b3fd-937a0dfe70ea successfully. {{(pid=83259) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1234}} Sep 16 15:24:29 devstack cinder-volume[83259]: DEBUG cinder.image.image_utils [None req-05626c7c-beb1-45a9-8979-0b4c86ad14a0 tempest-VolumeImageDependencyTests-668319046 None] Temporary image f17be5a1-9772-4c46-bd96-f3a7b78e2376 for user 2e67a7848a2f4fd28b6e24b36445fce1 is deleted. {{(pid=83259) fetch /opt/stack/cinder/cinder/image/image_utils.py:1403}} Sep 16 15:24:29 devstack cinder-volume[83259]: DEBUG cinder.volume.volume_utils [None req-05626c7c-beb1-45a9-8979-0b4c86ad14a0 tempest-VolumeImageDependencyTests-668319046 None] Marking volume f71438f5-1674-407b-b3fd-937a0dfe70ea as bootable. {{(pid=83259) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1138}} Sep 16 15:24:29 devstack cinder-volume[83259]: DEBUG cinder.volume.flows.manager.create_volume [None req-05626c7c-beb1-45a9-8979-0b4c86ad14a0 tempest-VolumeImageDependencyTests-668319046 None] Copying metadata from image f17be5a1-9772-4c46-bd96-f3a7b78e2376 to f71438f5-1674-407b-b3fd-937a0dfe70ea. {{(pid=83259) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Sep 16 15:24:29 devstack cinder-volume[83259]: DEBUG cinder.volume.flows.manager.create_volume [None req-05626c7c-beb1-45a9-8979-0b4c86ad14a0 tempest-VolumeImageDependencyTests-668319046 None] Creating volume glance metadata for volume f71438f5-1674-407b-b3fd-937a0dfe70ea backed by image f17be5a1-9772-4c46-bd96-f3a7b78e2376 with: {'image_id': 'f17be5a1-9772-4c46-bd96-f3a7b78e2376', 'image_name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'checksum': '86fafb2a011dfe3d545129cde577739a', 'container_format': 'bare', 'disk_format': 'raw', 'min_disk': 1, 'min_ram': 0, 'size': 1024}. {{(pid=83259) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Sep 16 15:24:29 devstack cinder-volume[83259]: DEBUG cinder.volume.manager [None req-05626c7c-beb1-45a9-8979-0b4c86ad14a0 tempest-VolumeImageDependencyTests-668319046 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (beb0b87c-7993-48ef-812b-aa79b0add083) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f71438f5-1674-407b-b3fd-937a0dfe70ea', 'volume_size': 1, 'image_id': 'f17be5a1-9772-4c46-bd96-f3a7b78e2376', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/f17be5a1-9772-4c46-bd96-f3a7b78e2376', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '86fafb2a011dfe3d545129cde577739a', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'd116159dd3fa4f8c934e5abbfcd2c617', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '036e06b3ae7043c2e5467ae0c1fea028139861305c52111f013a877bfb70c27685e0452230252776009ba6e713fa0094088ec172ae589f13eeda88ad072221a4', 'id': 'f17be5a1-9772-4c46-bd96-f3a7b78e2376', 'created_at': datetime.datetime(2025, 9, 16, 13, 24, 7, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2025, 9, 16, 13, 24, 8, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/f17be5a1-9772-4c46-bd96-f3a7b78e2376/file', 'properties': {}}, 'image_service': }' {{(pid=83259) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 15:24:29 devstack cinder-volume[83259]: DEBUG cinder.volume.manager [None req-05626c7c-beb1-45a9-8979-0b4c86ad14a0 tempest-VolumeImageDependencyTests-668319046 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (69902401-ceef-43bc-84e1-7564e1e566dc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83259) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 15:24:29 devstack cinder-volume[83259]: INFO cinder.volume.flows.manager.create_volume [None req-05626c7c-beb1-45a9-8979-0b4c86ad14a0 tempest-VolumeImageDependencyTests-668319046 None] Volume volume-f71438f5-1674-407b-b3fd-937a0dfe70ea (f71438f5-1674-407b-b3fd-937a0dfe70ea): created successfully Sep 16 15:24:29 devstack cinder-volume[83259]: DEBUG cinder.volume.manager [None req-05626c7c-beb1-45a9-8979-0b4c86ad14a0 tempest-VolumeImageDependencyTests-668319046 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (69902401-ceef-43bc-84e1-7564e1e566dc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83259) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 15:24:29 devstack cinder-volume[83259]: DEBUG cinder.volume.manager [None req-05626c7c-beb1-45a9-8979-0b4c86ad14a0 tempest-VolumeImageDependencyTests-668319046 None] Flow 'volume_create_manager' (340add4a-13f6-4991-aa85-4226f6c102a5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83259) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 16 15:24:29 devstack cinder-volume[83259]: INFO cinder.volume.manager [None req-05626c7c-beb1-45a9-8979-0b4c86ad14a0 tempest-VolumeImageDependencyTests-668319046 None] Created volume successfully. Sep 16 15:24:30 devstack cinder-volume[83259]: DEBUG cinder.coordination [None req-c40a69a4-0a91-4ee6-bac9-76e6743def42 tempest-VolumeImageDependencyTests-668319046 None] Acquiring lock "cinder-f71438f5-1674-407b-b3fd-937a0dfe70ea-delete_volume" by "delete_volume" {{(pid=83259) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 16 15:24:30 devstack cinder-volume[83259]: DEBUG cinder.coordination [None req-c40a69a4-0a91-4ee6-bac9-76e6743def42 tempest-VolumeImageDependencyTests-668319046 None] Lock "cinder-f71438f5-1674-407b-b3fd-937a0dfe70ea-delete_volume" acquired by "delete_volume" :: waited 0.053s {{(pid=83259) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 16 15:24:30 devstack cinder-volume[83259]: WARNING cinder.volume.volume_utils [None req-c40a69a4-0a91-4ee6-bac9-76e6743def42 tempest-VolumeImageDependencyTests-668319046 None] Volume driver (QuobyteDriver 1.2) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 16 15:24:30 devstack cinder-volume[83259]: DEBUG cinder.coordination [None req-c40a69a4-0a91-4ee6-bac9-76e6743def42 tempest-VolumeImageDependencyTests-668319046 None] Acquiring lock "cinder-quobyte-f71438f5-1674-407b-b3fd-937a0dfe70ea" by "delete_volume" {{(pid=83259) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 16 15:24:30 devstack cinder-volume[83259]: DEBUG cinder.coordination [None req-c40a69a4-0a91-4ee6-bac9-76e6743def42 tempest-VolumeImageDependencyTests-668319046 None] Lock "cinder-quobyte-f71438f5-1674-407b-b3fd-937a0dfe70ea" acquired by "delete_volume" :: waited 0.011s {{(pid=83259) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 16 15:24:30 devstack cinder-volume[83259]: DEBUG oslo.privsep.daemon [-] privsep: reply[d8011509-ec2c-4de2-915e-7436caa44f4c]: (4, 'qcow2') {{(pid=84312) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 16 15:24:30 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [None req-c40a69a4-0a91-4ee6-bac9-76e6743def42 tempest-VolumeImageDependencyTests-668319046 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c/volume-f71438f5-1674-407b-b3fd-937a0dfe70ea {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 15:24:30 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [None req-c40a69a4-0a91-4ee6-bac9-76e6743def42 tempest-VolumeImageDependencyTests-668319046 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c/volume-f71438f5-1674-407b-b3fd-937a0dfe70ea" returned: 0 in 0.377s {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 15:24:31 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [None req-c40a69a4-0a91-4ee6-bac9-76e6743def42 tempest-VolumeImageDependencyTests-668319046 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c/volume-f71438f5-1674-407b-b3fd-937a0dfe70ea {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 15:24:31 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [None req-c40a69a4-0a91-4ee6-bac9-76e6743def42 tempest-VolumeImageDependencyTests-668319046 None] CMD "rm -f /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c/volume-f71438f5-1674-407b-b3fd-937a0dfe70ea" returned: 0 in 0.111s {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 15:24:31 devstack cinder-volume[83259]: DEBUG cinder.coordination [None req-c40a69a4-0a91-4ee6-bac9-76e6743def42 tempest-VolumeImageDependencyTests-668319046 None] Lock "cinder-quobyte-f71438f5-1674-407b-b3fd-937a0dfe70ea" released by "delete_volume" :: held 0.644s {{(pid=83259) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 16 15:24:31 devstack cinder-volume[83259]: DEBUG cinder.quota [None req-c40a69a4-0a91-4ee6-bac9-76e6743def42 tempest-VolumeImageDependencyTests-668319046 None] Created reservations ['2251c3be-78ea-4c3b-ad46-7b93af453c62', '77aec258-2b30-4422-aec9-23e7f5f1295c', '4b650fc5-b83d-4fed-8992-bce0b5bfcb4c', '5c6ad019-0730-456a-97fc-ab43b0210ffb'] {{(pid=83259) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 16 15:24:31 devstack cinder-volume[83259]: DEBUG oslo_concurrency.lockutils [None req-c40a69a4-0a91-4ee6-bac9-76e6743def42 tempest-VolumeImageDependencyTests-668319046 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83259) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 16 15:24:31 devstack cinder-volume[83259]: DEBUG oslo_concurrency.lockutils [None req-c40a69a4-0a91-4ee6-bac9-76e6743def42 tempest-VolumeImageDependencyTests-668319046 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.005s {{(pid=83259) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 16 15:24:31 devstack cinder-volume[83259]: DEBUG cinder.volume.drivers.quobyte [None req-c40a69a4-0a91-4ee6-bac9-76e6743def42 tempest-VolumeImageDependencyTests-668319046 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-61f585ac-f8e2-4d19-a890-7ebc2726cc72': None} {{(pid=83259) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:639}} Sep 16 15:24:31 devstack cinder-volume[83259]: DEBUG cinder.volume.drivers.quobyte [None req-c40a69a4-0a91-4ee6-bac9-76e6743def42 tempest-VolumeImageDependencyTests-668319046 None] Available shares ['10.10.41.181/cinder-vol-61f585ac-f8e2-4d19-a890-7ebc2726cc72'] {{(pid=83259) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:669}} Sep 16 15:24:31 devstack cinder-volume[83259]: DEBUG oslo_concurrency.lockutils [None req-c40a69a4-0a91-4ee6-bac9-76e6743def42 tempest-VolumeImageDependencyTests-668319046 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=83259) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 16 15:24:31 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [None req-c40a69a4-0a91-4ee6-bac9-76e6743def42 tempest-VolumeImageDependencyTests-668319046 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 15:24:31 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [None req-c40a69a4-0a91-4ee6-bac9-76e6743def42 tempest-VolumeImageDependencyTests-668319046 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c" returned: 0 in 0.087s {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 15:24:31 devstack cinder-volume[83259]: DEBUG cinder.manager [None req-c40a69a4-0a91-4ee6-bac9-76e6743def42 tempest-VolumeImageDependencyTests-668319046 None] Notifying Schedulers of capabilities ... {{(pid=83259) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 16 15:24:31 devstack cinder-volume[83259]: INFO cinder.volume.manager [None req-c40a69a4-0a91-4ee6-bac9-76e6743def42 tempest-VolumeImageDependencyTests-668319046 None] Deleted volume successfully. Sep 16 15:24:32 devstack cinder-volume[83259]: DEBUG cinder.coordination [None req-c40a69a4-0a91-4ee6-bac9-76e6743def42 tempest-VolumeImageDependencyTests-668319046 None] Lock "cinder-f71438f5-1674-407b-b3fd-937a0dfe70ea-delete_volume" released by "delete_volume" :: held 1.596s {{(pid=83259) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 16 15:24:41 devstack cinder-volume[83259]: DEBUG dbcounter [-] [83259] Writing DB stats cinder:SELECT=6,cinder:INSERT=9,cinder:UPDATE=7 {{(pid=83259) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Sep 16 15:24:41 devstack cinder-volume[83259]: DEBUG dbcounter [-] [83259] Writing DB stats cinder:UPDATE=13,cinder:INSERT=3,cinder:SELECT=13,cinder:DELETE=2 {{(pid=83259) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Sep 16 15:24:46 devstack cinder-volume[83259]: DEBUG oslo_service.periodic_task [None req-050ec8a1-6ffd-499d-95ad-d548a84437e2 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=83259) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} Sep 16 15:24:46 devstack cinder-volume[83259]: DEBUG oslo_concurrency.lockutils [None req-050ec8a1-6ffd-499d-95ad-d548a84437e2 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83259) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 16 15:24:46 devstack cinder-volume[83259]: DEBUG oslo_concurrency.lockutils [None req-050ec8a1-6ffd-499d-95ad-d548a84437e2 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83259) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 16 15:24:46 devstack cinder-volume[83259]: DEBUG cinder.volume.drivers.quobyte [None req-050ec8a1-6ffd-499d-95ad-d548a84437e2 None None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-61f585ac-f8e2-4d19-a890-7ebc2726cc72': None} {{(pid=83259) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:639}} Sep 16 15:24:46 devstack cinder-volume[83259]: DEBUG cinder.volume.drivers.quobyte [None req-050ec8a1-6ffd-499d-95ad-d548a84437e2 None None] Available shares ['10.10.41.181/cinder-vol-61f585ac-f8e2-4d19-a890-7ebc2726cc72'] {{(pid=83259) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:669}} Sep 16 15:24:46 devstack cinder-volume[83259]: DEBUG oslo_concurrency.lockutils [None req-050ec8a1-6ffd-499d-95ad-d548a84437e2 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=83259) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 16 15:24:46 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [None req-050ec8a1-6ffd-499d-95ad-d548a84437e2 None None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 15:24:46 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [None req-050ec8a1-6ffd-499d-95ad-d548a84437e2 None None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c" returned: 0 in 0.162s {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 15:24:46 devstack cinder-volume[83259]: DEBUG cinder.manager [None req-050ec8a1-6ffd-499d-95ad-d548a84437e2 None None] Notifying Schedulers of capabilities ... {{(pid=83259) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 16 15:24:53 devstack cinder-volume[83259]: WARNING cinder.volume.volume_utils [None req-13ca7806-f23c-4b2d-8f7e-32c2b50004db tempest-CreateVolumesFromSourceVolumeTest-644256109 None] Volume driver (QuobyteDriver 1.2) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 16 15:24:53 devstack cinder-volume[83259]: DEBUG cinder.volume.flows.manager.create_volume [None req-13ca7806-f23c-4b2d-8f7e-32c2b50004db tempest-CreateVolumesFromSourceVolumeTest-644256109 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#Quobyte'], 'hosts': ['devstack@QuobyteHD#Quobyte']} {{(pid=83259) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1387}} Sep 16 15:24:53 devstack cinder-volume[83259]: DEBUG cinder.volume.manager [None req-13ca7806-f23c-4b2d-8f7e-32c2b50004db tempest-CreateVolumesFromSourceVolumeTest-644256109 None] Flow 'volume_create_manager' (c4ed6400-40f6-4861-8a1e-7a695bfddf9d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83259) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 16 15:24:53 devstack cinder-volume[83259]: DEBUG cinder.volume.manager [None req-13ca7806-f23c-4b2d-8f7e-32c2b50004db tempest-CreateVolumesFromSourceVolumeTest-644256109 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b10df66a-c00b-4a9b-8383-046dac8b7b82) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83259) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 15:24:53 devstack cinder-volume[83259]: DEBUG cinder.volume.manager [None req-13ca7806-f23c-4b2d-8f7e-32c2b50004db tempest-CreateVolumesFromSourceVolumeTest-644256109 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b10df66a-c00b-4a9b-8383-046dac8b7b82) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-16T13:24:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1425576056',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#Quobyte',id=df8f422c-7eb4-4059-aba7-290a5d1dee03,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b047c692efbd4022b3cea93b0d5b9c2a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-16T13:24:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-16T13:24:53Z,use_quota=True,user_id='d83e020b86574dd1a77b0be23e17d7cf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(485ead50-3df8-4d76-8d34-a4db136c980a),volume_type_id=485ead50-3df8-4d76-8d34-a4db136c980a)' {{(pid=83259) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 15:24:53 devstack cinder-volume[83259]: DEBUG cinder.volume.manager [None req-13ca7806-f23c-4b2d-8f7e-32c2b50004db tempest-CreateVolumesFromSourceVolumeTest-644256109 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (15976352-1378-40a7-ab36-5ef62d17ce98) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83259) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 15:24:53 devstack cinder-volume[83259]: DEBUG cinder.volume.manager [None req-13ca7806-f23c-4b2d-8f7e-32c2b50004db tempest-CreateVolumesFromSourceVolumeTest-644256109 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (15976352-1378-40a7-ab36-5ef62d17ce98) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83259) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 15:24:53 devstack cinder-volume[83259]: DEBUG cinder.volume.manager [None req-13ca7806-f23c-4b2d-8f7e-32c2b50004db tempest-CreateVolumesFromSourceVolumeTest-644256109 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (03305f56-3325-474f-b9a7-2b4108920223) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83259) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 15:24:53 devstack cinder-volume[83259]: DEBUG cinder.volume.manager [None req-13ca7806-f23c-4b2d-8f7e-32c2b50004db tempest-CreateVolumesFromSourceVolumeTest-644256109 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (03305f56-3325-474f-b9a7-2b4108920223) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'df8f422c-7eb4-4059-aba7-290a5d1dee03', 'volume_name': 'volume-df8f422c-7eb4-4059-aba7-290a5d1dee03', 'volume_size': 1}' {{(pid=83259) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 15:24:53 devstack cinder-volume[83259]: DEBUG cinder.volume.manager [None req-13ca7806-f23c-4b2d-8f7e-32c2b50004db tempest-CreateVolumesFromSourceVolumeTest-644256109 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (27c55d87-9db3-4727-9341-80f0c3bd0ff0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83259) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 15:24:53 devstack cinder-volume[83259]: DEBUG cinder.volume.manager [None req-13ca7806-f23c-4b2d-8f7e-32c2b50004db tempest-CreateVolumesFromSourceVolumeTest-644256109 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (27c55d87-9db3-4727-9341-80f0c3bd0ff0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83259) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 15:24:53 devstack cinder-volume[83259]: DEBUG cinder.volume.manager [None req-13ca7806-f23c-4b2d-8f7e-32c2b50004db tempest-CreateVolumesFromSourceVolumeTest-644256109 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a63250a2-d676-47c3-9aa4-46c513b5cc4d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83259) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 15:24:53 devstack cinder-volume[83259]: INFO cinder.volume.flows.manager.create_volume [None req-13ca7806-f23c-4b2d-8f7e-32c2b50004db tempest-CreateVolumesFromSourceVolumeTest-644256109 None] Volume df8f422c-7eb4-4059-aba7-290a5d1dee03: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-df8f422c-7eb4-4059-aba7-290a5d1dee03', 'volume_size': 1} Sep 16 15:24:53 devstack cinder-volume[83259]: DEBUG oslo_concurrency.lockutils [None req-13ca7806-f23c-4b2d-8f7e-32c2b50004db tempest-CreateVolumesFromSourceVolumeTest-644256109 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83259) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 16 15:24:53 devstack cinder-volume[83259]: DEBUG oslo_concurrency.lockutils [None req-13ca7806-f23c-4b2d-8f7e-32c2b50004db tempest-CreateVolumesFromSourceVolumeTest-644256109 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.003s {{(pid=83259) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 16 15:24:53 devstack cinder-volume[83259]: DEBUG cinder.volume.drivers.quobyte [None req-13ca7806-f23c-4b2d-8f7e-32c2b50004db tempest-CreateVolumesFromSourceVolumeTest-644256109 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-16T13:24:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1425576056',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#Quobyte',id=df8f422c-7eb4-4059-aba7-290a5d1dee03,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b047c692efbd4022b3cea93b0d5b9c2a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-16T13:24:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-16T13:24:53Z,use_quota=True,user_id='d83e020b86574dd1a77b0be23e17d7cf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(485ead50-3df8-4d76-8d34-a4db136c980a),volume_type_id=485ead50-3df8-4d76-8d34-a4db136c980a)}" {{(pid=83259) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Sep 16 15:24:53 devstack cinder-volume[83259]: DEBUG cinder.volume.drivers.remotefs [None req-13ca7806-f23c-4b2d-8f7e-32c2b50004db tempest-CreateVolumesFromSourceVolumeTest-644256109 None] Creating volume df8f422c-7eb4-4059-aba7-290a5d1dee03 {{(pid=83259) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}} Sep 16 15:24:53 devstack cinder-volume[83259]: DEBUG oslo_concurrency.lockutils [None req-13ca7806-f23c-4b2d-8f7e-32c2b50004db tempest-CreateVolumesFromSourceVolumeTest-644256109 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83259) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 16 15:24:53 devstack cinder-volume[83259]: DEBUG oslo_concurrency.lockutils [None req-13ca7806-f23c-4b2d-8f7e-32c2b50004db tempest-CreateVolumesFromSourceVolumeTest-644256109 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83259) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 16 15:24:53 devstack cinder-volume[83259]: DEBUG cinder.volume.drivers.quobyte [None req-13ca7806-f23c-4b2d-8f7e-32c2b50004db tempest-CreateVolumesFromSourceVolumeTest-644256109 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-61f585ac-f8e2-4d19-a890-7ebc2726cc72': None} {{(pid=83259) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:639}} Sep 16 15:24:53 devstack cinder-volume[83259]: DEBUG cinder.volume.drivers.quobyte [None req-13ca7806-f23c-4b2d-8f7e-32c2b50004db tempest-CreateVolumesFromSourceVolumeTest-644256109 None] Available shares ['10.10.41.181/cinder-vol-61f585ac-f8e2-4d19-a890-7ebc2726cc72'] {{(pid=83259) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:669}} Sep 16 15:24:53 devstack cinder-volume[83259]: DEBUG oslo_concurrency.lockutils [None req-13ca7806-f23c-4b2d-8f7e-32c2b50004db tempest-CreateVolumesFromSourceVolumeTest-644256109 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.021s {{(pid=83259) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 16 15:24:53 devstack cinder-volume[83259]: DEBUG cinder.volume.drivers.quobyte [None req-13ca7806-f23c-4b2d-8f7e-32c2b50004db tempest-CreateVolumesFromSourceVolumeTest-644256109 None] Selected 10.10.41.181/cinder-vol-61f585ac-f8e2-4d19-a890-7ebc2726cc72 as target Quobyte volume. {{(pid=83259) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:690}} Sep 16 15:24:53 devstack cinder-volume[83259]: INFO cinder.volume.drivers.remotefs [None req-13ca7806-f23c-4b2d-8f7e-32c2b50004db tempest-CreateVolumesFromSourceVolumeTest-644256109 None] casted to 10.10.41.181/cinder-vol-61f585ac-f8e2-4d19-a890-7ebc2726cc72 Sep 16 15:24:53 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [None req-13ca7806-f23c-4b2d-8f7e-32c2b50004db tempest-CreateVolumesFromSourceVolumeTest-644256109 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c/volume-df8f422c-7eb4-4059-aba7-290a5d1dee03 1073741824 {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 15:24:53 devstack quobyte-client[83286]: The server volume:87712ffe-8a69-446d-9ed6-4430c7ee9792@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=87712ffe-8a69-446d-9ed6-4430c7ee9792, inode=146, name=volume-df8f422c-7eb4-4059-aba7-290a5d1dee03, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.206), requestorAccessMask=0 Sep 16 15:24:54 devstack cinder-volume[83259]: WARNING cinder.volume.volume_utils [None req-4a8b8646-b69d-428e-87f6-77fb7ad625e4 tempest-CreateVolumesFromImageTest-720201122 None] Volume driver (QuobyteDriver 1.2) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 16 15:24:54 devstack cinder-volume[83259]: DEBUG cinder.volume.flows.manager.create_volume [None req-4a8b8646-b69d-428e-87f6-77fb7ad625e4 tempest-CreateVolumesFromImageTest-720201122 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#Quobyte'], 'hosts': ['devstack@QuobyteHD#Quobyte']} {{(pid=83259) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1387}} Sep 16 15:24:54 devstack cinder-volume[83259]: DEBUG cinder.volume.manager [None req-4a8b8646-b69d-428e-87f6-77fb7ad625e4 tempest-CreateVolumesFromImageTest-720201122 None] Flow 'volume_create_manager' (84467aa0-e739-4714-854a-53ed9d3e5ccd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83259) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 16 15:24:54 devstack cinder-volume[83259]: DEBUG cinder.volume.manager [None req-4a8b8646-b69d-428e-87f6-77fb7ad625e4 tempest-CreateVolumesFromImageTest-720201122 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cbb5c2b0-ea0a-40e4-9130-f2ae832039a6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83259) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 15:24:54 devstack cinder-volume[83259]: DEBUG cinder.volume.manager [None req-4a8b8646-b69d-428e-87f6-77fb7ad625e4 tempest-CreateVolumesFromImageTest-720201122 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cbb5c2b0-ea0a-40e4-9130-f2ae832039a6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-16T13:24:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1474275937',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#Quobyte',id=60d0bb78-46e4-4e37-bf47-96e6428b635e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8bd04cfd64064ab8a87507b6a2b87d14',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-16T13:24:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-16T13:24:53Z,use_quota=True,user_id='46e7349c0f454da8b9fda7da82a040a4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(485ead50-3df8-4d76-8d34-a4db136c980a),volume_type_id=485ead50-3df8-4d76-8d34-a4db136c980a)' {{(pid=83259) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 15:24:54 devstack cinder-volume[83259]: DEBUG cinder.volume.manager [None req-4a8b8646-b69d-428e-87f6-77fb7ad625e4 tempest-CreateVolumesFromImageTest-720201122 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c82c49ed-0337-4edc-ad0b-2ea1f76ddc54) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83259) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 15:24:54 devstack cinder-volume[83259]: DEBUG cinder.volume.manager [None req-4a8b8646-b69d-428e-87f6-77fb7ad625e4 tempest-CreateVolumesFromImageTest-720201122 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c82c49ed-0337-4edc-ad0b-2ea1f76ddc54) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83259) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 15:24:54 devstack cinder-volume[83259]: DEBUG cinder.volume.manager [None req-4a8b8646-b69d-428e-87f6-77fb7ad625e4 tempest-CreateVolumesFromImageTest-720201122 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (085e5202-1469-4c0a-907d-07788177bf7c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83259) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 15:24:54 devstack cinder-volume[83259]: DEBUG cinder.volume.manager [None req-4a8b8646-b69d-428e-87f6-77fb7ad625e4 tempest-CreateVolumesFromImageTest-720201122 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (085e5202-1469-4c0a-907d-07788177bf7c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '60d0bb78-46e4-4e37-bf47-96e6428b635e', 'volume_name': 'volume-60d0bb78-46e4-4e37-bf47-96e6428b635e', 'volume_size': 1}' {{(pid=83259) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 15:24:54 devstack cinder-volume[83259]: DEBUG cinder.volume.manager [None req-4a8b8646-b69d-428e-87f6-77fb7ad625e4 tempest-CreateVolumesFromImageTest-720201122 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (da0c91b4-421b-43fd-a8d1-b7eed04eab62) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83259) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 15:24:54 devstack cinder-volume[83259]: DEBUG cinder.volume.manager [None req-4a8b8646-b69d-428e-87f6-77fb7ad625e4 tempest-CreateVolumesFromImageTest-720201122 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (da0c91b4-421b-43fd-a8d1-b7eed04eab62) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83259) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 15:24:54 devstack cinder-volume[83259]: DEBUG cinder.volume.manager [None req-4a8b8646-b69d-428e-87f6-77fb7ad625e4 tempest-CreateVolumesFromImageTest-720201122 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (17ca9ac9-17e8-47e9-ace1-93429c72a2ce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83259) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 15:24:54 devstack cinder-volume[83259]: INFO cinder.volume.flows.manager.create_volume [None req-4a8b8646-b69d-428e-87f6-77fb7ad625e4 tempest-CreateVolumesFromImageTest-720201122 None] Volume 60d0bb78-46e4-4e37-bf47-96e6428b635e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-60d0bb78-46e4-4e37-bf47-96e6428b635e', 'volume_size': 1} Sep 16 15:24:54 devstack cinder-volume[83259]: DEBUG oslo_concurrency.lockutils [None req-4a8b8646-b69d-428e-87f6-77fb7ad625e4 tempest-CreateVolumesFromImageTest-720201122 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83259) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 16 15:24:54 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [None req-13ca7806-f23c-4b2d-8f7e-32c2b50004db tempest-CreateVolumesFromSourceVolumeTest-644256109 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c/volume-df8f422c-7eb4-4059-aba7-290a5d1dee03 1073741824" returned: 0 in 1.098s {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 15:24:54 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [None req-13ca7806-f23c-4b2d-8f7e-32c2b50004db tempest-CreateVolumesFromSourceVolumeTest-644256109 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c/volume-df8f422c-7eb4-4059-aba7-290a5d1dee03 {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 15:24:54 devstack cinder-volume[83259]: WARNING cinder.volume.volume_utils [None req-4908b669-d3fe-43a5-87f1-fd8b26b67dd9 tempest-CreateVolumesFromImageTest-720201122 None] Volume driver (QuobyteDriver 1.2) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 16 15:24:55 devstack cinder-volume[83259]: DEBUG cinder.volume.flows.manager.create_volume [None req-4908b669-d3fe-43a5-87f1-fd8b26b67dd9 tempest-CreateVolumesFromImageTest-720201122 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#Quobyte'], 'hosts': ['devstack@QuobyteHD#Quobyte']} {{(pid=83259) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1387}} Sep 16 15:24:55 devstack cinder-volume[83259]: DEBUG cinder.volume.manager [None req-4908b669-d3fe-43a5-87f1-fd8b26b67dd9 tempest-CreateVolumesFromImageTest-720201122 None] Flow 'volume_create_manager' (3108fef4-ea2d-4989-84f2-b908d9c4e9b2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83259) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 16 15:24:55 devstack cinder-volume[83259]: DEBUG cinder.volume.manager [None req-4908b669-d3fe-43a5-87f1-fd8b26b67dd9 tempest-CreateVolumesFromImageTest-720201122 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bbd4abee-ab4e-4b31-93e7-c9262b245f04) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83259) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 15:24:55 devstack cinder-volume[83259]: DEBUG cinder.volume.manager [None req-4908b669-d3fe-43a5-87f1-fd8b26b67dd9 tempest-CreateVolumesFromImageTest-720201122 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bbd4abee-ab4e-4b31-93e7-c9262b245f04) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-16T13:24:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-393622737',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#Quobyte',id=c25ac34f-86c7-4df0-b2f8-626cd2fd6a3e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8bd04cfd64064ab8a87507b6a2b87d14',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-16T13:24:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-16T13:24:54Z,use_quota=True,user_id='46e7349c0f454da8b9fda7da82a040a4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(485ead50-3df8-4d76-8d34-a4db136c980a),volume_type_id=485ead50-3df8-4d76-8d34-a4db136c980a)' {{(pid=83259) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 15:24:55 devstack cinder-volume[83259]: DEBUG cinder.volume.manager [None req-4908b669-d3fe-43a5-87f1-fd8b26b67dd9 tempest-CreateVolumesFromImageTest-720201122 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0131a6b2-141e-4bdb-9764-3c76c7bc0048) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83259) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 15:24:55 devstack cinder-volume[83259]: DEBUG cinder.volume.manager [None req-4908b669-d3fe-43a5-87f1-fd8b26b67dd9 tempest-CreateVolumesFromImageTest-720201122 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0131a6b2-141e-4bdb-9764-3c76c7bc0048) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83259) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 15:24:55 devstack cinder-volume[83259]: DEBUG cinder.volume.manager [None req-4908b669-d3fe-43a5-87f1-fd8b26b67dd9 tempest-CreateVolumesFromImageTest-720201122 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (282a9987-9afb-40b3-9b39-eedade036f9b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83259) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 15:24:55 devstack cinder-volume[83259]: DEBUG cinder.volume.manager [None req-4908b669-d3fe-43a5-87f1-fd8b26b67dd9 tempest-CreateVolumesFromImageTest-720201122 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (282a9987-9afb-40b3-9b39-eedade036f9b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c25ac34f-86c7-4df0-b2f8-626cd2fd6a3e', 'volume_name': 'volume-c25ac34f-86c7-4df0-b2f8-626cd2fd6a3e', 'volume_size': 1}' {{(pid=83259) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 15:24:55 devstack cinder-volume[83259]: DEBUG cinder.volume.manager [None req-4908b669-d3fe-43a5-87f1-fd8b26b67dd9 tempest-CreateVolumesFromImageTest-720201122 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (05dee940-bab0-45c3-a92d-a4abae548302) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83259) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 15:24:55 devstack cinder-volume[83259]: DEBUG cinder.volume.manager [None req-4908b669-d3fe-43a5-87f1-fd8b26b67dd9 tempest-CreateVolumesFromImageTest-720201122 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (05dee940-bab0-45c3-a92d-a4abae548302) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83259) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 15:24:55 devstack cinder-volume[83259]: DEBUG cinder.volume.manager [None req-4908b669-d3fe-43a5-87f1-fd8b26b67dd9 tempest-CreateVolumesFromImageTest-720201122 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (61edeb73-b680-4e98-91d7-e0d8553ed3d6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83259) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 15:24:55 devstack cinder-volume[83259]: INFO cinder.volume.flows.manager.create_volume [None req-4908b669-d3fe-43a5-87f1-fd8b26b67dd9 tempest-CreateVolumesFromImageTest-720201122 None] Volume c25ac34f-86c7-4df0-b2f8-626cd2fd6a3e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c25ac34f-86c7-4df0-b2f8-626cd2fd6a3e', 'volume_size': 1} Sep 16 15:24:55 devstack cinder-volume[83259]: DEBUG oslo_concurrency.lockutils [None req-4908b669-d3fe-43a5-87f1-fd8b26b67dd9 tempest-CreateVolumesFromImageTest-720201122 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83259) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 16 15:24:55 devstack cinder-volume[83259]: WARNING cinder.volume.volume_utils [None req-50083ccb-3a01-418e-bbef-e4978f541ae0 tempest-CreateVolumesFromImageTest-720201122 None] Volume driver (QuobyteDriver 1.2) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 16 15:24:55 devstack cinder-volume[83259]: DEBUG cinder.volume.flows.manager.create_volume [None req-50083ccb-3a01-418e-bbef-e4978f541ae0 tempest-CreateVolumesFromImageTest-720201122 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#Quobyte'], 'hosts': ['devstack@QuobyteHD#Quobyte']} {{(pid=83259) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1387}} Sep 16 15:24:55 devstack cinder-volume[83259]: DEBUG cinder.volume.manager [None req-50083ccb-3a01-418e-bbef-e4978f541ae0 tempest-CreateVolumesFromImageTest-720201122 None] Flow 'volume_create_manager' (e97bc5fa-933d-4c00-839f-33e43501c58f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83259) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 16 15:24:55 devstack cinder-volume[83259]: DEBUG cinder.volume.manager [None req-50083ccb-3a01-418e-bbef-e4978f541ae0 tempest-CreateVolumesFromImageTest-720201122 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (57ebbee2-b2a8-4352-b9e6-2622b60745f1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83259) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 15:24:55 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [None req-13ca7806-f23c-4b2d-8f7e-32c2b50004db tempest-CreateVolumesFromSourceVolumeTest-644256109 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c/volume-df8f422c-7eb4-4059-aba7-290a5d1dee03" returned: 0 in 0.854s {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 15:24:55 devstack cinder-volume[83259]: DEBUG cinder.volume.drivers.quobyte [None req-13ca7806-f23c-4b2d-8f7e-32c2b50004db tempest-CreateVolumesFromSourceVolumeTest-644256109 None] <== create_volume: return (1991ms) {'provider_location': '10.10.41.181/cinder-vol-61f585ac-f8e2-4d19-a890-7ebc2726cc72'} {{(pid=83259) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Sep 16 15:24:55 devstack cinder-volume[83259]: DEBUG oslo_concurrency.lockutils [None req-13ca7806-f23c-4b2d-8f7e-32c2b50004db tempest-CreateVolumesFromSourceVolumeTest-644256109 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.001s {{(pid=83259) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 16 15:24:55 devstack cinder-volume[83259]: DEBUG cinder.volume.manager [None req-50083ccb-3a01-418e-bbef-e4978f541ae0 tempest-CreateVolumesFromImageTest-720201122 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (57ebbee2-b2a8-4352-b9e6-2622b60745f1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-16T13:24:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-70806224',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#Quobyte',id=35e9c3e3-9b63-4e02-a4c6-17e57dd4cd51,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8bd04cfd64064ab8a87507b6a2b87d14',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-16T13:24:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-16T13:24:54Z,use_quota=True,user_id='46e7349c0f454da8b9fda7da82a040a4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(485ead50-3df8-4d76-8d34-a4db136c980a),volume_type_id=485ead50-3df8-4d76-8d34-a4db136c980a)' {{(pid=83259) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 15:24:55 devstack cinder-volume[83259]: DEBUG cinder.volume.manager [None req-50083ccb-3a01-418e-bbef-e4978f541ae0 tempest-CreateVolumesFromImageTest-720201122 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (04aa4185-8435-43e8-b786-f19efb2059fa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83259) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 15:24:55 devstack cinder-volume[83259]: DEBUG cinder.volume.manager [None req-50083ccb-3a01-418e-bbef-e4978f541ae0 tempest-CreateVolumesFromImageTest-720201122 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (04aa4185-8435-43e8-b786-f19efb2059fa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83259) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 15:24:55 devstack cinder-volume[83259]: DEBUG cinder.volume.manager [None req-50083ccb-3a01-418e-bbef-e4978f541ae0 tempest-CreateVolumesFromImageTest-720201122 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (719dcafd-7609-4eb4-8036-56786a6c112c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83259) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 15:24:55 devstack cinder-volume[83259]: DEBUG cinder.volume.manager [None req-50083ccb-3a01-418e-bbef-e4978f541ae0 tempest-CreateVolumesFromImageTest-720201122 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (719dcafd-7609-4eb4-8036-56786a6c112c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '35e9c3e3-9b63-4e02-a4c6-17e57dd4cd51', 'volume_name': 'volume-35e9c3e3-9b63-4e02-a4c6-17e57dd4cd51', 'volume_size': 1}' {{(pid=83259) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 15:24:55 devstack cinder-volume[83259]: DEBUG cinder.volume.manager [None req-50083ccb-3a01-418e-bbef-e4978f541ae0 tempest-CreateVolumesFromImageTest-720201122 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b0d6f47a-34f6-458e-8b08-96f27cead961) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83259) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 15:24:55 devstack cinder-volume[83259]: DEBUG cinder.volume.manager [None req-50083ccb-3a01-418e-bbef-e4978f541ae0 tempest-CreateVolumesFromImageTest-720201122 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b0d6f47a-34f6-458e-8b08-96f27cead961) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83259) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 15:24:55 devstack cinder-volume[83259]: DEBUG cinder.volume.manager [None req-50083ccb-3a01-418e-bbef-e4978f541ae0 tempest-CreateVolumesFromImageTest-720201122 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1f49dd4d-2ea5-44e0-93c4-807f11d2a2d3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83259) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 15:24:55 devstack cinder-volume[83259]: INFO cinder.volume.flows.manager.create_volume [None req-50083ccb-3a01-418e-bbef-e4978f541ae0 tempest-CreateVolumesFromImageTest-720201122 None] Volume 35e9c3e3-9b63-4e02-a4c6-17e57dd4cd51: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-35e9c3e3-9b63-4e02-a4c6-17e57dd4cd51', 'volume_size': 1} Sep 16 15:24:55 devstack cinder-volume[83259]: DEBUG oslo_concurrency.lockutils [None req-50083ccb-3a01-418e-bbef-e4978f541ae0 tempest-CreateVolumesFromImageTest-720201122 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83259) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 16 15:24:55 devstack cinder-volume[83259]: DEBUG oslo_concurrency.lockutils [None req-50083ccb-3a01-418e-bbef-e4978f541ae0 tempest-CreateVolumesFromImageTest-720201122 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=83259) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 16 15:24:55 devstack cinder-volume[83259]: DEBUG cinder.volume.drivers.quobyte [None req-50083ccb-3a01-418e-bbef-e4978f541ae0 tempest-CreateVolumesFromImageTest-720201122 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-16T13:24:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-70806224',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#Quobyte',id=35e9c3e3-9b63-4e02-a4c6-17e57dd4cd51,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8bd04cfd64064ab8a87507b6a2b87d14',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-16T13:24:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-16T13:24:54Z,use_quota=True,user_id='46e7349c0f454da8b9fda7da82a040a4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(485ead50-3df8-4d76-8d34-a4db136c980a),volume_type_id=485ead50-3df8-4d76-8d34-a4db136c980a)}" {{(pid=83259) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Sep 16 15:24:55 devstack cinder-volume[83259]: DEBUG cinder.volume.drivers.remotefs [None req-50083ccb-3a01-418e-bbef-e4978f541ae0 tempest-CreateVolumesFromImageTest-720201122 None] Creating volume 35e9c3e3-9b63-4e02-a4c6-17e57dd4cd51 {{(pid=83259) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}} Sep 16 15:24:55 devstack cinder-volume[83259]: DEBUG oslo_concurrency.lockutils [None req-50083ccb-3a01-418e-bbef-e4978f541ae0 tempest-CreateVolumesFromImageTest-720201122 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83259) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 16 15:24:55 devstack cinder-volume[83259]: DEBUG oslo_concurrency.lockutils [None req-50083ccb-3a01-418e-bbef-e4978f541ae0 tempest-CreateVolumesFromImageTest-720201122 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83259) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 16 15:24:55 devstack cinder-volume[83259]: DEBUG cinder.volume.drivers.quobyte [None req-50083ccb-3a01-418e-bbef-e4978f541ae0 tempest-CreateVolumesFromImageTest-720201122 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-61f585ac-f8e2-4d19-a890-7ebc2726cc72': None} {{(pid=83259) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:639}} Sep 16 15:24:55 devstack cinder-volume[83259]: DEBUG cinder.volume.drivers.quobyte [None req-50083ccb-3a01-418e-bbef-e4978f541ae0 tempest-CreateVolumesFromImageTest-720201122 None] Available shares ['10.10.41.181/cinder-vol-61f585ac-f8e2-4d19-a890-7ebc2726cc72'] {{(pid=83259) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:669}} Sep 16 15:24:55 devstack cinder-volume[83259]: DEBUG oslo_concurrency.lockutils [None req-50083ccb-3a01-418e-bbef-e4978f541ae0 tempest-CreateVolumesFromImageTest-720201122 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=83259) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 16 15:24:55 devstack cinder-volume[83259]: DEBUG cinder.volume.drivers.quobyte [None req-50083ccb-3a01-418e-bbef-e4978f541ae0 tempest-CreateVolumesFromImageTest-720201122 None] Selected 10.10.41.181/cinder-vol-61f585ac-f8e2-4d19-a890-7ebc2726cc72 as target Quobyte volume. {{(pid=83259) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:690}} Sep 16 15:24:55 devstack cinder-volume[83259]: INFO cinder.volume.drivers.remotefs [None req-50083ccb-3a01-418e-bbef-e4978f541ae0 tempest-CreateVolumesFromImageTest-720201122 None] casted to 10.10.41.181/cinder-vol-61f585ac-f8e2-4d19-a890-7ebc2726cc72 Sep 16 15:24:55 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [None req-50083ccb-3a01-418e-bbef-e4978f541ae0 tempest-CreateVolumesFromImageTest-720201122 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c/volume-35e9c3e3-9b63-4e02-a4c6-17e57dd4cd51 1073741824 {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 15:24:55 devstack quobyte-client[83286]: The server volume:87712ffe-8a69-446d-9ed6-4430c7ee9792@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=87712ffe-8a69-446d-9ed6-4430c7ee9792, inode=147, name=volume-35e9c3e3-9b63-4e02-a4c6-17e57dd4cd51, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.206), requestorAccessMask=0 Sep 16 15:24:55 devstack cinder-volume[83259]: DEBUG cinder.volume.manager [None req-13ca7806-f23c-4b2d-8f7e-32c2b50004db tempest-CreateVolumesFromSourceVolumeTest-644256109 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a63250a2-d676-47c3-9aa4-46c513b5cc4d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-df8f422c-7eb4-4059-aba7-290a5d1dee03', 'volume_size': 1}' {{(pid=83259) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 15:24:55 devstack cinder-volume[83259]: DEBUG cinder.volume.manager [None req-13ca7806-f23c-4b2d-8f7e-32c2b50004db tempest-CreateVolumesFromSourceVolumeTest-644256109 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (56ff3d4d-6207-45f7-a254-d59aeb9e5d44) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83259) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 15:24:56 devstack cinder-volume[83259]: WARNING cinder.volume.volume_utils [None req-432f1e3d-8d32-4413-af4c-5f29aaba3cdc tempest-CreateVolumesFromImageTest-720201122 None] Volume driver (QuobyteDriver 1.2) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 16 15:24:56 devstack cinder-volume[83259]: DEBUG cinder.volume.flows.manager.create_volume [None req-432f1e3d-8d32-4413-af4c-5f29aaba3cdc tempest-CreateVolumesFromImageTest-720201122 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#Quobyte'], 'hosts': ['devstack@QuobyteHD#Quobyte']} {{(pid=83259) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1387}} Sep 16 15:24:56 devstack cinder-volume[83259]: DEBUG cinder.volume.manager [None req-432f1e3d-8d32-4413-af4c-5f29aaba3cdc tempest-CreateVolumesFromImageTest-720201122 None] Flow 'volume_create_manager' (f4aea756-14a3-427b-ac31-58682685171e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83259) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 16 15:24:56 devstack cinder-volume[83259]: DEBUG cinder.volume.manager [None req-432f1e3d-8d32-4413-af4c-5f29aaba3cdc tempest-CreateVolumesFromImageTest-720201122 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (48941e45-ed52-49d5-b763-f7c44a061b81) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83259) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 15:24:56 devstack cinder-volume[83259]: DEBUG cinder.volume.manager [None req-432f1e3d-8d32-4413-af4c-5f29aaba3cdc tempest-CreateVolumesFromImageTest-720201122 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (48941e45-ed52-49d5-b763-f7c44a061b81) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-16T13:24:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1172967727',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#Quobyte',id=cbc2bd98-4f5b-49cb-8fe2-8cd876ca4b47,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8bd04cfd64064ab8a87507b6a2b87d14',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-16T13:24:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-16T13:24:55Z,use_quota=True,user_id='46e7349c0f454da8b9fda7da82a040a4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(485ead50-3df8-4d76-8d34-a4db136c980a),volume_type_id=485ead50-3df8-4d76-8d34-a4db136c980a)' {{(pid=83259) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 15:24:56 devstack cinder-volume[83259]: DEBUG cinder.volume.manager [None req-432f1e3d-8d32-4413-af4c-5f29aaba3cdc tempest-CreateVolumesFromImageTest-720201122 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f3d4662b-24e7-4a2e-966a-d6679f32fa70) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83259) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 15:24:56 devstack cinder-volume[83259]: DEBUG cinder.volume.manager [None req-432f1e3d-8d32-4413-af4c-5f29aaba3cdc tempest-CreateVolumesFromImageTest-720201122 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f3d4662b-24e7-4a2e-966a-d6679f32fa70) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83259) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 15:24:56 devstack cinder-volume[83259]: DEBUG cinder.volume.manager [None req-432f1e3d-8d32-4413-af4c-5f29aaba3cdc tempest-CreateVolumesFromImageTest-720201122 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (017f11c2-c1e8-4f6e-a27b-d465dec802a3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83259) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 15:24:56 devstack cinder-volume[83259]: DEBUG cinder.volume.manager [None req-432f1e3d-8d32-4413-af4c-5f29aaba3cdc tempest-CreateVolumesFromImageTest-720201122 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (017f11c2-c1e8-4f6e-a27b-d465dec802a3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'cbc2bd98-4f5b-49cb-8fe2-8cd876ca4b47', 'volume_name': 'volume-cbc2bd98-4f5b-49cb-8fe2-8cd876ca4b47', 'volume_size': 1}' {{(pid=83259) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 15:24:56 devstack cinder-volume[83259]: DEBUG cinder.volume.manager [None req-432f1e3d-8d32-4413-af4c-5f29aaba3cdc tempest-CreateVolumesFromImageTest-720201122 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7bf21e17-0156-4d58-b8c2-d7a55c514671) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83259) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 15:24:56 devstack cinder-volume[83259]: DEBUG cinder.volume.manager [None req-432f1e3d-8d32-4413-af4c-5f29aaba3cdc tempest-CreateVolumesFromImageTest-720201122 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7bf21e17-0156-4d58-b8c2-d7a55c514671) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83259) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 15:24:56 devstack cinder-volume[83259]: DEBUG cinder.volume.manager [None req-432f1e3d-8d32-4413-af4c-5f29aaba3cdc tempest-CreateVolumesFromImageTest-720201122 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7d64a10f-2188-4bac-ad63-e1e0d7ce612f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83259) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 15:24:56 devstack cinder-volume[83259]: INFO cinder.volume.flows.manager.create_volume [None req-432f1e3d-8d32-4413-af4c-5f29aaba3cdc tempest-CreateVolumesFromImageTest-720201122 None] Volume cbc2bd98-4f5b-49cb-8fe2-8cd876ca4b47: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-cbc2bd98-4f5b-49cb-8fe2-8cd876ca4b47', 'volume_size': 1} Sep 16 15:24:56 devstack cinder-volume[83259]: DEBUG oslo_concurrency.lockutils [None req-432f1e3d-8d32-4413-af4c-5f29aaba3cdc tempest-CreateVolumesFromImageTest-720201122 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83259) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 16 15:24:56 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [None req-50083ccb-3a01-418e-bbef-e4978f541ae0 tempest-CreateVolumesFromImageTest-720201122 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c/volume-35e9c3e3-9b63-4e02-a4c6-17e57dd4cd51 1073741824" returned: 0 in 0.717s {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 15:24:56 devstack cinder-volume[83259]: WARNING cinder.volume.volume_utils [None req-7e5c4dc8-c00f-40d5-aa8f-5c16387efc11 tempest-CreateVolumesFromImageTest-720201122 None] Volume driver (QuobyteDriver 1.2) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 16 15:24:56 devstack cinder-volume[83259]: DEBUG cinder.volume.flows.manager.create_volume [None req-7e5c4dc8-c00f-40d5-aa8f-5c16387efc11 tempest-CreateVolumesFromImageTest-720201122 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#Quobyte'], 'hosts': ['devstack@QuobyteHD#Quobyte']} {{(pid=83259) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1387}} Sep 16 15:24:56 devstack cinder-volume[83259]: DEBUG cinder.volume.manager [None req-7e5c4dc8-c00f-40d5-aa8f-5c16387efc11 tempest-CreateVolumesFromImageTest-720201122 None] Flow 'volume_create_manager' (76aad1f1-0ee5-464a-a7ca-747b9787253d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83259) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 16 15:24:56 devstack cinder-volume[83259]: DEBUG cinder.volume.manager [None req-7e5c4dc8-c00f-40d5-aa8f-5c16387efc11 tempest-CreateVolumesFromImageTest-720201122 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4dc4be76-3143-43a1-948c-39b381ff2ab1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83259) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 15:24:56 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [None req-50083ccb-3a01-418e-bbef-e4978f541ae0 tempest-CreateVolumesFromImageTest-720201122 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c/volume-35e9c3e3-9b63-4e02-a4c6-17e57dd4cd51 {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 15:24:56 devstack cinder-volume[83259]: INFO cinder.volume.flows.manager.create_volume [None req-13ca7806-f23c-4b2d-8f7e-32c2b50004db tempest-CreateVolumesFromSourceVolumeTest-644256109 None] Volume volume-df8f422c-7eb4-4059-aba7-290a5d1dee03 (df8f422c-7eb4-4059-aba7-290a5d1dee03): created successfully Sep 16 15:24:56 devstack cinder-volume[83259]: DEBUG cinder.volume.manager [None req-13ca7806-f23c-4b2d-8f7e-32c2b50004db tempest-CreateVolumesFromSourceVolumeTest-644256109 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (56ff3d4d-6207-45f7-a254-d59aeb9e5d44) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83259) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 15:24:56 devstack cinder-volume[83259]: DEBUG cinder.volume.manager [None req-13ca7806-f23c-4b2d-8f7e-32c2b50004db tempest-CreateVolumesFromSourceVolumeTest-644256109 None] Flow 'volume_create_manager' (c4ed6400-40f6-4861-8a1e-7a695bfddf9d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83259) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 16 15:24:56 devstack cinder-volume[83259]: DEBUG cinder.volume.manager [None req-7e5c4dc8-c00f-40d5-aa8f-5c16387efc11 tempest-CreateVolumesFromImageTest-720201122 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4dc4be76-3143-43a1-948c-39b381ff2ab1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-16T13:24:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-891211279',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#Quobyte',id=80f07420-429d-4da3-8050-09d3953830bd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8bd04cfd64064ab8a87507b6a2b87d14',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-16T13:24:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-16T13:24:55Z,use_quota=True,user_id='46e7349c0f454da8b9fda7da82a040a4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(485ead50-3df8-4d76-8d34-a4db136c980a),volume_type_id=485ead50-3df8-4d76-8d34-a4db136c980a)' {{(pid=83259) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 15:24:56 devstack cinder-volume[83259]: DEBUG cinder.volume.manager [None req-7e5c4dc8-c00f-40d5-aa8f-5c16387efc11 tempest-CreateVolumesFromImageTest-720201122 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6cb076b2-b5e6-41c1-b2c0-939abeb687ae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83259) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 15:24:56 devstack cinder-volume[83259]: DEBUG cinder.volume.manager [None req-7e5c4dc8-c00f-40d5-aa8f-5c16387efc11 tempest-CreateVolumesFromImageTest-720201122 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6cb076b2-b5e6-41c1-b2c0-939abeb687ae) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83259) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 15:24:56 devstack cinder-volume[83259]: DEBUG cinder.volume.manager [None req-7e5c4dc8-c00f-40d5-aa8f-5c16387efc11 tempest-CreateVolumesFromImageTest-720201122 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2b7fcc31-b2e1-4675-89b2-665647539aab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83259) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 15:24:56 devstack cinder-volume[83259]: DEBUG cinder.volume.manager [None req-7e5c4dc8-c00f-40d5-aa8f-5c16387efc11 tempest-CreateVolumesFromImageTest-720201122 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2b7fcc31-b2e1-4675-89b2-665647539aab) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '80f07420-429d-4da3-8050-09d3953830bd', 'volume_name': 'volume-80f07420-429d-4da3-8050-09d3953830bd', 'volume_size': 1}' {{(pid=83259) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 15:24:56 devstack cinder-volume[83259]: DEBUG cinder.volume.manager [None req-7e5c4dc8-c00f-40d5-aa8f-5c16387efc11 tempest-CreateVolumesFromImageTest-720201122 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e7ba9099-7d36-4fa9-aecc-f9d749a5aa80) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83259) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 15:24:56 devstack cinder-volume[83259]: DEBUG cinder.volume.manager [None req-7e5c4dc8-c00f-40d5-aa8f-5c16387efc11 tempest-CreateVolumesFromImageTest-720201122 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e7ba9099-7d36-4fa9-aecc-f9d749a5aa80) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83259) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 15:24:56 devstack cinder-volume[83259]: DEBUG cinder.volume.manager [None req-7e5c4dc8-c00f-40d5-aa8f-5c16387efc11 tempest-CreateVolumesFromImageTest-720201122 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9f4694b1-c300-41a1-a9c9-e0503f0057aa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83259) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 15:24:56 devstack cinder-volume[83259]: INFO cinder.volume.flows.manager.create_volume [None req-7e5c4dc8-c00f-40d5-aa8f-5c16387efc11 tempest-CreateVolumesFromImageTest-720201122 None] Volume 80f07420-429d-4da3-8050-09d3953830bd: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-80f07420-429d-4da3-8050-09d3953830bd', 'volume_size': 1} Sep 16 15:24:56 devstack cinder-volume[83259]: DEBUG oslo_concurrency.lockutils [None req-7e5c4dc8-c00f-40d5-aa8f-5c16387efc11 tempest-CreateVolumesFromImageTest-720201122 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83259) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 16 15:24:56 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [None req-50083ccb-3a01-418e-bbef-e4978f541ae0 tempest-CreateVolumesFromImageTest-720201122 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c/volume-35e9c3e3-9b63-4e02-a4c6-17e57dd4cd51" returned: 0 in 0.524s {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 15:24:56 devstack cinder-volume[83259]: DEBUG cinder.volume.drivers.quobyte [None req-50083ccb-3a01-418e-bbef-e4978f541ae0 tempest-CreateVolumesFromImageTest-720201122 None] <== create_volume: return (1325ms) {'provider_location': '10.10.41.181/cinder-vol-61f585ac-f8e2-4d19-a890-7ebc2726cc72'} {{(pid=83259) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Sep 16 15:24:56 devstack cinder-volume[83259]: DEBUG oslo_concurrency.lockutils [None req-50083ccb-3a01-418e-bbef-e4978f541ae0 tempest-CreateVolumesFromImageTest-720201122 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.332s {{(pid=83259) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 16 15:24:56 devstack cinder-volume[83259]: INFO cinder.volume.manager [None req-13ca7806-f23c-4b2d-8f7e-32c2b50004db tempest-CreateVolumesFromSourceVolumeTest-644256109 None] Created volume successfully. Sep 16 15:24:57 devstack cinder-volume[83259]: DEBUG oslo_concurrency.lockutils [None req-4908b669-d3fe-43a5-87f1-fd8b26b67dd9 tempest-CreateVolumesFromImageTest-720201122 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.586s {{(pid=83259) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 16 15:24:57 devstack cinder-volume[83259]: DEBUG cinder.volume.drivers.quobyte [None req-4908b669-d3fe-43a5-87f1-fd8b26b67dd9 tempest-CreateVolumesFromImageTest-720201122 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-16T13:24:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-393622737',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#Quobyte',id=c25ac34f-86c7-4df0-b2f8-626cd2fd6a3e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8bd04cfd64064ab8a87507b6a2b87d14',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-16T13:24:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-16T13:24:54Z,use_quota=True,user_id='46e7349c0f454da8b9fda7da82a040a4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(485ead50-3df8-4d76-8d34-a4db136c980a),volume_type_id=485ead50-3df8-4d76-8d34-a4db136c980a)}" {{(pid=83259) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Sep 16 15:24:57 devstack cinder-volume[83259]: DEBUG cinder.volume.drivers.remotefs [None req-4908b669-d3fe-43a5-87f1-fd8b26b67dd9 tempest-CreateVolumesFromImageTest-720201122 None] Creating volume c25ac34f-86c7-4df0-b2f8-626cd2fd6a3e {{(pid=83259) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}} Sep 16 15:24:57 devstack cinder-volume[83259]: DEBUG oslo_concurrency.lockutils [None req-4908b669-d3fe-43a5-87f1-fd8b26b67dd9 tempest-CreateVolumesFromImageTest-720201122 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83259) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 16 15:24:57 devstack cinder-volume[83259]: DEBUG oslo_concurrency.lockutils [None req-4908b669-d3fe-43a5-87f1-fd8b26b67dd9 tempest-CreateVolumesFromImageTest-720201122 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83259) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 16 15:24:57 devstack cinder-volume[83259]: DEBUG cinder.volume.drivers.quobyte [None req-4908b669-d3fe-43a5-87f1-fd8b26b67dd9 tempest-CreateVolumesFromImageTest-720201122 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-61f585ac-f8e2-4d19-a890-7ebc2726cc72': None} {{(pid=83259) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:639}} Sep 16 15:24:57 devstack cinder-volume[83259]: DEBUG cinder.volume.drivers.quobyte [None req-4908b669-d3fe-43a5-87f1-fd8b26b67dd9 tempest-CreateVolumesFromImageTest-720201122 None] Available shares ['10.10.41.181/cinder-vol-61f585ac-f8e2-4d19-a890-7ebc2726cc72'] {{(pid=83259) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:669}} Sep 16 15:24:57 devstack cinder-volume[83259]: DEBUG oslo_concurrency.lockutils [None req-4908b669-d3fe-43a5-87f1-fd8b26b67dd9 tempest-CreateVolumesFromImageTest-720201122 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=83259) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 16 15:24:57 devstack cinder-volume[83259]: DEBUG cinder.volume.drivers.quobyte [None req-4908b669-d3fe-43a5-87f1-fd8b26b67dd9 tempest-CreateVolumesFromImageTest-720201122 None] Selected 10.10.41.181/cinder-vol-61f585ac-f8e2-4d19-a890-7ebc2726cc72 as target Quobyte volume. {{(pid=83259) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:690}} Sep 16 15:24:57 devstack cinder-volume[83259]: INFO cinder.volume.drivers.remotefs [None req-4908b669-d3fe-43a5-87f1-fd8b26b67dd9 tempest-CreateVolumesFromImageTest-720201122 None] casted to 10.10.41.181/cinder-vol-61f585ac-f8e2-4d19-a890-7ebc2726cc72 Sep 16 15:24:57 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [None req-4908b669-d3fe-43a5-87f1-fd8b26b67dd9 tempest-CreateVolumesFromImageTest-720201122 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c/volume-c25ac34f-86c7-4df0-b2f8-626cd2fd6a3e 1073741824 {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 15:24:57 devstack quobyte-client[83286]: System call of process 99962 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 16 15:24:57 devstack quobyte-client[83286]: The server volume:87712ffe-8a69-446d-9ed6-4430c7ee9792@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=87712ffe-8a69-446d-9ed6-4430c7ee9792, inode=148, name=volume-c25ac34f-86c7-4df0-b2f8-626cd2fd6a3e, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.206), requestorAccessMask=0 Sep 16 15:24:57 devstack cinder-volume[83259]: DEBUG cinder.volume.manager [None req-50083ccb-3a01-418e-bbef-e4978f541ae0 tempest-CreateVolumesFromImageTest-720201122 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1f49dd4d-2ea5-44e0-93c4-807f11d2a2d3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-35e9c3e3-9b63-4e02-a4c6-17e57dd4cd51', 'volume_size': 1}' {{(pid=83259) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 15:24:57 devstack cinder-volume[83259]: DEBUG cinder.volume.manager [None req-50083ccb-3a01-418e-bbef-e4978f541ae0 tempest-CreateVolumesFromImageTest-720201122 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (658fb7d6-c913-42c7-b5cd-caa8d2fff452) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83259) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 15:24:57 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [None req-4908b669-d3fe-43a5-87f1-fd8b26b67dd9 tempest-CreateVolumesFromImageTest-720201122 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c/volume-c25ac34f-86c7-4df0-b2f8-626cd2fd6a3e 1073741824" returned: 0 in 0.567s {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 15:24:57 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [None req-4908b669-d3fe-43a5-87f1-fd8b26b67dd9 tempest-CreateVolumesFromImageTest-720201122 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c/volume-c25ac34f-86c7-4df0-b2f8-626cd2fd6a3e {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 15:24:57 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [None req-4908b669-d3fe-43a5-87f1-fd8b26b67dd9 tempest-CreateVolumesFromImageTest-720201122 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c/volume-c25ac34f-86c7-4df0-b2f8-626cd2fd6a3e" returned: 0 in 0.256s {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 15:24:57 devstack cinder-volume[83259]: DEBUG cinder.volume.drivers.quobyte [None req-4908b669-d3fe-43a5-87f1-fd8b26b67dd9 tempest-CreateVolumesFromImageTest-720201122 None] <== create_volume: return (887ms) {'provider_location': '10.10.41.181/cinder-vol-61f585ac-f8e2-4d19-a890-7ebc2726cc72'} {{(pid=83259) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Sep 16 15:24:57 devstack cinder-volume[83259]: DEBUG oslo_concurrency.lockutils [None req-4908b669-d3fe-43a5-87f1-fd8b26b67dd9 tempest-CreateVolumesFromImageTest-720201122 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.910s {{(pid=83259) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 16 15:24:58 devstack cinder-volume[83259]: DEBUG oslo_concurrency.lockutils [None req-4a8b8646-b69d-428e-87f6-77fb7ad625e4 tempest-CreateVolumesFromImageTest-720201122 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.357s {{(pid=83259) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 16 15:24:58 devstack cinder-volume[83259]: DEBUG cinder.volume.drivers.quobyte [None req-4a8b8646-b69d-428e-87f6-77fb7ad625e4 tempest-CreateVolumesFromImageTest-720201122 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-16T13:24:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1474275937',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#Quobyte',id=60d0bb78-46e4-4e37-bf47-96e6428b635e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8bd04cfd64064ab8a87507b6a2b87d14',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-16T13:24:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-16T13:24:53Z,use_quota=True,user_id='46e7349c0f454da8b9fda7da82a040a4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(485ead50-3df8-4d76-8d34-a4db136c980a),volume_type_id=485ead50-3df8-4d76-8d34-a4db136c980a)}" {{(pid=83259) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Sep 16 15:24:58 devstack cinder-volume[83259]: DEBUG cinder.volume.drivers.remotefs [None req-4a8b8646-b69d-428e-87f6-77fb7ad625e4 tempest-CreateVolumesFromImageTest-720201122 None] Creating volume 60d0bb78-46e4-4e37-bf47-96e6428b635e {{(pid=83259) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}} Sep 16 15:24:58 devstack cinder-volume[83259]: DEBUG oslo_concurrency.lockutils [None req-4a8b8646-b69d-428e-87f6-77fb7ad625e4 tempest-CreateVolumesFromImageTest-720201122 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83259) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 16 15:24:58 devstack cinder-volume[83259]: DEBUG oslo_concurrency.lockutils [None req-4a8b8646-b69d-428e-87f6-77fb7ad625e4 tempest-CreateVolumesFromImageTest-720201122 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=83259) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 16 15:24:58 devstack cinder-volume[83259]: DEBUG cinder.volume.drivers.quobyte [None req-4a8b8646-b69d-428e-87f6-77fb7ad625e4 tempest-CreateVolumesFromImageTest-720201122 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-61f585ac-f8e2-4d19-a890-7ebc2726cc72': None} {{(pid=83259) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:639}} Sep 16 15:24:58 devstack cinder-volume[83259]: DEBUG cinder.volume.drivers.quobyte [None req-4a8b8646-b69d-428e-87f6-77fb7ad625e4 tempest-CreateVolumesFromImageTest-720201122 None] Available shares ['10.10.41.181/cinder-vol-61f585ac-f8e2-4d19-a890-7ebc2726cc72'] {{(pid=83259) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:669}} Sep 16 15:24:58 devstack cinder-volume[83259]: DEBUG oslo_concurrency.lockutils [None req-4a8b8646-b69d-428e-87f6-77fb7ad625e4 tempest-CreateVolumesFromImageTest-720201122 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=83259) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 16 15:24:58 devstack cinder-volume[83259]: DEBUG cinder.volume.drivers.quobyte [None req-4a8b8646-b69d-428e-87f6-77fb7ad625e4 tempest-CreateVolumesFromImageTest-720201122 None] Selected 10.10.41.181/cinder-vol-61f585ac-f8e2-4d19-a890-7ebc2726cc72 as target Quobyte volume. {{(pid=83259) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:690}} Sep 16 15:24:58 devstack cinder-volume[83259]: INFO cinder.volume.drivers.remotefs [None req-4a8b8646-b69d-428e-87f6-77fb7ad625e4 tempest-CreateVolumesFromImageTest-720201122 None] casted to 10.10.41.181/cinder-vol-61f585ac-f8e2-4d19-a890-7ebc2726cc72 Sep 16 15:24:58 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [None req-4a8b8646-b69d-428e-87f6-77fb7ad625e4 tempest-CreateVolumesFromImageTest-720201122 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c/volume-60d0bb78-46e4-4e37-bf47-96e6428b635e 1073741824 {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 15:24:58 devstack cinder-volume[83259]: INFO cinder.volume.flows.manager.create_volume [None req-50083ccb-3a01-418e-bbef-e4978f541ae0 tempest-CreateVolumesFromImageTest-720201122 None] Volume volume-35e9c3e3-9b63-4e02-a4c6-17e57dd4cd51 (35e9c3e3-9b63-4e02-a4c6-17e57dd4cd51): created successfully Sep 16 15:24:58 devstack cinder-volume[83259]: DEBUG cinder.volume.manager [None req-50083ccb-3a01-418e-bbef-e4978f541ae0 tempest-CreateVolumesFromImageTest-720201122 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (658fb7d6-c913-42c7-b5cd-caa8d2fff452) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83259) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 15:24:58 devstack quobyte-client[83286]: The server volume:87712ffe-8a69-446d-9ed6-4430c7ee9792@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=87712ffe-8a69-446d-9ed6-4430c7ee9792, inode=149, name=volume-60d0bb78-46e4-4e37-bf47-96e6428b635e, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.206), requestorAccessMask=0 Sep 16 15:24:58 devstack cinder-volume[83259]: DEBUG cinder.volume.manager [None req-50083ccb-3a01-418e-bbef-e4978f541ae0 tempest-CreateVolumesFromImageTest-720201122 None] Flow 'volume_create_manager' (e97bc5fa-933d-4c00-839f-33e43501c58f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83259) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 16 15:24:58 devstack cinder-volume[83259]: INFO cinder.volume.manager [None req-50083ccb-3a01-418e-bbef-e4978f541ae0 tempest-CreateVolumesFromImageTest-720201122 None] Created volume successfully. Sep 16 15:24:58 devstack cinder-volume[83259]: DEBUG cinder.volume.manager [None req-4908b669-d3fe-43a5-87f1-fd8b26b67dd9 tempest-CreateVolumesFromImageTest-720201122 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (61edeb73-b680-4e98-91d7-e0d8553ed3d6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c25ac34f-86c7-4df0-b2f8-626cd2fd6a3e', 'volume_size': 1}' {{(pid=83259) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 15:24:58 devstack cinder-volume[83259]: DEBUG cinder.volume.manager [None req-4908b669-d3fe-43a5-87f1-fd8b26b67dd9 tempest-CreateVolumesFromImageTest-720201122 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0784c641-76a8-4e6b-b19e-b921701df717) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83259) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 15:24:58 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [None req-4a8b8646-b69d-428e-87f6-77fb7ad625e4 tempest-CreateVolumesFromImageTest-720201122 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c/volume-60d0bb78-46e4-4e37-bf47-96e6428b635e 1073741824" returned: 0 in 0.774s {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 15:24:58 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [None req-4a8b8646-b69d-428e-87f6-77fb7ad625e4 tempest-CreateVolumesFromImageTest-720201122 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c/volume-60d0bb78-46e4-4e37-bf47-96e6428b635e {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 15:24:59 devstack cinder-volume[83259]: WARNING cinder.volume.volume_utils [None req-94631229-3d2c-47c3-8517-24810eec3332 tempest-CreateVolumesFromSourceVolumeTest-644256109 None] Volume driver (QuobyteDriver 1.2) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 16 15:24:59 devstack cinder-volume[83259]: DEBUG cinder.volume.flows.manager.create_volume [None req-94631229-3d2c-47c3-8517-24810eec3332 tempest-CreateVolumesFromSourceVolumeTest-644256109 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#Quobyte'], 'hosts': ['devstack@QuobyteHD#Quobyte']} {{(pid=83259) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1387}} Sep 16 15:24:59 devstack cinder-volume[83259]: DEBUG cinder.volume.manager [None req-94631229-3d2c-47c3-8517-24810eec3332 tempest-CreateVolumesFromSourceVolumeTest-644256109 None] Flow 'volume_create_manager' (27fe02ac-6668-4973-bc69-727cd874d6ec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83259) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 16 15:24:59 devstack cinder-volume[83259]: DEBUG cinder.volume.manager [None req-94631229-3d2c-47c3-8517-24810eec3332 tempest-CreateVolumesFromSourceVolumeTest-644256109 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (853020f9-331b-4751-9a16-458195de20a6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83259) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 15:24:59 devstack cinder-volume[83259]: INFO cinder.volume.flows.manager.create_volume [None req-4908b669-d3fe-43a5-87f1-fd8b26b67dd9 tempest-CreateVolumesFromImageTest-720201122 None] Volume volume-c25ac34f-86c7-4df0-b2f8-626cd2fd6a3e (c25ac34f-86c7-4df0-b2f8-626cd2fd6a3e): created successfully Sep 16 15:24:59 devstack cinder-volume[83259]: DEBUG cinder.volume.manager [None req-4908b669-d3fe-43a5-87f1-fd8b26b67dd9 tempest-CreateVolumesFromImageTest-720201122 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0784c641-76a8-4e6b-b19e-b921701df717) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83259) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 15:24:59 devstack cinder-volume[83259]: DEBUG cinder.volume.manager [None req-4908b669-d3fe-43a5-87f1-fd8b26b67dd9 tempest-CreateVolumesFromImageTest-720201122 None] Flow 'volume_create_manager' (3108fef4-ea2d-4989-84f2-b908d9c4e9b2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83259) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 16 15:24:59 devstack cinder-volume[83259]: DEBUG cinder.volume.manager [None req-94631229-3d2c-47c3-8517-24810eec3332 tempest-CreateVolumesFromSourceVolumeTest-644256109 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (853020f9-331b-4751-9a16-458195de20a6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-16T13:24:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-261275269',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#Quobyte',id=61142dde-da13-4e27-bba5-bb03c06e2c70,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b047c692efbd4022b3cea93b0d5b9c2a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-16T13:24:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-16T13:24:58Z,use_quota=True,user_id='d83e020b86574dd1a77b0be23e17d7cf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(485ead50-3df8-4d76-8d34-a4db136c980a),volume_type_id=485ead50-3df8-4d76-8d34-a4db136c980a)' {{(pid=83259) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 15:24:59 devstack cinder-volume[83259]: DEBUG cinder.volume.manager [None req-94631229-3d2c-47c3-8517-24810eec3332 tempest-CreateVolumesFromSourceVolumeTest-644256109 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3f069f4b-8202-42d4-92a4-dc869a36011e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83259) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 15:24:59 devstack cinder-volume[83259]: DEBUG cinder.volume.manager [None req-94631229-3d2c-47c3-8517-24810eec3332 tempest-CreateVolumesFromSourceVolumeTest-644256109 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3f069f4b-8202-42d4-92a4-dc869a36011e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83259) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 15:24:59 devstack cinder-volume[83259]: DEBUG cinder.volume.manager [None req-94631229-3d2c-47c3-8517-24810eec3332 tempest-CreateVolumesFromSourceVolumeTest-644256109 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3bf563a4-72de-41f5-947b-710b3a780e3c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83259) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 15:24:59 devstack cinder-volume[83259]: DEBUG cinder.volume.manager [None req-94631229-3d2c-47c3-8517-24810eec3332 tempest-CreateVolumesFromSourceVolumeTest-644256109 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3bf563a4-72de-41f5-947b-710b3a780e3c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '61142dde-da13-4e27-bba5-bb03c06e2c70', 'volume_name': 'volume-61142dde-da13-4e27-bba5-bb03c06e2c70', 'volume_size': 1}' {{(pid=83259) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 15:24:59 devstack cinder-volume[83259]: DEBUG cinder.volume.manager [None req-94631229-3d2c-47c3-8517-24810eec3332 tempest-CreateVolumesFromSourceVolumeTest-644256109 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b48c7796-f101-4550-8300-af5ad754a9de) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83259) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 15:24:59 devstack cinder-volume[83259]: DEBUG cinder.volume.manager [None req-94631229-3d2c-47c3-8517-24810eec3332 tempest-CreateVolumesFromSourceVolumeTest-644256109 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b48c7796-f101-4550-8300-af5ad754a9de) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83259) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 15:24:59 devstack cinder-volume[83259]: DEBUG cinder.volume.manager [None req-94631229-3d2c-47c3-8517-24810eec3332 tempest-CreateVolumesFromSourceVolumeTest-644256109 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (78654612-1fc9-49ab-81a6-6d58b4a612b7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83259) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 15:24:59 devstack cinder-volume[83259]: INFO cinder.volume.flows.manager.create_volume [None req-94631229-3d2c-47c3-8517-24810eec3332 tempest-CreateVolumesFromSourceVolumeTest-644256109 None] Volume 61142dde-da13-4e27-bba5-bb03c06e2c70: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-61142dde-da13-4e27-bba5-bb03c06e2c70', 'volume_size': 1} Sep 16 15:24:59 devstack cinder-volume[83259]: DEBUG oslo_concurrency.lockutils [None req-94631229-3d2c-47c3-8517-24810eec3332 tempest-CreateVolumesFromSourceVolumeTest-644256109 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83259) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 16 15:24:59 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [None req-4a8b8646-b69d-428e-87f6-77fb7ad625e4 tempest-CreateVolumesFromImageTest-720201122 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c/volume-60d0bb78-46e4-4e37-bf47-96e6428b635e" returned: 0 in 1.025s {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 15:24:59 devstack cinder-volume[83259]: DEBUG cinder.volume.drivers.quobyte [None req-4a8b8646-b69d-428e-87f6-77fb7ad625e4 tempest-CreateVolumesFromImageTest-720201122 None] <== create_volume: return (1844ms) {'provider_location': '10.10.41.181/cinder-vol-61f585ac-f8e2-4d19-a890-7ebc2726cc72'} {{(pid=83259) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Sep 16 15:24:59 devstack cinder-volume[83259]: DEBUG oslo_concurrency.lockutils [None req-4a8b8646-b69d-428e-87f6-77fb7ad625e4 tempest-CreateVolumesFromImageTest-720201122 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.865s {{(pid=83259) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 16 15:24:59 devstack cinder-volume[83259]: DEBUG oslo_concurrency.lockutils [None req-432f1e3d-8d32-4413-af4c-5f29aaba3cdc tempest-CreateVolumesFromImageTest-720201122 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.550s {{(pid=83259) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 16 15:24:59 devstack cinder-volume[83259]: DEBUG cinder.volume.drivers.quobyte [None req-432f1e3d-8d32-4413-af4c-5f29aaba3cdc tempest-CreateVolumesFromImageTest-720201122 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-16T13:24:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1172967727',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#Quobyte',id=cbc2bd98-4f5b-49cb-8fe2-8cd876ca4b47,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8bd04cfd64064ab8a87507b6a2b87d14',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-16T13:24:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-16T13:24:55Z,use_quota=True,user_id='46e7349c0f454da8b9fda7da82a040a4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(485ead50-3df8-4d76-8d34-a4db136c980a),volume_type_id=485ead50-3df8-4d76-8d34-a4db136c980a)}" {{(pid=83259) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Sep 16 15:24:59 devstack cinder-volume[83259]: DEBUG cinder.volume.drivers.remotefs [None req-432f1e3d-8d32-4413-af4c-5f29aaba3cdc tempest-CreateVolumesFromImageTest-720201122 None] Creating volume cbc2bd98-4f5b-49cb-8fe2-8cd876ca4b47 {{(pid=83259) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}} Sep 16 15:24:59 devstack cinder-volume[83259]: DEBUG oslo_concurrency.lockutils [None req-432f1e3d-8d32-4413-af4c-5f29aaba3cdc tempest-CreateVolumesFromImageTest-720201122 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83259) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 16 15:24:59 devstack cinder-volume[83259]: DEBUG oslo_concurrency.lockutils [None req-432f1e3d-8d32-4413-af4c-5f29aaba3cdc tempest-CreateVolumesFromImageTest-720201122 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83259) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 16 15:24:59 devstack cinder-volume[83259]: DEBUG cinder.volume.drivers.quobyte [None req-432f1e3d-8d32-4413-af4c-5f29aaba3cdc tempest-CreateVolumesFromImageTest-720201122 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-61f585ac-f8e2-4d19-a890-7ebc2726cc72': None} {{(pid=83259) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:639}} Sep 16 15:24:59 devstack cinder-volume[83259]: DEBUG cinder.volume.drivers.quobyte [None req-432f1e3d-8d32-4413-af4c-5f29aaba3cdc tempest-CreateVolumesFromImageTest-720201122 None] Available shares ['10.10.41.181/cinder-vol-61f585ac-f8e2-4d19-a890-7ebc2726cc72'] {{(pid=83259) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:669}} Sep 16 15:24:59 devstack cinder-volume[83259]: DEBUG oslo_concurrency.lockutils [None req-432f1e3d-8d32-4413-af4c-5f29aaba3cdc tempest-CreateVolumesFromImageTest-720201122 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=83259) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 16 15:24:59 devstack cinder-volume[83259]: DEBUG cinder.volume.drivers.quobyte [None req-432f1e3d-8d32-4413-af4c-5f29aaba3cdc tempest-CreateVolumesFromImageTest-720201122 None] Selected 10.10.41.181/cinder-vol-61f585ac-f8e2-4d19-a890-7ebc2726cc72 as target Quobyte volume. {{(pid=83259) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:690}} Sep 16 15:24:59 devstack cinder-volume[83259]: INFO cinder.volume.drivers.remotefs [None req-432f1e3d-8d32-4413-af4c-5f29aaba3cdc tempest-CreateVolumesFromImageTest-720201122 None] casted to 10.10.41.181/cinder-vol-61f585ac-f8e2-4d19-a890-7ebc2726cc72 Sep 16 15:24:59 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [None req-432f1e3d-8d32-4413-af4c-5f29aaba3cdc tempest-CreateVolumesFromImageTest-720201122 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c/volume-cbc2bd98-4f5b-49cb-8fe2-8cd876ca4b47 1073741824 {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 15:25:00 devstack cinder-volume[83259]: INFO cinder.volume.manager [None req-4908b669-d3fe-43a5-87f1-fd8b26b67dd9 tempest-CreateVolumesFromImageTest-720201122 None] Created volume successfully. Sep 16 15:25:00 devstack quobyte-client[83286]: System call of process 99970 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 16 15:25:00 devstack quobyte-client[83286]: The server volume:87712ffe-8a69-446d-9ed6-4430c7ee9792@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=87712ffe-8a69-446d-9ed6-4430c7ee9792, inode=150, name=volume-cbc2bd98-4f5b-49cb-8fe2-8cd876ca4b47, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.206), requestorAccessMask=0 Sep 16 15:25:00 devstack cinder-volume[83259]: DEBUG cinder.volume.manager [None req-4a8b8646-b69d-428e-87f6-77fb7ad625e4 tempest-CreateVolumesFromImageTest-720201122 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (17ca9ac9-17e8-47e9-ace1-93429c72a2ce) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-60d0bb78-46e4-4e37-bf47-96e6428b635e', 'volume_size': 1}' {{(pid=83259) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 15:25:00 devstack cinder-volume[83259]: DEBUG cinder.volume.manager [None req-4a8b8646-b69d-428e-87f6-77fb7ad625e4 tempest-CreateVolumesFromImageTest-720201122 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (eb60dcb0-fcb5-4288-84ad-1fb4f600ed3d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83259) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 15:25:00 devstack cinder-volume[83259]: WARNING cinder.volume.volume_utils [None req-6a80f0aa-df9a-4e50-94c4-7759c077bf44 tempest-CreateVolumesFromSourceVolumeTest-644256109 None] Volume driver (QuobyteDriver 1.2) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 16 15:25:00 devstack cinder-volume[83259]: DEBUG cinder.volume.flows.manager.create_volume [None req-6a80f0aa-df9a-4e50-94c4-7759c077bf44 tempest-CreateVolumesFromSourceVolumeTest-644256109 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#Quobyte'], 'hosts': ['devstack@QuobyteHD#Quobyte']} {{(pid=83259) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1387}} Sep 16 15:25:00 devstack cinder-volume[83259]: DEBUG cinder.volume.manager [None req-6a80f0aa-df9a-4e50-94c4-7759c077bf44 tempest-CreateVolumesFromSourceVolumeTest-644256109 None] Flow 'volume_create_manager' (18d2dbd6-c86e-48d7-9a24-a16b8f8cea7a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83259) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 16 15:25:00 devstack cinder-volume[83259]: DEBUG cinder.volume.manager [None req-6a80f0aa-df9a-4e50-94c4-7759c077bf44 tempest-CreateVolumesFromSourceVolumeTest-644256109 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9a4e3c17-3b37-4b80-9135-3576214cbdb4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83259) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 15:25:00 devstack cinder-volume[83259]: INFO cinder.volume.flows.manager.create_volume [None req-4a8b8646-b69d-428e-87f6-77fb7ad625e4 tempest-CreateVolumesFromImageTest-720201122 None] Volume volume-60d0bb78-46e4-4e37-bf47-96e6428b635e (60d0bb78-46e4-4e37-bf47-96e6428b635e): created successfully Sep 16 15:25:00 devstack cinder-volume[83259]: DEBUG cinder.volume.manager [None req-4a8b8646-b69d-428e-87f6-77fb7ad625e4 tempest-CreateVolumesFromImageTest-720201122 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (eb60dcb0-fcb5-4288-84ad-1fb4f600ed3d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83259) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 15:25:00 devstack cinder-volume[83259]: DEBUG cinder.volume.manager [None req-4a8b8646-b69d-428e-87f6-77fb7ad625e4 tempest-CreateVolumesFromImageTest-720201122 None] Flow 'volume_create_manager' (84467aa0-e739-4714-854a-53ed9d3e5ccd) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83259) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 16 15:25:00 devstack cinder-volume[83259]: WARNING cinder.volume.volume_utils [None req-dfee0bd4-8a0f-4239-8933-e9b1aa542413 tempest-CreateVolumesFromSourceVolumeTest-644256109 None] Volume driver (QuobyteDriver 1.2) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 16 15:25:00 devstack cinder-volume[83259]: DEBUG cinder.volume.flows.manager.create_volume [None req-dfee0bd4-8a0f-4239-8933-e9b1aa542413 tempest-CreateVolumesFromSourceVolumeTest-644256109 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#Quobyte'], 'hosts': ['devstack@QuobyteHD#Quobyte']} {{(pid=83259) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1387}} Sep 16 15:25:01 devstack cinder-volume[83259]: DEBUG cinder.volume.manager [None req-dfee0bd4-8a0f-4239-8933-e9b1aa542413 tempest-CreateVolumesFromSourceVolumeTest-644256109 None] Flow 'volume_create_manager' (34afd806-6fc6-44dd-b42c-5de82ba9b116) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83259) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 16 15:25:01 devstack cinder-volume[83259]: DEBUG cinder.volume.manager [None req-dfee0bd4-8a0f-4239-8933-e9b1aa542413 tempest-CreateVolumesFromSourceVolumeTest-644256109 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b6368f61-5770-4373-bc72-0590fb9e1473) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83259) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 15:25:01 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [None req-432f1e3d-8d32-4413-af4c-5f29aaba3cdc tempest-CreateVolumesFromImageTest-720201122 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c/volume-cbc2bd98-4f5b-49cb-8fe2-8cd876ca4b47 1073741824" returned: 0 in 1.097s {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 15:25:01 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [None req-432f1e3d-8d32-4413-af4c-5f29aaba3cdc tempest-CreateVolumesFromImageTest-720201122 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c/volume-cbc2bd98-4f5b-49cb-8fe2-8cd876ca4b47 {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 15:25:01 devstack cinder-volume[83259]: INFO cinder.volume.manager [None req-4a8b8646-b69d-428e-87f6-77fb7ad625e4 tempest-CreateVolumesFromImageTest-720201122 None] Created volume successfully. Sep 16 15:25:01 devstack cinder-volume[83259]: WARNING cinder.volume.volume_utils [None req-cdc6a31c-900a-4562-9ef7-5a51bf2653b0 tempest-CreateVolumesFromSourceVolumeTest-644256109 None] Volume driver (QuobyteDriver 1.2) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 16 15:25:01 devstack cinder-volume[83259]: DEBUG cinder.volume.flows.manager.create_volume [None req-cdc6a31c-900a-4562-9ef7-5a51bf2653b0 tempest-CreateVolumesFromSourceVolumeTest-644256109 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#Quobyte'], 'hosts': ['devstack@QuobyteHD#Quobyte']} {{(pid=83259) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1387}} Sep 16 15:25:01 devstack cinder-volume[83259]: DEBUG cinder.volume.manager [None req-cdc6a31c-900a-4562-9ef7-5a51bf2653b0 tempest-CreateVolumesFromSourceVolumeTest-644256109 None] Flow 'volume_create_manager' (ef0a26b6-19d9-4317-88ff-d458df9dc488) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83259) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 16 15:25:01 devstack cinder-volume[83259]: DEBUG cinder.volume.manager [None req-cdc6a31c-900a-4562-9ef7-5a51bf2653b0 tempest-CreateVolumesFromSourceVolumeTest-644256109 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fd5cec03-9763-4f2d-941c-79dc8f1ecd4b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83259) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 15:25:01 devstack cinder-volume[83259]: DEBUG cinder.volume.manager [None req-6a80f0aa-df9a-4e50-94c4-7759c077bf44 tempest-CreateVolumesFromSourceVolumeTest-644256109 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9a4e3c17-3b37-4b80-9135-3576214cbdb4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-16T13:24:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1332374052',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#Quobyte',id=b9495b05-d0ef-4c4c-961a-d54de3d64117,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b047c692efbd4022b3cea93b0d5b9c2a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-16T13:24:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-16T13:24:59Z,use_quota=True,user_id='d83e020b86574dd1a77b0be23e17d7cf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(485ead50-3df8-4d76-8d34-a4db136c980a),volume_type_id=485ead50-3df8-4d76-8d34-a4db136c980a)' {{(pid=83259) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 15:25:01 devstack cinder-volume[83259]: DEBUG cinder.volume.manager [None req-6a80f0aa-df9a-4e50-94c4-7759c077bf44 tempest-CreateVolumesFromSourceVolumeTest-644256109 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (98cb1aa6-2156-4b27-8ab0-4c6e7c95b15d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83259) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 15:25:01 devstack cinder-volume[83259]: DEBUG cinder.volume.manager [None req-6a80f0aa-df9a-4e50-94c4-7759c077bf44 tempest-CreateVolumesFromSourceVolumeTest-644256109 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (98cb1aa6-2156-4b27-8ab0-4c6e7c95b15d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83259) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 15:25:01 devstack cinder-volume[83259]: DEBUG cinder.volume.manager [None req-6a80f0aa-df9a-4e50-94c4-7759c077bf44 tempest-CreateVolumesFromSourceVolumeTest-644256109 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4cd18fd7-2371-4d95-9f96-d506761bf381) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83259) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 15:25:01 devstack cinder-volume[83259]: DEBUG cinder.volume.manager [None req-6a80f0aa-df9a-4e50-94c4-7759c077bf44 tempest-CreateVolumesFromSourceVolumeTest-644256109 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4cd18fd7-2371-4d95-9f96-d506761bf381) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b9495b05-d0ef-4c4c-961a-d54de3d64117', 'volume_name': 'volume-b9495b05-d0ef-4c4c-961a-d54de3d64117', 'volume_size': 1}' {{(pid=83259) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 15:25:01 devstack cinder-volume[83259]: DEBUG cinder.volume.manager [None req-6a80f0aa-df9a-4e50-94c4-7759c077bf44 tempest-CreateVolumesFromSourceVolumeTest-644256109 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8ec0c239-8d10-4f98-8edd-4571736699ed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83259) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 15:25:02 devstack cinder-volume[83259]: DEBUG cinder.volume.manager [None req-6a80f0aa-df9a-4e50-94c4-7759c077bf44 tempest-CreateVolumesFromSourceVolumeTest-644256109 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8ec0c239-8d10-4f98-8edd-4571736699ed) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83259) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 15:25:02 devstack cinder-volume[83259]: DEBUG cinder.volume.manager [None req-6a80f0aa-df9a-4e50-94c4-7759c077bf44 tempest-CreateVolumesFromSourceVolumeTest-644256109 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (43f61ac3-2018-481c-a7c7-473358dd2233) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83259) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 15:25:02 devstack cinder-volume[83259]: INFO cinder.volume.flows.manager.create_volume [None req-6a80f0aa-df9a-4e50-94c4-7759c077bf44 tempest-CreateVolumesFromSourceVolumeTest-644256109 None] Volume b9495b05-d0ef-4c4c-961a-d54de3d64117: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b9495b05-d0ef-4c4c-961a-d54de3d64117', 'volume_size': 1} Sep 16 15:25:02 devstack cinder-volume[83259]: DEBUG oslo_concurrency.lockutils [None req-6a80f0aa-df9a-4e50-94c4-7759c077bf44 tempest-CreateVolumesFromSourceVolumeTest-644256109 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83259) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 16 15:25:02 devstack cinder-volume[83259]: DEBUG cinder.volume.manager [None req-dfee0bd4-8a0f-4239-8933-e9b1aa542413 tempest-CreateVolumesFromSourceVolumeTest-644256109 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b6368f61-5770-4373-bc72-0590fb9e1473) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-16T13:24:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1183059857',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#Quobyte',id=a0f1de91-d70d-4895-9dd1-d8768daf622f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b047c692efbd4022b3cea93b0d5b9c2a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-16T13:25:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-16T13:25:00Z,use_quota=True,user_id='d83e020b86574dd1a77b0be23e17d7cf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(485ead50-3df8-4d76-8d34-a4db136c980a),volume_type_id=485ead50-3df8-4d76-8d34-a4db136c980a)' {{(pid=83259) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 15:25:02 devstack cinder-volume[83259]: DEBUG cinder.volume.manager [None req-dfee0bd4-8a0f-4239-8933-e9b1aa542413 tempest-CreateVolumesFromSourceVolumeTest-644256109 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (26ae5bd7-30f1-4b96-8ea3-09afda584e0e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83259) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 15:25:02 devstack cinder-volume[83259]: DEBUG cinder.volume.manager [None req-dfee0bd4-8a0f-4239-8933-e9b1aa542413 tempest-CreateVolumesFromSourceVolumeTest-644256109 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (26ae5bd7-30f1-4b96-8ea3-09afda584e0e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83259) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 15:25:02 devstack cinder-volume[83259]: DEBUG cinder.volume.manager [None req-dfee0bd4-8a0f-4239-8933-e9b1aa542413 tempest-CreateVolumesFromSourceVolumeTest-644256109 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cca713be-0745-425e-b2ba-0bc9d0d49ac7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83259) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 15:25:02 devstack cinder-volume[83259]: DEBUG cinder.volume.manager [None req-dfee0bd4-8a0f-4239-8933-e9b1aa542413 tempest-CreateVolumesFromSourceVolumeTest-644256109 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cca713be-0745-425e-b2ba-0bc9d0d49ac7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a0f1de91-d70d-4895-9dd1-d8768daf622f', 'volume_name': 'volume-a0f1de91-d70d-4895-9dd1-d8768daf622f', 'volume_size': 1}' {{(pid=83259) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 15:25:02 devstack cinder-volume[83259]: DEBUG cinder.volume.manager [None req-dfee0bd4-8a0f-4239-8933-e9b1aa542413 tempest-CreateVolumesFromSourceVolumeTest-644256109 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (515274e9-6e94-4cf5-b336-59d554cad609) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83259) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 15:25:02 devstack cinder-volume[83259]: DEBUG cinder.volume.manager [None req-dfee0bd4-8a0f-4239-8933-e9b1aa542413 tempest-CreateVolumesFromSourceVolumeTest-644256109 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (515274e9-6e94-4cf5-b336-59d554cad609) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83259) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 15:25:02 devstack cinder-volume[83259]: DEBUG cinder.volume.manager [None req-dfee0bd4-8a0f-4239-8933-e9b1aa542413 tempest-CreateVolumesFromSourceVolumeTest-644256109 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e381fe11-511b-478f-9a3b-648d4d123241) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83259) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 15:25:02 devstack cinder-volume[83259]: INFO cinder.volume.flows.manager.create_volume [None req-dfee0bd4-8a0f-4239-8933-e9b1aa542413 tempest-CreateVolumesFromSourceVolumeTest-644256109 None] Volume a0f1de91-d70d-4895-9dd1-d8768daf622f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a0f1de91-d70d-4895-9dd1-d8768daf622f', 'volume_size': 1} Sep 16 15:25:02 devstack cinder-volume[83259]: DEBUG oslo_concurrency.lockutils [None req-dfee0bd4-8a0f-4239-8933-e9b1aa542413 tempest-CreateVolumesFromSourceVolumeTest-644256109 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83259) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 16 15:25:02 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [None req-432f1e3d-8d32-4413-af4c-5f29aaba3cdc tempest-CreateVolumesFromImageTest-720201122 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c/volume-cbc2bd98-4f5b-49cb-8fe2-8cd876ca4b47" returned: 0 in 1.031s {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 15:25:02 devstack cinder-volume[83259]: DEBUG cinder.volume.drivers.quobyte [None req-432f1e3d-8d32-4413-af4c-5f29aaba3cdc tempest-CreateVolumesFromImageTest-720201122 None] <== create_volume: return (2194ms) {'provider_location': '10.10.41.181/cinder-vol-61f585ac-f8e2-4d19-a890-7ebc2726cc72'} {{(pid=83259) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Sep 16 15:25:02 devstack cinder-volume[83259]: DEBUG oslo_concurrency.lockutils [None req-432f1e3d-8d32-4413-af4c-5f29aaba3cdc tempest-CreateVolumesFromImageTest-720201122 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.204s {{(pid=83259) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 16 15:25:02 devstack cinder-volume[83259]: DEBUG cinder.volume.manager [None req-cdc6a31c-900a-4562-9ef7-5a51bf2653b0 tempest-CreateVolumesFromSourceVolumeTest-644256109 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fd5cec03-9763-4f2d-941c-79dc8f1ecd4b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-16T13:25:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1866340431',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#Quobyte',id=563cb599-f010-435f-bc99-161d4436aebc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b047c692efbd4022b3cea93b0d5b9c2a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-16T13:25:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-16T13:25:00Z,use_quota=True,user_id='d83e020b86574dd1a77b0be23e17d7cf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(485ead50-3df8-4d76-8d34-a4db136c980a),volume_type_id=485ead50-3df8-4d76-8d34-a4db136c980a)' {{(pid=83259) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 15:25:02 devstack cinder-volume[83259]: DEBUG cinder.volume.manager [None req-cdc6a31c-900a-4562-9ef7-5a51bf2653b0 tempest-CreateVolumesFromSourceVolumeTest-644256109 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (38deaee4-6a15-482c-8ba1-34811da44ed2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83259) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 15:25:02 devstack cinder-volume[83259]: DEBUG cinder.volume.manager [None req-cdc6a31c-900a-4562-9ef7-5a51bf2653b0 tempest-CreateVolumesFromSourceVolumeTest-644256109 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (38deaee4-6a15-482c-8ba1-34811da44ed2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83259) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 15:25:02 devstack cinder-volume[83259]: DEBUG cinder.volume.manager [None req-cdc6a31c-900a-4562-9ef7-5a51bf2653b0 tempest-CreateVolumesFromSourceVolumeTest-644256109 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (93f0e6e0-e8dc-47f3-bb5d-44d6766495f6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83259) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 15:25:02 devstack cinder-volume[83259]: DEBUG cinder.volume.manager [None req-cdc6a31c-900a-4562-9ef7-5a51bf2653b0 tempest-CreateVolumesFromSourceVolumeTest-644256109 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (93f0e6e0-e8dc-47f3-bb5d-44d6766495f6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '563cb599-f010-435f-bc99-161d4436aebc', 'volume_name': 'volume-563cb599-f010-435f-bc99-161d4436aebc', 'volume_size': 1}' {{(pid=83259) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 15:25:02 devstack cinder-volume[83259]: DEBUG cinder.volume.manager [None req-cdc6a31c-900a-4562-9ef7-5a51bf2653b0 tempest-CreateVolumesFromSourceVolumeTest-644256109 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fd91c62d-a815-412d-bdcf-0b2a747de7ad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83259) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 15:25:02 devstack cinder-volume[83259]: DEBUG cinder.volume.manager [None req-cdc6a31c-900a-4562-9ef7-5a51bf2653b0 tempest-CreateVolumesFromSourceVolumeTest-644256109 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fd91c62d-a815-412d-bdcf-0b2a747de7ad) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83259) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 15:25:02 devstack cinder-volume[83259]: DEBUG cinder.volume.manager [None req-cdc6a31c-900a-4562-9ef7-5a51bf2653b0 tempest-CreateVolumesFromSourceVolumeTest-644256109 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (37caf369-05f1-4f78-a39e-072dcae4c302) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83259) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 15:25:02 devstack cinder-volume[83259]: INFO cinder.volume.flows.manager.create_volume [None req-cdc6a31c-900a-4562-9ef7-5a51bf2653b0 tempest-CreateVolumesFromSourceVolumeTest-644256109 None] Volume 563cb599-f010-435f-bc99-161d4436aebc: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-563cb599-f010-435f-bc99-161d4436aebc', 'volume_size': 1} Sep 16 15:25:02 devstack cinder-volume[83259]: DEBUG oslo_concurrency.lockutils [None req-cdc6a31c-900a-4562-9ef7-5a51bf2653b0 tempest-CreateVolumesFromSourceVolumeTest-644256109 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83259) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 16 15:25:02 devstack cinder-volume[83259]: DEBUG oslo_concurrency.lockutils [None req-cdc6a31c-900a-4562-9ef7-5a51bf2653b0 tempest-CreateVolumesFromSourceVolumeTest-644256109 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=83259) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 16 15:25:02 devstack cinder-volume[83259]: DEBUG cinder.volume.drivers.quobyte [None req-cdc6a31c-900a-4562-9ef7-5a51bf2653b0 tempest-CreateVolumesFromSourceVolumeTest-644256109 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-16T13:25:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1866340431',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#Quobyte',id=563cb599-f010-435f-bc99-161d4436aebc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b047c692efbd4022b3cea93b0d5b9c2a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-16T13:25:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-16T13:25:00Z,use_quota=True,user_id='d83e020b86574dd1a77b0be23e17d7cf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(485ead50-3df8-4d76-8d34-a4db136c980a),volume_type_id=485ead50-3df8-4d76-8d34-a4db136c980a)}" {{(pid=83259) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Sep 16 15:25:02 devstack cinder-volume[83259]: DEBUG cinder.volume.drivers.remotefs [None req-cdc6a31c-900a-4562-9ef7-5a51bf2653b0 tempest-CreateVolumesFromSourceVolumeTest-644256109 None] Creating volume 563cb599-f010-435f-bc99-161d4436aebc {{(pid=83259) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}} Sep 16 15:25:02 devstack cinder-volume[83259]: DEBUG oslo_concurrency.lockutils [None req-cdc6a31c-900a-4562-9ef7-5a51bf2653b0 tempest-CreateVolumesFromSourceVolumeTest-644256109 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83259) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 16 15:25:02 devstack cinder-volume[83259]: DEBUG oslo_concurrency.lockutils [None req-cdc6a31c-900a-4562-9ef7-5a51bf2653b0 tempest-CreateVolumesFromSourceVolumeTest-644256109 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83259) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 16 15:25:02 devstack cinder-volume[83259]: DEBUG cinder.volume.drivers.quobyte [None req-cdc6a31c-900a-4562-9ef7-5a51bf2653b0 tempest-CreateVolumesFromSourceVolumeTest-644256109 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-61f585ac-f8e2-4d19-a890-7ebc2726cc72': None} {{(pid=83259) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:639}} Sep 16 15:25:02 devstack cinder-volume[83259]: DEBUG cinder.volume.drivers.quobyte [None req-cdc6a31c-900a-4562-9ef7-5a51bf2653b0 tempest-CreateVolumesFromSourceVolumeTest-644256109 None] Available shares ['10.10.41.181/cinder-vol-61f585ac-f8e2-4d19-a890-7ebc2726cc72'] {{(pid=83259) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:669}} Sep 16 15:25:02 devstack cinder-volume[83259]: DEBUG oslo_concurrency.lockutils [None req-cdc6a31c-900a-4562-9ef7-5a51bf2653b0 tempest-CreateVolumesFromSourceVolumeTest-644256109 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.026s {{(pid=83259) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 16 15:25:02 devstack cinder-volume[83259]: DEBUG cinder.volume.drivers.quobyte [None req-cdc6a31c-900a-4562-9ef7-5a51bf2653b0 tempest-CreateVolumesFromSourceVolumeTest-644256109 None] Selected 10.10.41.181/cinder-vol-61f585ac-f8e2-4d19-a890-7ebc2726cc72 as target Quobyte volume. {{(pid=83259) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:690}} Sep 16 15:25:02 devstack cinder-volume[83259]: INFO cinder.volume.drivers.remotefs [None req-cdc6a31c-900a-4562-9ef7-5a51bf2653b0 tempest-CreateVolumesFromSourceVolumeTest-644256109 None] casted to 10.10.41.181/cinder-vol-61f585ac-f8e2-4d19-a890-7ebc2726cc72 Sep 16 15:25:02 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [None req-cdc6a31c-900a-4562-9ef7-5a51bf2653b0 tempest-CreateVolumesFromSourceVolumeTest-644256109 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c/volume-563cb599-f010-435f-bc99-161d4436aebc 1073741824 {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 15:25:02 devstack quobyte-client[83286]: The server volume:87712ffe-8a69-446d-9ed6-4430c7ee9792@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=87712ffe-8a69-446d-9ed6-4430c7ee9792, inode=151, name=volume-563cb599-f010-435f-bc99-161d4436aebc, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.206), requestorAccessMask=0 Sep 16 15:25:02 devstack cinder-volume[83259]: DEBUG cinder.volume.manager [None req-432f1e3d-8d32-4413-af4c-5f29aaba3cdc tempest-CreateVolumesFromImageTest-720201122 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7d64a10f-2188-4bac-ad63-e1e0d7ce612f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-cbc2bd98-4f5b-49cb-8fe2-8cd876ca4b47', 'volume_size': 1}' {{(pid=83259) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 15:25:02 devstack cinder-volume[83259]: DEBUG cinder.volume.manager [None req-432f1e3d-8d32-4413-af4c-5f29aaba3cdc tempest-CreateVolumesFromImageTest-720201122 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bce6dbb5-5237-47e6-8453-029d5ff57681) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83259) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 15:25:02 devstack cinder-volume[83259]: WARNING cinder.volume.volume_utils [None req-fca20055-4b32-4b42-a98a-0e818d9f0e41 tempest-CreateVolumesFromSourceVolumeTest-644256109 None] Volume driver (QuobyteDriver 1.2) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 16 15:25:02 devstack cinder-volume[83259]: DEBUG cinder.volume.flows.manager.create_volume [None req-fca20055-4b32-4b42-a98a-0e818d9f0e41 tempest-CreateVolumesFromSourceVolumeTest-644256109 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#Quobyte'], 'hosts': ['devstack@QuobyteHD#Quobyte']} {{(pid=83259) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1387}} Sep 16 15:25:03 devstack cinder-volume[83259]: DEBUG cinder.volume.manager [None req-fca20055-4b32-4b42-a98a-0e818d9f0e41 tempest-CreateVolumesFromSourceVolumeTest-644256109 None] Flow 'volume_create_manager' (534718bb-b8e5-45b7-96e6-ff9f5a49aef1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83259) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 16 15:25:03 devstack cinder-volume[83259]: DEBUG cinder.volume.manager [None req-fca20055-4b32-4b42-a98a-0e818d9f0e41 tempest-CreateVolumesFromSourceVolumeTest-644256109 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c6545ce8-0631-458f-9732-4480bd7a51b2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83259) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 15:25:03 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [None req-cdc6a31c-900a-4562-9ef7-5a51bf2653b0 tempest-CreateVolumesFromSourceVolumeTest-644256109 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c/volume-563cb599-f010-435f-bc99-161d4436aebc 1073741824" returned: 0 in 0.942s {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 15:25:03 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [None req-cdc6a31c-900a-4562-9ef7-5a51bf2653b0 tempest-CreateVolumesFromSourceVolumeTest-644256109 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c/volume-563cb599-f010-435f-bc99-161d4436aebc {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 15:25:03 devstack cinder-volume[83259]: INFO cinder.volume.flows.manager.create_volume [None req-432f1e3d-8d32-4413-af4c-5f29aaba3cdc tempest-CreateVolumesFromImageTest-720201122 None] Volume volume-cbc2bd98-4f5b-49cb-8fe2-8cd876ca4b47 (cbc2bd98-4f5b-49cb-8fe2-8cd876ca4b47): created successfully Sep 16 15:25:03 devstack cinder-volume[83259]: DEBUG cinder.volume.manager [None req-432f1e3d-8d32-4413-af4c-5f29aaba3cdc tempest-CreateVolumesFromImageTest-720201122 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bce6dbb5-5237-47e6-8453-029d5ff57681) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83259) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 15:25:03 devstack cinder-volume[83259]: DEBUG cinder.volume.manager [None req-432f1e3d-8d32-4413-af4c-5f29aaba3cdc tempest-CreateVolumesFromImageTest-720201122 None] Flow 'volume_create_manager' (f4aea756-14a3-427b-ac31-58682685171e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83259) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 16 15:25:03 devstack cinder-volume[83259]: DEBUG cinder.volume.manager [None req-fca20055-4b32-4b42-a98a-0e818d9f0e41 tempest-CreateVolumesFromSourceVolumeTest-644256109 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c6545ce8-0631-458f-9732-4480bd7a51b2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-16T13:25:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1940306542',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#Quobyte',id=0665e528-09ab-4d71-93a7-97beab9a2ae7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b047c692efbd4022b3cea93b0d5b9c2a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-16T13:25:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-16T13:25:01Z,use_quota=True,user_id='d83e020b86574dd1a77b0be23e17d7cf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(485ead50-3df8-4d76-8d34-a4db136c980a),volume_type_id=485ead50-3df8-4d76-8d34-a4db136c980a)' {{(pid=83259) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 15:25:03 devstack cinder-volume[83259]: DEBUG cinder.volume.manager [None req-fca20055-4b32-4b42-a98a-0e818d9f0e41 tempest-CreateVolumesFromSourceVolumeTest-644256109 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5cb8739d-b9e0-4a81-b1dc-2048019182a2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83259) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 15:25:03 devstack cinder-volume[83259]: DEBUG cinder.volume.manager [None req-fca20055-4b32-4b42-a98a-0e818d9f0e41 tempest-CreateVolumesFromSourceVolumeTest-644256109 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5cb8739d-b9e0-4a81-b1dc-2048019182a2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83259) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 15:25:03 devstack cinder-volume[83259]: DEBUG cinder.volume.manager [None req-fca20055-4b32-4b42-a98a-0e818d9f0e41 tempest-CreateVolumesFromSourceVolumeTest-644256109 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (865a623a-2f48-41d3-bf1e-7ada927481bc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83259) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 15:25:03 devstack cinder-volume[83259]: DEBUG cinder.volume.manager [None req-fca20055-4b32-4b42-a98a-0e818d9f0e41 tempest-CreateVolumesFromSourceVolumeTest-644256109 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (865a623a-2f48-41d3-bf1e-7ada927481bc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0665e528-09ab-4d71-93a7-97beab9a2ae7', 'volume_name': 'volume-0665e528-09ab-4d71-93a7-97beab9a2ae7', 'volume_size': 1}' {{(pid=83259) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 15:25:03 devstack cinder-volume[83259]: DEBUG cinder.volume.manager [None req-fca20055-4b32-4b42-a98a-0e818d9f0e41 tempest-CreateVolumesFromSourceVolumeTest-644256109 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (41f29825-180b-4748-a2db-25b82b0dd9bb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83259) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 15:25:03 devstack cinder-volume[83259]: DEBUG cinder.volume.manager [None req-fca20055-4b32-4b42-a98a-0e818d9f0e41 tempest-CreateVolumesFromSourceVolumeTest-644256109 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (41f29825-180b-4748-a2db-25b82b0dd9bb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83259) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 15:25:03 devstack cinder-volume[83259]: DEBUG cinder.volume.manager [None req-fca20055-4b32-4b42-a98a-0e818d9f0e41 tempest-CreateVolumesFromSourceVolumeTest-644256109 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4856cd34-0bfe-4250-a6f8-925b8ab5e342) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83259) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 15:25:03 devstack cinder-volume[83259]: INFO cinder.volume.flows.manager.create_volume [None req-fca20055-4b32-4b42-a98a-0e818d9f0e41 tempest-CreateVolumesFromSourceVolumeTest-644256109 None] Volume 0665e528-09ab-4d71-93a7-97beab9a2ae7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0665e528-09ab-4d71-93a7-97beab9a2ae7', 'volume_size': 1} Sep 16 15:25:03 devstack cinder-volume[83259]: DEBUG oslo_concurrency.lockutils [None req-fca20055-4b32-4b42-a98a-0e818d9f0e41 tempest-CreateVolumesFromSourceVolumeTest-644256109 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83259) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 16 15:25:03 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [None req-cdc6a31c-900a-4562-9ef7-5a51bf2653b0 tempest-CreateVolumesFromSourceVolumeTest-644256109 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c/volume-563cb599-f010-435f-bc99-161d4436aebc" returned: 0 in 0.495s {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 15:25:03 devstack cinder-volume[83259]: DEBUG cinder.volume.drivers.quobyte [None req-cdc6a31c-900a-4562-9ef7-5a51bf2653b0 tempest-CreateVolumesFromSourceVolumeTest-644256109 None] <== create_volume: return (1478ms) {'provider_location': '10.10.41.181/cinder-vol-61f585ac-f8e2-4d19-a890-7ebc2726cc72'} {{(pid=83259) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Sep 16 15:25:03 devstack cinder-volume[83259]: DEBUG oslo_concurrency.lockutils [None req-cdc6a31c-900a-4562-9ef7-5a51bf2653b0 tempest-CreateVolumesFromSourceVolumeTest-644256109 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.489s {{(pid=83259) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 16 15:25:03 devstack cinder-volume[83259]: DEBUG oslo_concurrency.lockutils [None req-94631229-3d2c-47c3-8517-24810eec3332 tempest-CreateVolumesFromSourceVolumeTest-644256109 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.806s {{(pid=83259) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 16 15:25:03 devstack cinder-volume[83259]: DEBUG cinder.volume.drivers.quobyte [None req-94631229-3d2c-47c3-8517-24810eec3332 tempest-CreateVolumesFromSourceVolumeTest-644256109 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-16T13:24:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-261275269',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#Quobyte',id=61142dde-da13-4e27-bba5-bb03c06e2c70,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b047c692efbd4022b3cea93b0d5b9c2a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-16T13:24:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-16T13:24:58Z,use_quota=True,user_id='d83e020b86574dd1a77b0be23e17d7cf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(485ead50-3df8-4d76-8d34-a4db136c980a),volume_type_id=485ead50-3df8-4d76-8d34-a4db136c980a)}" {{(pid=83259) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Sep 16 15:25:03 devstack cinder-volume[83259]: DEBUG cinder.volume.drivers.remotefs [None req-94631229-3d2c-47c3-8517-24810eec3332 tempest-CreateVolumesFromSourceVolumeTest-644256109 None] Creating volume 61142dde-da13-4e27-bba5-bb03c06e2c70 {{(pid=83259) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}} Sep 16 15:25:03 devstack cinder-volume[83259]: DEBUG oslo_concurrency.lockutils [None req-94631229-3d2c-47c3-8517-24810eec3332 tempest-CreateVolumesFromSourceVolumeTest-644256109 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83259) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 16 15:25:03 devstack cinder-volume[83259]: DEBUG oslo_concurrency.lockutils [None req-94631229-3d2c-47c3-8517-24810eec3332 tempest-CreateVolumesFromSourceVolumeTest-644256109 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83259) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 16 15:25:03 devstack cinder-volume[83259]: DEBUG cinder.volume.drivers.quobyte [None req-94631229-3d2c-47c3-8517-24810eec3332 tempest-CreateVolumesFromSourceVolumeTest-644256109 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-61f585ac-f8e2-4d19-a890-7ebc2726cc72': None} {{(pid=83259) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:639}} Sep 16 15:25:03 devstack cinder-volume[83259]: DEBUG cinder.volume.drivers.quobyte [None req-94631229-3d2c-47c3-8517-24810eec3332 tempest-CreateVolumesFromSourceVolumeTest-644256109 None] Available shares ['10.10.41.181/cinder-vol-61f585ac-f8e2-4d19-a890-7ebc2726cc72'] {{(pid=83259) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:669}} Sep 16 15:25:03 devstack cinder-volume[83259]: DEBUG oslo_concurrency.lockutils [None req-94631229-3d2c-47c3-8517-24810eec3332 tempest-CreateVolumesFromSourceVolumeTest-644256109 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=83259) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 16 15:25:03 devstack cinder-volume[83259]: DEBUG cinder.volume.drivers.quobyte [None req-94631229-3d2c-47c3-8517-24810eec3332 tempest-CreateVolumesFromSourceVolumeTest-644256109 None] Selected 10.10.41.181/cinder-vol-61f585ac-f8e2-4d19-a890-7ebc2726cc72 as target Quobyte volume. {{(pid=83259) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:690}} Sep 16 15:25:03 devstack cinder-volume[83259]: INFO cinder.volume.drivers.remotefs [None req-94631229-3d2c-47c3-8517-24810eec3332 tempest-CreateVolumesFromSourceVolumeTest-644256109 None] casted to 10.10.41.181/cinder-vol-61f585ac-f8e2-4d19-a890-7ebc2726cc72 Sep 16 15:25:03 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [None req-94631229-3d2c-47c3-8517-24810eec3332 tempest-CreateVolumesFromSourceVolumeTest-644256109 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c/volume-61142dde-da13-4e27-bba5-bb03c06e2c70 1073741824 {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 15:25:03 devstack quobyte-client[83286]: The server volume:87712ffe-8a69-446d-9ed6-4430c7ee9792@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=87712ffe-8a69-446d-9ed6-4430c7ee9792, inode=152, name=volume-61142dde-da13-4e27-bba5-bb03c06e2c70, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.206), requestorAccessMask=0 Sep 16 15:25:03 devstack cinder-volume[83259]: INFO cinder.volume.manager [None req-432f1e3d-8d32-4413-af4c-5f29aaba3cdc tempest-CreateVolumesFromImageTest-720201122 None] Created volume successfully. Sep 16 15:25:04 devstack cinder-volume[83259]: DEBUG cinder.volume.manager [None req-cdc6a31c-900a-4562-9ef7-5a51bf2653b0 tempest-CreateVolumesFromSourceVolumeTest-644256109 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (37caf369-05f1-4f78-a39e-072dcae4c302) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-563cb599-f010-435f-bc99-161d4436aebc', 'volume_size': 1}' {{(pid=83259) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 15:25:04 devstack cinder-volume[83259]: DEBUG cinder.volume.manager [None req-cdc6a31c-900a-4562-9ef7-5a51bf2653b0 tempest-CreateVolumesFromSourceVolumeTest-644256109 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1180b314-0665-4485-ad0c-27585bd0db93) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83259) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 15:25:04 devstack cinder-volume[83259]: INFO cinder.volume.flows.manager.create_volume [None req-cdc6a31c-900a-4562-9ef7-5a51bf2653b0 tempest-CreateVolumesFromSourceVolumeTest-644256109 None] Volume volume-563cb599-f010-435f-bc99-161d4436aebc (563cb599-f010-435f-bc99-161d4436aebc): created successfully Sep 16 15:25:04 devstack cinder-volume[83259]: DEBUG cinder.volume.manager [None req-cdc6a31c-900a-4562-9ef7-5a51bf2653b0 tempest-CreateVolumesFromSourceVolumeTest-644256109 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1180b314-0665-4485-ad0c-27585bd0db93) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83259) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 15:25:04 devstack cinder-volume[83259]: DEBUG cinder.volume.manager [None req-cdc6a31c-900a-4562-9ef7-5a51bf2653b0 tempest-CreateVolumesFromSourceVolumeTest-644256109 None] Flow 'volume_create_manager' (ef0a26b6-19d9-4317-88ff-d458df9dc488) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83259) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 16 15:25:04 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [None req-94631229-3d2c-47c3-8517-24810eec3332 tempest-CreateVolumesFromSourceVolumeTest-644256109 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c/volume-61142dde-da13-4e27-bba5-bb03c06e2c70 1073741824" returned: 0 in 0.567s {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 15:25:04 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [None req-94631229-3d2c-47c3-8517-24810eec3332 tempest-CreateVolumesFromSourceVolumeTest-644256109 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c/volume-61142dde-da13-4e27-bba5-bb03c06e2c70 {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 15:25:04 devstack cinder-volume[83259]: INFO cinder.volume.manager [None req-cdc6a31c-900a-4562-9ef7-5a51bf2653b0 tempest-CreateVolumesFromSourceVolumeTest-644256109 None] Created volume successfully. Sep 16 15:25:04 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [None req-94631229-3d2c-47c3-8517-24810eec3332 tempest-CreateVolumesFromSourceVolumeTest-644256109 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c/volume-61142dde-da13-4e27-bba5-bb03c06e2c70" returned: 0 in 0.395s {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 15:25:04 devstack cinder-volume[83259]: DEBUG cinder.volume.drivers.quobyte [None req-94631229-3d2c-47c3-8517-24810eec3332 tempest-CreateVolumesFromSourceVolumeTest-644256109 None] <== create_volume: return (991ms) {'provider_location': '10.10.41.181/cinder-vol-61f585ac-f8e2-4d19-a890-7ebc2726cc72'} {{(pid=83259) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Sep 16 15:25:04 devstack cinder-volume[83259]: DEBUG oslo_concurrency.lockutils [None req-94631229-3d2c-47c3-8517-24810eec3332 tempest-CreateVolumesFromSourceVolumeTest-644256109 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.005s {{(pid=83259) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 16 15:25:04 devstack cinder-volume[83259]: DEBUG oslo_concurrency.lockutils [None req-6a80f0aa-df9a-4e50-94c4-7759c077bf44 tempest-CreateVolumesFromSourceVolumeTest-644256109 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.687s {{(pid=83259) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 16 15:25:04 devstack cinder-volume[83259]: DEBUG cinder.volume.drivers.quobyte [None req-6a80f0aa-df9a-4e50-94c4-7759c077bf44 tempest-CreateVolumesFromSourceVolumeTest-644256109 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-16T13:24:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1332374052',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#Quobyte',id=b9495b05-d0ef-4c4c-961a-d54de3d64117,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b047c692efbd4022b3cea93b0d5b9c2a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-16T13:24:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-16T13:24:59Z,use_quota=True,user_id='d83e020b86574dd1a77b0be23e17d7cf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(485ead50-3df8-4d76-8d34-a4db136c980a),volume_type_id=485ead50-3df8-4d76-8d34-a4db136c980a)}" {{(pid=83259) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Sep 16 15:25:04 devstack cinder-volume[83259]: DEBUG cinder.volume.drivers.remotefs [None req-6a80f0aa-df9a-4e50-94c4-7759c077bf44 tempest-CreateVolumesFromSourceVolumeTest-644256109 None] Creating volume b9495b05-d0ef-4c4c-961a-d54de3d64117 {{(pid=83259) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}} Sep 16 15:25:04 devstack cinder-volume[83259]: DEBUG oslo_concurrency.lockutils [None req-6a80f0aa-df9a-4e50-94c4-7759c077bf44 tempest-CreateVolumesFromSourceVolumeTest-644256109 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83259) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 16 15:25:04 devstack cinder-volume[83259]: DEBUG oslo_concurrency.lockutils [None req-6a80f0aa-df9a-4e50-94c4-7759c077bf44 tempest-CreateVolumesFromSourceVolumeTest-644256109 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=83259) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 16 15:25:04 devstack cinder-volume[83259]: DEBUG cinder.volume.drivers.quobyte [None req-6a80f0aa-df9a-4e50-94c4-7759c077bf44 tempest-CreateVolumesFromSourceVolumeTest-644256109 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-61f585ac-f8e2-4d19-a890-7ebc2726cc72': None} {{(pid=83259) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:639}} Sep 16 15:25:04 devstack cinder-volume[83259]: DEBUG cinder.volume.drivers.quobyte [None req-6a80f0aa-df9a-4e50-94c4-7759c077bf44 tempest-CreateVolumesFromSourceVolumeTest-644256109 None] Available shares ['10.10.41.181/cinder-vol-61f585ac-f8e2-4d19-a890-7ebc2726cc72'] {{(pid=83259) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:669}} Sep 16 15:25:04 devstack cinder-volume[83259]: DEBUG oslo_concurrency.lockutils [None req-6a80f0aa-df9a-4e50-94c4-7759c077bf44 tempest-CreateVolumesFromSourceVolumeTest-644256109 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=83259) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 16 15:25:04 devstack cinder-volume[83259]: DEBUG cinder.volume.drivers.quobyte [None req-6a80f0aa-df9a-4e50-94c4-7759c077bf44 tempest-CreateVolumesFromSourceVolumeTest-644256109 None] Selected 10.10.41.181/cinder-vol-61f585ac-f8e2-4d19-a890-7ebc2726cc72 as target Quobyte volume. {{(pid=83259) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:690}} Sep 16 15:25:04 devstack cinder-volume[83259]: INFO cinder.volume.drivers.remotefs [None req-6a80f0aa-df9a-4e50-94c4-7759c077bf44 tempest-CreateVolumesFromSourceVolumeTest-644256109 None] casted to 10.10.41.181/cinder-vol-61f585ac-f8e2-4d19-a890-7ebc2726cc72 Sep 16 15:25:04 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [None req-6a80f0aa-df9a-4e50-94c4-7759c077bf44 tempest-CreateVolumesFromSourceVolumeTest-644256109 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c/volume-b9495b05-d0ef-4c4c-961a-d54de3d64117 1073741824 {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 15:25:04 devstack quobyte-client[83286]: The server volume:87712ffe-8a69-446d-9ed6-4430c7ee9792@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=87712ffe-8a69-446d-9ed6-4430c7ee9792, inode=153, name=volume-b9495b05-d0ef-4c4c-961a-d54de3d64117, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.206), requestorAccessMask=0 Sep 16 15:25:05 devstack cinder-volume[83259]: DEBUG cinder.volume.manager [None req-94631229-3d2c-47c3-8517-24810eec3332 tempest-CreateVolumesFromSourceVolumeTest-644256109 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (78654612-1fc9-49ab-81a6-6d58b4a612b7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-61142dde-da13-4e27-bba5-bb03c06e2c70', 'volume_size': 1}' {{(pid=83259) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 15:25:05 devstack cinder-volume[83259]: DEBUG cinder.volume.manager [None req-94631229-3d2c-47c3-8517-24810eec3332 tempest-CreateVolumesFromSourceVolumeTest-644256109 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (22725478-1036-454a-92ee-5960f4bb4adc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83259) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 15:25:05 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [None req-6a80f0aa-df9a-4e50-94c4-7759c077bf44 tempest-CreateVolumesFromSourceVolumeTest-644256109 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c/volume-b9495b05-d0ef-4c4c-961a-d54de3d64117 1073741824" returned: 0 in 0.483s {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 15:25:05 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [None req-6a80f0aa-df9a-4e50-94c4-7759c077bf44 tempest-CreateVolumesFromSourceVolumeTest-644256109 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c/volume-b9495b05-d0ef-4c4c-961a-d54de3d64117 {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 15:25:05 devstack cinder-volume[83259]: INFO cinder.volume.flows.manager.create_volume [None req-94631229-3d2c-47c3-8517-24810eec3332 tempest-CreateVolumesFromSourceVolumeTest-644256109 None] Volume volume-61142dde-da13-4e27-bba5-bb03c06e2c70 (61142dde-da13-4e27-bba5-bb03c06e2c70): created successfully Sep 16 15:25:05 devstack cinder-volume[83259]: DEBUG cinder.volume.manager [None req-94631229-3d2c-47c3-8517-24810eec3332 tempest-CreateVolumesFromSourceVolumeTest-644256109 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (22725478-1036-454a-92ee-5960f4bb4adc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83259) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 15:25:05 devstack cinder-volume[83259]: DEBUG cinder.volume.manager [None req-94631229-3d2c-47c3-8517-24810eec3332 tempest-CreateVolumesFromSourceVolumeTest-644256109 None] Flow 'volume_create_manager' (27fe02ac-6668-4973-bc69-727cd874d6ec) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83259) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 16 15:25:05 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [None req-6a80f0aa-df9a-4e50-94c4-7759c077bf44 tempest-CreateVolumesFromSourceVolumeTest-644256109 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c/volume-b9495b05-d0ef-4c4c-961a-d54de3d64117" returned: 0 in 0.680s {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 15:25:05 devstack cinder-volume[83259]: DEBUG cinder.volume.drivers.quobyte [None req-6a80f0aa-df9a-4e50-94c4-7759c077bf44 tempest-CreateVolumesFromSourceVolumeTest-644256109 None] <== create_volume: return (1192ms) {'provider_location': '10.10.41.181/cinder-vol-61f585ac-f8e2-4d19-a890-7ebc2726cc72'} {{(pid=83259) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Sep 16 15:25:05 devstack cinder-volume[83259]: DEBUG oslo_concurrency.lockutils [None req-6a80f0aa-df9a-4e50-94c4-7759c077bf44 tempest-CreateVolumesFromSourceVolumeTest-644256109 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.211s {{(pid=83259) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 16 15:25:05 devstack cinder-volume[83259]: DEBUG oslo_concurrency.lockutils [None req-dfee0bd4-8a0f-4239-8933-e9b1aa542413 tempest-CreateVolumesFromSourceVolumeTest-644256109 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.844s {{(pid=83259) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 16 15:25:05 devstack cinder-volume[83259]: DEBUG cinder.volume.drivers.quobyte [None req-dfee0bd4-8a0f-4239-8933-e9b1aa542413 tempest-CreateVolumesFromSourceVolumeTest-644256109 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-16T13:24:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1183059857',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#Quobyte',id=a0f1de91-d70d-4895-9dd1-d8768daf622f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b047c692efbd4022b3cea93b0d5b9c2a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-16T13:25:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-16T13:25:00Z,use_quota=True,user_id='d83e020b86574dd1a77b0be23e17d7cf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(485ead50-3df8-4d76-8d34-a4db136c980a),volume_type_id=485ead50-3df8-4d76-8d34-a4db136c980a)}" {{(pid=83259) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Sep 16 15:25:05 devstack cinder-volume[83259]: DEBUG cinder.volume.drivers.remotefs [None req-dfee0bd4-8a0f-4239-8933-e9b1aa542413 tempest-CreateVolumesFromSourceVolumeTest-644256109 None] Creating volume a0f1de91-d70d-4895-9dd1-d8768daf622f {{(pid=83259) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}} Sep 16 15:25:05 devstack cinder-volume[83259]: DEBUG oslo_concurrency.lockutils [None req-dfee0bd4-8a0f-4239-8933-e9b1aa542413 tempest-CreateVolumesFromSourceVolumeTest-644256109 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83259) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 16 15:25:05 devstack cinder-volume[83259]: DEBUG oslo_concurrency.lockutils [None req-dfee0bd4-8a0f-4239-8933-e9b1aa542413 tempest-CreateVolumesFromSourceVolumeTest-644256109 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=83259) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 16 15:25:05 devstack cinder-volume[83259]: DEBUG cinder.volume.drivers.quobyte [None req-dfee0bd4-8a0f-4239-8933-e9b1aa542413 tempest-CreateVolumesFromSourceVolumeTest-644256109 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-61f585ac-f8e2-4d19-a890-7ebc2726cc72': None} {{(pid=83259) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:639}} Sep 16 15:25:05 devstack cinder-volume[83259]: DEBUG cinder.volume.drivers.quobyte [None req-dfee0bd4-8a0f-4239-8933-e9b1aa542413 tempest-CreateVolumesFromSourceVolumeTest-644256109 None] Available shares ['10.10.41.181/cinder-vol-61f585ac-f8e2-4d19-a890-7ebc2726cc72'] {{(pid=83259) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:669}} Sep 16 15:25:05 devstack cinder-volume[83259]: DEBUG oslo_concurrency.lockutils [None req-dfee0bd4-8a0f-4239-8933-e9b1aa542413 tempest-CreateVolumesFromSourceVolumeTest-644256109 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=83259) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 16 15:25:05 devstack cinder-volume[83259]: DEBUG cinder.volume.drivers.quobyte [None req-dfee0bd4-8a0f-4239-8933-e9b1aa542413 tempest-CreateVolumesFromSourceVolumeTest-644256109 None] Selected 10.10.41.181/cinder-vol-61f585ac-f8e2-4d19-a890-7ebc2726cc72 as target Quobyte volume. {{(pid=83259) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:690}} Sep 16 15:25:05 devstack cinder-volume[83259]: INFO cinder.volume.drivers.remotefs [None req-dfee0bd4-8a0f-4239-8933-e9b1aa542413 tempest-CreateVolumesFromSourceVolumeTest-644256109 None] casted to 10.10.41.181/cinder-vol-61f585ac-f8e2-4d19-a890-7ebc2726cc72 Sep 16 15:25:05 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [None req-dfee0bd4-8a0f-4239-8933-e9b1aa542413 tempest-CreateVolumesFromSourceVolumeTest-644256109 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c/volume-a0f1de91-d70d-4895-9dd1-d8768daf622f 1073741824 {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 15:25:06 devstack cinder-volume[83259]: INFO cinder.volume.manager [None req-94631229-3d2c-47c3-8517-24810eec3332 tempest-CreateVolumesFromSourceVolumeTest-644256109 None] Created volume successfully. Sep 16 15:25:06 devstack quobyte-client[83286]: System call of process 99987 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 16 15:25:06 devstack quobyte-client[83286]: The server volume:87712ffe-8a69-446d-9ed6-4430c7ee9792@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=87712ffe-8a69-446d-9ed6-4430c7ee9792, inode=154, name=volume-a0f1de91-d70d-4895-9dd1-d8768daf622f, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.206), requestorAccessMask=0 Sep 16 15:25:06 devstack cinder-volume[83259]: DEBUG cinder.volume.manager [None req-6a80f0aa-df9a-4e50-94c4-7759c077bf44 tempest-CreateVolumesFromSourceVolumeTest-644256109 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (43f61ac3-2018-481c-a7c7-473358dd2233) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b9495b05-d0ef-4c4c-961a-d54de3d64117', 'volume_size': 1}' {{(pid=83259) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 15:25:06 devstack cinder-volume[83259]: DEBUG cinder.volume.manager [None req-6a80f0aa-df9a-4e50-94c4-7759c077bf44 tempest-CreateVolumesFromSourceVolumeTest-644256109 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3295ef71-e165-4eaf-9383-83b887b34b91) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83259) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 15:25:06 devstack cinder-volume[83259]: INFO cinder.volume.flows.manager.create_volume [None req-6a80f0aa-df9a-4e50-94c4-7759c077bf44 tempest-CreateVolumesFromSourceVolumeTest-644256109 None] Volume volume-b9495b05-d0ef-4c4c-961a-d54de3d64117 (b9495b05-d0ef-4c4c-961a-d54de3d64117): created successfully Sep 16 15:25:06 devstack cinder-volume[83259]: DEBUG cinder.volume.manager [None req-6a80f0aa-df9a-4e50-94c4-7759c077bf44 tempest-CreateVolumesFromSourceVolumeTest-644256109 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3295ef71-e165-4eaf-9383-83b887b34b91) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83259) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 15:25:06 devstack cinder-volume[83259]: DEBUG cinder.volume.manager [None req-6a80f0aa-df9a-4e50-94c4-7759c077bf44 tempest-CreateVolumesFromSourceVolumeTest-644256109 None] Flow 'volume_create_manager' (18d2dbd6-c86e-48d7-9a24-a16b8f8cea7a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83259) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 16 15:25:06 devstack cinder-volume[83259]: INFO cinder.volume.manager [None req-6a80f0aa-df9a-4e50-94c4-7759c077bf44 tempest-CreateVolumesFromSourceVolumeTest-644256109 None] Created volume successfully. Sep 16 15:25:06 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [None req-dfee0bd4-8a0f-4239-8933-e9b1aa542413 tempest-CreateVolumesFromSourceVolumeTest-644256109 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c/volume-a0f1de91-d70d-4895-9dd1-d8768daf622f 1073741824" returned: 0 in 0.602s {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 15:25:06 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [None req-dfee0bd4-8a0f-4239-8933-e9b1aa542413 tempest-CreateVolumesFromSourceVolumeTest-644256109 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c/volume-a0f1de91-d70d-4895-9dd1-d8768daf622f {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 15:25:06 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [None req-dfee0bd4-8a0f-4239-8933-e9b1aa542413 tempest-CreateVolumesFromSourceVolumeTest-644256109 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c/volume-a0f1de91-d70d-4895-9dd1-d8768daf622f" returned: 0 in 0.203s {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 15:25:06 devstack cinder-volume[83259]: DEBUG cinder.volume.drivers.quobyte [None req-dfee0bd4-8a0f-4239-8933-e9b1aa542413 tempest-CreateVolumesFromSourceVolumeTest-644256109 None] <== create_volume: return (947ms) {'provider_location': '10.10.41.181/cinder-vol-61f585ac-f8e2-4d19-a890-7ebc2726cc72'} {{(pid=83259) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Sep 16 15:25:06 devstack cinder-volume[83259]: DEBUG oslo_concurrency.lockutils [None req-dfee0bd4-8a0f-4239-8933-e9b1aa542413 tempest-CreateVolumesFromSourceVolumeTest-644256109 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.988s {{(pid=83259) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 16 15:25:07 devstack cinder-volume[83259]: DEBUG oslo_concurrency.lockutils [None req-7e5c4dc8-c00f-40d5-aa8f-5c16387efc11 tempest-CreateVolumesFromImageTest-720201122 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 10.118s {{(pid=83259) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 16 15:25:07 devstack cinder-volume[83259]: DEBUG cinder.volume.drivers.quobyte [None req-7e5c4dc8-c00f-40d5-aa8f-5c16387efc11 tempest-CreateVolumesFromImageTest-720201122 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-16T13:24:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-891211279',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#Quobyte',id=80f07420-429d-4da3-8050-09d3953830bd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8bd04cfd64064ab8a87507b6a2b87d14',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-16T13:24:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-16T13:24:55Z,use_quota=True,user_id='46e7349c0f454da8b9fda7da82a040a4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(485ead50-3df8-4d76-8d34-a4db136c980a),volume_type_id=485ead50-3df8-4d76-8d34-a4db136c980a)}" {{(pid=83259) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Sep 16 15:25:07 devstack cinder-volume[83259]: DEBUG cinder.volume.drivers.remotefs [None req-7e5c4dc8-c00f-40d5-aa8f-5c16387efc11 tempest-CreateVolumesFromImageTest-720201122 None] Creating volume 80f07420-429d-4da3-8050-09d3953830bd {{(pid=83259) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}} Sep 16 15:25:07 devstack cinder-volume[83259]: DEBUG oslo_concurrency.lockutils [None req-7e5c4dc8-c00f-40d5-aa8f-5c16387efc11 tempest-CreateVolumesFromImageTest-720201122 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83259) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 16 15:25:07 devstack cinder-volume[83259]: DEBUG oslo_concurrency.lockutils [None req-7e5c4dc8-c00f-40d5-aa8f-5c16387efc11 tempest-CreateVolumesFromImageTest-720201122 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.007s {{(pid=83259) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 16 15:25:07 devstack cinder-volume[83259]: DEBUG cinder.volume.drivers.quobyte [None req-7e5c4dc8-c00f-40d5-aa8f-5c16387efc11 tempest-CreateVolumesFromImageTest-720201122 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-61f585ac-f8e2-4d19-a890-7ebc2726cc72': None} {{(pid=83259) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:639}} Sep 16 15:25:07 devstack cinder-volume[83259]: DEBUG cinder.volume.drivers.quobyte [None req-7e5c4dc8-c00f-40d5-aa8f-5c16387efc11 tempest-CreateVolumesFromImageTest-720201122 None] Available shares ['10.10.41.181/cinder-vol-61f585ac-f8e2-4d19-a890-7ebc2726cc72'] {{(pid=83259) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:669}} Sep 16 15:25:07 devstack cinder-volume[83259]: DEBUG oslo_concurrency.lockutils [None req-7e5c4dc8-c00f-40d5-aa8f-5c16387efc11 tempest-CreateVolumesFromImageTest-720201122 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=83259) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 16 15:25:07 devstack cinder-volume[83259]: DEBUG cinder.volume.drivers.quobyte [None req-7e5c4dc8-c00f-40d5-aa8f-5c16387efc11 tempest-CreateVolumesFromImageTest-720201122 None] Selected 10.10.41.181/cinder-vol-61f585ac-f8e2-4d19-a890-7ebc2726cc72 as target Quobyte volume. {{(pid=83259) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:690}} Sep 16 15:25:07 devstack cinder-volume[83259]: INFO cinder.volume.drivers.remotefs [None req-7e5c4dc8-c00f-40d5-aa8f-5c16387efc11 tempest-CreateVolumesFromImageTest-720201122 None] casted to 10.10.41.181/cinder-vol-61f585ac-f8e2-4d19-a890-7ebc2726cc72 Sep 16 15:25:07 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [None req-7e5c4dc8-c00f-40d5-aa8f-5c16387efc11 tempest-CreateVolumesFromImageTest-720201122 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c/volume-80f07420-429d-4da3-8050-09d3953830bd 1073741824 {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 15:25:07 devstack quobyte-client[83286]: The server volume:87712ffe-8a69-446d-9ed6-4430c7ee9792@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=87712ffe-8a69-446d-9ed6-4430c7ee9792, inode=155, name=volume-80f07420-429d-4da3-8050-09d3953830bd, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.206), requestorAccessMask=0 Sep 16 15:25:07 devstack cinder-volume[83259]: DEBUG cinder.volume.manager [None req-dfee0bd4-8a0f-4239-8933-e9b1aa542413 tempest-CreateVolumesFromSourceVolumeTest-644256109 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e381fe11-511b-478f-9a3b-648d4d123241) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a0f1de91-d70d-4895-9dd1-d8768daf622f', 'volume_size': 1}' {{(pid=83259) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 15:25:07 devstack cinder-volume[83259]: DEBUG cinder.volume.manager [None req-dfee0bd4-8a0f-4239-8933-e9b1aa542413 tempest-CreateVolumesFromSourceVolumeTest-644256109 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (85b79193-4534-406e-8c1b-a09ba896c9ba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83259) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 15:25:07 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [None req-7e5c4dc8-c00f-40d5-aa8f-5c16387efc11 tempest-CreateVolumesFromImageTest-720201122 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c/volume-80f07420-429d-4da3-8050-09d3953830bd 1073741824" returned: 0 in 0.563s {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 15:25:07 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [None req-7e5c4dc8-c00f-40d5-aa8f-5c16387efc11 tempest-CreateVolumesFromImageTest-720201122 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c/volume-80f07420-429d-4da3-8050-09d3953830bd {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 15:25:07 devstack cinder-volume[83259]: INFO cinder.volume.flows.manager.create_volume [None req-dfee0bd4-8a0f-4239-8933-e9b1aa542413 tempest-CreateVolumesFromSourceVolumeTest-644256109 None] Volume volume-a0f1de91-d70d-4895-9dd1-d8768daf622f (a0f1de91-d70d-4895-9dd1-d8768daf622f): created successfully Sep 16 15:25:07 devstack cinder-volume[83259]: DEBUG cinder.volume.manager [None req-dfee0bd4-8a0f-4239-8933-e9b1aa542413 tempest-CreateVolumesFromSourceVolumeTest-644256109 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (85b79193-4534-406e-8c1b-a09ba896c9ba) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83259) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 15:25:07 devstack cinder-volume[83259]: DEBUG cinder.volume.manager [None req-dfee0bd4-8a0f-4239-8933-e9b1aa542413 tempest-CreateVolumesFromSourceVolumeTest-644256109 None] Flow 'volume_create_manager' (34afd806-6fc6-44dd-b42c-5de82ba9b116) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83259) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 16 15:25:08 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [None req-7e5c4dc8-c00f-40d5-aa8f-5c16387efc11 tempest-CreateVolumesFromImageTest-720201122 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c/volume-80f07420-429d-4da3-8050-09d3953830bd" returned: 0 in 0.471s {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 15:25:08 devstack cinder-volume[83259]: INFO cinder.volume.manager [None req-dfee0bd4-8a0f-4239-8933-e9b1aa542413 tempest-CreateVolumesFromSourceVolumeTest-644256109 None] Created volume successfully. Sep 16 15:25:08 devstack cinder-volume[83259]: DEBUG cinder.volume.drivers.quobyte [None req-7e5c4dc8-c00f-40d5-aa8f-5c16387efc11 tempest-CreateVolumesFromImageTest-720201122 None] <== create_volume: return (1120ms) {'provider_location': '10.10.41.181/cinder-vol-61f585ac-f8e2-4d19-a890-7ebc2726cc72'} {{(pid=83259) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Sep 16 15:25:08 devstack cinder-volume[83259]: DEBUG oslo_concurrency.lockutils [None req-7e5c4dc8-c00f-40d5-aa8f-5c16387efc11 tempest-CreateVolumesFromImageTest-720201122 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.146s {{(pid=83259) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 16 15:25:08 devstack cinder-volume[83259]: DEBUG oslo_concurrency.lockutils [None req-fca20055-4b32-4b42-a98a-0e818d9f0e41 tempest-CreateVolumesFromSourceVolumeTest-644256109 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.571s {{(pid=83259) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 16 15:25:08 devstack cinder-volume[83259]: DEBUG cinder.volume.drivers.quobyte [None req-fca20055-4b32-4b42-a98a-0e818d9f0e41 tempest-CreateVolumesFromSourceVolumeTest-644256109 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-16T13:25:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1940306542',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#Quobyte',id=0665e528-09ab-4d71-93a7-97beab9a2ae7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b047c692efbd4022b3cea93b0d5b9c2a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-16T13:25:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-16T13:25:01Z,use_quota=True,user_id='d83e020b86574dd1a77b0be23e17d7cf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(485ead50-3df8-4d76-8d34-a4db136c980a),volume_type_id=485ead50-3df8-4d76-8d34-a4db136c980a)}" {{(pid=83259) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Sep 16 15:25:08 devstack cinder-volume[83259]: DEBUG cinder.volume.drivers.remotefs [None req-fca20055-4b32-4b42-a98a-0e818d9f0e41 tempest-CreateVolumesFromSourceVolumeTest-644256109 None] Creating volume 0665e528-09ab-4d71-93a7-97beab9a2ae7 {{(pid=83259) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}} Sep 16 15:25:08 devstack cinder-volume[83259]: DEBUG oslo_concurrency.lockutils [None req-fca20055-4b32-4b42-a98a-0e818d9f0e41 tempest-CreateVolumesFromSourceVolumeTest-644256109 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83259) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 16 15:25:08 devstack cinder-volume[83259]: DEBUG oslo_concurrency.lockutils [None req-fca20055-4b32-4b42-a98a-0e818d9f0e41 tempest-CreateVolumesFromSourceVolumeTest-644256109 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=83259) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 16 15:25:08 devstack cinder-volume[83259]: DEBUG cinder.volume.drivers.quobyte [None req-fca20055-4b32-4b42-a98a-0e818d9f0e41 tempest-CreateVolumesFromSourceVolumeTest-644256109 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-61f585ac-f8e2-4d19-a890-7ebc2726cc72': None} {{(pid=83259) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:639}} Sep 16 15:25:08 devstack cinder-volume[83259]: DEBUG cinder.volume.drivers.quobyte [None req-fca20055-4b32-4b42-a98a-0e818d9f0e41 tempest-CreateVolumesFromSourceVolumeTest-644256109 None] Available shares ['10.10.41.181/cinder-vol-61f585ac-f8e2-4d19-a890-7ebc2726cc72'] {{(pid=83259) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:669}} Sep 16 15:25:08 devstack cinder-volume[83259]: DEBUG oslo_concurrency.lockutils [None req-fca20055-4b32-4b42-a98a-0e818d9f0e41 tempest-CreateVolumesFromSourceVolumeTest-644256109 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=83259) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 16 15:25:08 devstack cinder-volume[83259]: DEBUG cinder.volume.drivers.quobyte [None req-fca20055-4b32-4b42-a98a-0e818d9f0e41 tempest-CreateVolumesFromSourceVolumeTest-644256109 None] Selected 10.10.41.181/cinder-vol-61f585ac-f8e2-4d19-a890-7ebc2726cc72 as target Quobyte volume. {{(pid=83259) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:690}} Sep 16 15:25:08 devstack cinder-volume[83259]: INFO cinder.volume.drivers.remotefs [None req-fca20055-4b32-4b42-a98a-0e818d9f0e41 tempest-CreateVolumesFromSourceVolumeTest-644256109 None] casted to 10.10.41.181/cinder-vol-61f585ac-f8e2-4d19-a890-7ebc2726cc72 Sep 16 15:25:08 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [None req-fca20055-4b32-4b42-a98a-0e818d9f0e41 tempest-CreateVolumesFromSourceVolumeTest-644256109 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c/volume-0665e528-09ab-4d71-93a7-97beab9a2ae7 1073741824 {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 15:25:08 devstack quobyte-client[83286]: The server volume:87712ffe-8a69-446d-9ed6-4430c7ee9792@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=87712ffe-8a69-446d-9ed6-4430c7ee9792, inode=156, name=volume-0665e528-09ab-4d71-93a7-97beab9a2ae7, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.206), requestorAccessMask=0 Sep 16 15:25:08 devstack cinder-volume[83259]: DEBUG cinder.volume.manager [None req-7e5c4dc8-c00f-40d5-aa8f-5c16387efc11 tempest-CreateVolumesFromImageTest-720201122 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9f4694b1-c300-41a1-a9c9-e0503f0057aa) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-80f07420-429d-4da3-8050-09d3953830bd', 'volume_size': 1}' {{(pid=83259) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 15:25:08 devstack cinder-volume[83259]: DEBUG cinder.volume.manager [None req-7e5c4dc8-c00f-40d5-aa8f-5c16387efc11 tempest-CreateVolumesFromImageTest-720201122 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (43205e61-873d-4f68-9fba-46affb60f27d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83259) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 15:25:08 devstack cinder-volume[83259]: INFO cinder.volume.flows.manager.create_volume [None req-7e5c4dc8-c00f-40d5-aa8f-5c16387efc11 tempest-CreateVolumesFromImageTest-720201122 None] Volume volume-80f07420-429d-4da3-8050-09d3953830bd (80f07420-429d-4da3-8050-09d3953830bd): created successfully Sep 16 15:25:08 devstack cinder-volume[83259]: DEBUG cinder.volume.manager [None req-7e5c4dc8-c00f-40d5-aa8f-5c16387efc11 tempest-CreateVolumesFromImageTest-720201122 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (43205e61-873d-4f68-9fba-46affb60f27d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83259) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 15:25:08 devstack cinder-volume[83259]: DEBUG cinder.volume.manager [None req-7e5c4dc8-c00f-40d5-aa8f-5c16387efc11 tempest-CreateVolumesFromImageTest-720201122 None] Flow 'volume_create_manager' (76aad1f1-0ee5-464a-a7ca-747b9787253d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83259) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 16 15:25:08 devstack cinder-volume[83259]: INFO cinder.volume.manager [None req-7e5c4dc8-c00f-40d5-aa8f-5c16387efc11 tempest-CreateVolumesFromImageTest-720201122 None] Created volume successfully. Sep 16 15:25:08 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [None req-fca20055-4b32-4b42-a98a-0e818d9f0e41 tempest-CreateVolumesFromSourceVolumeTest-644256109 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c/volume-0665e528-09ab-4d71-93a7-97beab9a2ae7 1073741824" returned: 0 in 0.718s {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 15:25:08 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [None req-fca20055-4b32-4b42-a98a-0e818d9f0e41 tempest-CreateVolumesFromSourceVolumeTest-644256109 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c/volume-0665e528-09ab-4d71-93a7-97beab9a2ae7 {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 15:25:09 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [None req-fca20055-4b32-4b42-a98a-0e818d9f0e41 tempest-CreateVolumesFromSourceVolumeTest-644256109 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c/volume-0665e528-09ab-4d71-93a7-97beab9a2ae7" returned: 0 in 0.242s {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 15:25:09 devstack cinder-volume[83259]: DEBUG cinder.volume.drivers.quobyte [None req-fca20055-4b32-4b42-a98a-0e818d9f0e41 tempest-CreateVolumesFromSourceVolumeTest-644256109 None] <== create_volume: return (1017ms) {'provider_location': '10.10.41.181/cinder-vol-61f585ac-f8e2-4d19-a890-7ebc2726cc72'} {{(pid=83259) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Sep 16 15:25:09 devstack cinder-volume[83259]: DEBUG oslo_concurrency.lockutils [None req-fca20055-4b32-4b42-a98a-0e818d9f0e41 tempest-CreateVolumesFromSourceVolumeTest-644256109 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.042s {{(pid=83259) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 16 15:25:09 devstack cinder-volume[83259]: DEBUG cinder.volume.manager [None req-fca20055-4b32-4b42-a98a-0e818d9f0e41 tempest-CreateVolumesFromSourceVolumeTest-644256109 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4856cd34-0bfe-4250-a6f8-925b8ab5e342) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0665e528-09ab-4d71-93a7-97beab9a2ae7', 'volume_size': 1}' {{(pid=83259) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 15:25:09 devstack cinder-volume[83259]: DEBUG cinder.volume.manager [None req-fca20055-4b32-4b42-a98a-0e818d9f0e41 tempest-CreateVolumesFromSourceVolumeTest-644256109 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ba60a58f-def2-46ac-94ba-2533d66545d2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83259) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 15:25:09 devstack cinder-volume[83259]: INFO cinder.volume.flows.manager.create_volume [None req-fca20055-4b32-4b42-a98a-0e818d9f0e41 tempest-CreateVolumesFromSourceVolumeTest-644256109 None] Volume volume-0665e528-09ab-4d71-93a7-97beab9a2ae7 (0665e528-09ab-4d71-93a7-97beab9a2ae7): created successfully Sep 16 15:25:09 devstack cinder-volume[83259]: DEBUG cinder.volume.manager [None req-fca20055-4b32-4b42-a98a-0e818d9f0e41 tempest-CreateVolumesFromSourceVolumeTest-644256109 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ba60a58f-def2-46ac-94ba-2533d66545d2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83259) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 15:25:09 devstack cinder-volume[83259]: DEBUG cinder.volume.manager [None req-fca20055-4b32-4b42-a98a-0e818d9f0e41 tempest-CreateVolumesFromSourceVolumeTest-644256109 None] Flow 'volume_create_manager' (534718bb-b8e5-45b7-96e6-ff9f5a49aef1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83259) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 16 15:25:09 devstack cinder-volume[83259]: INFO cinder.volume.manager [None req-fca20055-4b32-4b42-a98a-0e818d9f0e41 tempest-CreateVolumesFromSourceVolumeTest-644256109 None] Created volume successfully. Sep 16 15:25:09 devstack cinder-volume[83259]: DEBUG cinder.coordination [None req-371dbfb4-e1f3-4687-9286-11c7433b380a tempest-CreateVolumesFromSourceVolumeTest-644256109 None] Acquiring lock "cinder-0665e528-09ab-4d71-93a7-97beab9a2ae7-delete_volume" by "delete_volume" {{(pid=83259) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 16 15:25:10 devstack cinder-volume[83259]: DEBUG cinder.coordination [None req-371dbfb4-e1f3-4687-9286-11c7433b380a tempest-CreateVolumesFromSourceVolumeTest-644256109 None] Lock "cinder-0665e528-09ab-4d71-93a7-97beab9a2ae7-delete_volume" acquired by "delete_volume" :: waited 0.120s {{(pid=83259) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 16 15:25:10 devstack cinder-volume[83259]: WARNING cinder.volume.volume_utils [None req-371dbfb4-e1f3-4687-9286-11c7433b380a tempest-CreateVolumesFromSourceVolumeTest-644256109 None] Volume driver (QuobyteDriver 1.2) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 16 15:25:10 devstack cinder-volume[83259]: DEBUG cinder.coordination [None req-371dbfb4-e1f3-4687-9286-11c7433b380a tempest-CreateVolumesFromSourceVolumeTest-644256109 None] Acquiring lock "cinder-quobyte-0665e528-09ab-4d71-93a7-97beab9a2ae7" by "delete_volume" {{(pid=83259) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 16 15:25:10 devstack cinder-volume[83259]: DEBUG cinder.coordination [None req-215f68bd-1571-41b2-8fdf-cfc26a4b3977 tempest-CreateVolumesFromImageTest-720201122 None] Acquiring lock "cinder-80f07420-429d-4da3-8050-09d3953830bd-delete_volume" by "delete_volume" {{(pid=83259) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 16 15:25:10 devstack cinder-volume[83259]: DEBUG cinder.coordination [None req-215f68bd-1571-41b2-8fdf-cfc26a4b3977 tempest-CreateVolumesFromImageTest-720201122 None] Lock "cinder-80f07420-429d-4da3-8050-09d3953830bd-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=83259) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 16 15:25:10 devstack cinder-volume[83259]: DEBUG cinder.coordination [None req-371dbfb4-e1f3-4687-9286-11c7433b380a tempest-CreateVolumesFromSourceVolumeTest-644256109 None] Lock "cinder-quobyte-0665e528-09ab-4d71-93a7-97beab9a2ae7" acquired by "delete_volume" :: waited 0.042s {{(pid=83259) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 16 15:25:10 devstack cinder-volume[83259]: DEBUG oslo.privsep.daemon [-] privsep: reply[34409510-73f8-4e99-9a07-82e379ea7752]: (4, 'qcow2') {{(pid=84312) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 16 15:25:10 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [None req-371dbfb4-e1f3-4687-9286-11c7433b380a tempest-CreateVolumesFromSourceVolumeTest-644256109 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c/volume-0665e528-09ab-4d71-93a7-97beab9a2ae7 {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 15:25:10 devstack cinder-volume[83259]: WARNING cinder.volume.volume_utils [None req-215f68bd-1571-41b2-8fdf-cfc26a4b3977 tempest-CreateVolumesFromImageTest-720201122 None] Volume driver (QuobyteDriver 1.2) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 16 15:25:10 devstack cinder-volume[83259]: DEBUG cinder.coordination [None req-215f68bd-1571-41b2-8fdf-cfc26a4b3977 tempest-CreateVolumesFromImageTest-720201122 None] Acquiring lock "cinder-quobyte-80f07420-429d-4da3-8050-09d3953830bd" by "delete_volume" {{(pid=83259) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 16 15:25:10 devstack cinder-volume[83259]: DEBUG cinder.coordination [None req-215f68bd-1571-41b2-8fdf-cfc26a4b3977 tempest-CreateVolumesFromImageTest-720201122 None] Lock "cinder-quobyte-80f07420-429d-4da3-8050-09d3953830bd" acquired by "delete_volume" :: waited 0.107s {{(pid=83259) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 16 15:25:10 devstack cinder-volume[83259]: DEBUG oslo.privsep.daemon [-] privsep: reply[35a318f2-8315-440a-974e-8cdb84acbaea]: (4, 'qcow2') {{(pid=84312) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 16 15:25:10 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [None req-215f68bd-1571-41b2-8fdf-cfc26a4b3977 tempest-CreateVolumesFromImageTest-720201122 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c/volume-80f07420-429d-4da3-8050-09d3953830bd {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 15:25:11 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [None req-371dbfb4-e1f3-4687-9286-11c7433b380a tempest-CreateVolumesFromSourceVolumeTest-644256109 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c/volume-0665e528-09ab-4d71-93a7-97beab9a2ae7" returned: 0 in 0.791s {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 15:25:11 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [None req-371dbfb4-e1f3-4687-9286-11c7433b380a tempest-CreateVolumesFromSourceVolumeTest-644256109 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c/volume-0665e528-09ab-4d71-93a7-97beab9a2ae7 {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 15:25:11 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [None req-371dbfb4-e1f3-4687-9286-11c7433b380a tempest-CreateVolumesFromSourceVolumeTest-644256109 None] CMD "rm -f /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c/volume-0665e528-09ab-4d71-93a7-97beab9a2ae7" returned: 0 in 0.161s {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 15:25:11 devstack cinder-volume[83259]: DEBUG cinder.coordination [None req-371dbfb4-e1f3-4687-9286-11c7433b380a tempest-CreateVolumesFromSourceVolumeTest-644256109 None] Lock "cinder-quobyte-0665e528-09ab-4d71-93a7-97beab9a2ae7" released by "delete_volume" :: held 1.293s {{(pid=83259) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 16 15:25:11 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [None req-215f68bd-1571-41b2-8fdf-cfc26a4b3977 tempest-CreateVolumesFromImageTest-720201122 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c/volume-80f07420-429d-4da3-8050-09d3953830bd" returned: 0 in 0.801s {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 15:25:11 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [None req-215f68bd-1571-41b2-8fdf-cfc26a4b3977 tempest-CreateVolumesFromImageTest-720201122 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c/volume-80f07420-429d-4da3-8050-09d3953830bd {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 15:25:12 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [None req-215f68bd-1571-41b2-8fdf-cfc26a4b3977 tempest-CreateVolumesFromImageTest-720201122 None] CMD "rm -f /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c/volume-80f07420-429d-4da3-8050-09d3953830bd" returned: 0 in 0.402s {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 15:25:12 devstack cinder-volume[83259]: DEBUG cinder.coordination [None req-215f68bd-1571-41b2-8fdf-cfc26a4b3977 tempest-CreateVolumesFromImageTest-720201122 None] Lock "cinder-quobyte-80f07420-429d-4da3-8050-09d3953830bd" released by "delete_volume" :: held 1.327s {{(pid=83259) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 16 15:25:12 devstack cinder-volume[83259]: DEBUG cinder.quota [None req-371dbfb4-e1f3-4687-9286-11c7433b380a tempest-CreateVolumesFromSourceVolumeTest-644256109 None] Created reservations ['170e2e2c-40c2-44f1-8c6f-e7e6b725c4c8', 'cde91046-4a92-47c3-bc67-9766934903be', '9a1ced33-7e0f-455a-a634-fd43fb130c5a', '72b4d076-499e-4c30-95ba-b22d1a8868f5'] {{(pid=83259) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 16 15:25:12 devstack cinder-volume[83259]: DEBUG cinder.quota [None req-215f68bd-1571-41b2-8fdf-cfc26a4b3977 tempest-CreateVolumesFromImageTest-720201122 None] Created reservations ['45e6e900-7efc-4464-b74c-79f14ee47df7', '2f5483b4-49aa-4793-9f4c-8120b603be00', '866c203a-e043-47a5-b655-30b14e0c37e1', '5a59519f-40af-4416-b2b3-9554200ff897'] {{(pid=83259) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 16 15:25:12 devstack cinder-volume[83259]: DEBUG oslo_concurrency.lockutils [None req-371dbfb4-e1f3-4687-9286-11c7433b380a tempest-CreateVolumesFromSourceVolumeTest-644256109 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83259) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 16 15:25:12 devstack cinder-volume[83259]: DEBUG oslo_concurrency.lockutils [None req-371dbfb4-e1f3-4687-9286-11c7433b380a tempest-CreateVolumesFromSourceVolumeTest-644256109 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=83259) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 16 15:25:12 devstack cinder-volume[83259]: DEBUG cinder.volume.drivers.quobyte [None req-371dbfb4-e1f3-4687-9286-11c7433b380a tempest-CreateVolumesFromSourceVolumeTest-644256109 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-61f585ac-f8e2-4d19-a890-7ebc2726cc72': None} {{(pid=83259) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:639}} Sep 16 15:25:12 devstack cinder-volume[83259]: DEBUG cinder.volume.drivers.quobyte [None req-371dbfb4-e1f3-4687-9286-11c7433b380a tempest-CreateVolumesFromSourceVolumeTest-644256109 None] Available shares ['10.10.41.181/cinder-vol-61f585ac-f8e2-4d19-a890-7ebc2726cc72'] {{(pid=83259) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:669}} Sep 16 15:25:12 devstack cinder-volume[83259]: DEBUG oslo_concurrency.lockutils [None req-371dbfb4-e1f3-4687-9286-11c7433b380a tempest-CreateVolumesFromSourceVolumeTest-644256109 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=83259) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 16 15:25:12 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [None req-371dbfb4-e1f3-4687-9286-11c7433b380a tempest-CreateVolumesFromSourceVolumeTest-644256109 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 15:25:13 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [None req-371dbfb4-e1f3-4687-9286-11c7433b380a tempest-CreateVolumesFromSourceVolumeTest-644256109 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c" returned: 0 in 0.329s {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 15:25:13 devstack cinder-volume[83259]: DEBUG cinder.manager [None req-371dbfb4-e1f3-4687-9286-11c7433b380a tempest-CreateVolumesFromSourceVolumeTest-644256109 None] Notifying Schedulers of capabilities ... {{(pid=83259) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 16 15:25:13 devstack cinder-volume[83259]: DEBUG oslo_concurrency.lockutils [None req-215f68bd-1571-41b2-8fdf-cfc26a4b3977 tempest-CreateVolumesFromImageTest-720201122 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83259) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 16 15:25:13 devstack cinder-volume[83259]: DEBUG oslo_concurrency.lockutils [None req-215f68bd-1571-41b2-8fdf-cfc26a4b3977 tempest-CreateVolumesFromImageTest-720201122 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.008s {{(pid=83259) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 16 15:25:13 devstack cinder-volume[83259]: DEBUG cinder.volume.drivers.quobyte [None req-215f68bd-1571-41b2-8fdf-cfc26a4b3977 tempest-CreateVolumesFromImageTest-720201122 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-61f585ac-f8e2-4d19-a890-7ebc2726cc72': None} {{(pid=83259) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:639}} Sep 16 15:25:13 devstack cinder-volume[83259]: DEBUG cinder.volume.drivers.quobyte [None req-215f68bd-1571-41b2-8fdf-cfc26a4b3977 tempest-CreateVolumesFromImageTest-720201122 None] Available shares ['10.10.41.181/cinder-vol-61f585ac-f8e2-4d19-a890-7ebc2726cc72'] {{(pid=83259) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:669}} Sep 16 15:25:13 devstack cinder-volume[83259]: DEBUG oslo_concurrency.lockutils [None req-215f68bd-1571-41b2-8fdf-cfc26a4b3977 tempest-CreateVolumesFromImageTest-720201122 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=83259) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 16 15:25:13 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [None req-215f68bd-1571-41b2-8fdf-cfc26a4b3977 tempest-CreateVolumesFromImageTest-720201122 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 15:25:13 devstack cinder-volume[83259]: INFO cinder.volume.manager [None req-371dbfb4-e1f3-4687-9286-11c7433b380a tempest-CreateVolumesFromSourceVolumeTest-644256109 None] Deleted volume successfully. Sep 16 15:25:13 devstack cinder-volume[83259]: DEBUG cinder.coordination [None req-0f91f4e6-4b97-48b0-ba62-4b94d5e710ef tempest-CreateVolumesFromSourceVolumeTest-644256109 None] Acquiring lock "cinder-563cb599-f010-435f-bc99-161d4436aebc-delete_volume" by "delete_volume" {{(pid=83259) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 16 15:25:13 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [None req-215f68bd-1571-41b2-8fdf-cfc26a4b3977 tempest-CreateVolumesFromImageTest-720201122 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c" returned: 0 in 0.562s {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 15:25:13 devstack cinder-volume[83259]: DEBUG cinder.manager [None req-215f68bd-1571-41b2-8fdf-cfc26a4b3977 tempest-CreateVolumesFromImageTest-720201122 None] Notifying Schedulers of capabilities ... {{(pid=83259) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 16 15:25:13 devstack cinder-volume[83259]: INFO cinder.volume.manager [None req-215f68bd-1571-41b2-8fdf-cfc26a4b3977 tempest-CreateVolumesFromImageTest-720201122 None] Deleted volume successfully. Sep 16 15:25:13 devstack cinder-volume[83259]: DEBUG cinder.coordination [None req-371dbfb4-e1f3-4687-9286-11c7433b380a tempest-CreateVolumesFromSourceVolumeTest-644256109 None] Lock "cinder-0665e528-09ab-4d71-93a7-97beab9a2ae7-delete_volume" released by "delete_volume" :: held 3.736s {{(pid=83259) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 16 15:25:13 devstack cinder-volume[83259]: DEBUG cinder.coordination [None req-0f91f4e6-4b97-48b0-ba62-4b94d5e710ef tempest-CreateVolumesFromSourceVolumeTest-644256109 None] Lock "cinder-563cb599-f010-435f-bc99-161d4436aebc-delete_volume" acquired by "delete_volume" :: waited 0.163s {{(pid=83259) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 16 15:25:13 devstack cinder-volume[83259]: DEBUG cinder.coordination [None req-d9f13ac1-e433-47e1-ad7c-41b6a91df7dd tempest-CreateVolumesFromImageTest-720201122 None] Acquiring lock "cinder-cbc2bd98-4f5b-49cb-8fe2-8cd876ca4b47-delete_volume" by "delete_volume" {{(pid=83259) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 16 15:25:13 devstack cinder-volume[83259]: DEBUG cinder.coordination [None req-215f68bd-1571-41b2-8fdf-cfc26a4b3977 tempest-CreateVolumesFromImageTest-720201122 None] Lock "cinder-80f07420-429d-4da3-8050-09d3953830bd-delete_volume" released by "delete_volume" :: held 3.593s {{(pid=83259) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 16 15:25:13 devstack cinder-volume[83259]: DEBUG cinder.coordination [None req-d9f13ac1-e433-47e1-ad7c-41b6a91df7dd tempest-CreateVolumesFromImageTest-720201122 None] Lock "cinder-cbc2bd98-4f5b-49cb-8fe2-8cd876ca4b47-delete_volume" acquired by "delete_volume" :: waited 0.061s {{(pid=83259) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 16 15:25:13 devstack cinder-volume[83259]: WARNING cinder.volume.volume_utils [None req-0f91f4e6-4b97-48b0-ba62-4b94d5e710ef tempest-CreateVolumesFromSourceVolumeTest-644256109 None] Volume driver (QuobyteDriver 1.2) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 16 15:25:13 devstack cinder-volume[83259]: DEBUG cinder.coordination [None req-0f91f4e6-4b97-48b0-ba62-4b94d5e710ef tempest-CreateVolumesFromSourceVolumeTest-644256109 None] Acquiring lock "cinder-quobyte-563cb599-f010-435f-bc99-161d4436aebc" by "delete_volume" {{(pid=83259) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 16 15:25:13 devstack cinder-volume[83259]: DEBUG cinder.coordination [None req-0f91f4e6-4b97-48b0-ba62-4b94d5e710ef tempest-CreateVolumesFromSourceVolumeTest-644256109 None] Lock "cinder-quobyte-563cb599-f010-435f-bc99-161d4436aebc" acquired by "delete_volume" :: waited 0.025s {{(pid=83259) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 16 15:25:13 devstack cinder-volume[83259]: DEBUG oslo.privsep.daemon [-] privsep: reply[c0bee07d-b15c-4f04-ab50-faeb6a4009a2]: (4, 'qcow2') {{(pid=84312) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 16 15:25:14 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [None req-0f91f4e6-4b97-48b0-ba62-4b94d5e710ef tempest-CreateVolumesFromSourceVolumeTest-644256109 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c/volume-563cb599-f010-435f-bc99-161d4436aebc {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 15:25:14 devstack cinder-volume[83259]: WARNING cinder.volume.volume_utils [None req-d9f13ac1-e433-47e1-ad7c-41b6a91df7dd tempest-CreateVolumesFromImageTest-720201122 None] Volume driver (QuobyteDriver 1.2) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 16 15:25:14 devstack cinder-volume[83259]: DEBUG cinder.coordination [None req-d9f13ac1-e433-47e1-ad7c-41b6a91df7dd tempest-CreateVolumesFromImageTest-720201122 None] Acquiring lock "cinder-quobyte-cbc2bd98-4f5b-49cb-8fe2-8cd876ca4b47" by "delete_volume" {{(pid=83259) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 16 15:25:14 devstack cinder-volume[83259]: DEBUG cinder.coordination [None req-d9f13ac1-e433-47e1-ad7c-41b6a91df7dd tempest-CreateVolumesFromImageTest-720201122 None] Lock "cinder-quobyte-cbc2bd98-4f5b-49cb-8fe2-8cd876ca4b47" acquired by "delete_volume" :: waited 0.121s {{(pid=83259) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 16 15:25:14 devstack cinder-volume[83259]: DEBUG oslo.privsep.daemon [-] privsep: reply[d0cbc623-2425-4a85-93b3-ffca81e7204c]: (4, 'qcow2') {{(pid=84312) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 16 15:25:14 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [None req-d9f13ac1-e433-47e1-ad7c-41b6a91df7dd tempest-CreateVolumesFromImageTest-720201122 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c/volume-cbc2bd98-4f5b-49cb-8fe2-8cd876ca4b47 {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 15:25:14 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [None req-0f91f4e6-4b97-48b0-ba62-4b94d5e710ef tempest-CreateVolumesFromSourceVolumeTest-644256109 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c/volume-563cb599-f010-435f-bc99-161d4436aebc" returned: 0 in 0.723s {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 15:25:14 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [None req-0f91f4e6-4b97-48b0-ba62-4b94d5e710ef tempest-CreateVolumesFromSourceVolumeTest-644256109 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c/volume-563cb599-f010-435f-bc99-161d4436aebc {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 15:25:14 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [None req-0f91f4e6-4b97-48b0-ba62-4b94d5e710ef tempest-CreateVolumesFromSourceVolumeTest-644256109 None] CMD "rm -f /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c/volume-563cb599-f010-435f-bc99-161d4436aebc" returned: 0 in 0.167s {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 15:25:15 devstack cinder-volume[83259]: DEBUG cinder.coordination [None req-0f91f4e6-4b97-48b0-ba62-4b94d5e710ef tempest-CreateVolumesFromSourceVolumeTest-644256109 None] Lock "cinder-quobyte-563cb599-f010-435f-bc99-161d4436aebc" released by "delete_volume" :: held 1.141s {{(pid=83259) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 16 15:25:15 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [None req-d9f13ac1-e433-47e1-ad7c-41b6a91df7dd tempest-CreateVolumesFromImageTest-720201122 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c/volume-cbc2bd98-4f5b-49cb-8fe2-8cd876ca4b47" returned: 0 in 0.897s {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 15:25:15 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [None req-d9f13ac1-e433-47e1-ad7c-41b6a91df7dd tempest-CreateVolumesFromImageTest-720201122 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c/volume-cbc2bd98-4f5b-49cb-8fe2-8cd876ca4b47 {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 15:25:15 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [None req-d9f13ac1-e433-47e1-ad7c-41b6a91df7dd tempest-CreateVolumesFromImageTest-720201122 None] CMD "rm -f /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c/volume-cbc2bd98-4f5b-49cb-8fe2-8cd876ca4b47" returned: 0 in 0.291s {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 15:25:15 devstack cinder-volume[83259]: DEBUG cinder.coordination [None req-d9f13ac1-e433-47e1-ad7c-41b6a91df7dd tempest-CreateVolumesFromImageTest-720201122 None] Lock "cinder-quobyte-cbc2bd98-4f5b-49cb-8fe2-8cd876ca4b47" released by "delete_volume" :: held 1.349s {{(pid=83259) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 16 15:25:15 devstack cinder-volume[83259]: DEBUG cinder.quota [None req-0f91f4e6-4b97-48b0-ba62-4b94d5e710ef tempest-CreateVolumesFromSourceVolumeTest-644256109 None] Created reservations ['5d0c9fc6-5828-4cab-8319-f0b3b9a81a33', '558a8099-7223-406c-b60a-439e58858e77', 'a0dd8d46-df9d-431e-aa8f-d771e4762a39', 'cb3f3432-2835-44bd-b9e7-d17d0c9b97ee'] {{(pid=83259) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 16 15:25:15 devstack cinder-volume[83259]: DEBUG cinder.quota [None req-d9f13ac1-e433-47e1-ad7c-41b6a91df7dd tempest-CreateVolumesFromImageTest-720201122 None] Created reservations ['552c4431-06fe-43dc-a90e-ef69d6889310', 'e0f3ce6e-2d64-456a-b340-7bc4e91fdec3', 'a5561072-20e0-4ab6-9987-daabc87ea3d4', '172157b9-8ebf-4906-ae59-7ad40c3e3599'] {{(pid=83259) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 16 15:25:16 devstack cinder-volume[83259]: DEBUG oslo_concurrency.lockutils [None req-0f91f4e6-4b97-48b0-ba62-4b94d5e710ef tempest-CreateVolumesFromSourceVolumeTest-644256109 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83259) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 16 15:25:16 devstack cinder-volume[83259]: DEBUG oslo_concurrency.lockutils [None req-0f91f4e6-4b97-48b0-ba62-4b94d5e710ef tempest-CreateVolumesFromSourceVolumeTest-644256109 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=83259) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 16 15:25:16 devstack cinder-volume[83259]: DEBUG cinder.volume.drivers.quobyte [None req-0f91f4e6-4b97-48b0-ba62-4b94d5e710ef tempest-CreateVolumesFromSourceVolumeTest-644256109 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-61f585ac-f8e2-4d19-a890-7ebc2726cc72': None} {{(pid=83259) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:639}} Sep 16 15:25:16 devstack cinder-volume[83259]: DEBUG cinder.volume.drivers.quobyte [None req-0f91f4e6-4b97-48b0-ba62-4b94d5e710ef tempest-CreateVolumesFromSourceVolumeTest-644256109 None] Available shares ['10.10.41.181/cinder-vol-61f585ac-f8e2-4d19-a890-7ebc2726cc72'] {{(pid=83259) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:669}} Sep 16 15:25:16 devstack cinder-volume[83259]: DEBUG oslo_concurrency.lockutils [None req-0f91f4e6-4b97-48b0-ba62-4b94d5e710ef tempest-CreateVolumesFromSourceVolumeTest-644256109 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=83259) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 16 15:25:16 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [None req-0f91f4e6-4b97-48b0-ba62-4b94d5e710ef tempest-CreateVolumesFromSourceVolumeTest-644256109 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 15:25:16 devstack cinder-volume[83259]: DEBUG cinder.coordination [None req-0d3d21a5-8bb2-493d-b8bb-6dc9405a4061 tempest-CreateVolumesFromImageTest-720201122 None] Acquiring lock "cinder-35e9c3e3-9b63-4e02-a4c6-17e57dd4cd51-delete_volume" by "delete_volume" {{(pid=83259) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 16 15:25:16 devstack cinder-volume[83259]: DEBUG cinder.coordination [None req-0d3d21a5-8bb2-493d-b8bb-6dc9405a4061 tempest-CreateVolumesFromImageTest-720201122 None] Lock "cinder-35e9c3e3-9b63-4e02-a4c6-17e57dd4cd51-delete_volume" acquired by "delete_volume" :: waited 0.131s {{(pid=83259) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 16 15:25:16 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [None req-0f91f4e6-4b97-48b0-ba62-4b94d5e710ef tempest-CreateVolumesFromSourceVolumeTest-644256109 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c" returned: 0 in 0.546s {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 15:25:16 devstack cinder-volume[83259]: DEBUG cinder.manager [None req-0f91f4e6-4b97-48b0-ba62-4b94d5e710ef tempest-CreateVolumesFromSourceVolumeTest-644256109 None] Notifying Schedulers of capabilities ... {{(pid=83259) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 16 15:25:16 devstack cinder-volume[83259]: DEBUG oslo_concurrency.lockutils [None req-d9f13ac1-e433-47e1-ad7c-41b6a91df7dd tempest-CreateVolumesFromImageTest-720201122 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83259) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 16 15:25:16 devstack cinder-volume[83259]: DEBUG oslo_concurrency.lockutils [None req-d9f13ac1-e433-47e1-ad7c-41b6a91df7dd tempest-CreateVolumesFromImageTest-720201122 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.005s {{(pid=83259) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 16 15:25:16 devstack cinder-volume[83259]: DEBUG cinder.volume.drivers.quobyte [None req-d9f13ac1-e433-47e1-ad7c-41b6a91df7dd tempest-CreateVolumesFromImageTest-720201122 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-61f585ac-f8e2-4d19-a890-7ebc2726cc72': None} {{(pid=83259) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:639}} Sep 16 15:25:16 devstack cinder-volume[83259]: DEBUG cinder.volume.drivers.quobyte [None req-d9f13ac1-e433-47e1-ad7c-41b6a91df7dd tempest-CreateVolumesFromImageTest-720201122 None] Available shares ['10.10.41.181/cinder-vol-61f585ac-f8e2-4d19-a890-7ebc2726cc72'] {{(pid=83259) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:669}} Sep 16 15:25:16 devstack cinder-volume[83259]: DEBUG oslo_concurrency.lockutils [None req-d9f13ac1-e433-47e1-ad7c-41b6a91df7dd tempest-CreateVolumesFromImageTest-720201122 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=83259) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 16 15:25:16 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [None req-d9f13ac1-e433-47e1-ad7c-41b6a91df7dd tempest-CreateVolumesFromImageTest-720201122 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 15:25:16 devstack cinder-volume[83259]: INFO cinder.volume.manager [None req-0f91f4e6-4b97-48b0-ba62-4b94d5e710ef tempest-CreateVolumesFromSourceVolumeTest-644256109 None] Deleted volume successfully. Sep 16 15:25:17 devstack cinder-volume[83259]: DEBUG cinder.coordination [None req-7b093ae2-35d9-4e48-be10-9382ce39358f tempest-CreateVolumesFromSourceVolumeTest-644256109 None] Acquiring lock "cinder-a0f1de91-d70d-4895-9dd1-d8768daf622f-delete_volume" by "delete_volume" {{(pid=83259) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 16 15:25:17 devstack cinder-volume[83259]: WARNING cinder.volume.volume_utils [None req-0d3d21a5-8bb2-493d-b8bb-6dc9405a4061 tempest-CreateVolumesFromImageTest-720201122 None] Volume driver (QuobyteDriver 1.2) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 16 15:25:17 devstack cinder-volume[83259]: DEBUG cinder.coordination [None req-0d3d21a5-8bb2-493d-b8bb-6dc9405a4061 tempest-CreateVolumesFromImageTest-720201122 None] Acquiring lock "cinder-quobyte-35e9c3e3-9b63-4e02-a4c6-17e57dd4cd51" by "delete_volume" {{(pid=83259) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 16 15:25:17 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [None req-d9f13ac1-e433-47e1-ad7c-41b6a91df7dd tempest-CreateVolumesFromImageTest-720201122 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c" returned: 0 in 0.661s {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 15:25:17 devstack cinder-volume[83259]: DEBUG cinder.manager [None req-d9f13ac1-e433-47e1-ad7c-41b6a91df7dd tempest-CreateVolumesFromImageTest-720201122 None] Notifying Schedulers of capabilities ... {{(pid=83259) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 16 15:25:17 devstack cinder-volume[83259]: DEBUG cinder.coordination [None req-0f91f4e6-4b97-48b0-ba62-4b94d5e710ef tempest-CreateVolumesFromSourceVolumeTest-644256109 None] Lock "cinder-563cb599-f010-435f-bc99-161d4436aebc-delete_volume" released by "delete_volume" :: held 3.695s {{(pid=83259) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 16 15:25:17 devstack cinder-volume[83259]: INFO cinder.volume.manager [None req-d9f13ac1-e433-47e1-ad7c-41b6a91df7dd tempest-CreateVolumesFromImageTest-720201122 None] Deleted volume successfully. Sep 16 15:25:17 devstack cinder-volume[83259]: DEBUG cinder.coordination [None req-0d3d21a5-8bb2-493d-b8bb-6dc9405a4061 tempest-CreateVolumesFromImageTest-720201122 None] Lock "cinder-quobyte-35e9c3e3-9b63-4e02-a4c6-17e57dd4cd51" acquired by "delete_volume" :: waited 0.106s {{(pid=83259) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 16 15:25:17 devstack cinder-volume[83259]: DEBUG cinder.coordination [None req-7b093ae2-35d9-4e48-be10-9382ce39358f tempest-CreateVolumesFromSourceVolumeTest-644256109 None] Lock "cinder-a0f1de91-d70d-4895-9dd1-d8768daf622f-delete_volume" acquired by "delete_volume" :: waited 0.168s {{(pid=83259) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 16 15:25:17 devstack cinder-volume[83259]: DEBUG oslo.privsep.daemon [-] privsep: reply[2cbc1681-e8ef-4acb-9654-b01fba453c9d]: (4, 'qcow2') {{(pid=84312) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 16 15:25:17 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [None req-0d3d21a5-8bb2-493d-b8bb-6dc9405a4061 tempest-CreateVolumesFromImageTest-720201122 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c/volume-35e9c3e3-9b63-4e02-a4c6-17e57dd4cd51 {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 15:25:17 devstack cinder-volume[83259]: DEBUG cinder.coordination [None req-d9f13ac1-e433-47e1-ad7c-41b6a91df7dd tempest-CreateVolumesFromImageTest-720201122 None] Lock "cinder-cbc2bd98-4f5b-49cb-8fe2-8cd876ca4b47-delete_volume" released by "delete_volume" :: held 4.153s {{(pid=83259) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 16 15:25:18 devstack cinder-volume[83259]: WARNING cinder.volume.volume_utils [None req-7b093ae2-35d9-4e48-be10-9382ce39358f tempest-CreateVolumesFromSourceVolumeTest-644256109 None] Volume driver (QuobyteDriver 1.2) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 16 15:25:18 devstack cinder-volume[83259]: DEBUG cinder.coordination [None req-7b093ae2-35d9-4e48-be10-9382ce39358f tempest-CreateVolumesFromSourceVolumeTest-644256109 None] Acquiring lock "cinder-quobyte-a0f1de91-d70d-4895-9dd1-d8768daf622f" by "delete_volume" {{(pid=83259) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 16 15:25:18 devstack cinder-volume[83259]: DEBUG cinder.coordination [None req-7b093ae2-35d9-4e48-be10-9382ce39358f tempest-CreateVolumesFromSourceVolumeTest-644256109 None] Lock "cinder-quobyte-a0f1de91-d70d-4895-9dd1-d8768daf622f" acquired by "delete_volume" :: waited 0.029s {{(pid=83259) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 16 15:25:18 devstack cinder-volume[83259]: DEBUG oslo.privsep.daemon [-] privsep: reply[d6651d85-a9e4-48f9-814e-9ca57a4e5fec]: (4, 'qcow2') {{(pid=84312) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 16 15:25:18 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [None req-7b093ae2-35d9-4e48-be10-9382ce39358f tempest-CreateVolumesFromSourceVolumeTest-644256109 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c/volume-a0f1de91-d70d-4895-9dd1-d8768daf622f {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 15:25:18 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [None req-0d3d21a5-8bb2-493d-b8bb-6dc9405a4061 tempest-CreateVolumesFromImageTest-720201122 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c/volume-35e9c3e3-9b63-4e02-a4c6-17e57dd4cd51" returned: 0 in 0.854s {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 15:25:18 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [None req-0d3d21a5-8bb2-493d-b8bb-6dc9405a4061 tempest-CreateVolumesFromImageTest-720201122 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c/volume-35e9c3e3-9b63-4e02-a4c6-17e57dd4cd51 {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 15:25:18 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [None req-0d3d21a5-8bb2-493d-b8bb-6dc9405a4061 tempest-CreateVolumesFromImageTest-720201122 None] CMD "rm -f /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c/volume-35e9c3e3-9b63-4e02-a4c6-17e57dd4cd51" returned: 0 in 0.190s {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 15:25:18 devstack cinder-volume[83259]: DEBUG cinder.coordination [None req-0d3d21a5-8bb2-493d-b8bb-6dc9405a4061 tempest-CreateVolumesFromImageTest-720201122 None] Lock "cinder-quobyte-35e9c3e3-9b63-4e02-a4c6-17e57dd4cd51" released by "delete_volume" :: held 1.270s {{(pid=83259) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 16 15:25:18 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [None req-7b093ae2-35d9-4e48-be10-9382ce39358f tempest-CreateVolumesFromSourceVolumeTest-644256109 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c/volume-a0f1de91-d70d-4895-9dd1-d8768daf622f" returned: 0 in 0.779s {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 15:25:18 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [None req-7b093ae2-35d9-4e48-be10-9382ce39358f tempest-CreateVolumesFromSourceVolumeTest-644256109 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c/volume-a0f1de91-d70d-4895-9dd1-d8768daf622f {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 15:25:19 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [None req-7b093ae2-35d9-4e48-be10-9382ce39358f tempest-CreateVolumesFromSourceVolumeTest-644256109 None] CMD "rm -f /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c/volume-a0f1de91-d70d-4895-9dd1-d8768daf622f" returned: 0 in 0.266s {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 15:25:19 devstack cinder-volume[83259]: DEBUG cinder.coordination [None req-7b093ae2-35d9-4e48-be10-9382ce39358f tempest-CreateVolumesFromSourceVolumeTest-644256109 None] Lock "cinder-quobyte-a0f1de91-d70d-4895-9dd1-d8768daf622f" released by "delete_volume" :: held 1.215s {{(pid=83259) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 16 15:25:19 devstack cinder-volume[83259]: DEBUG cinder.quota [None req-0d3d21a5-8bb2-493d-b8bb-6dc9405a4061 tempest-CreateVolumesFromImageTest-720201122 None] Created reservations ['ffded85e-6b07-4957-a675-64501ac431c2', 'e2bf4517-c263-4220-8df2-1dc799d1cb2c', 'd457466e-b9d7-4871-9277-a4434185dbeb', '1d4c94fc-f995-44e8-a3d8-5c93c9b46ac9'] {{(pid=83259) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 16 15:25:19 devstack cinder-volume[83259]: DEBUG cinder.quota [None req-7b093ae2-35d9-4e48-be10-9382ce39358f tempest-CreateVolumesFromSourceVolumeTest-644256109 None] Created reservations ['a92f0e22-ee11-43d7-a1ab-0f887269f499', '77cf279a-b856-4bd8-a7a0-e49200219a6c', '9592b801-605f-45f3-a681-1c6dd6ffa224', '422f3740-acbc-4b27-8bd6-fa1983170b1c'] {{(pid=83259) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 16 15:25:19 devstack cinder-volume[83259]: DEBUG oslo_concurrency.lockutils [None req-0d3d21a5-8bb2-493d-b8bb-6dc9405a4061 tempest-CreateVolumesFromImageTest-720201122 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83259) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 16 15:25:19 devstack cinder-volume[83259]: DEBUG oslo_concurrency.lockutils [None req-0d3d21a5-8bb2-493d-b8bb-6dc9405a4061 tempest-CreateVolumesFromImageTest-720201122 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=83259) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 16 15:25:19 devstack cinder-volume[83259]: DEBUG cinder.volume.drivers.quobyte [None req-0d3d21a5-8bb2-493d-b8bb-6dc9405a4061 tempest-CreateVolumesFromImageTest-720201122 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-61f585ac-f8e2-4d19-a890-7ebc2726cc72': None} {{(pid=83259) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:639}} Sep 16 15:25:19 devstack cinder-volume[83259]: DEBUG cinder.volume.drivers.quobyte [None req-0d3d21a5-8bb2-493d-b8bb-6dc9405a4061 tempest-CreateVolumesFromImageTest-720201122 None] Available shares ['10.10.41.181/cinder-vol-61f585ac-f8e2-4d19-a890-7ebc2726cc72'] {{(pid=83259) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:669}} Sep 16 15:25:19 devstack cinder-volume[83259]: DEBUG oslo_concurrency.lockutils [None req-0d3d21a5-8bb2-493d-b8bb-6dc9405a4061 tempest-CreateVolumesFromImageTest-720201122 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=83259) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 16 15:25:19 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [None req-0d3d21a5-8bb2-493d-b8bb-6dc9405a4061 tempest-CreateVolumesFromImageTest-720201122 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 15:25:20 devstack cinder-volume[83259]: DEBUG cinder.coordination [None req-b5ee6201-de52-481f-9cdd-580e0c557618 tempest-CreateVolumesFromImageTest-720201122 None] Acquiring lock "cinder-c25ac34f-86c7-4df0-b2f8-626cd2fd6a3e-delete_volume" by "delete_volume" {{(pid=83259) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 16 15:25:20 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [None req-0d3d21a5-8bb2-493d-b8bb-6dc9405a4061 tempest-CreateVolumesFromImageTest-720201122 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c" returned: 0 in 0.445s {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 15:25:20 devstack cinder-volume[83259]: DEBUG cinder.manager [None req-0d3d21a5-8bb2-493d-b8bb-6dc9405a4061 tempest-CreateVolumesFromImageTest-720201122 None] Notifying Schedulers of capabilities ... {{(pid=83259) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 16 15:25:20 devstack cinder-volume[83259]: DEBUG cinder.coordination [None req-b5ee6201-de52-481f-9cdd-580e0c557618 tempest-CreateVolumesFromImageTest-720201122 None] Lock "cinder-c25ac34f-86c7-4df0-b2f8-626cd2fd6a3e-delete_volume" acquired by "delete_volume" :: waited 0.185s {{(pid=83259) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 16 15:25:20 devstack cinder-volume[83259]: INFO cinder.volume.manager [None req-0d3d21a5-8bb2-493d-b8bb-6dc9405a4061 tempest-CreateVolumesFromImageTest-720201122 None] Deleted volume successfully. Sep 16 15:25:20 devstack cinder-volume[83259]: DEBUG oslo_concurrency.lockutils [None req-7b093ae2-35d9-4e48-be10-9382ce39358f tempest-CreateVolumesFromSourceVolumeTest-644256109 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83259) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 16 15:25:20 devstack cinder-volume[83259]: DEBUG oslo_concurrency.lockutils [None req-7b093ae2-35d9-4e48-be10-9382ce39358f tempest-CreateVolumesFromSourceVolumeTest-644256109 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=83259) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 16 15:25:20 devstack cinder-volume[83259]: DEBUG cinder.volume.drivers.quobyte [None req-7b093ae2-35d9-4e48-be10-9382ce39358f tempest-CreateVolumesFromSourceVolumeTest-644256109 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-61f585ac-f8e2-4d19-a890-7ebc2726cc72': None} {{(pid=83259) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:639}} Sep 16 15:25:20 devstack cinder-volume[83259]: DEBUG cinder.volume.drivers.quobyte [None req-7b093ae2-35d9-4e48-be10-9382ce39358f tempest-CreateVolumesFromSourceVolumeTest-644256109 None] Available shares ['10.10.41.181/cinder-vol-61f585ac-f8e2-4d19-a890-7ebc2726cc72'] {{(pid=83259) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:669}} Sep 16 15:25:20 devstack cinder-volume[83259]: DEBUG oslo_concurrency.lockutils [None req-7b093ae2-35d9-4e48-be10-9382ce39358f tempest-CreateVolumesFromSourceVolumeTest-644256109 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=83259) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 16 15:25:20 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [None req-7b093ae2-35d9-4e48-be10-9382ce39358f tempest-CreateVolumesFromSourceVolumeTest-644256109 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 15:25:20 devstack cinder-volume[83259]: DEBUG cinder.coordination [None req-0d3d21a5-8bb2-493d-b8bb-6dc9405a4061 tempest-CreateVolumesFromImageTest-720201122 None] Lock "cinder-35e9c3e3-9b63-4e02-a4c6-17e57dd4cd51-delete_volume" released by "delete_volume" :: held 4.072s {{(pid=83259) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 16 15:25:20 devstack cinder-volume[83259]: DEBUG cinder.coordination [None req-031e3715-d9cc-4df2-a8ac-f4f54223b917 tempest-CreateVolumesFromSourceVolumeTest-644256109 None] Acquiring lock "cinder-b9495b05-d0ef-4c4c-961a-d54de3d64117-delete_volume" by "delete_volume" {{(pid=83259) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 16 15:25:21 devstack cinder-volume[83259]: WARNING cinder.volume.volume_utils [None req-b5ee6201-de52-481f-9cdd-580e0c557618 tempest-CreateVolumesFromImageTest-720201122 None] Volume driver (QuobyteDriver 1.2) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 16 15:25:21 devstack cinder-volume[83259]: DEBUG cinder.coordination [None req-b5ee6201-de52-481f-9cdd-580e0c557618 tempest-CreateVolumesFromImageTest-720201122 None] Acquiring lock "cinder-quobyte-c25ac34f-86c7-4df0-b2f8-626cd2fd6a3e" by "delete_volume" {{(pid=83259) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 16 15:25:21 devstack cinder-volume[83259]: DEBUG cinder.coordination [None req-031e3715-d9cc-4df2-a8ac-f4f54223b917 tempest-CreateVolumesFromSourceVolumeTest-644256109 None] Lock "cinder-b9495b05-d0ef-4c4c-961a-d54de3d64117-delete_volume" acquired by "delete_volume" :: waited 0.229s {{(pid=83259) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 16 15:25:21 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [None req-7b093ae2-35d9-4e48-be10-9382ce39358f tempest-CreateVolumesFromSourceVolumeTest-644256109 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c" returned: 0 in 0.551s {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 15:25:21 devstack cinder-volume[83259]: DEBUG cinder.manager [None req-7b093ae2-35d9-4e48-be10-9382ce39358f tempest-CreateVolumesFromSourceVolumeTest-644256109 None] Notifying Schedulers of capabilities ... {{(pid=83259) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 16 15:25:21 devstack cinder-volume[83259]: INFO cinder.volume.manager [None req-7b093ae2-35d9-4e48-be10-9382ce39358f tempest-CreateVolumesFromSourceVolumeTest-644256109 None] Deleted volume successfully. Sep 16 15:25:21 devstack cinder-volume[83259]: WARNING cinder.volume.volume_utils [None req-031e3715-d9cc-4df2-a8ac-f4f54223b917 tempest-CreateVolumesFromSourceVolumeTest-644256109 None] Volume driver (QuobyteDriver 1.2) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 16 15:25:21 devstack cinder-volume[83259]: DEBUG cinder.coordination [None req-031e3715-d9cc-4df2-a8ac-f4f54223b917 tempest-CreateVolumesFromSourceVolumeTest-644256109 None] Acquiring lock "cinder-quobyte-b9495b05-d0ef-4c4c-961a-d54de3d64117" by "delete_volume" {{(pid=83259) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 16 15:25:21 devstack cinder-volume[83259]: DEBUG cinder.coordination [None req-b5ee6201-de52-481f-9cdd-580e0c557618 tempest-CreateVolumesFromImageTest-720201122 None] Lock "cinder-quobyte-c25ac34f-86c7-4df0-b2f8-626cd2fd6a3e" acquired by "delete_volume" :: waited 0.116s {{(pid=83259) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 16 15:25:21 devstack cinder-volume[83259]: DEBUG oslo.privsep.daemon [-] privsep: reply[5a10c8e8-48d8-459b-ab00-3a2f0bf5951a]: (4, 'qcow2') {{(pid=84312) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 16 15:25:21 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [None req-b5ee6201-de52-481f-9cdd-580e0c557618 tempest-CreateVolumesFromImageTest-720201122 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c/volume-c25ac34f-86c7-4df0-b2f8-626cd2fd6a3e {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 15:25:21 devstack cinder-volume[83259]: DEBUG cinder.coordination [None req-7b093ae2-35d9-4e48-be10-9382ce39358f tempest-CreateVolumesFromSourceVolumeTest-644256109 None] Lock "cinder-a0f1de91-d70d-4895-9dd1-d8768daf622f-delete_volume" released by "delete_volume" :: held 3.811s {{(pid=83259) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 16 15:25:21 devstack cinder-volume[83259]: DEBUG cinder.coordination [None req-031e3715-d9cc-4df2-a8ac-f4f54223b917 tempest-CreateVolumesFromSourceVolumeTest-644256109 None] Lock "cinder-quobyte-b9495b05-d0ef-4c4c-961a-d54de3d64117" acquired by "delete_volume" :: waited 0.285s {{(pid=83259) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 16 15:25:21 devstack cinder-volume[83259]: DEBUG oslo.privsep.daemon [-] privsep: reply[9ee45c35-9e94-40be-b41d-020bb7013cb8]: (4, 'qcow2') {{(pid=84312) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 16 15:25:21 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [None req-031e3715-d9cc-4df2-a8ac-f4f54223b917 tempest-CreateVolumesFromSourceVolumeTest-644256109 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c/volume-b9495b05-d0ef-4c4c-961a-d54de3d64117 {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 15:25:22 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [None req-b5ee6201-de52-481f-9cdd-580e0c557618 tempest-CreateVolumesFromImageTest-720201122 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c/volume-c25ac34f-86c7-4df0-b2f8-626cd2fd6a3e" returned: 0 in 0.875s {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 15:25:22 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [None req-b5ee6201-de52-481f-9cdd-580e0c557618 tempest-CreateVolumesFromImageTest-720201122 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c/volume-c25ac34f-86c7-4df0-b2f8-626cd2fd6a3e {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 15:25:22 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [None req-031e3715-d9cc-4df2-a8ac-f4f54223b917 tempest-CreateVolumesFromSourceVolumeTest-644256109 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c/volume-b9495b05-d0ef-4c4c-961a-d54de3d64117" returned: 0 in 0.785s {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 15:25:22 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [None req-031e3715-d9cc-4df2-a8ac-f4f54223b917 tempest-CreateVolumesFromSourceVolumeTest-644256109 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c/volume-b9495b05-d0ef-4c4c-961a-d54de3d64117 {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 15:25:22 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [None req-b5ee6201-de52-481f-9cdd-580e0c557618 tempest-CreateVolumesFromImageTest-720201122 None] CMD "rm -f /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c/volume-c25ac34f-86c7-4df0-b2f8-626cd2fd6a3e" returned: 0 in 0.288s {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 15:25:22 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [None req-031e3715-d9cc-4df2-a8ac-f4f54223b917 tempest-CreateVolumesFromSourceVolumeTest-644256109 None] CMD "rm -f /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c/volume-b9495b05-d0ef-4c4c-961a-d54de3d64117" returned: 0 in 0.253s {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 15:25:22 devstack cinder-volume[83259]: DEBUG cinder.coordination [None req-b5ee6201-de52-481f-9cdd-580e0c557618 tempest-CreateVolumesFromImageTest-720201122 None] Lock "cinder-quobyte-c25ac34f-86c7-4df0-b2f8-626cd2fd6a3e" released by "delete_volume" :: held 1.472s {{(pid=83259) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 16 15:25:22 devstack cinder-volume[83259]: DEBUG cinder.coordination [None req-031e3715-d9cc-4df2-a8ac-f4f54223b917 tempest-CreateVolumesFromSourceVolumeTest-644256109 None] Lock "cinder-quobyte-b9495b05-d0ef-4c4c-961a-d54de3d64117" released by "delete_volume" :: held 1.341s {{(pid=83259) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 16 15:25:22 devstack cinder-volume[83259]: DEBUG cinder.quota [None req-b5ee6201-de52-481f-9cdd-580e0c557618 tempest-CreateVolumesFromImageTest-720201122 None] Created reservations ['4bb6e03c-f9c7-4598-831d-486df0c4298a', '94dfa49a-0519-470e-94c4-f033f7622bbd', 'd5d40771-30a9-4c6e-8064-d37b8e791bed', '30b7d95c-3c72-4f1d-a14e-93b68be78a91'] {{(pid=83259) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 16 15:25:23 devstack cinder-volume[83259]: DEBUG cinder.quota [None req-031e3715-d9cc-4df2-a8ac-f4f54223b917 tempest-CreateVolumesFromSourceVolumeTest-644256109 None] Created reservations ['b3f651ca-762e-4bfb-a9df-332e2a0783e1', '5a7109de-a491-4ff4-9041-ca4f364ed047', 'bd963c49-7871-4093-bd9f-11bf439aacf3', 'd3509353-1a90-433d-83d5-dd8ae747d0f5'] {{(pid=83259) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 16 15:25:23 devstack cinder-volume[83259]: DEBUG oslo_concurrency.lockutils [None req-031e3715-d9cc-4df2-a8ac-f4f54223b917 tempest-CreateVolumesFromSourceVolumeTest-644256109 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83259) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 16 15:25:23 devstack cinder-volume[83259]: DEBUG oslo_concurrency.lockutils [None req-031e3715-d9cc-4df2-a8ac-f4f54223b917 tempest-CreateVolumesFromSourceVolumeTest-644256109 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=83259) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 16 15:25:23 devstack cinder-volume[83259]: DEBUG cinder.volume.drivers.quobyte [None req-031e3715-d9cc-4df2-a8ac-f4f54223b917 tempest-CreateVolumesFromSourceVolumeTest-644256109 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-61f585ac-f8e2-4d19-a890-7ebc2726cc72': None} {{(pid=83259) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:639}} Sep 16 15:25:23 devstack cinder-volume[83259]: DEBUG cinder.volume.drivers.quobyte [None req-031e3715-d9cc-4df2-a8ac-f4f54223b917 tempest-CreateVolumesFromSourceVolumeTest-644256109 None] Available shares ['10.10.41.181/cinder-vol-61f585ac-f8e2-4d19-a890-7ebc2726cc72'] {{(pid=83259) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:669}} Sep 16 15:25:23 devstack cinder-volume[83259]: DEBUG oslo_concurrency.lockutils [None req-031e3715-d9cc-4df2-a8ac-f4f54223b917 tempest-CreateVolumesFromSourceVolumeTest-644256109 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=83259) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 16 15:25:23 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [None req-031e3715-d9cc-4df2-a8ac-f4f54223b917 tempest-CreateVolumesFromSourceVolumeTest-644256109 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 15:25:23 devstack cinder-volume[83259]: DEBUG oslo_concurrency.lockutils [None req-b5ee6201-de52-481f-9cdd-580e0c557618 tempest-CreateVolumesFromImageTest-720201122 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83259) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 16 15:25:23 devstack cinder-volume[83259]: DEBUG oslo_concurrency.lockutils [None req-b5ee6201-de52-481f-9cdd-580e0c557618 tempest-CreateVolumesFromImageTest-720201122 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.036s {{(pid=83259) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 16 15:25:23 devstack cinder-volume[83259]: DEBUG cinder.volume.drivers.quobyte [None req-b5ee6201-de52-481f-9cdd-580e0c557618 tempest-CreateVolumesFromImageTest-720201122 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-61f585ac-f8e2-4d19-a890-7ebc2726cc72': None} {{(pid=83259) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:639}} Sep 16 15:25:23 devstack cinder-volume[83259]: DEBUG cinder.volume.drivers.quobyte [None req-b5ee6201-de52-481f-9cdd-580e0c557618 tempest-CreateVolumesFromImageTest-720201122 None] Available shares ['10.10.41.181/cinder-vol-61f585ac-f8e2-4d19-a890-7ebc2726cc72'] {{(pid=83259) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:669}} Sep 16 15:25:23 devstack cinder-volume[83259]: DEBUG oslo_concurrency.lockutils [None req-b5ee6201-de52-481f-9cdd-580e0c557618 tempest-CreateVolumesFromImageTest-720201122 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.025s {{(pid=83259) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 16 15:25:23 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [None req-b5ee6201-de52-481f-9cdd-580e0c557618 tempest-CreateVolumesFromImageTest-720201122 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 15:25:23 devstack cinder-volume[83259]: DEBUG cinder.coordination [None req-4ea012ae-8b6d-4044-9103-d4958e82ea13 tempest-CreateVolumesFromImageTest-720201122 None] Acquiring lock "cinder-60d0bb78-46e4-4e37-bf47-96e6428b635e-delete_volume" by "delete_volume" {{(pid=83259) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 16 15:25:23 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [None req-b5ee6201-de52-481f-9cdd-580e0c557618 tempest-CreateVolumesFromImageTest-720201122 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c" returned: 0 in 0.434s {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 15:25:23 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [None req-031e3715-d9cc-4df2-a8ac-f4f54223b917 tempest-CreateVolumesFromSourceVolumeTest-644256109 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c" returned: 0 in 0.702s {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 15:25:23 devstack cinder-volume[83259]: DEBUG cinder.manager [None req-b5ee6201-de52-481f-9cdd-580e0c557618 tempest-CreateVolumesFromImageTest-720201122 None] Notifying Schedulers of capabilities ... {{(pid=83259) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 16 15:25:23 devstack cinder-volume[83259]: DEBUG cinder.manager [None req-031e3715-d9cc-4df2-a8ac-f4f54223b917 tempest-CreateVolumesFromSourceVolumeTest-644256109 None] Notifying Schedulers of capabilities ... {{(pid=83259) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 16 15:25:24 devstack cinder-volume[83259]: INFO cinder.volume.manager [None req-b5ee6201-de52-481f-9cdd-580e0c557618 tempest-CreateVolumesFromImageTest-720201122 None] Deleted volume successfully. Sep 16 15:25:24 devstack cinder-volume[83259]: INFO cinder.volume.manager [None req-031e3715-d9cc-4df2-a8ac-f4f54223b917 tempest-CreateVolumesFromSourceVolumeTest-644256109 None] Deleted volume successfully. Sep 16 15:25:24 devstack cinder-volume[83259]: DEBUG cinder.coordination [None req-4ea012ae-8b6d-4044-9103-d4958e82ea13 tempest-CreateVolumesFromImageTest-720201122 None] Lock "cinder-60d0bb78-46e4-4e37-bf47-96e6428b635e-delete_volume" acquired by "delete_volume" :: waited 0.322s {{(pid=83259) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 16 15:25:24 devstack cinder-volume[83259]: DEBUG cinder.coordination [None req-b5ee6201-de52-481f-9cdd-580e0c557618 tempest-CreateVolumesFromImageTest-720201122 None] Lock "cinder-c25ac34f-86c7-4df0-b2f8-626cd2fd6a3e-delete_volume" released by "delete_volume" :: held 3.922s {{(pid=83259) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 16 15:25:24 devstack cinder-volume[83259]: DEBUG cinder.coordination [None req-8c2bd8db-af92-40d5-be65-174b69943c56 tempest-CreateVolumesFromSourceVolumeTest-644256109 None] Acquiring lock "cinder-61142dde-da13-4e27-bba5-bb03c06e2c70-delete_volume" by "delete_volume" {{(pid=83259) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 16 15:25:24 devstack cinder-volume[83259]: DEBUG cinder.coordination [None req-8c2bd8db-af92-40d5-be65-174b69943c56 tempest-CreateVolumesFromSourceVolumeTest-644256109 None] Lock "cinder-61142dde-da13-4e27-bba5-bb03c06e2c70-delete_volume" acquired by "delete_volume" :: waited 0.074s {{(pid=83259) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 16 15:25:24 devstack cinder-volume[83259]: DEBUG cinder.coordination [None req-031e3715-d9cc-4df2-a8ac-f4f54223b917 tempest-CreateVolumesFromSourceVolumeTest-644256109 None] Lock "cinder-b9495b05-d0ef-4c4c-961a-d54de3d64117-delete_volume" released by "delete_volume" :: held 3.339s {{(pid=83259) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 16 15:25:24 devstack cinder-volume[83259]: WARNING cinder.volume.volume_utils [None req-4ea012ae-8b6d-4044-9103-d4958e82ea13 tempest-CreateVolumesFromImageTest-720201122 None] Volume driver (QuobyteDriver 1.2) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 16 15:25:24 devstack cinder-volume[83259]: DEBUG cinder.coordination [None req-4ea012ae-8b6d-4044-9103-d4958e82ea13 tempest-CreateVolumesFromImageTest-720201122 None] Acquiring lock "cinder-quobyte-60d0bb78-46e4-4e37-bf47-96e6428b635e" by "delete_volume" {{(pid=83259) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 16 15:25:24 devstack cinder-volume[83259]: DEBUG cinder.coordination [None req-4ea012ae-8b6d-4044-9103-d4958e82ea13 tempest-CreateVolumesFromImageTest-720201122 None] Lock "cinder-quobyte-60d0bb78-46e4-4e37-bf47-96e6428b635e" acquired by "delete_volume" :: waited 0.016s {{(pid=83259) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 16 15:25:24 devstack cinder-volume[83259]: DEBUG oslo.privsep.daemon [-] privsep: reply[4344220d-8898-483e-9b13-6d32f2373f74]: (4, 'qcow2') {{(pid=84312) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 16 15:25:24 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [None req-4ea012ae-8b6d-4044-9103-d4958e82ea13 tempest-CreateVolumesFromImageTest-720201122 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c/volume-60d0bb78-46e4-4e37-bf47-96e6428b635e {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 15:25:25 devstack cinder-volume[83259]: WARNING cinder.volume.volume_utils [None req-8c2bd8db-af92-40d5-be65-174b69943c56 tempest-CreateVolumesFromSourceVolumeTest-644256109 None] Volume driver (QuobyteDriver 1.2) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 16 15:25:25 devstack cinder-volume[83259]: DEBUG cinder.coordination [None req-8c2bd8db-af92-40d5-be65-174b69943c56 tempest-CreateVolumesFromSourceVolumeTest-644256109 None] Acquiring lock "cinder-quobyte-61142dde-da13-4e27-bba5-bb03c06e2c70" by "delete_volume" {{(pid=83259) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 16 15:25:25 devstack cinder-volume[83259]: DEBUG cinder.coordination [None req-8c2bd8db-af92-40d5-be65-174b69943c56 tempest-CreateVolumesFromSourceVolumeTest-644256109 None] Lock "cinder-quobyte-61142dde-da13-4e27-bba5-bb03c06e2c70" acquired by "delete_volume" :: waited 0.093s {{(pid=83259) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 16 15:25:25 devstack cinder-volume[83259]: DEBUG oslo.privsep.daemon [-] privsep: reply[ff109883-e46d-401e-a173-a9448ed1e8ea]: (4, 'qcow2') {{(pid=84312) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 16 15:25:25 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [None req-8c2bd8db-af92-40d5-be65-174b69943c56 tempest-CreateVolumesFromSourceVolumeTest-644256109 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c/volume-61142dde-da13-4e27-bba5-bb03c06e2c70 {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 15:25:25 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [None req-4ea012ae-8b6d-4044-9103-d4958e82ea13 tempest-CreateVolumesFromImageTest-720201122 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c/volume-60d0bb78-46e4-4e37-bf47-96e6428b635e" returned: 0 in 0.892s {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 15:25:25 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [None req-4ea012ae-8b6d-4044-9103-d4958e82ea13 tempest-CreateVolumesFromImageTest-720201122 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c/volume-60d0bb78-46e4-4e37-bf47-96e6428b635e {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 15:25:25 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [None req-4ea012ae-8b6d-4044-9103-d4958e82ea13 tempest-CreateVolumesFromImageTest-720201122 None] CMD "rm -f /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c/volume-60d0bb78-46e4-4e37-bf47-96e6428b635e" returned: 0 in 0.250s {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 15:25:25 devstack cinder-volume[83259]: DEBUG cinder.coordination [None req-4ea012ae-8b6d-4044-9103-d4958e82ea13 tempest-CreateVolumesFromImageTest-720201122 None] Lock "cinder-quobyte-60d0bb78-46e4-4e37-bf47-96e6428b635e" released by "delete_volume" :: held 1.437s {{(pid=83259) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 16 15:25:25 devstack quobyte-client[83286]: System call of process 100041 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 16 15:25:26 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [None req-8c2bd8db-af92-40d5-be65-174b69943c56 tempest-CreateVolumesFromSourceVolumeTest-644256109 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c/volume-61142dde-da13-4e27-bba5-bb03c06e2c70" returned: 0 in 0.927s {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 15:25:26 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [None req-8c2bd8db-af92-40d5-be65-174b69943c56 tempest-CreateVolumesFromSourceVolumeTest-644256109 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c/volume-61142dde-da13-4e27-bba5-bb03c06e2c70 {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 15:25:26 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [None req-8c2bd8db-af92-40d5-be65-174b69943c56 tempest-CreateVolumesFromSourceVolumeTest-644256109 None] CMD "rm -f /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c/volume-61142dde-da13-4e27-bba5-bb03c06e2c70" returned: 0 in 0.247s {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 15:25:26 devstack cinder-volume[83259]: DEBUG cinder.coordination [None req-8c2bd8db-af92-40d5-be65-174b69943c56 tempest-CreateVolumesFromSourceVolumeTest-644256109 None] Lock "cinder-quobyte-61142dde-da13-4e27-bba5-bb03c06e2c70" released by "delete_volume" :: held 1.368s {{(pid=83259) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 16 15:25:26 devstack cinder-volume[83259]: DEBUG cinder.quota [None req-4ea012ae-8b6d-4044-9103-d4958e82ea13 tempest-CreateVolumesFromImageTest-720201122 None] Created reservations ['d5b5326a-d981-435a-8579-78bc65b8b51d', 'e608ee03-94cf-433c-9bef-bba4a2d54a73', '3b5a6a12-c706-485d-9a02-e61277ab7a77', '238476bb-5ca6-4ee3-8cb1-755cee11eb85'] {{(pid=83259) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 16 15:25:26 devstack cinder-volume[83259]: DEBUG cinder.quota [None req-8c2bd8db-af92-40d5-be65-174b69943c56 tempest-CreateVolumesFromSourceVolumeTest-644256109 None] Created reservations ['b3eac37e-9caf-45fb-8d51-5cac5f80b5cd', '7168777e-50a4-4c51-b0c5-50c5cd8f1e60', '2e5b457d-8bd2-4b72-b285-06451361649f', '0f37f2fc-f58a-46c4-95d0-f50bfe6727be'] {{(pid=83259) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 16 15:25:26 devstack cinder-volume[83259]: DEBUG oslo_concurrency.lockutils [None req-8c2bd8db-af92-40d5-be65-174b69943c56 tempest-CreateVolumesFromSourceVolumeTest-644256109 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83259) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 16 15:25:26 devstack cinder-volume[83259]: DEBUG oslo_concurrency.lockutils [None req-8c2bd8db-af92-40d5-be65-174b69943c56 tempest-CreateVolumesFromSourceVolumeTest-644256109 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.005s {{(pid=83259) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 16 15:25:26 devstack cinder-volume[83259]: DEBUG cinder.volume.drivers.quobyte [None req-8c2bd8db-af92-40d5-be65-174b69943c56 tempest-CreateVolumesFromSourceVolumeTest-644256109 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-61f585ac-f8e2-4d19-a890-7ebc2726cc72': None} {{(pid=83259) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:639}} Sep 16 15:25:26 devstack cinder-volume[83259]: DEBUG cinder.volume.drivers.quobyte [None req-8c2bd8db-af92-40d5-be65-174b69943c56 tempest-CreateVolumesFromSourceVolumeTest-644256109 None] Available shares ['10.10.41.181/cinder-vol-61f585ac-f8e2-4d19-a890-7ebc2726cc72'] {{(pid=83259) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:669}} Sep 16 15:25:26 devstack cinder-volume[83259]: DEBUG oslo_concurrency.lockutils [None req-8c2bd8db-af92-40d5-be65-174b69943c56 tempest-CreateVolumesFromSourceVolumeTest-644256109 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=83259) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 16 15:25:26 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [None req-8c2bd8db-af92-40d5-be65-174b69943c56 tempest-CreateVolumesFromSourceVolumeTest-644256109 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 15:25:27 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [None req-8c2bd8db-af92-40d5-be65-174b69943c56 tempest-CreateVolumesFromSourceVolumeTest-644256109 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c" returned: 0 in 0.388s {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 15:25:27 devstack cinder-volume[83259]: DEBUG cinder.manager [None req-8c2bd8db-af92-40d5-be65-174b69943c56 tempest-CreateVolumesFromSourceVolumeTest-644256109 None] Notifying Schedulers of capabilities ... {{(pid=83259) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 16 15:25:27 devstack cinder-volume[83259]: INFO cinder.volume.manager [None req-8c2bd8db-af92-40d5-be65-174b69943c56 tempest-CreateVolumesFromSourceVolumeTest-644256109 None] Deleted volume successfully. Sep 16 15:25:27 devstack cinder-volume[83259]: DEBUG oslo_concurrency.lockutils [None req-4ea012ae-8b6d-4044-9103-d4958e82ea13 tempest-CreateVolumesFromImageTest-720201122 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83259) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 16 15:25:27 devstack cinder-volume[83259]: DEBUG oslo_concurrency.lockutils [None req-4ea012ae-8b6d-4044-9103-d4958e82ea13 tempest-CreateVolumesFromImageTest-720201122 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=83259) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 16 15:25:27 devstack cinder-volume[83259]: DEBUG cinder.volume.drivers.quobyte [None req-4ea012ae-8b6d-4044-9103-d4958e82ea13 tempest-CreateVolumesFromImageTest-720201122 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-61f585ac-f8e2-4d19-a890-7ebc2726cc72': None} {{(pid=83259) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:639}} Sep 16 15:25:27 devstack cinder-volume[83259]: DEBUG cinder.volume.drivers.quobyte [None req-4ea012ae-8b6d-4044-9103-d4958e82ea13 tempest-CreateVolumesFromImageTest-720201122 None] Available shares ['10.10.41.181/cinder-vol-61f585ac-f8e2-4d19-a890-7ebc2726cc72'] {{(pid=83259) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:669}} Sep 16 15:25:27 devstack cinder-volume[83259]: DEBUG oslo_concurrency.lockutils [None req-4ea012ae-8b6d-4044-9103-d4958e82ea13 tempest-CreateVolumesFromImageTest-720201122 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=83259) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 16 15:25:27 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [None req-4ea012ae-8b6d-4044-9103-d4958e82ea13 tempest-CreateVolumesFromImageTest-720201122 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 15:25:28 devstack cinder-volume[83259]: DEBUG cinder.coordination [None req-b2107317-159e-4bff-a696-e197a3178901 tempest-CreateVolumesFromSourceVolumeTest-644256109 None] Acquiring lock "cinder-df8f422c-7eb4-4059-aba7-290a5d1dee03-delete_volume" by "delete_volume" {{(pid=83259) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 16 15:25:28 devstack cinder-volume[83259]: DEBUG cinder.coordination [None req-8c2bd8db-af92-40d5-be65-174b69943c56 tempest-CreateVolumesFromSourceVolumeTest-644256109 None] Lock "cinder-61142dde-da13-4e27-bba5-bb03c06e2c70-delete_volume" released by "delete_volume" :: held 3.685s {{(pid=83259) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 16 15:25:28 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [None req-4ea012ae-8b6d-4044-9103-d4958e82ea13 tempest-CreateVolumesFromImageTest-720201122 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c" returned: 0 in 0.559s {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 15:25:28 devstack cinder-volume[83259]: DEBUG cinder.manager [None req-4ea012ae-8b6d-4044-9103-d4958e82ea13 tempest-CreateVolumesFromImageTest-720201122 None] Notifying Schedulers of capabilities ... {{(pid=83259) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 16 15:25:28 devstack cinder-volume[83259]: DEBUG cinder.coordination [None req-b2107317-159e-4bff-a696-e197a3178901 tempest-CreateVolumesFromSourceVolumeTest-644256109 None] Lock "cinder-df8f422c-7eb4-4059-aba7-290a5d1dee03-delete_volume" acquired by "delete_volume" :: waited 0.159s {{(pid=83259) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 16 15:25:28 devstack cinder-volume[83259]: INFO cinder.volume.manager [None req-4ea012ae-8b6d-4044-9103-d4958e82ea13 tempest-CreateVolumesFromImageTest-720201122 None] Deleted volume successfully. Sep 16 15:25:28 devstack cinder-volume[83259]: WARNING cinder.volume.volume_utils [None req-b2107317-159e-4bff-a696-e197a3178901 tempest-CreateVolumesFromSourceVolumeTest-644256109 None] Volume driver (QuobyteDriver 1.2) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 16 15:25:28 devstack cinder-volume[83259]: DEBUG cinder.coordination [None req-b2107317-159e-4bff-a696-e197a3178901 tempest-CreateVolumesFromSourceVolumeTest-644256109 None] Acquiring lock "cinder-quobyte-df8f422c-7eb4-4059-aba7-290a5d1dee03" by "delete_volume" {{(pid=83259) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 16 15:25:28 devstack cinder-volume[83259]: DEBUG cinder.coordination [None req-4ea012ae-8b6d-4044-9103-d4958e82ea13 tempest-CreateVolumesFromImageTest-720201122 None] Lock "cinder-60d0bb78-46e4-4e37-bf47-96e6428b635e-delete_volume" released by "delete_volume" :: held 4.433s {{(pid=83259) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 16 15:25:28 devstack cinder-volume[83259]: DEBUG cinder.coordination [None req-b2107317-159e-4bff-a696-e197a3178901 tempest-CreateVolumesFromSourceVolumeTest-644256109 None] Lock "cinder-quobyte-df8f422c-7eb4-4059-aba7-290a5d1dee03" acquired by "delete_volume" :: waited 0.021s {{(pid=83259) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 16 15:25:28 devstack cinder-volume[83259]: DEBUG oslo.privsep.daemon [-] privsep: reply[ed78b18c-dea4-4368-8c7a-846fef46d1c5]: (4, 'qcow2') {{(pid=84312) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 16 15:25:28 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [None req-b2107317-159e-4bff-a696-e197a3178901 tempest-CreateVolumesFromSourceVolumeTest-644256109 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c/volume-df8f422c-7eb4-4059-aba7-290a5d1dee03 {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 15:25:29 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [None req-b2107317-159e-4bff-a696-e197a3178901 tempest-CreateVolumesFromSourceVolumeTest-644256109 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c/volume-df8f422c-7eb4-4059-aba7-290a5d1dee03" returned: 0 in 0.706s {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 15:25:29 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [None req-b2107317-159e-4bff-a696-e197a3178901 tempest-CreateVolumesFromSourceVolumeTest-644256109 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c/volume-df8f422c-7eb4-4059-aba7-290a5d1dee03 {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 15:25:29 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [None req-b2107317-159e-4bff-a696-e197a3178901 tempest-CreateVolumesFromSourceVolumeTest-644256109 None] CMD "rm -f /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c/volume-df8f422c-7eb4-4059-aba7-290a5d1dee03" returned: 0 in 0.220s {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 15:25:29 devstack cinder-volume[83259]: DEBUG cinder.coordination [None req-b2107317-159e-4bff-a696-e197a3178901 tempest-CreateVolumesFromSourceVolumeTest-644256109 None] Lock "cinder-quobyte-df8f422c-7eb4-4059-aba7-290a5d1dee03" released by "delete_volume" :: held 1.221s {{(pid=83259) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 16 15:25:30 devstack cinder-volume[83259]: DEBUG cinder.quota [None req-b2107317-159e-4bff-a696-e197a3178901 tempest-CreateVolumesFromSourceVolumeTest-644256109 None] Created reservations ['182a6cf0-b4b1-4f50-b748-64746d7ea3bf', 'ed5e685f-3707-4e2d-acba-423129dd931c', '619fc828-4689-4fbd-9f4c-4755c2761120', '7fa95108-3b8b-4aeb-8320-1f6110b12979'] {{(pid=83259) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 16 15:25:30 devstack cinder-volume[83259]: DEBUG oslo_concurrency.lockutils [None req-b2107317-159e-4bff-a696-e197a3178901 tempest-CreateVolumesFromSourceVolumeTest-644256109 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83259) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 16 15:25:30 devstack cinder-volume[83259]: DEBUG oslo_concurrency.lockutils [None req-b2107317-159e-4bff-a696-e197a3178901 tempest-CreateVolumesFromSourceVolumeTest-644256109 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.007s {{(pid=83259) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 16 15:25:30 devstack cinder-volume[83259]: DEBUG cinder.volume.drivers.quobyte [None req-b2107317-159e-4bff-a696-e197a3178901 tempest-CreateVolumesFromSourceVolumeTest-644256109 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-61f585ac-f8e2-4d19-a890-7ebc2726cc72': None} {{(pid=83259) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:639}} Sep 16 15:25:30 devstack cinder-volume[83259]: DEBUG cinder.volume.drivers.quobyte [None req-b2107317-159e-4bff-a696-e197a3178901 tempest-CreateVolumesFromSourceVolumeTest-644256109 None] Available shares ['10.10.41.181/cinder-vol-61f585ac-f8e2-4d19-a890-7ebc2726cc72'] {{(pid=83259) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:669}} Sep 16 15:25:30 devstack cinder-volume[83259]: DEBUG oslo_concurrency.lockutils [None req-b2107317-159e-4bff-a696-e197a3178901 tempest-CreateVolumesFromSourceVolumeTest-644256109 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=83259) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 16 15:25:30 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [None req-b2107317-159e-4bff-a696-e197a3178901 tempest-CreateVolumesFromSourceVolumeTest-644256109 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 15:25:30 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [None req-b2107317-159e-4bff-a696-e197a3178901 tempest-CreateVolumesFromSourceVolumeTest-644256109 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c" returned: 0 in 0.166s {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 15:25:30 devstack cinder-volume[83259]: DEBUG cinder.manager [None req-b2107317-159e-4bff-a696-e197a3178901 tempest-CreateVolumesFromSourceVolumeTest-644256109 None] Notifying Schedulers of capabilities ... {{(pid=83259) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 16 15:25:30 devstack cinder-volume[83259]: INFO cinder.volume.manager [None req-b2107317-159e-4bff-a696-e197a3178901 tempest-CreateVolumesFromSourceVolumeTest-644256109 None] Deleted volume successfully. Sep 16 15:25:31 devstack cinder-volume[83259]: DEBUG cinder.coordination [None req-b2107317-159e-4bff-a696-e197a3178901 tempest-CreateVolumesFromSourceVolumeTest-644256109 None] Lock "cinder-df8f422c-7eb4-4059-aba7-290a5d1dee03-delete_volume" released by "delete_volume" :: held 2.960s {{(pid=83259) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 16 15:25:31 devstack cinder-volume[83259]: WARNING cinder.volume.volume_utils [None req-63d398ea-a214-4b6a-a4f4-e0f3e0c385ad tempest-SnapshotDependencyTests-1639469217 None] Volume driver (QuobyteDriver 1.2) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 16 15:25:31 devstack cinder-volume[83259]: DEBUG cinder.volume.flows.manager.create_volume [None req-63d398ea-a214-4b6a-a4f4-e0f3e0c385ad tempest-SnapshotDependencyTests-1639469217 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#Quobyte'], 'hosts': ['devstack@QuobyteHD#Quobyte']} {{(pid=83259) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1387}} Sep 16 15:25:31 devstack cinder-volume[83259]: DEBUG cinder.volume.manager [None req-63d398ea-a214-4b6a-a4f4-e0f3e0c385ad tempest-SnapshotDependencyTests-1639469217 None] Flow 'volume_create_manager' (2df50cea-a058-4105-84f9-ee148c5859c7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83259) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 16 15:25:31 devstack cinder-volume[83259]: DEBUG cinder.volume.manager [None req-63d398ea-a214-4b6a-a4f4-e0f3e0c385ad tempest-SnapshotDependencyTests-1639469217 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (efc6bbd2-726d-4cd1-8cd3-903fa72bd1fe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83259) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 15:25:31 devstack cinder-volume[83259]: DEBUG cinder.volume.manager [None req-63d398ea-a214-4b6a-a4f4-e0f3e0c385ad tempest-SnapshotDependencyTests-1639469217 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (efc6bbd2-726d-4cd1-8cd3-903fa72bd1fe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-16T13:25:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-848976254',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#Quobyte',id=fb056960-1e79-47e9-8b58-6accef1fb32a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d778b1f2a2ab49dabc7e529d141418f2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-16T13:25:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-16T13:25:31Z,use_quota=True,user_id='dd4f533cfeac4f139a0efc67e1370426',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(485ead50-3df8-4d76-8d34-a4db136c980a),volume_type_id=485ead50-3df8-4d76-8d34-a4db136c980a)' {{(pid=83259) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 15:25:31 devstack cinder-volume[83259]: DEBUG cinder.volume.manager [None req-63d398ea-a214-4b6a-a4f4-e0f3e0c385ad tempest-SnapshotDependencyTests-1639469217 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e7939dbe-e1a6-46ba-9dde-989308afe0a6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83259) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 15:25:31 devstack cinder-volume[83259]: DEBUG cinder.volume.manager [None req-63d398ea-a214-4b6a-a4f4-e0f3e0c385ad tempest-SnapshotDependencyTests-1639469217 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e7939dbe-e1a6-46ba-9dde-989308afe0a6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83259) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 15:25:31 devstack cinder-volume[83259]: DEBUG cinder.volume.manager [None req-63d398ea-a214-4b6a-a4f4-e0f3e0c385ad tempest-SnapshotDependencyTests-1639469217 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (adb8084b-f194-4402-8e4c-b21373f917d2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83259) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 15:25:31 devstack cinder-volume[83259]: DEBUG cinder.volume.manager [None req-63d398ea-a214-4b6a-a4f4-e0f3e0c385ad tempest-SnapshotDependencyTests-1639469217 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (adb8084b-f194-4402-8e4c-b21373f917d2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'fb056960-1e79-47e9-8b58-6accef1fb32a', 'volume_name': 'volume-fb056960-1e79-47e9-8b58-6accef1fb32a', 'volume_size': 1}' {{(pid=83259) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 15:25:31 devstack cinder-volume[83259]: DEBUG cinder.volume.manager [None req-63d398ea-a214-4b6a-a4f4-e0f3e0c385ad tempest-SnapshotDependencyTests-1639469217 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8aa92624-109c-4323-9172-36e24ae6d26b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83259) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 15:25:31 devstack cinder-volume[83259]: DEBUG cinder.volume.manager [None req-63d398ea-a214-4b6a-a4f4-e0f3e0c385ad tempest-SnapshotDependencyTests-1639469217 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8aa92624-109c-4323-9172-36e24ae6d26b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83259) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 15:25:31 devstack cinder-volume[83259]: DEBUG cinder.volume.manager [None req-63d398ea-a214-4b6a-a4f4-e0f3e0c385ad tempest-SnapshotDependencyTests-1639469217 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b442b2e7-127d-46b9-af69-0ad965015c74) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83259) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 15:25:31 devstack cinder-volume[83259]: INFO cinder.volume.flows.manager.create_volume [None req-63d398ea-a214-4b6a-a4f4-e0f3e0c385ad tempest-SnapshotDependencyTests-1639469217 None] Volume fb056960-1e79-47e9-8b58-6accef1fb32a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-fb056960-1e79-47e9-8b58-6accef1fb32a', 'volume_size': 1} Sep 16 15:25:31 devstack cinder-volume[83259]: DEBUG oslo_concurrency.lockutils [None req-63d398ea-a214-4b6a-a4f4-e0f3e0c385ad tempest-SnapshotDependencyTests-1639469217 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83259) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 16 15:25:31 devstack cinder-volume[83259]: DEBUG oslo_concurrency.lockutils [None req-63d398ea-a214-4b6a-a4f4-e0f3e0c385ad tempest-SnapshotDependencyTests-1639469217 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=83259) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 16 15:25:31 devstack cinder-volume[83259]: DEBUG cinder.volume.drivers.quobyte [None req-63d398ea-a214-4b6a-a4f4-e0f3e0c385ad tempest-SnapshotDependencyTests-1639469217 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-16T13:25:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-848976254',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#Quobyte',id=fb056960-1e79-47e9-8b58-6accef1fb32a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d778b1f2a2ab49dabc7e529d141418f2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-16T13:25:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-16T13:25:31Z,use_quota=True,user_id='dd4f533cfeac4f139a0efc67e1370426',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(485ead50-3df8-4d76-8d34-a4db136c980a),volume_type_id=485ead50-3df8-4d76-8d34-a4db136c980a)}" {{(pid=83259) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Sep 16 15:25:31 devstack cinder-volume[83259]: DEBUG cinder.volume.drivers.remotefs [None req-63d398ea-a214-4b6a-a4f4-e0f3e0c385ad tempest-SnapshotDependencyTests-1639469217 None] Creating volume fb056960-1e79-47e9-8b58-6accef1fb32a {{(pid=83259) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}} Sep 16 15:25:31 devstack cinder-volume[83259]: DEBUG oslo_concurrency.lockutils [None req-63d398ea-a214-4b6a-a4f4-e0f3e0c385ad tempest-SnapshotDependencyTests-1639469217 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83259) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 16 15:25:31 devstack cinder-volume[83259]: DEBUG oslo_concurrency.lockutils [None req-63d398ea-a214-4b6a-a4f4-e0f3e0c385ad tempest-SnapshotDependencyTests-1639469217 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83259) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 16 15:25:31 devstack cinder-volume[83259]: DEBUG cinder.volume.drivers.quobyte [None req-63d398ea-a214-4b6a-a4f4-e0f3e0c385ad tempest-SnapshotDependencyTests-1639469217 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-61f585ac-f8e2-4d19-a890-7ebc2726cc72': None} {{(pid=83259) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:639}} Sep 16 15:25:31 devstack cinder-volume[83259]: DEBUG cinder.volume.drivers.quobyte [None req-63d398ea-a214-4b6a-a4f4-e0f3e0c385ad tempest-SnapshotDependencyTests-1639469217 None] Available shares ['10.10.41.181/cinder-vol-61f585ac-f8e2-4d19-a890-7ebc2726cc72'] {{(pid=83259) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:669}} Sep 16 15:25:31 devstack cinder-volume[83259]: DEBUG oslo_concurrency.lockutils [None req-63d398ea-a214-4b6a-a4f4-e0f3e0c385ad tempest-SnapshotDependencyTests-1639469217 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=83259) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 16 15:25:31 devstack cinder-volume[83259]: DEBUG cinder.volume.drivers.quobyte [None req-63d398ea-a214-4b6a-a4f4-e0f3e0c385ad tempest-SnapshotDependencyTests-1639469217 None] Selected 10.10.41.181/cinder-vol-61f585ac-f8e2-4d19-a890-7ebc2726cc72 as target Quobyte volume. {{(pid=83259) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:690}} Sep 16 15:25:31 devstack cinder-volume[83259]: INFO cinder.volume.drivers.remotefs [None req-63d398ea-a214-4b6a-a4f4-e0f3e0c385ad tempest-SnapshotDependencyTests-1639469217 None] casted to 10.10.41.181/cinder-vol-61f585ac-f8e2-4d19-a890-7ebc2726cc72 Sep 16 15:25:31 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [None req-63d398ea-a214-4b6a-a4f4-e0f3e0c385ad tempest-SnapshotDependencyTests-1639469217 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c/volume-fb056960-1e79-47e9-8b58-6accef1fb32a 1073741824 {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 15:25:31 devstack quobyte-client[83286]: The server volume:87712ffe-8a69-446d-9ed6-4430c7ee9792@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=87712ffe-8a69-446d-9ed6-4430c7ee9792, inode=157, name=volume-fb056960-1e79-47e9-8b58-6accef1fb32a, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.206), requestorAccessMask=0 Sep 16 15:25:31 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [None req-63d398ea-a214-4b6a-a4f4-e0f3e0c385ad tempest-SnapshotDependencyTests-1639469217 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c/volume-fb056960-1e79-47e9-8b58-6accef1fb32a 1073741824" returned: 0 in 0.458s {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 15:25:31 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [None req-63d398ea-a214-4b6a-a4f4-e0f3e0c385ad tempest-SnapshotDependencyTests-1639469217 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c/volume-fb056960-1e79-47e9-8b58-6accef1fb32a {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 15:25:32 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [None req-63d398ea-a214-4b6a-a4f4-e0f3e0c385ad tempest-SnapshotDependencyTests-1639469217 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c/volume-fb056960-1e79-47e9-8b58-6accef1fb32a" returned: 0 in 0.191s {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 15:25:32 devstack cinder-volume[83259]: DEBUG cinder.volume.drivers.quobyte [None req-63d398ea-a214-4b6a-a4f4-e0f3e0c385ad tempest-SnapshotDependencyTests-1639469217 None] <== create_volume: return (726ms) {'provider_location': '10.10.41.181/cinder-vol-61f585ac-f8e2-4d19-a890-7ebc2726cc72'} {{(pid=83259) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Sep 16 15:25:32 devstack cinder-volume[83259]: DEBUG oslo_concurrency.lockutils [None req-63d398ea-a214-4b6a-a4f4-e0f3e0c385ad tempest-SnapshotDependencyTests-1639469217 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.742s {{(pid=83259) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 16 15:25:32 devstack cinder-volume[83259]: DEBUG cinder.volume.manager [None req-63d398ea-a214-4b6a-a4f4-e0f3e0c385ad tempest-SnapshotDependencyTests-1639469217 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b442b2e7-127d-46b9-af69-0ad965015c74) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-fb056960-1e79-47e9-8b58-6accef1fb32a', 'volume_size': 1}' {{(pid=83259) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 15:25:32 devstack cinder-volume[83259]: DEBUG cinder.volume.manager [None req-63d398ea-a214-4b6a-a4f4-e0f3e0c385ad tempest-SnapshotDependencyTests-1639469217 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (98f10d9a-e2fa-45c7-9d98-aa687333eb7e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83259) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 15:25:32 devstack cinder-volume[83259]: INFO cinder.volume.flows.manager.create_volume [None req-63d398ea-a214-4b6a-a4f4-e0f3e0c385ad tempest-SnapshotDependencyTests-1639469217 None] Volume volume-fb056960-1e79-47e9-8b58-6accef1fb32a (fb056960-1e79-47e9-8b58-6accef1fb32a): created successfully Sep 16 15:25:32 devstack cinder-volume[83259]: DEBUG cinder.volume.manager [None req-63d398ea-a214-4b6a-a4f4-e0f3e0c385ad tempest-SnapshotDependencyTests-1639469217 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (98f10d9a-e2fa-45c7-9d98-aa687333eb7e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83259) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 15:25:32 devstack cinder-volume[83259]: DEBUG cinder.volume.manager [None req-63d398ea-a214-4b6a-a4f4-e0f3e0c385ad tempest-SnapshotDependencyTests-1639469217 None] Flow 'volume_create_manager' (2df50cea-a058-4105-84f9-ee148c5859c7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83259) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 16 15:25:32 devstack cinder-volume[83259]: INFO cinder.volume.manager [None req-63d398ea-a214-4b6a-a4f4-e0f3e0c385ad tempest-SnapshotDependencyTests-1639469217 None] Created volume successfully. Sep 16 15:25:32 devstack cinder-volume[83259]: WARNING cinder.volume.volume_utils [None req-b0577c13-0e93-4575-bd5b-9ddf6185a9da tempest-CreateVolumesFromSnapshotTest-853054668 None] Volume driver (QuobyteDriver 1.2) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 16 15:25:32 devstack cinder-volume[83259]: DEBUG cinder.volume.flows.manager.create_volume [None req-b0577c13-0e93-4575-bd5b-9ddf6185a9da tempest-CreateVolumesFromSnapshotTest-853054668 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#Quobyte'], 'hosts': ['devstack@QuobyteHD#Quobyte']} {{(pid=83259) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1387}} Sep 16 15:25:32 devstack cinder-volume[83259]: DEBUG cinder.volume.manager [None req-b0577c13-0e93-4575-bd5b-9ddf6185a9da tempest-CreateVolumesFromSnapshotTest-853054668 None] Flow 'volume_create_manager' (ffb8359c-faed-46c4-84d7-65c45e923894) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83259) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 16 15:25:32 devstack cinder-volume[83259]: DEBUG cinder.volume.manager [None req-b0577c13-0e93-4575-bd5b-9ddf6185a9da tempest-CreateVolumesFromSnapshotTest-853054668 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (38959057-beb9-429a-95f3-3dda351f0f7b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83259) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 15:25:32 devstack cinder-volume[83259]: DEBUG cinder.volume.manager [None req-b0577c13-0e93-4575-bd5b-9ddf6185a9da tempest-CreateVolumesFromSnapshotTest-853054668 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (38959057-beb9-429a-95f3-3dda351f0f7b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-16T13:25:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-947924603',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#Quobyte',id=b5d13a99-d0aa-49b6-aea0-a30656b55662,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d3e07dd8ed944a4e832e4091183e70ca',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-16T13:25:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-16T13:25:32Z,use_quota=True,user_id='bd19339b7db74ce6a52197e7902747d2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(485ead50-3df8-4d76-8d34-a4db136c980a),volume_type_id=485ead50-3df8-4d76-8d34-a4db136c980a)' {{(pid=83259) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 15:25:32 devstack cinder-volume[83259]: DEBUG cinder.volume.manager [None req-b0577c13-0e93-4575-bd5b-9ddf6185a9da tempest-CreateVolumesFromSnapshotTest-853054668 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1bd0f6cc-d734-4066-90f1-1d367fe92322) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83259) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 15:25:32 devstack cinder-volume[83259]: DEBUG cinder.volume.manager [None req-b0577c13-0e93-4575-bd5b-9ddf6185a9da tempest-CreateVolumesFromSnapshotTest-853054668 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1bd0f6cc-d734-4066-90f1-1d367fe92322) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83259) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 15:25:32 devstack cinder-volume[83259]: DEBUG cinder.volume.manager [None req-b0577c13-0e93-4575-bd5b-9ddf6185a9da tempest-CreateVolumesFromSnapshotTest-853054668 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e00899e4-e78b-42e6-aa9b-be7bb0acbdce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83259) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 15:25:32 devstack cinder-volume[83259]: DEBUG cinder.volume.manager [None req-b0577c13-0e93-4575-bd5b-9ddf6185a9da tempest-CreateVolumesFromSnapshotTest-853054668 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e00899e4-e78b-42e6-aa9b-be7bb0acbdce) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b5d13a99-d0aa-49b6-aea0-a30656b55662', 'volume_name': 'volume-b5d13a99-d0aa-49b6-aea0-a30656b55662', 'volume_size': 1}' {{(pid=83259) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 15:25:32 devstack cinder-volume[83259]: DEBUG cinder.volume.manager [None req-b0577c13-0e93-4575-bd5b-9ddf6185a9da tempest-CreateVolumesFromSnapshotTest-853054668 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5a528a2e-3edd-416e-9349-9c8fcc0df5dc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83259) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 15:25:32 devstack cinder-volume[83259]: DEBUG cinder.volume.manager [None req-b0577c13-0e93-4575-bd5b-9ddf6185a9da tempest-CreateVolumesFromSnapshotTest-853054668 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5a528a2e-3edd-416e-9349-9c8fcc0df5dc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83259) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 15:25:32 devstack cinder-volume[83259]: DEBUG cinder.volume.manager [None req-b0577c13-0e93-4575-bd5b-9ddf6185a9da tempest-CreateVolumesFromSnapshotTest-853054668 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4ac6f101-3582-4b67-90e6-d1d190a817c3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83259) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 15:25:32 devstack cinder-volume[83259]: INFO cinder.volume.flows.manager.create_volume [None req-b0577c13-0e93-4575-bd5b-9ddf6185a9da tempest-CreateVolumesFromSnapshotTest-853054668 None] Volume b5d13a99-d0aa-49b6-aea0-a30656b55662: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b5d13a99-d0aa-49b6-aea0-a30656b55662', 'volume_size': 1} Sep 16 15:25:32 devstack cinder-volume[83259]: DEBUG oslo_concurrency.lockutils [None req-b0577c13-0e93-4575-bd5b-9ddf6185a9da tempest-CreateVolumesFromSnapshotTest-853054668 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83259) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 16 15:25:32 devstack cinder-volume[83259]: DEBUG oslo_concurrency.lockutils [None req-b0577c13-0e93-4575-bd5b-9ddf6185a9da tempest-CreateVolumesFromSnapshotTest-853054668 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.004s {{(pid=83259) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 16 15:25:32 devstack cinder-volume[83259]: DEBUG cinder.volume.drivers.quobyte [None req-b0577c13-0e93-4575-bd5b-9ddf6185a9da tempest-CreateVolumesFromSnapshotTest-853054668 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-16T13:25:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-947924603',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#Quobyte',id=b5d13a99-d0aa-49b6-aea0-a30656b55662,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d3e07dd8ed944a4e832e4091183e70ca',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-16T13:25:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-16T13:25:32Z,use_quota=True,user_id='bd19339b7db74ce6a52197e7902747d2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(485ead50-3df8-4d76-8d34-a4db136c980a),volume_type_id=485ead50-3df8-4d76-8d34-a4db136c980a)}" {{(pid=83259) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Sep 16 15:25:32 devstack cinder-volume[83259]: DEBUG cinder.volume.drivers.remotefs [None req-b0577c13-0e93-4575-bd5b-9ddf6185a9da tempest-CreateVolumesFromSnapshotTest-853054668 None] Creating volume b5d13a99-d0aa-49b6-aea0-a30656b55662 {{(pid=83259) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}} Sep 16 15:25:32 devstack cinder-volume[83259]: DEBUG oslo_concurrency.lockutils [None req-b0577c13-0e93-4575-bd5b-9ddf6185a9da tempest-CreateVolumesFromSnapshotTest-853054668 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83259) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 16 15:25:32 devstack cinder-volume[83259]: DEBUG oslo_concurrency.lockutils [None req-b0577c13-0e93-4575-bd5b-9ddf6185a9da tempest-CreateVolumesFromSnapshotTest-853054668 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83259) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 16 15:25:32 devstack cinder-volume[83259]: DEBUG cinder.volume.drivers.quobyte [None req-b0577c13-0e93-4575-bd5b-9ddf6185a9da tempest-CreateVolumesFromSnapshotTest-853054668 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-61f585ac-f8e2-4d19-a890-7ebc2726cc72': None} {{(pid=83259) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:639}} Sep 16 15:25:32 devstack cinder-volume[83259]: DEBUG cinder.volume.drivers.quobyte [None req-b0577c13-0e93-4575-bd5b-9ddf6185a9da tempest-CreateVolumesFromSnapshotTest-853054668 None] Available shares ['10.10.41.181/cinder-vol-61f585ac-f8e2-4d19-a890-7ebc2726cc72'] {{(pid=83259) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:669}} Sep 16 15:25:32 devstack cinder-volume[83259]: DEBUG oslo_concurrency.lockutils [None req-b0577c13-0e93-4575-bd5b-9ddf6185a9da tempest-CreateVolumesFromSnapshotTest-853054668 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=83259) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 16 15:25:32 devstack cinder-volume[83259]: DEBUG cinder.volume.drivers.quobyte [None req-b0577c13-0e93-4575-bd5b-9ddf6185a9da tempest-CreateVolumesFromSnapshotTest-853054668 None] Selected 10.10.41.181/cinder-vol-61f585ac-f8e2-4d19-a890-7ebc2726cc72 as target Quobyte volume. {{(pid=83259) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:690}} Sep 16 15:25:32 devstack cinder-volume[83259]: INFO cinder.volume.drivers.remotefs [None req-b0577c13-0e93-4575-bd5b-9ddf6185a9da tempest-CreateVolumesFromSnapshotTest-853054668 None] casted to 10.10.41.181/cinder-vol-61f585ac-f8e2-4d19-a890-7ebc2726cc72 Sep 16 15:25:32 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [None req-b0577c13-0e93-4575-bd5b-9ddf6185a9da tempest-CreateVolumesFromSnapshotTest-853054668 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c/volume-b5d13a99-d0aa-49b6-aea0-a30656b55662 1073741824 {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 15:25:33 devstack quobyte-client[83286]: System call of process 100062 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 16 15:25:33 devstack quobyte-client[83286]: The server volume:87712ffe-8a69-446d-9ed6-4430c7ee9792@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=87712ffe-8a69-446d-9ed6-4430c7ee9792, inode=158, name=volume-b5d13a99-d0aa-49b6-aea0-a30656b55662, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.206), requestorAccessMask=0 Sep 16 15:25:33 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [None req-b0577c13-0e93-4575-bd5b-9ddf6185a9da tempest-CreateVolumesFromSnapshotTest-853054668 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c/volume-b5d13a99-d0aa-49b6-aea0-a30656b55662 1073741824" returned: 0 in 0.408s {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 15:25:33 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [None req-b0577c13-0e93-4575-bd5b-9ddf6185a9da tempest-CreateVolumesFromSnapshotTest-853054668 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c/volume-b5d13a99-d0aa-49b6-aea0-a30656b55662 {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 15:25:33 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [None req-b0577c13-0e93-4575-bd5b-9ddf6185a9da tempest-CreateVolumesFromSnapshotTest-853054668 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c/volume-b5d13a99-d0aa-49b6-aea0-a30656b55662" returned: 0 in 0.169s {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 15:25:33 devstack cinder-volume[83259]: DEBUG cinder.volume.drivers.quobyte [None req-b0577c13-0e93-4575-bd5b-9ddf6185a9da tempest-CreateVolumesFromSnapshotTest-853054668 None] <== create_volume: return (658ms) {'provider_location': '10.10.41.181/cinder-vol-61f585ac-f8e2-4d19-a890-7ebc2726cc72'} {{(pid=83259) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Sep 16 15:25:33 devstack cinder-volume[83259]: DEBUG oslo_concurrency.lockutils [None req-b0577c13-0e93-4575-bd5b-9ddf6185a9da tempest-CreateVolumesFromSnapshotTest-853054668 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.673s {{(pid=83259) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 16 15:25:33 devstack cinder-volume[83259]: DEBUG cinder.volume.manager [None req-b0577c13-0e93-4575-bd5b-9ddf6185a9da tempest-CreateVolumesFromSnapshotTest-853054668 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4ac6f101-3582-4b67-90e6-d1d190a817c3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b5d13a99-d0aa-49b6-aea0-a30656b55662', 'volume_size': 1}' {{(pid=83259) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 15:25:33 devstack cinder-volume[83259]: DEBUG cinder.volume.manager [None req-b0577c13-0e93-4575-bd5b-9ddf6185a9da tempest-CreateVolumesFromSnapshotTest-853054668 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (49431d24-f704-4a75-a2f2-97adf6e48671) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83259) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 15:25:34 devstack cinder-volume[83259]: INFO cinder.volume.flows.manager.create_volume [None req-b0577c13-0e93-4575-bd5b-9ddf6185a9da tempest-CreateVolumesFromSnapshotTest-853054668 None] Volume volume-b5d13a99-d0aa-49b6-aea0-a30656b55662 (b5d13a99-d0aa-49b6-aea0-a30656b55662): created successfully Sep 16 15:25:34 devstack cinder-volume[83259]: DEBUG cinder.volume.manager [None req-b0577c13-0e93-4575-bd5b-9ddf6185a9da tempest-CreateVolumesFromSnapshotTest-853054668 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (49431d24-f704-4a75-a2f2-97adf6e48671) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83259) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 15:25:34 devstack cinder-volume[83259]: DEBUG cinder.volume.manager [None req-b0577c13-0e93-4575-bd5b-9ddf6185a9da tempest-CreateVolumesFromSnapshotTest-853054668 None] Flow 'volume_create_manager' (ffb8359c-faed-46c4-84d7-65c45e923894) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83259) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 16 15:25:34 devstack cinder-volume[83259]: WARNING cinder.volume.volume_utils [None req-5b40f924-8537-4620-9d93-dc0c190c9974 tempest-SnapshotDependencyTests-1639469217 None] Volume driver (QuobyteDriver 1.2) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 16 15:25:34 devstack cinder-volume[83259]: DEBUG oslo_concurrency.lockutils [None req-5b40f924-8537-4620-9d93-dc0c190c9974 tempest-SnapshotDependencyTests-1639469217 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=83259) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 16 15:25:34 devstack cinder-volume[83259]: DEBUG oslo_concurrency.lockutils [None req-5b40f924-8537-4620-9d93-dc0c190c9974 tempest-SnapshotDependencyTests-1639469217 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.003s {{(pid=83259) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 16 15:25:34 devstack cinder-volume[83259]: INFO cinder.volume.manager [None req-b0577c13-0e93-4575-bd5b-9ddf6185a9da tempest-CreateVolumesFromSnapshotTest-853054668 None] Created volume successfully. Sep 16 15:25:34 devstack cinder-volume[83259]: DEBUG cinder.volume.drivers.remotefs [None req-5b40f924-8537-4620-9d93-dc0c190c9974 tempest-SnapshotDependencyTests-1639469217 None] Creating offline snapshot a8b16fa4-35da-41a8-b8f4-55013aa8fe09 of volume fb056960-1e79-47e9-8b58-6accef1fb32a {{(pid=83259) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1694}} Sep 16 15:25:34 devstack cinder-volume[83259]: DEBUG oslo.privsep.daemon [-] privsep: reply[c3efa9de-fc47-426a-a6c9-3f7396de4a6b]: (4, 'qcow2') {{(pid=84312) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 16 15:25:34 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [None req-5b40f924-8537-4620-9d93-dc0c190c9974 tempest-SnapshotDependencyTests-1639469217 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c/volume-fb056960-1e79-47e9-8b58-6accef1fb32a {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 15:25:34 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [None req-5b40f924-8537-4620-9d93-dc0c190c9974 tempest-SnapshotDependencyTests-1639469217 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c/volume-fb056960-1e79-47e9-8b58-6accef1fb32a" returned: 0 in 0.452s {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 15:25:34 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [None req-5b40f924-8537-4620-9d93-dc0c190c9974 tempest-SnapshotDependencyTests-1639469217 None] Running cmd (subprocess): qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c/volume-fb056960-1e79-47e9-8b58-6accef1fb32a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c/volume-fb056960-1e79-47e9-8b58-6accef1fb32a.a8b16fa4-35da-41a8-b8f4-55013aa8fe09 1G {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 15:25:34 devstack quobyte-client[83286]: The server volume:87712ffe-8a69-446d-9ed6-4430c7ee9792@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=87712ffe-8a69-446d-9ed6-4430c7ee9792, inode=159, name=volume-fb056960-1e79-47e9-8b58-6accef1fb32a.a8b16fa4-35da-41a8-b8f4-55013aa8fe09, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.206), requestorAccessMask=0 Sep 16 15:25:35 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [None req-5b40f924-8537-4620-9d93-dc0c190c9974 tempest-SnapshotDependencyTests-1639469217 None] CMD "qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c/volume-fb056960-1e79-47e9-8b58-6accef1fb32a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c/volume-fb056960-1e79-47e9-8b58-6accef1fb32a.a8b16fa4-35da-41a8-b8f4-55013aa8fe09 1G" returned: 0 in 0.309s {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 15:25:35 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [None req-5b40f924-8537-4620-9d93-dc0c190c9974 tempest-SnapshotDependencyTests-1639469217 None] Running cmd (subprocess): qemu-img rebase -u -b volume-fb056960-1e79-47e9-8b58-6accef1fb32a -F qcow2 /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c/volume-fb056960-1e79-47e9-8b58-6accef1fb32a.a8b16fa4-35da-41a8-b8f4-55013aa8fe09 {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 15:25:35 devstack quobyte-client[83286]: System call of process 100084 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 16 15:25:36 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [None req-5b40f924-8537-4620-9d93-dc0c190c9974 tempest-SnapshotDependencyTests-1639469217 None] CMD "qemu-img rebase -u -b volume-fb056960-1e79-47e9-8b58-6accef1fb32a -F qcow2 /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c/volume-fb056960-1e79-47e9-8b58-6accef1fb32a.a8b16fa4-35da-41a8-b8f4-55013aa8fe09" returned: 0 in 1.170s {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 15:25:36 devstack cinder-volume[83259]: DEBUG cinder.volume.drivers.remotefs [None req-5b40f924-8537-4620-9d93-dc0c190c9974 tempest-SnapshotDependencyTests-1639469217 None] File path /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c/volume-fb056960-1e79-47e9-8b58-6accef1fb32a.a8b16fa4-35da-41a8-b8f4-55013aa8fe09 is being set with permissions: 660 {{(pid=83259) _set_rw_permissions /opt/stack/cinder/cinder/volume/drivers/remotefs.py:492}} Sep 16 15:25:36 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [None req-5b40f924-8537-4620-9d93-dc0c190c9974 tempest-SnapshotDependencyTests-1639469217 None] Running cmd (subprocess): chmod 660 /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c/volume-fb056960-1e79-47e9-8b58-6accef1fb32a.a8b16fa4-35da-41a8-b8f4-55013aa8fe09 {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 15:25:36 devstack cinder-volume[83259]: WARNING cinder.volume.volume_utils [None req-aeb2a20e-29a0-464e-8c63-82b725e2330d tempest-CreateVolumesFromSnapshotTest-853054668 None] Volume driver (QuobyteDriver 1.2) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 16 15:25:36 devstack cinder-volume[83259]: DEBUG oslo_concurrency.lockutils [None req-aeb2a20e-29a0-464e-8c63-82b725e2330d tempest-CreateVolumesFromSnapshotTest-853054668 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=83259) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 16 15:25:36 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [None req-5b40f924-8537-4620-9d93-dc0c190c9974 tempest-SnapshotDependencyTests-1639469217 None] CMD "chmod 660 /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c/volume-fb056960-1e79-47e9-8b58-6accef1fb32a.a8b16fa4-35da-41a8-b8f4-55013aa8fe09" returned: 0 in 0.408s {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 15:25:36 devstack cinder-volume[83259]: DEBUG cinder.volume.drivers.remotefs [None req-5b40f924-8537-4620-9d93-dc0c190c9974 tempest-SnapshotDependencyTests-1639469217 None] Setting permissions: /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c/volume-fb056960-1e79-47e9-8b58-6accef1fb32a -> 1000:1000 {{(pid=83259) _do_create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1584}} Sep 16 15:25:36 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [None req-5b40f924-8537-4620-9d93-dc0c190c9974 tempest-SnapshotDependencyTests-1639469217 None] Running cmd (subprocess): chown --reference=/opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c/volume-fb056960-1e79-47e9-8b58-6accef1fb32a /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c/volume-fb056960-1e79-47e9-8b58-6accef1fb32a.a8b16fa4-35da-41a8-b8f4-55013aa8fe09 {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 15:25:36 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [None req-5b40f924-8537-4620-9d93-dc0c190c9974 tempest-SnapshotDependencyTests-1639469217 None] CMD "chown --reference=/opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c/volume-fb056960-1e79-47e9-8b58-6accef1fb32a /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c/volume-fb056960-1e79-47e9-8b58-6accef1fb32a.a8b16fa4-35da-41a8-b8f4-55013aa8fe09" returned: 0 in 0.183s {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 15:25:36 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [None req-5b40f924-8537-4620-9d93-dc0c190c9974 tempest-SnapshotDependencyTests-1639469217 None] Running cmd (subprocess): truncate -s0 /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c/volume-fb056960-1e79-47e9-8b58-6accef1fb32a.info {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 15:25:37 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [None req-5b40f924-8537-4620-9d93-dc0c190c9974 tempest-SnapshotDependencyTests-1639469217 None] CMD "truncate -s0 /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c/volume-fb056960-1e79-47e9-8b58-6accef1fb32a.info" returned: 0 in 0.171s {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 15:25:37 devstack cinder-volume[83259]: DEBUG cinder.volume.drivers.remotefs [None req-5b40f924-8537-4620-9d93-dc0c190c9974 tempest-SnapshotDependencyTests-1639469217 None] File path /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c/volume-fb056960-1e79-47e9-8b58-6accef1fb32a.info is being set with permissions: 660 {{(pid=83259) _set_rw_permissions /opt/stack/cinder/cinder/volume/drivers/remotefs.py:492}} Sep 16 15:25:37 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [None req-5b40f924-8537-4620-9d93-dc0c190c9974 tempest-SnapshotDependencyTests-1639469217 None] Running cmd (subprocess): chmod 660 /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c/volume-fb056960-1e79-47e9-8b58-6accef1fb32a.info {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 15:25:37 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [None req-5b40f924-8537-4620-9d93-dc0c190c9974 tempest-SnapshotDependencyTests-1639469217 None] CMD "chmod 660 /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c/volume-fb056960-1e79-47e9-8b58-6accef1fb32a.info" returned: 0 in 0.186s {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 15:25:37 devstack cinder-volume[83259]: DEBUG oslo_concurrency.lockutils [None req-5b40f924-8537-4620-9d93-dc0c190c9974 tempest-SnapshotDependencyTests-1639469217 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.328s {{(pid=83259) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 16 15:25:37 devstack cinder-volume[83259]: DEBUG oslo_concurrency.lockutils [None req-aeb2a20e-29a0-464e-8c63-82b725e2330d tempest-CreateVolumesFromSnapshotTest-853054668 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.857s {{(pid=83259) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 16 15:25:37 devstack cinder-volume[83259]: DEBUG cinder.volume.drivers.remotefs [None req-aeb2a20e-29a0-464e-8c63-82b725e2330d tempest-CreateVolumesFromSnapshotTest-853054668 None] Creating offline snapshot 5fdcf1c8-bc59-42af-9700-d1581956b154 of volume b5d13a99-d0aa-49b6-aea0-a30656b55662 {{(pid=83259) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1694}} Sep 16 15:25:37 devstack cinder-volume[83259]: DEBUG oslo.privsep.daemon [-] privsep: reply[93efb2b9-7da4-4705-b014-2b54c81a2075]: (4, 'qcow2') {{(pid=84312) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 16 15:25:37 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [None req-aeb2a20e-29a0-464e-8c63-82b725e2330d tempest-CreateVolumesFromSnapshotTest-853054668 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c/volume-b5d13a99-d0aa-49b6-aea0-a30656b55662 {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 15:25:37 devstack cinder-volume[83259]: INFO cinder.volume.manager [None req-5b40f924-8537-4620-9d93-dc0c190c9974 tempest-SnapshotDependencyTests-1639469217 None] Create snapshot completed successfully Sep 16 15:25:38 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [None req-aeb2a20e-29a0-464e-8c63-82b725e2330d tempest-CreateVolumesFromSnapshotTest-853054668 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c/volume-b5d13a99-d0aa-49b6-aea0-a30656b55662" returned: 0 in 0.629s {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 15:25:38 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [None req-aeb2a20e-29a0-464e-8c63-82b725e2330d tempest-CreateVolumesFromSnapshotTest-853054668 None] Running cmd (subprocess): qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c/volume-b5d13a99-d0aa-49b6-aea0-a30656b55662,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c/volume-b5d13a99-d0aa-49b6-aea0-a30656b55662.5fdcf1c8-bc59-42af-9700-d1581956b154 1G {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 15:25:38 devstack quobyte-client[83286]: System call of process 100318 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 16 15:25:38 devstack quobyte-client[83286]: The server volume:87712ffe-8a69-446d-9ed6-4430c7ee9792@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=87712ffe-8a69-446d-9ed6-4430c7ee9792, inode=161, name=volume-b5d13a99-d0aa-49b6-aea0-a30656b55662.5fdcf1c8-bc59-42af-9700-d1581956b154, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.206), requestorAccessMask=0 Sep 16 15:25:38 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [None req-aeb2a20e-29a0-464e-8c63-82b725e2330d tempest-CreateVolumesFromSnapshotTest-853054668 None] CMD "qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c/volume-b5d13a99-d0aa-49b6-aea0-a30656b55662,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c/volume-b5d13a99-d0aa-49b6-aea0-a30656b55662.5fdcf1c8-bc59-42af-9700-d1581956b154 1G" returned: 0 in 0.403s {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 15:25:38 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [None req-aeb2a20e-29a0-464e-8c63-82b725e2330d tempest-CreateVolumesFromSnapshotTest-853054668 None] Running cmd (subprocess): qemu-img rebase -u -b volume-b5d13a99-d0aa-49b6-aea0-a30656b55662 -F qcow2 /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c/volume-b5d13a99-d0aa-49b6-aea0-a30656b55662.5fdcf1c8-bc59-42af-9700-d1581956b154 {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 15:25:39 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [None req-aeb2a20e-29a0-464e-8c63-82b725e2330d tempest-CreateVolumesFromSnapshotTest-853054668 None] CMD "qemu-img rebase -u -b volume-b5d13a99-d0aa-49b6-aea0-a30656b55662 -F qcow2 /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c/volume-b5d13a99-d0aa-49b6-aea0-a30656b55662.5fdcf1c8-bc59-42af-9700-d1581956b154" returned: 0 in 0.832s {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 15:25:39 devstack cinder-volume[83259]: DEBUG cinder.volume.drivers.remotefs [None req-aeb2a20e-29a0-464e-8c63-82b725e2330d tempest-CreateVolumesFromSnapshotTest-853054668 None] File path /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c/volume-b5d13a99-d0aa-49b6-aea0-a30656b55662.5fdcf1c8-bc59-42af-9700-d1581956b154 is being set with permissions: 660 {{(pid=83259) _set_rw_permissions /opt/stack/cinder/cinder/volume/drivers/remotefs.py:492}} Sep 16 15:25:39 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [None req-aeb2a20e-29a0-464e-8c63-82b725e2330d tempest-CreateVolumesFromSnapshotTest-853054668 None] Running cmd (subprocess): chmod 660 /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c/volume-b5d13a99-d0aa-49b6-aea0-a30656b55662.5fdcf1c8-bc59-42af-9700-d1581956b154 {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 15:25:39 devstack cinder-volume[83259]: WARNING cinder.volume.volume_utils [None req-244ee759-1a7a-41ca-87c9-53c21b135f00 tempest-SnapshotDependencyTests-1639469217 None] Volume driver (QuobyteDriver 1.2) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 16 15:25:39 devstack cinder-volume[83259]: DEBUG cinder.volume.flows.manager.create_volume [None req-244ee759-1a7a-41ca-87c9-53c21b135f00 tempest-SnapshotDependencyTests-1639469217 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#Quobyte'], 'hosts': ['devstack@QuobyteHD#Quobyte']} {{(pid=83259) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1387}} Sep 16 15:25:40 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [None req-aeb2a20e-29a0-464e-8c63-82b725e2330d tempest-CreateVolumesFromSnapshotTest-853054668 None] CMD "chmod 660 /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c/volume-b5d13a99-d0aa-49b6-aea0-a30656b55662.5fdcf1c8-bc59-42af-9700-d1581956b154" returned: 0 in 0.394s {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 15:25:40 devstack cinder-volume[83259]: DEBUG cinder.volume.drivers.remotefs [None req-aeb2a20e-29a0-464e-8c63-82b725e2330d tempest-CreateVolumesFromSnapshotTest-853054668 None] Setting permissions: /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c/volume-b5d13a99-d0aa-49b6-aea0-a30656b55662 -> 1000:1000 {{(pid=83259) _do_create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1584}} Sep 16 15:25:40 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [None req-aeb2a20e-29a0-464e-8c63-82b725e2330d tempest-CreateVolumesFromSnapshotTest-853054668 None] Running cmd (subprocess): chown --reference=/opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c/volume-b5d13a99-d0aa-49b6-aea0-a30656b55662 /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c/volume-b5d13a99-d0aa-49b6-aea0-a30656b55662.5fdcf1c8-bc59-42af-9700-d1581956b154 {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 15:25:40 devstack cinder-volume[83259]: DEBUG cinder.volume.manager [None req-244ee759-1a7a-41ca-87c9-53c21b135f00 tempest-SnapshotDependencyTests-1639469217 None] Flow 'volume_create_manager' (1d3e092f-8efb-47b3-8dc8-f41a24a2cf7b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83259) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 16 15:25:40 devstack cinder-volume[83259]: DEBUG cinder.volume.manager [None req-244ee759-1a7a-41ca-87c9-53c21b135f00 tempest-SnapshotDependencyTests-1639469217 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (037c88ba-e47b-4e20-a585-184d26f1487e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83259) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 15:25:40 devstack cinder-volume[83259]: DEBUG cinder.volume.manager [None req-244ee759-1a7a-41ca-87c9-53c21b135f00 tempest-SnapshotDependencyTests-1639469217 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (037c88ba-e47b-4e20-a585-184d26f1487e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-16T13:25:39Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#Quobyte',id=5bfa9b0a-2bac-43b9-b551-4be6e2e870e6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d778b1f2a2ab49dabc7e529d141418f2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-16T13:25:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=a8b16fa4-35da-41a8-b8f4-55013aa8fe09,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-16T13:25:39Z,use_quota=True,user_id='dd4f533cfeac4f139a0efc67e1370426',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(485ead50-3df8-4d76-8d34-a4db136c980a),volume_type_id=485ead50-3df8-4d76-8d34-a4db136c980a)' {{(pid=83259) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 15:25:40 devstack cinder-volume[83259]: DEBUG cinder.volume.manager [None req-244ee759-1a7a-41ca-87c9-53c21b135f00 tempest-SnapshotDependencyTests-1639469217 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fb902cda-537c-4a01-bba6-0e45a08985d4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83259) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 15:25:40 devstack cinder-volume[83259]: DEBUG cinder.volume.manager [None req-244ee759-1a7a-41ca-87c9-53c21b135f00 tempest-SnapshotDependencyTests-1639469217 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fb902cda-537c-4a01-bba6-0e45a08985d4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83259) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 15:25:40 devstack cinder-volume[83259]: DEBUG cinder.volume.manager [None req-244ee759-1a7a-41ca-87c9-53c21b135f00 tempest-SnapshotDependencyTests-1639469217 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c23a5586-623a-4079-bc21-52b5a8eaa71c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83259) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 15:25:40 devstack cinder-volume[83259]: DEBUG cinder.volume.manager [None req-244ee759-1a7a-41ca-87c9-53c21b135f00 tempest-SnapshotDependencyTests-1639469217 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c23a5586-623a-4079-bc21-52b5a8eaa71c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '5bfa9b0a-2bac-43b9-b551-4be6e2e870e6', 'volume_name': 'volume-5bfa9b0a-2bac-43b9-b551-4be6e2e870e6', 'volume_size': 1, 'snapshot_id': 'a8b16fa4-35da-41a8-b8f4-55013aa8fe09'}' {{(pid=83259) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 15:25:40 devstack cinder-volume[83259]: DEBUG cinder.volume.manager [None req-244ee759-1a7a-41ca-87c9-53c21b135f00 tempest-SnapshotDependencyTests-1639469217 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3d324b01-859c-4bdf-8d30-e5e111fe61c8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83259) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 15:25:40 devstack cinder-volume[83259]: DEBUG cinder.volume.manager [None req-244ee759-1a7a-41ca-87c9-53c21b135f00 tempest-SnapshotDependencyTests-1639469217 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3d324b01-859c-4bdf-8d30-e5e111fe61c8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83259) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 15:25:40 devstack cinder-volume[83259]: DEBUG cinder.volume.manager [None req-244ee759-1a7a-41ca-87c9-53c21b135f00 tempest-SnapshotDependencyTests-1639469217 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dc0e6d65-5a5a-4b90-a62f-07e882e704c0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83259) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 15:25:40 devstack cinder-volume[83259]: INFO cinder.volume.flows.manager.create_volume [None req-244ee759-1a7a-41ca-87c9-53c21b135f00 tempest-SnapshotDependencyTests-1639469217 None] Volume 5bfa9b0a-2bac-43b9-b551-4be6e2e870e6: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-5bfa9b0a-2bac-43b9-b551-4be6e2e870e6', 'volume_size': 1, 'snapshot_id': 'a8b16fa4-35da-41a8-b8f4-55013aa8fe09'} Sep 16 15:25:40 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [None req-aeb2a20e-29a0-464e-8c63-82b725e2330d tempest-CreateVolumesFromSnapshotTest-853054668 None] CMD "chown --reference=/opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c/volume-b5d13a99-d0aa-49b6-aea0-a30656b55662 /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c/volume-b5d13a99-d0aa-49b6-aea0-a30656b55662.5fdcf1c8-bc59-42af-9700-d1581956b154" returned: 0 in 0.615s {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 15:25:40 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [None req-aeb2a20e-29a0-464e-8c63-82b725e2330d tempest-CreateVolumesFromSnapshotTest-853054668 None] Running cmd (subprocess): truncate -s0 /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c/volume-b5d13a99-d0aa-49b6-aea0-a30656b55662.info {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 15:25:40 devstack cinder-volume[83259]: DEBUG oslo_concurrency.lockutils [None req-244ee759-1a7a-41ca-87c9-53c21b135f00 tempest-SnapshotDependencyTests-1639469217 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=83259) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 16 15:25:41 devstack cinder-volume[83259]: WARNING cinder.volume.volume_utils [None req-101e267a-7223-4d35-af33-9e8074024b2c tempest-VolumeImageDependencyTests-25375886 None] Volume driver (QuobyteDriver 1.2) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 16 15:25:41 devstack cinder-volume[83259]: DEBUG cinder.volume.flows.manager.create_volume [None req-101e267a-7223-4d35-af33-9e8074024b2c tempest-VolumeImageDependencyTests-25375886 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#Quobyte'], 'hosts': ['devstack@QuobyteHD#Quobyte']} {{(pid=83259) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1387}} Sep 16 15:25:41 devstack cinder-volume[83259]: DEBUG cinder.volume.manager [None req-101e267a-7223-4d35-af33-9e8074024b2c tempest-VolumeImageDependencyTests-25375886 None] Flow 'volume_create_manager' (9949af42-1cf6-40e4-9522-90610496996a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83259) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 16 15:25:41 devstack cinder-volume[83259]: DEBUG cinder.volume.manager [None req-101e267a-7223-4d35-af33-9e8074024b2c tempest-VolumeImageDependencyTests-25375886 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (81f0ee48-a355-4448-8b44-5a233d0584d1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83259) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 15:25:41 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [None req-aeb2a20e-29a0-464e-8c63-82b725e2330d tempest-CreateVolumesFromSnapshotTest-853054668 None] CMD "truncate -s0 /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c/volume-b5d13a99-d0aa-49b6-aea0-a30656b55662.info" returned: 0 in 0.417s {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 15:25:41 devstack cinder-volume[83259]: DEBUG cinder.volume.drivers.remotefs [None req-aeb2a20e-29a0-464e-8c63-82b725e2330d tempest-CreateVolumesFromSnapshotTest-853054668 None] File path /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c/volume-b5d13a99-d0aa-49b6-aea0-a30656b55662.info is being set with permissions: 660 {{(pid=83259) _set_rw_permissions /opt/stack/cinder/cinder/volume/drivers/remotefs.py:492}} Sep 16 15:25:41 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [None req-aeb2a20e-29a0-464e-8c63-82b725e2330d tempest-CreateVolumesFromSnapshotTest-853054668 None] Running cmd (subprocess): chmod 660 /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c/volume-b5d13a99-d0aa-49b6-aea0-a30656b55662.info {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 15:25:41 devstack cinder-volume[83259]: DEBUG cinder.volume.manager [None req-101e267a-7223-4d35-af33-9e8074024b2c tempest-VolumeImageDependencyTests-25375886 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (81f0ee48-a355-4448-8b44-5a233d0584d1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-16T13:25:40Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#Quobyte',id=e1442a37-0aca-4f7a-9ffd-c3dcb64c0b07,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='683678bd901a42ec9487acb038532b52',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-16T13:25:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-16T13:25:41Z,use_quota=True,user_id='b7026066d1834b8fb54dfd214995c7ed',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(485ead50-3df8-4d76-8d34-a4db136c980a),volume_type_id=485ead50-3df8-4d76-8d34-a4db136c980a)' {{(pid=83259) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 15:25:41 devstack cinder-volume[83259]: DEBUG cinder.volume.manager [None req-101e267a-7223-4d35-af33-9e8074024b2c tempest-VolumeImageDependencyTests-25375886 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c986a7d8-42cf-4717-8f71-13e341c86914) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83259) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 15:25:41 devstack cinder-volume[83259]: DEBUG cinder.volume.manager [None req-101e267a-7223-4d35-af33-9e8074024b2c tempest-VolumeImageDependencyTests-25375886 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c986a7d8-42cf-4717-8f71-13e341c86914) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83259) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 15:25:41 devstack cinder-volume[83259]: DEBUG cinder.volume.manager [None req-101e267a-7223-4d35-af33-9e8074024b2c tempest-VolumeImageDependencyTests-25375886 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a7f9275b-82b8-4f81-afb0-43c2178f79dc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83259) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 15:25:41 devstack cinder-volume[83259]: DEBUG cinder.image.glance [None req-101e267a-7223-4d35-af33-9e8074024b2c tempest-VolumeImageDependencyTests-25375886 None] Creating Keystone auth plugin from conf {{(pid=83259) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:128}} Sep 16 15:25:41 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [None req-aeb2a20e-29a0-464e-8c63-82b725e2330d tempest-CreateVolumesFromSnapshotTest-853054668 None] CMD "chmod 660 /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c/volume-b5d13a99-d0aa-49b6-aea0-a30656b55662.info" returned: 0 in 0.412s {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 15:25:41 devstack cinder-volume[83259]: DEBUG oslo_concurrency.lockutils [None req-aeb2a20e-29a0-464e-8c63-82b725e2330d tempest-CreateVolumesFromSnapshotTest-853054668 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.101s {{(pid=83259) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 16 15:25:41 devstack cinder-volume[83259]: DEBUG oslo_concurrency.lockutils [None req-244ee759-1a7a-41ca-87c9-53c21b135f00 tempest-SnapshotDependencyTests-1639469217 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.772s {{(pid=83259) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 16 15:25:41 devstack cinder-volume[83259]: DEBUG cinder.coordination [None req-244ee759-1a7a-41ca-87c9-53c21b135f00 tempest-SnapshotDependencyTests-1639469217 None] Acquiring lock "cinder-quobyte-a8b16fa4-35da-41a8-b8f4-55013aa8fe09-5bfa9b0a-2bac-43b9-b551-4be6e2e870e6" by "_create_volume_from_snapshot" {{(pid=83259) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 16 15:25:41 devstack cinder-volume[83259]: DEBUG cinder.coordination [None req-244ee759-1a7a-41ca-87c9-53c21b135f00 tempest-SnapshotDependencyTests-1639469217 None] Lock "cinder-quobyte-a8b16fa4-35da-41a8-b8f4-55013aa8fe09-5bfa9b0a-2bac-43b9-b551-4be6e2e870e6" acquired by "_create_volume_from_snapshot" :: waited 0.093s {{(pid=83259) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 16 15:25:41 devstack cinder-volume[83259]: DEBUG cinder.volume.drivers.quobyte [None req-244ee759-1a7a-41ca-87c9-53c21b135f00 tempest-SnapshotDependencyTests-1639469217 None] Creating volume 5bfa9b0a-2bac-43b9-b551-4be6e2e870e6 from snapshot a8b16fa4-35da-41a8-b8f4-55013aa8fe09 {{(pid=83259) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:361}} Sep 16 15:25:41 devstack cinder-volume[83259]: DEBUG oslo_concurrency.lockutils [None req-244ee759-1a7a-41ca-87c9-53c21b135f00 tempest-SnapshotDependencyTests-1639469217 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83259) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 16 15:25:41 devstack cinder-volume[83259]: DEBUG oslo_concurrency.lockutils [None req-244ee759-1a7a-41ca-87c9-53c21b135f00 tempest-SnapshotDependencyTests-1639469217 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=83259) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 16 15:25:41 devstack cinder-volume[83259]: DEBUG cinder.volume.drivers.quobyte [None req-244ee759-1a7a-41ca-87c9-53c21b135f00 tempest-SnapshotDependencyTests-1639469217 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-61f585ac-f8e2-4d19-a890-7ebc2726cc72': None} {{(pid=83259) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:639}} Sep 16 15:25:41 devstack cinder-volume[83259]: DEBUG cinder.volume.drivers.quobyte [None req-244ee759-1a7a-41ca-87c9-53c21b135f00 tempest-SnapshotDependencyTests-1639469217 None] Available shares ['10.10.41.181/cinder-vol-61f585ac-f8e2-4d19-a890-7ebc2726cc72'] {{(pid=83259) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:669}} Sep 16 15:25:41 devstack cinder-volume[83259]: DEBUG oslo_concurrency.lockutils [None req-244ee759-1a7a-41ca-87c9-53c21b135f00 tempest-SnapshotDependencyTests-1639469217 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=83259) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 16 15:25:41 devstack cinder-volume[83259]: DEBUG cinder.volume.drivers.quobyte [None req-244ee759-1a7a-41ca-87c9-53c21b135f00 tempest-SnapshotDependencyTests-1639469217 None] Selected 10.10.41.181/cinder-vol-61f585ac-f8e2-4d19-a890-7ebc2726cc72 as target Quobyte volume. {{(pid=83259) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:690}} Sep 16 15:25:41 devstack cinder-volume[83259]: DEBUG cinder.coordination [None req-244ee759-1a7a-41ca-87c9-53c21b135f00 tempest-SnapshotDependencyTests-1639469217 None] Acquiring lock "cinder-quobyte-5bfa9b0a-2bac-43b9-b551-4be6e2e870e6" by "_copy_volume_from_snapshot" {{(pid=83259) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 16 15:25:41 devstack cinder-volume[83259]: INFO cinder.volume.manager [None req-aeb2a20e-29a0-464e-8c63-82b725e2330d tempest-CreateVolumesFromSnapshotTest-853054668 None] Create snapshot completed successfully Sep 16 15:25:41 devstack cinder-volume[83259]: DEBUG cinder.coordination [None req-244ee759-1a7a-41ca-87c9-53c21b135f00 tempest-SnapshotDependencyTests-1639469217 None] Lock "cinder-quobyte-5bfa9b0a-2bac-43b9-b551-4be6e2e870e6" acquired by "_copy_volume_from_snapshot" :: waited 0.031s {{(pid=83259) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 16 15:25:41 devstack cinder-volume[83259]: DEBUG cinder.volume.drivers.quobyte [None req-244ee759-1a7a-41ca-87c9-53c21b135f00 tempest-SnapshotDependencyTests-1639469217 None] snapshot: a8b16fa4-35da-41a8-b8f4-55013aa8fe09, volume: 5bfa9b0a-2bac-43b9-b551-4be6e2e870e6, {{(pid=83259) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:406}} Sep 16 15:25:41 devstack cinder-volume[83259]: DEBUG oslo_concurrency.lockutils [None req-244ee759-1a7a-41ca-87c9-53c21b135f00 tempest-SnapshotDependencyTests-1639469217 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83259) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 16 15:25:41 devstack cinder-volume[83259]: DEBUG oslo_concurrency.lockutils [None req-244ee759-1a7a-41ca-87c9-53c21b135f00 tempest-SnapshotDependencyTests-1639469217 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83259) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 16 15:25:41 devstack cinder-volume[83259]: DEBUG cinder.volume.drivers.quobyte [None req-244ee759-1a7a-41ca-87c9-53c21b135f00 tempest-SnapshotDependencyTests-1639469217 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-61f585ac-f8e2-4d19-a890-7ebc2726cc72': None} {{(pid=83259) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:639}} Sep 16 15:25:41 devstack cinder-volume[83259]: DEBUG cinder.volume.drivers.quobyte [None req-244ee759-1a7a-41ca-87c9-53c21b135f00 tempest-SnapshotDependencyTests-1639469217 None] Available shares ['10.10.41.181/cinder-vol-61f585ac-f8e2-4d19-a890-7ebc2726cc72'] {{(pid=83259) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:669}} Sep 16 15:25:41 devstack cinder-volume[83259]: DEBUG oslo_concurrency.lockutils [None req-244ee759-1a7a-41ca-87c9-53c21b135f00 tempest-SnapshotDependencyTests-1639469217 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=83259) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 16 15:25:41 devstack cinder-volume[83259]: DEBUG oslo.privsep.daemon [-] privsep: reply[8f4b2048-98eb-4e60-8d20-37e4ce9781ba]: (4, 'qcow2') {{(pid=84312) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 16 15:25:41 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [None req-244ee759-1a7a-41ca-87c9-53c21b135f00 tempest-SnapshotDependencyTests-1639469217 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c/volume-fb056960-1e79-47e9-8b58-6accef1fb32a.a8b16fa4-35da-41a8-b8f4-55013aa8fe09 {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 15:25:42 devstack cinder-volume[83259]: DEBUG cinder.volume.manager [None req-101e267a-7223-4d35-af33-9e8074024b2c tempest-VolumeImageDependencyTests-25375886 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a7f9275b-82b8-4f81-afb0-43c2178f79dc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'e1442a37-0aca-4f7a-9ffd-c3dcb64c0b07', 'volume_name': 'volume-e1442a37-0aca-4f7a-9ffd-c3dcb64c0b07', 'volume_size': 1, 'image_id': 'c1e8e8dc-7887-4cc1-aef8-37968c6baf5c', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/c1e8e8dc-7887-4cc1-aef8-37968c6baf5c', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '01ff9feff5a03c11d9d05bae6b76fce5', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '683678bd901a42ec9487acb038532b52', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '6576905ee751186781601563d4fc2c79003824357eb5598624623ff727fbd08a8ec7eb82545c5895e0b7c91890265d56617455b6194dddfe3ad340a1324ae721', 'id': 'c1e8e8dc-7887-4cc1-aef8-37968c6baf5c', 'created_at': datetime.datetime(2025, 9, 16, 13, 25, 37, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2025, 9, 16, 13, 25, 39, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/c1e8e8dc-7887-4cc1-aef8-37968c6baf5c/file', 'properties': {}}, 'image_service': }' {{(pid=83259) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 15:25:42 devstack cinder-volume[83259]: DEBUG cinder.volume.manager [None req-101e267a-7223-4d35-af33-9e8074024b2c tempest-VolumeImageDependencyTests-25375886 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (95540f7f-1b31-482b-8b30-f0747e5ac1ec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83259) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 15:25:42 devstack cinder-volume[83259]: DEBUG cinder.volume.manager [None req-101e267a-7223-4d35-af33-9e8074024b2c tempest-VolumeImageDependencyTests-25375886 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (95540f7f-1b31-482b-8b30-f0747e5ac1ec) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83259) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 15:25:42 devstack cinder-volume[83259]: DEBUG cinder.volume.manager [None req-101e267a-7223-4d35-af33-9e8074024b2c tempest-VolumeImageDependencyTests-25375886 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (10b1f3a0-0c75-4695-b5aa-978dcef0ce88) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83259) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 15:25:42 devstack cinder-volume[83259]: INFO cinder.volume.flows.manager.create_volume [None req-101e267a-7223-4d35-af33-9e8074024b2c tempest-VolumeImageDependencyTests-25375886 None] Volume e1442a37-0aca-4f7a-9ffd-c3dcb64c0b07: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-e1442a37-0aca-4f7a-9ffd-c3dcb64c0b07', 'volume_size': 1, 'image_id': 'c1e8e8dc-7887-4cc1-aef8-37968c6baf5c', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/c1e8e8dc-7887-4cc1-aef8-37968c6baf5c', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '01ff9feff5a03c11d9d05bae6b76fce5', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '683678bd901a42ec9487acb038532b52', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '6576905ee751186781601563d4fc2c79003824357eb5598624623ff727fbd08a8ec7eb82545c5895e0b7c91890265d56617455b6194dddfe3ad340a1324ae721', 'id': 'c1e8e8dc-7887-4cc1-aef8-37968c6baf5c', 'created_at': datetime.datetime(2025, 9, 16, 13, 25, 37, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2025, 9, 16, 13, 25, 39, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/c1e8e8dc-7887-4cc1-aef8-37968c6baf5c/file', 'properties': {}}, 'image_service': } Sep 16 15:25:42 devstack cinder-volume[83259]: DEBUG cinder.volume.flows.manager.create_volume [None req-101e267a-7223-4d35-af33-9e8074024b2c tempest-VolumeImageDependencyTests-25375886 None] Cloning e1442a37-0aca-4f7a-9ffd-c3dcb64c0b07 from image c1e8e8dc-7887-4cc1-aef8-37968c6baf5c at location (None, [{'url': 'file:///opt/stack/data/glance/images/c1e8e8dc-7887-4cc1-aef8-37968c6baf5c', 'metadata': {}}]). {{(pid=83259) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1085}} Sep 16 15:25:42 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [None req-244ee759-1a7a-41ca-87c9-53c21b135f00 tempest-SnapshotDependencyTests-1639469217 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c/volume-fb056960-1e79-47e9-8b58-6accef1fb32a.a8b16fa4-35da-41a8-b8f4-55013aa8fe09" returned: 0 in 0.908s {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 15:25:42 devstack cinder-volume[83259]: DEBUG cinder.volume.drivers.remotefs [None req-244ee759-1a7a-41ca-87c9-53c21b135f00 tempest-SnapshotDependencyTests-1639469217 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-fb056960-1e79-47e9-8b58-6accef1fb32a(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83259) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:886}} Sep 16 15:25:42 devstack cinder-volume[83259]: DEBUG cinder.volume.drivers.quobyte [None req-244ee759-1a7a-41ca-87c9-53c21b135f00 tempest-SnapshotDependencyTests-1639469217 None] will copy from snapshot at /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c/volume-fb056960-1e79-47e9-8b58-6accef1fb32a {{(pid=83259) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:425}} Sep 16 15:25:42 devstack cinder-volume[83259]: DEBUG cinder.volume.drivers.quobyte [None req-244ee759-1a7a-41ca-87c9-53c21b135f00 tempest-SnapshotDependencyTests-1639469217 None] Creating direct copy from snapshot {{(pid=83259) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:433}} Sep 16 15:25:42 devstack cinder-volume[83259]: DEBUG oslo.privsep.daemon [-] privsep: reply[35c45507-76f1-42ef-9941-7b721483f431]: (4, 'qcow2') {{(pid=84312) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 16 15:25:42 devstack cinder-volume[83259]: WARNING cinder.volume.volume_utils [None req-f3e908d7-5536-48f5-a771-c2bb406fcf85 tempest-CreateVolumesFromSnapshotTest-853054668 None] Volume driver (QuobyteDriver 1.2) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 16 15:25:42 devstack cinder-volume[83259]: DEBUG cinder.volume.flows.manager.create_volume [None req-f3e908d7-5536-48f5-a771-c2bb406fcf85 tempest-CreateVolumesFromSnapshotTest-853054668 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#Quobyte'], 'hosts': ['devstack@QuobyteHD#Quobyte']} {{(pid=83259) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1387}} Sep 16 15:25:43 devstack cinder-volume[83259]: DEBUG cinder.volume.manager [None req-f3e908d7-5536-48f5-a771-c2bb406fcf85 tempest-CreateVolumesFromSnapshotTest-853054668 None] Flow 'volume_create_manager' (d91e71ef-2943-40c3-bd37-0ccd9022f97e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83259) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 16 15:25:43 devstack cinder-volume[83259]: DEBUG cinder.volume.manager [None req-f3e908d7-5536-48f5-a771-c2bb406fcf85 tempest-CreateVolumesFromSnapshotTest-853054668 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4a3e8cec-cfb7-4acd-9e86-9173e567ac72) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83259) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 15:25:43 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [None req-244ee759-1a7a-41ca-87c9-53c21b135f00 tempest-SnapshotDependencyTests-1639469217 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c/volume-fb056960-1e79-47e9-8b58-6accef1fb32a {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 15:25:43 devstack cinder-volume[83259]: DEBUG cinder.image.image_utils [None req-101e267a-7223-4d35-af33-9e8074024b2c tempest-VolumeImageDependencyTests-25375886 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_c1e8e8dc-7887-4cc1-aef8-37968c6baf5c_73q3q5xjdevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec {{(pid=83259) fetch /opt/stack/cinder/cinder/image/image_utils.py:700}} Sep 16 15:25:43 devstack cinder-volume[83259]: INFO cinder.image.image_utils [None req-101e267a-7223-4d35-af33-9e8074024b2c tempest-VolumeImageDependencyTests-25375886 None] Image download 0.00 MB at 0.00 MB/s Sep 16 15:25:44 devstack cinder-volume[83259]: DEBUG cinder.volume.manager [None req-f3e908d7-5536-48f5-a771-c2bb406fcf85 tempest-CreateVolumesFromSnapshotTest-853054668 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4a3e8cec-cfb7-4acd-9e86-9173e567ac72) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-16T13:25:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1727684655',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#Quobyte',id=5a69e104-0230-463d-a98e-3cede0895bb4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d3e07dd8ed944a4e832e4091183e70ca',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-16T13:25:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-16T13:25:42Z,use_quota=True,user_id='bd19339b7db74ce6a52197e7902747d2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(485ead50-3df8-4d76-8d34-a4db136c980a),volume_type_id=485ead50-3df8-4d76-8d34-a4db136c980a)' {{(pid=83259) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 15:25:44 devstack cinder-volume[83259]: DEBUG cinder.volume.manager [None req-f3e908d7-5536-48f5-a771-c2bb406fcf85 tempest-CreateVolumesFromSnapshotTest-853054668 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c3a59cc1-935d-4995-8083-cfc548858b21) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83259) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 15:25:44 devstack cinder-volume[83259]: DEBUG cinder.volume.manager [None req-f3e908d7-5536-48f5-a771-c2bb406fcf85 tempest-CreateVolumesFromSnapshotTest-853054668 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c3a59cc1-935d-4995-8083-cfc548858b21) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83259) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 15:25:44 devstack cinder-volume[83259]: DEBUG cinder.volume.manager [None req-f3e908d7-5536-48f5-a771-c2bb406fcf85 tempest-CreateVolumesFromSnapshotTest-853054668 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f4f5c70e-e2f7-4158-919c-c69eaa2f33bf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83259) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 15:25:44 devstack cinder-volume[83259]: DEBUG cinder.volume.manager [None req-f3e908d7-5536-48f5-a771-c2bb406fcf85 tempest-CreateVolumesFromSnapshotTest-853054668 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f4f5c70e-e2f7-4158-919c-c69eaa2f33bf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5a69e104-0230-463d-a98e-3cede0895bb4', 'volume_name': 'volume-5a69e104-0230-463d-a98e-3cede0895bb4', 'volume_size': 1}' {{(pid=83259) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 15:25:44 devstack cinder-volume[83259]: DEBUG cinder.volume.manager [None req-f3e908d7-5536-48f5-a771-c2bb406fcf85 tempest-CreateVolumesFromSnapshotTest-853054668 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2c1b2c62-299a-4d08-98a8-51c938886ba0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83259) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 15:25:44 devstack cinder-volume[83259]: DEBUG cinder.volume.manager [None req-f3e908d7-5536-48f5-a771-c2bb406fcf85 tempest-CreateVolumesFromSnapshotTest-853054668 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2c1b2c62-299a-4d08-98a8-51c938886ba0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83259) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 15:25:44 devstack cinder-volume[83259]: DEBUG cinder.volume.manager [None req-f3e908d7-5536-48f5-a771-c2bb406fcf85 tempest-CreateVolumesFromSnapshotTest-853054668 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3bfb2366-f913-4cfd-9ec5-7178fafb605d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83259) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 15:25:44 devstack cinder-volume[83259]: INFO cinder.volume.flows.manager.create_volume [None req-f3e908d7-5536-48f5-a771-c2bb406fcf85 tempest-CreateVolumesFromSnapshotTest-853054668 None] Volume 5a69e104-0230-463d-a98e-3cede0895bb4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5a69e104-0230-463d-a98e-3cede0895bb4', 'volume_size': 1} Sep 16 15:25:44 devstack cinder-volume[83259]: DEBUG oslo_concurrency.lockutils [None req-f3e908d7-5536-48f5-a771-c2bb406fcf85 tempest-CreateVolumesFromSnapshotTest-853054668 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83259) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 16 15:25:44 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [None req-244ee759-1a7a-41ca-87c9-53c21b135f00 tempest-SnapshotDependencyTests-1639469217 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c/volume-fb056960-1e79-47e9-8b58-6accef1fb32a" returned: 0 in 1.204s {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 15:25:44 devstack cinder-volume[83259]: DEBUG cinder.utils [None req-244ee759-1a7a-41ca-87c9-53c21b135f00 tempest-SnapshotDependencyTests-1639469217 None] Path /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c/volume-5bfa9b0a-2bac-43b9-b551-4be6e2e870e6 not found in is_blk_device check {{(pid=83259) is_blk_device /opt/stack/cinder/cinder/utils.py:591}} Sep 16 15:25:44 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [None req-244ee759-1a7a-41ca-87c9-53c21b135f00 tempest-SnapshotDependencyTests-1639469217 None] Running cmd (subprocess): qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c/volume-fb056960-1e79-47e9-8b58-6accef1fb32a /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c/volume-5bfa9b0a-2bac-43b9-b551-4be6e2e870e6 {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 15:25:44 devstack quobyte-client[83286]: The server volume:87712ffe-8a69-446d-9ed6-4430c7ee9792@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=87712ffe-8a69-446d-9ed6-4430c7ee9792, inode=163, name=volume-5bfa9b0a-2bac-43b9-b551-4be6e2e870e6, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.206), requestorAccessMask=0 Sep 16 15:25:44 devstack cinder-volume[83259]: WARNING cinder.volume.volume_utils [None req-6beb2171-4deb-4b68-bbfc-8f2712cce132 tempest-CreateVolumesFromSnapshotTest-853054668 None] Volume driver (QuobyteDriver 1.2) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 16 15:25:44 devstack cinder-volume[83259]: DEBUG cinder.volume.flows.manager.create_volume [None req-6beb2171-4deb-4b68-bbfc-8f2712cce132 tempest-CreateVolumesFromSnapshotTest-853054668 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#Quobyte'], 'hosts': ['devstack@QuobyteHD#Quobyte']} {{(pid=83259) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1387}} Sep 16 15:25:45 devstack cinder-volume[83259]: DEBUG cinder.volume.manager [None req-6beb2171-4deb-4b68-bbfc-8f2712cce132 tempest-CreateVolumesFromSnapshotTest-853054668 None] Flow 'volume_create_manager' (71ba8d4b-c3cc-4d96-9df9-03772aa0883a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83259) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 16 15:25:45 devstack cinder-volume[83259]: DEBUG cinder.volume.manager [None req-6beb2171-4deb-4b68-bbfc-8f2712cce132 tempest-CreateVolumesFromSnapshotTest-853054668 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (56dc1e5e-37af-4fd2-959c-1891fbc4928e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83259) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 15:25:45 devstack cinder-volume[83259]: DEBUG oslo.privsep.daemon [-] privsep: reply[c6342eb5-54f2-46ca-8ff4-4303389af898]: (4, 'raw') {{(pid=84312) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 16 15:25:45 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [None req-101e267a-7223-4d35-af33-9e8074024b2c tempest-VolumeImageDependencyTests-25375886 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_c1e8e8dc-7887-4cc1-aef8-37968c6baf5c_73q3q5xjdevstack@QuobyteHD {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 15:25:47 devstack cinder-volume[83259]: DEBUG cinder.volume.manager [None req-6beb2171-4deb-4b68-bbfc-8f2712cce132 tempest-CreateVolumesFromSnapshotTest-853054668 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (56dc1e5e-37af-4fd2-959c-1891fbc4928e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-16T13:25:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-257566109',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#Quobyte',id=eed9218a-6d1f-4192-9b58-07168a7c9d92,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d3e07dd8ed944a4e832e4091183e70ca',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-16T13:25:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-16T13:25:43Z,use_quota=True,user_id='bd19339b7db74ce6a52197e7902747d2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(485ead50-3df8-4d76-8d34-a4db136c980a),volume_type_id=485ead50-3df8-4d76-8d34-a4db136c980a)' {{(pid=83259) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 15:25:47 devstack cinder-volume[83259]: DEBUG cinder.volume.manager [None req-6beb2171-4deb-4b68-bbfc-8f2712cce132 tempest-CreateVolumesFromSnapshotTest-853054668 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2334cd24-44e3-4c59-a79a-049c1d4bb33b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83259) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 15:25:47 devstack cinder-volume[83259]: DEBUG cinder.volume.manager [None req-6beb2171-4deb-4b68-bbfc-8f2712cce132 tempest-CreateVolumesFromSnapshotTest-853054668 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2334cd24-44e3-4c59-a79a-049c1d4bb33b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83259) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 15:25:47 devstack cinder-volume[83259]: DEBUG cinder.volume.manager [None req-6beb2171-4deb-4b68-bbfc-8f2712cce132 tempest-CreateVolumesFromSnapshotTest-853054668 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (db3e5651-2078-47fc-9a05-def76c1503e6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83259) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 15:25:47 devstack cinder-volume[83259]: DEBUG cinder.volume.manager [None req-6beb2171-4deb-4b68-bbfc-8f2712cce132 tempest-CreateVolumesFromSnapshotTest-853054668 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (db3e5651-2078-47fc-9a05-def76c1503e6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'eed9218a-6d1f-4192-9b58-07168a7c9d92', 'volume_name': 'volume-eed9218a-6d1f-4192-9b58-07168a7c9d92', 'volume_size': 1}' {{(pid=83259) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 15:25:47 devstack cinder-volume[83259]: DEBUG cinder.volume.manager [None req-6beb2171-4deb-4b68-bbfc-8f2712cce132 tempest-CreateVolumesFromSnapshotTest-853054668 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (85d6b096-0975-4b2a-b799-b35a3f48c876) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83259) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 15:25:47 devstack cinder-volume[83259]: DEBUG cinder.volume.manager [None req-6beb2171-4deb-4b68-bbfc-8f2712cce132 tempest-CreateVolumesFromSnapshotTest-853054668 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (85d6b096-0975-4b2a-b799-b35a3f48c876) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83259) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 15:25:47 devstack cinder-volume[83259]: DEBUG cinder.volume.manager [None req-6beb2171-4deb-4b68-bbfc-8f2712cce132 tempest-CreateVolumesFromSnapshotTest-853054668 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1e2e28c5-893a-439e-a155-372617f55dc5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83259) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 15:25:47 devstack cinder-volume[83259]: INFO cinder.volume.flows.manager.create_volume [None req-6beb2171-4deb-4b68-bbfc-8f2712cce132 tempest-CreateVolumesFromSnapshotTest-853054668 None] Volume eed9218a-6d1f-4192-9b58-07168a7c9d92: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-eed9218a-6d1f-4192-9b58-07168a7c9d92', 'volume_size': 1} Sep 16 15:25:47 devstack cinder-volume[83259]: DEBUG oslo_concurrency.lockutils [None req-6beb2171-4deb-4b68-bbfc-8f2712cce132 tempest-CreateVolumesFromSnapshotTest-853054668 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83259) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 16 15:25:47 devstack cinder-volume[83259]: DEBUG oslo_service.periodic_task [None req-050ec8a1-6ffd-499d-95ad-d548a84437e2 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=83259) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} Sep 16 15:25:47 devstack cinder-volume[83259]: DEBUG oslo_concurrency.lockutils [None req-050ec8a1-6ffd-499d-95ad-d548a84437e2 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83259) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 16 15:25:47 devstack cinder-volume[83259]: DEBUG oslo_concurrency.lockutils [None req-050ec8a1-6ffd-499d-95ad-d548a84437e2 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=83259) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 16 15:25:47 devstack cinder-volume[83259]: DEBUG cinder.volume.drivers.quobyte [None req-050ec8a1-6ffd-499d-95ad-d548a84437e2 None None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-61f585ac-f8e2-4d19-a890-7ebc2726cc72': None} {{(pid=83259) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:639}} Sep 16 15:25:47 devstack cinder-volume[83259]: DEBUG cinder.volume.drivers.quobyte [None req-050ec8a1-6ffd-499d-95ad-d548a84437e2 None None] Available shares ['10.10.41.181/cinder-vol-61f585ac-f8e2-4d19-a890-7ebc2726cc72'] {{(pid=83259) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:669}} Sep 16 15:25:47 devstack cinder-volume[83259]: DEBUG oslo_concurrency.lockutils [None req-050ec8a1-6ffd-499d-95ad-d548a84437e2 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.030s {{(pid=83259) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 16 15:25:47 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [None req-050ec8a1-6ffd-499d-95ad-d548a84437e2 None None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 15:25:47 devstack sudo[100379]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_c1e8e8dc-7887-4cc1-aef8-37968c6baf5c_73q3q5xjdevstack@QuobyteHD Sep 16 15:25:48 devstack sudo[100379]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 15:25:48 devstack cinder-volume[83259]: WARNING cinder.volume.volume_utils [None req-a4ae20ba-1fd5-4612-8f34-4bd76b3e3f5d tempest-CreateVolumesFromSnapshotTest-853054668 None] Volume driver (QuobyteDriver 1.2) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 16 15:25:48 devstack cinder-volume[83259]: DEBUG cinder.volume.flows.manager.create_volume [None req-a4ae20ba-1fd5-4612-8f34-4bd76b3e3f5d tempest-CreateVolumesFromSnapshotTest-853054668 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#Quobyte'], 'hosts': ['devstack@QuobyteHD#Quobyte']} {{(pid=83259) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1387}} Sep 16 15:25:49 devstack cinder-volume[83259]: DEBUG cinder.volume.manager [None req-a4ae20ba-1fd5-4612-8f34-4bd76b3e3f5d tempest-CreateVolumesFromSnapshotTest-853054668 None] Flow 'volume_create_manager' (f646301e-9960-4e1e-aef7-ee82781fb4e8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83259) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 16 15:25:49 devstack cinder-volume[83259]: DEBUG cinder.volume.manager [None req-a4ae20ba-1fd5-4612-8f34-4bd76b3e3f5d tempest-CreateVolumesFromSnapshotTest-853054668 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ccd3e165-781b-4ecd-80de-ff5b09e20262) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83259) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 15:25:50 devstack cinder-volume[83259]: DEBUG cinder.volume.manager [None req-a4ae20ba-1fd5-4612-8f34-4bd76b3e3f5d tempest-CreateVolumesFromSnapshotTest-853054668 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ccd3e165-781b-4ecd-80de-ff5b09e20262) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-16T13:25:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1639756360',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#Quobyte',id=9e87b1ab-d992-435d-83d1-a32eac37f0c8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d3e07dd8ed944a4e832e4091183e70ca',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-16T13:25:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-16T13:25:44Z,use_quota=True,user_id='bd19339b7db74ce6a52197e7902747d2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(485ead50-3df8-4d76-8d34-a4db136c980a),volume_type_id=485ead50-3df8-4d76-8d34-a4db136c980a)' {{(pid=83259) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 15:25:50 devstack cinder-volume[83259]: DEBUG cinder.volume.manager [None req-a4ae20ba-1fd5-4612-8f34-4bd76b3e3f5d tempest-CreateVolumesFromSnapshotTest-853054668 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (147310fc-9b72-4661-b6ef-8488e96c8ee0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83259) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 15:25:50 devstack cinder-volume[83259]: DEBUG cinder.volume.manager [None req-a4ae20ba-1fd5-4612-8f34-4bd76b3e3f5d tempest-CreateVolumesFromSnapshotTest-853054668 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (147310fc-9b72-4661-b6ef-8488e96c8ee0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83259) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 15:25:50 devstack cinder-volume[83259]: DEBUG cinder.volume.manager [None req-a4ae20ba-1fd5-4612-8f34-4bd76b3e3f5d tempest-CreateVolumesFromSnapshotTest-853054668 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (488ace92-55df-464a-9f35-f90a4704ef46) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83259) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 15:25:50 devstack cinder-volume[83259]: DEBUG cinder.volume.manager [None req-a4ae20ba-1fd5-4612-8f34-4bd76b3e3f5d tempest-CreateVolumesFromSnapshotTest-853054668 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (488ace92-55df-464a-9f35-f90a4704ef46) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9e87b1ab-d992-435d-83d1-a32eac37f0c8', 'volume_name': 'volume-9e87b1ab-d992-435d-83d1-a32eac37f0c8', 'volume_size': 1}' {{(pid=83259) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 15:25:50 devstack cinder-volume[83259]: DEBUG cinder.volume.manager [None req-a4ae20ba-1fd5-4612-8f34-4bd76b3e3f5d tempest-CreateVolumesFromSnapshotTest-853054668 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (26176664-4a81-4e27-86b5-12454dff8095) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83259) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 15:25:50 devstack cinder-volume[83259]: DEBUG cinder.volume.manager [None req-a4ae20ba-1fd5-4612-8f34-4bd76b3e3f5d tempest-CreateVolumesFromSnapshotTest-853054668 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (26176664-4a81-4e27-86b5-12454dff8095) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83259) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 15:25:50 devstack cinder-volume[83259]: DEBUG cinder.volume.manager [None req-a4ae20ba-1fd5-4612-8f34-4bd76b3e3f5d tempest-CreateVolumesFromSnapshotTest-853054668 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e10d9d32-e866-4c51-a3f0-308ce7ae8cec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83259) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 15:25:50 devstack cinder-volume[83259]: INFO cinder.volume.flows.manager.create_volume [None req-a4ae20ba-1fd5-4612-8f34-4bd76b3e3f5d tempest-CreateVolumesFromSnapshotTest-853054668 None] Volume 9e87b1ab-d992-435d-83d1-a32eac37f0c8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9e87b1ab-d992-435d-83d1-a32eac37f0c8', 'volume_size': 1} Sep 16 15:25:50 devstack cinder-volume[83259]: DEBUG oslo_concurrency.lockutils [None req-a4ae20ba-1fd5-4612-8f34-4bd76b3e3f5d tempest-CreateVolumesFromSnapshotTest-853054668 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83259) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 16 15:25:50 devstack cinder-volume[83259]: WARNING cinder.volume.volume_utils [None req-02ced4b9-c63f-4c78-99b2-cb621f72bdee tempest-CreateVolumesFromSnapshotTest-853054668 None] Volume driver (QuobyteDriver 1.2) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 16 15:25:50 devstack cinder-volume[83259]: DEBUG cinder.volume.flows.manager.create_volume [None req-02ced4b9-c63f-4c78-99b2-cb621f72bdee tempest-CreateVolumesFromSnapshotTest-853054668 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#Quobyte'], 'hosts': ['devstack@QuobyteHD#Quobyte']} {{(pid=83259) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1387}} Sep 16 15:25:50 devstack cinder-volume[83259]: DEBUG cinder.volume.manager [None req-02ced4b9-c63f-4c78-99b2-cb621f72bdee tempest-CreateVolumesFromSnapshotTest-853054668 None] Flow 'volume_create_manager' (4c56a514-3e94-47c8-82f0-790e253d632e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83259) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 16 15:25:50 devstack cinder-volume[83259]: DEBUG cinder.volume.manager [None req-02ced4b9-c63f-4c78-99b2-cb621f72bdee tempest-CreateVolumesFromSnapshotTest-853054668 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8da828fa-411c-4f52-848a-931c0ad658e0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83259) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 15:25:50 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [None req-050ec8a1-6ffd-499d-95ad-d548a84437e2 None None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c" returned: 0 in 3.105s {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 15:25:50 devstack cinder-volume[83259]: DEBUG cinder.manager [None req-050ec8a1-6ffd-499d-95ad-d548a84437e2 None None] Notifying Schedulers of capabilities ... {{(pid=83259) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 16 15:25:50 devstack cinder-volume[83259]: WARNING cinder.volume.volume_utils [None req-32a298a4-808d-41de-b40b-b0f83fb3d0eb tempest-CreateVolumesFromSnapshotTest-853054668 None] Volume driver (QuobyteDriver 1.2) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 16 15:25:50 devstack cinder-volume[83259]: DEBUG cinder.volume.flows.manager.create_volume [None req-32a298a4-808d-41de-b40b-b0f83fb3d0eb tempest-CreateVolumesFromSnapshotTest-853054668 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#Quobyte'], 'hosts': ['devstack@QuobyteHD#Quobyte']} {{(pid=83259) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1387}} Sep 16 15:25:50 devstack cinder-volume[83259]: DEBUG cinder.volume.manager [None req-32a298a4-808d-41de-b40b-b0f83fb3d0eb tempest-CreateVolumesFromSnapshotTest-853054668 None] Flow 'volume_create_manager' (406c1135-8e3b-4af2-9c63-7d4365e6ed28) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83259) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 16 15:25:50 devstack cinder-volume[83259]: DEBUG cinder.volume.manager [None req-32a298a4-808d-41de-b40b-b0f83fb3d0eb tempest-CreateVolumesFromSnapshotTest-853054668 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (928bf75e-3aa9-4b8c-89d9-37b51279ed17) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83259) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 15:25:50 devstack cinder-volume[83259]: DEBUG cinder.volume.manager [None req-02ced4b9-c63f-4c78-99b2-cb621f72bdee tempest-CreateVolumesFromSnapshotTest-853054668 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8da828fa-411c-4f52-848a-931c0ad658e0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-16T13:25:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1856268917',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#Quobyte',id=970d7e92-63f1-47e9-ab30-9f4995f321fc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d3e07dd8ed944a4e832e4091183e70ca',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-16T13:25:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-16T13:25:46Z,use_quota=True,user_id='bd19339b7db74ce6a52197e7902747d2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(485ead50-3df8-4d76-8d34-a4db136c980a),volume_type_id=485ead50-3df8-4d76-8d34-a4db136c980a)' {{(pid=83259) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 15:25:50 devstack cinder-volume[83259]: DEBUG cinder.volume.manager [None req-02ced4b9-c63f-4c78-99b2-cb621f72bdee tempest-CreateVolumesFromSnapshotTest-853054668 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (59c5ebfd-248e-4201-a332-38e55f1ff4c7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83259) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 15:25:50 devstack cinder-volume[83259]: DEBUG cinder.volume.manager [None req-02ced4b9-c63f-4c78-99b2-cb621f72bdee tempest-CreateVolumesFromSnapshotTest-853054668 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (59c5ebfd-248e-4201-a332-38e55f1ff4c7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83259) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 15:25:50 devstack cinder-volume[83259]: DEBUG cinder.volume.manager [None req-02ced4b9-c63f-4c78-99b2-cb621f72bdee tempest-CreateVolumesFromSnapshotTest-853054668 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7a5b3838-4ad9-48bb-a674-6d3fb2feba73) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83259) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 15:25:50 devstack cinder-volume[83259]: DEBUG cinder.volume.manager [None req-02ced4b9-c63f-4c78-99b2-cb621f72bdee tempest-CreateVolumesFromSnapshotTest-853054668 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7a5b3838-4ad9-48bb-a674-6d3fb2feba73) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '970d7e92-63f1-47e9-ab30-9f4995f321fc', 'volume_name': 'volume-970d7e92-63f1-47e9-ab30-9f4995f321fc', 'volume_size': 1}' {{(pid=83259) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 15:25:50 devstack cinder-volume[83259]: DEBUG cinder.volume.manager [None req-02ced4b9-c63f-4c78-99b2-cb621f72bdee tempest-CreateVolumesFromSnapshotTest-853054668 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d1f7cee5-0607-411c-a848-6d8a48d67bae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83259) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 15:25:50 devstack cinder-volume[83259]: DEBUG cinder.volume.manager [None req-02ced4b9-c63f-4c78-99b2-cb621f72bdee tempest-CreateVolumesFromSnapshotTest-853054668 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d1f7cee5-0607-411c-a848-6d8a48d67bae) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83259) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 15:25:50 devstack cinder-volume[83259]: DEBUG cinder.volume.manager [None req-02ced4b9-c63f-4c78-99b2-cb621f72bdee tempest-CreateVolumesFromSnapshotTest-853054668 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2cba7913-2677-42a0-aa4a-765aaea80ce0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83259) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 15:25:50 devstack cinder-volume[83259]: INFO cinder.volume.flows.manager.create_volume [None req-02ced4b9-c63f-4c78-99b2-cb621f72bdee tempest-CreateVolumesFromSnapshotTest-853054668 None] Volume 970d7e92-63f1-47e9-ab30-9f4995f321fc: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-970d7e92-63f1-47e9-ab30-9f4995f321fc', 'volume_size': 1} Sep 16 15:25:50 devstack cinder-volume[83259]: DEBUG oslo_concurrency.lockutils [None req-02ced4b9-c63f-4c78-99b2-cb621f72bdee tempest-CreateVolumesFromSnapshotTest-853054668 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83259) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 16 15:25:51 devstack cinder-volume[83259]: DEBUG cinder.volume.manager [None req-32a298a4-808d-41de-b40b-b0f83fb3d0eb tempest-CreateVolumesFromSnapshotTest-853054668 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (928bf75e-3aa9-4b8c-89d9-37b51279ed17) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-16T13:25:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-2071963270',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#Quobyte',id=bc2f1ac8-5141-46e9-91f4-291033fdea05,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d3e07dd8ed944a4e832e4091183e70ca',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-16T13:25:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-16T13:25:44Z,use_quota=True,user_id='bd19339b7db74ce6a52197e7902747d2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(485ead50-3df8-4d76-8d34-a4db136c980a),volume_type_id=485ead50-3df8-4d76-8d34-a4db136c980a)' {{(pid=83259) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 15:25:51 devstack cinder-volume[83259]: DEBUG cinder.volume.manager [None req-32a298a4-808d-41de-b40b-b0f83fb3d0eb tempest-CreateVolumesFromSnapshotTest-853054668 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e9bcd84d-86ed-43c0-8581-b7f55cd63c86) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83259) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 15:25:51 devstack cinder-volume[83259]: DEBUG cinder.volume.manager [None req-32a298a4-808d-41de-b40b-b0f83fb3d0eb tempest-CreateVolumesFromSnapshotTest-853054668 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e9bcd84d-86ed-43c0-8581-b7f55cd63c86) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83259) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 15:25:51 devstack cinder-volume[83259]: DEBUG cinder.volume.manager [None req-32a298a4-808d-41de-b40b-b0f83fb3d0eb tempest-CreateVolumesFromSnapshotTest-853054668 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (aaabfa92-9b72-4d0f-ab30-7378f3ce484f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83259) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 15:25:51 devstack cinder-volume[83259]: DEBUG cinder.volume.manager [None req-32a298a4-808d-41de-b40b-b0f83fb3d0eb tempest-CreateVolumesFromSnapshotTest-853054668 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (aaabfa92-9b72-4d0f-ab30-7378f3ce484f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'bc2f1ac8-5141-46e9-91f4-291033fdea05', 'volume_name': 'volume-bc2f1ac8-5141-46e9-91f4-291033fdea05', 'volume_size': 1}' {{(pid=83259) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 15:25:51 devstack cinder-volume[83259]: DEBUG cinder.volume.manager [None req-32a298a4-808d-41de-b40b-b0f83fb3d0eb tempest-CreateVolumesFromSnapshotTest-853054668 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (20eb0631-514a-433c-86c9-cdc31a09889a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83259) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 15:25:51 devstack cinder-volume[83259]: DEBUG cinder.volume.manager [None req-32a298a4-808d-41de-b40b-b0f83fb3d0eb tempest-CreateVolumesFromSnapshotTest-853054668 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (20eb0631-514a-433c-86c9-cdc31a09889a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83259) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 15:25:51 devstack cinder-volume[83259]: DEBUG cinder.volume.manager [None req-32a298a4-808d-41de-b40b-b0f83fb3d0eb tempest-CreateVolumesFromSnapshotTest-853054668 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0315b8c9-2870-40d7-bcda-ac3d266bf3ec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83259) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 15:25:51 devstack cinder-volume[83259]: INFO cinder.volume.flows.manager.create_volume [None req-32a298a4-808d-41de-b40b-b0f83fb3d0eb tempest-CreateVolumesFromSnapshotTest-853054668 None] Volume bc2f1ac8-5141-46e9-91f4-291033fdea05: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-bc2f1ac8-5141-46e9-91f4-291033fdea05', 'volume_size': 1} Sep 16 15:25:51 devstack cinder-volume[83259]: DEBUG oslo_concurrency.lockutils [None req-32a298a4-808d-41de-b40b-b0f83fb3d0eb tempest-CreateVolumesFromSnapshotTest-853054668 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83259) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 16 15:25:52 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [None req-244ee759-1a7a-41ca-87c9-53c21b135f00 tempest-SnapshotDependencyTests-1639469217 None] CMD "qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c/volume-fb056960-1e79-47e9-8b58-6accef1fb32a /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c/volume-5bfa9b0a-2bac-43b9-b551-4be6e2e870e6" returned: 0 in 7.817s {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 15:25:52 devstack cinder-volume[83259]: DEBUG oslo.privsep.daemon [-] privsep: reply[20e56fee-480b-4fd0-95f8-3e4fc399a866]: (4, 'qcow2') {{(pid=84312) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 16 15:25:52 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [None req-244ee759-1a7a-41ca-87c9-53c21b135f00 tempest-SnapshotDependencyTests-1639469217 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c/volume-fb056960-1e79-47e9-8b58-6accef1fb32a {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 15:25:52 devstack sudo[100379]: pam_unix(sudo:session): session closed for user root Sep 16 15:25:52 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [None req-101e267a-7223-4d35-af33-9e8074024b2c tempest-VolumeImageDependencyTests-25375886 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_c1e8e8dc-7887-4cc1-aef8-37968c6baf5c_73q3q5xjdevstack@QuobyteHD" returned: 0 in 6.676s {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 15:25:52 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [None req-101e267a-7223-4d35-af33-9e8074024b2c tempest-VolumeImageDependencyTests-25375886 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_c1e8e8dc-7887-4cc1-aef8-37968c6baf5c_73q3q5xjdevstack@QuobyteHD {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 15:25:53 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [None req-244ee759-1a7a-41ca-87c9-53c21b135f00 tempest-SnapshotDependencyTests-1639469217 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c/volume-fb056960-1e79-47e9-8b58-6accef1fb32a" returned: 0 in 0.898s {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 15:25:53 devstack cinder-volume[83259]: DEBUG cinder.image.image_utils [None req-244ee759-1a7a-41ca-87c9-53c21b135f00 tempest-SnapshotDependencyTests-1639469217 None] Image conversion details: src /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c/volume-fb056960-1e79-47e9-8b58-6accef1fb32a, size 1024.00 MB, duration 7.82 sec, destination /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c/volume-5bfa9b0a-2bac-43b9-b551-4be6e2e870e6 {{(pid=83259) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:501}} Sep 16 15:25:53 devstack cinder-volume[83259]: INFO cinder.image.image_utils [None req-244ee759-1a7a-41ca-87c9-53c21b135f00 tempest-SnapshotDependencyTests-1639469217 None] Converted 1024.00 MB image at 130.95 MB/s Sep 16 15:25:53 devstack cinder-volume[83259]: DEBUG cinder.volume.drivers.remotefs [None req-244ee759-1a7a-41ca-87c9-53c21b135f00 tempest-SnapshotDependencyTests-1639469217 None] File path /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c/volume-5bfa9b0a-2bac-43b9-b551-4be6e2e870e6 is being set with permissions: 660 {{(pid=83259) _set_rw_permissions /opt/stack/cinder/cinder/volume/drivers/remotefs.py:492}} Sep 16 15:25:53 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [None req-244ee759-1a7a-41ca-87c9-53c21b135f00 tempest-SnapshotDependencyTests-1639469217 None] Running cmd (subprocess): chmod 660 /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c/volume-5bfa9b0a-2bac-43b9-b551-4be6e2e870e6 {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 15:25:53 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [None req-244ee759-1a7a-41ca-87c9-53c21b135f00 tempest-SnapshotDependencyTests-1639469217 None] CMD "chmod 660 /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c/volume-5bfa9b0a-2bac-43b9-b551-4be6e2e870e6" returned: 0 in 0.110s {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 15:25:53 devstack sudo[100385]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_c1e8e8dc-7887-4cc1-aef8-37968c6baf5c_73q3q5xjdevstack@QuobyteHD Sep 16 15:25:53 devstack sudo[100385]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 15:25:53 devstack cinder-volume[83259]: DEBUG cinder.coordination [None req-244ee759-1a7a-41ca-87c9-53c21b135f00 tempest-SnapshotDependencyTests-1639469217 None] Lock "cinder-quobyte-5bfa9b0a-2bac-43b9-b551-4be6e2e870e6" released by "_copy_volume_from_snapshot" :: held 11.496s {{(pid=83259) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 16 15:25:53 devstack cinder-volume[83259]: DEBUG cinder.coordination [None req-244ee759-1a7a-41ca-87c9-53c21b135f00 tempest-SnapshotDependencyTests-1639469217 None] Lock "cinder-quobyte-a8b16fa4-35da-41a8-b8f4-55013aa8fe09-5bfa9b0a-2bac-43b9-b551-4be6e2e870e6" released by "_create_volume_from_snapshot" :: held 11.563s {{(pid=83259) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 16 15:25:53 devstack cinder-volume[83259]: DEBUG oslo_concurrency.lockutils [None req-244ee759-1a7a-41ca-87c9-53c21b135f00 tempest-SnapshotDependencyTests-1639469217 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 11.673s {{(pid=83259) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 16 15:25:53 devstack cinder-volume[83259]: DEBUG oslo_concurrency.lockutils [None req-f3e908d7-5536-48f5-a771-c2bb406fcf85 tempest-CreateVolumesFromSnapshotTest-853054668 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 9.351s {{(pid=83259) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 16 15:25:53 devstack cinder-volume[83259]: DEBUG cinder.volume.drivers.quobyte [None req-f3e908d7-5536-48f5-a771-c2bb406fcf85 tempest-CreateVolumesFromSnapshotTest-853054668 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-16T13:25:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1727684655',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#Quobyte',id=5a69e104-0230-463d-a98e-3cede0895bb4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d3e07dd8ed944a4e832e4091183e70ca',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-16T13:25:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-16T13:25:42Z,use_quota=True,user_id='bd19339b7db74ce6a52197e7902747d2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(485ead50-3df8-4d76-8d34-a4db136c980a),volume_type_id=485ead50-3df8-4d76-8d34-a4db136c980a)}" {{(pid=83259) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Sep 16 15:25:53 devstack cinder-volume[83259]: DEBUG cinder.volume.drivers.remotefs [None req-f3e908d7-5536-48f5-a771-c2bb406fcf85 tempest-CreateVolumesFromSnapshotTest-853054668 None] Creating volume 5a69e104-0230-463d-a98e-3cede0895bb4 {{(pid=83259) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}} Sep 16 15:25:53 devstack cinder-volume[83259]: DEBUG oslo_concurrency.lockutils [None req-f3e908d7-5536-48f5-a771-c2bb406fcf85 tempest-CreateVolumesFromSnapshotTest-853054668 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83259) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 16 15:25:53 devstack cinder-volume[83259]: DEBUG oslo_concurrency.lockutils [None req-f3e908d7-5536-48f5-a771-c2bb406fcf85 tempest-CreateVolumesFromSnapshotTest-853054668 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=83259) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 16 15:25:53 devstack cinder-volume[83259]: DEBUG cinder.volume.drivers.quobyte [None req-f3e908d7-5536-48f5-a771-c2bb406fcf85 tempest-CreateVolumesFromSnapshotTest-853054668 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-61f585ac-f8e2-4d19-a890-7ebc2726cc72': None} {{(pid=83259) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:639}} Sep 16 15:25:53 devstack cinder-volume[83259]: DEBUG cinder.volume.drivers.quobyte [None req-f3e908d7-5536-48f5-a771-c2bb406fcf85 tempest-CreateVolumesFromSnapshotTest-853054668 None] Available shares ['10.10.41.181/cinder-vol-61f585ac-f8e2-4d19-a890-7ebc2726cc72'] {{(pid=83259) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:669}} Sep 16 15:25:53 devstack cinder-volume[83259]: DEBUG oslo_concurrency.lockutils [None req-f3e908d7-5536-48f5-a771-c2bb406fcf85 tempest-CreateVolumesFromSnapshotTest-853054668 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=83259) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 16 15:25:53 devstack cinder-volume[83259]: DEBUG cinder.volume.drivers.quobyte [None req-f3e908d7-5536-48f5-a771-c2bb406fcf85 tempest-CreateVolumesFromSnapshotTest-853054668 None] Selected 10.10.41.181/cinder-vol-61f585ac-f8e2-4d19-a890-7ebc2726cc72 as target Quobyte volume. {{(pid=83259) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:690}} Sep 16 15:25:53 devstack cinder-volume[83259]: INFO cinder.volume.drivers.remotefs [None req-f3e908d7-5536-48f5-a771-c2bb406fcf85 tempest-CreateVolumesFromSnapshotTest-853054668 None] casted to 10.10.41.181/cinder-vol-61f585ac-f8e2-4d19-a890-7ebc2726cc72 Sep 16 15:25:53 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [None req-f3e908d7-5536-48f5-a771-c2bb406fcf85 tempest-CreateVolumesFromSnapshotTest-853054668 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c/volume-5a69e104-0230-463d-a98e-3cede0895bb4 1073741824 {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 15:25:53 devstack cinder-volume[83259]: DEBUG dbcounter [-] [83259] Writing DB stats cinder:SELECT=79,cinder:UPDATE=125,cinder:DELETE=15,cinder:INSERT=23 {{(pid=83259) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Sep 16 15:25:53 devstack quobyte-client[83286]: System call of process 100390 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 16 15:25:53 devstack quobyte-client[83286]: The server volume:87712ffe-8a69-446d-9ed6-4430c7ee9792@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=87712ffe-8a69-446d-9ed6-4430c7ee9792, inode=164, name=volume-5a69e104-0230-463d-a98e-3cede0895bb4, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.206), requestorAccessMask=0 Sep 16 15:25:54 devstack cinder-volume[83259]: DEBUG dbcounter [-] [83259] Writing DB stats cinder:SELECT=80,cinder:UPDATE=115,cinder:DELETE=11,cinder:INSERT=21 {{(pid=83259) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Sep 16 15:25:54 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [None req-f3e908d7-5536-48f5-a771-c2bb406fcf85 tempest-CreateVolumesFromSnapshotTest-853054668 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c/volume-5a69e104-0230-463d-a98e-3cede0895bb4 1073741824" returned: 0 in 0.515s {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 15:25:54 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [None req-f3e908d7-5536-48f5-a771-c2bb406fcf85 tempest-CreateVolumesFromSnapshotTest-853054668 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c/volume-5a69e104-0230-463d-a98e-3cede0895bb4 {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 15:25:54 devstack cinder-volume[83259]: DEBUG cinder.volume.manager [None req-244ee759-1a7a-41ca-87c9-53c21b135f00 tempest-SnapshotDependencyTests-1639469217 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dc0e6d65-5a5a-4b90-a62f-07e882e704c0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5bfa9b0a-2bac-43b9-b551-4be6e2e870e6', 'volume_size': 1, 'snapshot_id': 'a8b16fa4-35da-41a8-b8f4-55013aa8fe09'}' {{(pid=83259) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 15:25:54 devstack cinder-volume[83259]: DEBUG cinder.volume.manager [None req-244ee759-1a7a-41ca-87c9-53c21b135f00 tempest-SnapshotDependencyTests-1639469217 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f0cb98df-af03-467c-adb9-0654f71f1335) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83259) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 15:25:54 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [None req-f3e908d7-5536-48f5-a771-c2bb406fcf85 tempest-CreateVolumesFromSnapshotTest-853054668 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c/volume-5a69e104-0230-463d-a98e-3cede0895bb4" returned: 0 in 0.443s {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 15:25:54 devstack cinder-volume[83259]: DEBUG cinder.volume.drivers.quobyte [None req-f3e908d7-5536-48f5-a771-c2bb406fcf85 tempest-CreateVolumesFromSnapshotTest-853054668 None] <== create_volume: return (1006ms) {'provider_location': '10.10.41.181/cinder-vol-61f585ac-f8e2-4d19-a890-7ebc2726cc72'} {{(pid=83259) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Sep 16 15:25:54 devstack cinder-volume[83259]: DEBUG oslo_concurrency.lockutils [None req-f3e908d7-5536-48f5-a771-c2bb406fcf85 tempest-CreateVolumesFromSnapshotTest-853054668 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.046s {{(pid=83259) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 16 15:25:54 devstack cinder-volume[83259]: DEBUG oslo_concurrency.lockutils [None req-6beb2171-4deb-4b68-bbfc-8f2712cce132 tempest-CreateVolumesFromSnapshotTest-853054668 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 7.280s {{(pid=83259) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 16 15:25:54 devstack cinder-volume[83259]: DEBUG cinder.volume.drivers.quobyte [None req-6beb2171-4deb-4b68-bbfc-8f2712cce132 tempest-CreateVolumesFromSnapshotTest-853054668 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-16T13:25:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-257566109',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#Quobyte',id=eed9218a-6d1f-4192-9b58-07168a7c9d92,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d3e07dd8ed944a4e832e4091183e70ca',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-16T13:25:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-16T13:25:43Z,use_quota=True,user_id='bd19339b7db74ce6a52197e7902747d2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(485ead50-3df8-4d76-8d34-a4db136c980a),volume_type_id=485ead50-3df8-4d76-8d34-a4db136c980a)}" {{(pid=83259) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Sep 16 15:25:54 devstack cinder-volume[83259]: DEBUG cinder.volume.drivers.remotefs [None req-6beb2171-4deb-4b68-bbfc-8f2712cce132 tempest-CreateVolumesFromSnapshotTest-853054668 None] Creating volume eed9218a-6d1f-4192-9b58-07168a7c9d92 {{(pid=83259) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}} Sep 16 15:25:54 devstack cinder-volume[83259]: DEBUG oslo_concurrency.lockutils [None req-6beb2171-4deb-4b68-bbfc-8f2712cce132 tempest-CreateVolumesFromSnapshotTest-853054668 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83259) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 16 15:25:54 devstack cinder-volume[83259]: DEBUG oslo_concurrency.lockutils [None req-6beb2171-4deb-4b68-bbfc-8f2712cce132 tempest-CreateVolumesFromSnapshotTest-853054668 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=83259) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 16 15:25:54 devstack cinder-volume[83259]: DEBUG cinder.volume.drivers.quobyte [None req-6beb2171-4deb-4b68-bbfc-8f2712cce132 tempest-CreateVolumesFromSnapshotTest-853054668 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-61f585ac-f8e2-4d19-a890-7ebc2726cc72': None} {{(pid=83259) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:639}} Sep 16 15:25:54 devstack cinder-volume[83259]: DEBUG cinder.volume.drivers.quobyte [None req-6beb2171-4deb-4b68-bbfc-8f2712cce132 tempest-CreateVolumesFromSnapshotTest-853054668 None] Available shares ['10.10.41.181/cinder-vol-61f585ac-f8e2-4d19-a890-7ebc2726cc72'] {{(pid=83259) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:669}} Sep 16 15:25:54 devstack cinder-volume[83259]: DEBUG oslo_concurrency.lockutils [None req-6beb2171-4deb-4b68-bbfc-8f2712cce132 tempest-CreateVolumesFromSnapshotTest-853054668 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=83259) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 16 15:25:54 devstack cinder-volume[83259]: DEBUG cinder.volume.drivers.quobyte [None req-6beb2171-4deb-4b68-bbfc-8f2712cce132 tempest-CreateVolumesFromSnapshotTest-853054668 None] Selected 10.10.41.181/cinder-vol-61f585ac-f8e2-4d19-a890-7ebc2726cc72 as target Quobyte volume. {{(pid=83259) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:690}} Sep 16 15:25:54 devstack cinder-volume[83259]: INFO cinder.volume.drivers.remotefs [None req-6beb2171-4deb-4b68-bbfc-8f2712cce132 tempest-CreateVolumesFromSnapshotTest-853054668 None] casted to 10.10.41.181/cinder-vol-61f585ac-f8e2-4d19-a890-7ebc2726cc72 Sep 16 15:25:54 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [None req-6beb2171-4deb-4b68-bbfc-8f2712cce132 tempest-CreateVolumesFromSnapshotTest-853054668 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c/volume-eed9218a-6d1f-4192-9b58-07168a7c9d92 1073741824 {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 15:25:54 devstack quobyte-client[83286]: The server volume:87712ffe-8a69-446d-9ed6-4430c7ee9792@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=87712ffe-8a69-446d-9ed6-4430c7ee9792, inode=165, name=volume-eed9218a-6d1f-4192-9b58-07168a7c9d92, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.206), requestorAccessMask=0 Sep 16 15:25:54 devstack cinder-volume[83259]: INFO cinder.volume.flows.manager.create_volume [None req-244ee759-1a7a-41ca-87c9-53c21b135f00 tempest-SnapshotDependencyTests-1639469217 None] Volume volume-5bfa9b0a-2bac-43b9-b551-4be6e2e870e6 (5bfa9b0a-2bac-43b9-b551-4be6e2e870e6): created successfully Sep 16 15:25:54 devstack cinder-volume[83259]: DEBUG cinder.volume.manager [None req-244ee759-1a7a-41ca-87c9-53c21b135f00 tempest-SnapshotDependencyTests-1639469217 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f0cb98df-af03-467c-adb9-0654f71f1335) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83259) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 15:25:55 devstack cinder-volume[83259]: DEBUG cinder.volume.manager [None req-244ee759-1a7a-41ca-87c9-53c21b135f00 tempest-SnapshotDependencyTests-1639469217 None] Flow 'volume_create_manager' (1d3e092f-8efb-47b3-8dc8-f41a24a2cf7b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83259) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 16 15:25:55 devstack cinder-volume[83259]: DEBUG cinder.volume.manager [None req-f3e908d7-5536-48f5-a771-c2bb406fcf85 tempest-CreateVolumesFromSnapshotTest-853054668 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3bfb2366-f913-4cfd-9ec5-7178fafb605d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5a69e104-0230-463d-a98e-3cede0895bb4', 'volume_size': 1}' {{(pid=83259) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 15:25:55 devstack cinder-volume[83259]: DEBUG cinder.volume.manager [None req-f3e908d7-5536-48f5-a771-c2bb406fcf85 tempest-CreateVolumesFromSnapshotTest-853054668 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (12d9f9d9-2459-477d-ae07-b48bd308951b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83259) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 15:25:55 devstack cinder-volume[83259]: DEBUG cinder.coordination [None req-473e8d8e-957d-4a4c-9da7-7f1c9545451d tempest-SnapshotDependencyTests-1639469217 None] Acquiring lock "cinder-a8b16fa4-35da-41a8-b8f4-55013aa8fe09-delete_snapshot" by "delete_snapshot" {{(pid=83259) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 16 15:25:55 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [None req-6beb2171-4deb-4b68-bbfc-8f2712cce132 tempest-CreateVolumesFromSnapshotTest-853054668 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c/volume-eed9218a-6d1f-4192-9b58-07168a7c9d92 1073741824" returned: 0 in 0.942s {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 15:25:55 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [None req-6beb2171-4deb-4b68-bbfc-8f2712cce132 tempest-CreateVolumesFromSnapshotTest-853054668 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c/volume-eed9218a-6d1f-4192-9b58-07168a7c9d92 {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 15:25:55 devstack sudo[100385]: pam_unix(sudo:session): session closed for user root Sep 16 15:25:55 devstack cinder-volume[83259]: INFO cinder.volume.flows.manager.create_volume [None req-f3e908d7-5536-48f5-a771-c2bb406fcf85 tempest-CreateVolumesFromSnapshotTest-853054668 None] Volume volume-5a69e104-0230-463d-a98e-3cede0895bb4 (5a69e104-0230-463d-a98e-3cede0895bb4): created successfully Sep 16 15:25:56 devstack cinder-volume[83259]: DEBUG cinder.volume.manager [None req-f3e908d7-5536-48f5-a771-c2bb406fcf85 tempest-CreateVolumesFromSnapshotTest-853054668 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (12d9f9d9-2459-477d-ae07-b48bd308951b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83259) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 15:25:56 devstack cinder-volume[83259]: DEBUG cinder.volume.manager [None req-f3e908d7-5536-48f5-a771-c2bb406fcf85 tempest-CreateVolumesFromSnapshotTest-853054668 None] Flow 'volume_create_manager' (d91e71ef-2943-40c3-bd37-0ccd9022f97e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83259) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 16 15:25:56 devstack cinder-volume[83259]: INFO cinder.volume.manager [None req-244ee759-1a7a-41ca-87c9-53c21b135f00 tempest-SnapshotDependencyTests-1639469217 None] Created volume successfully. Sep 16 15:25:56 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [None req-101e267a-7223-4d35-af33-9e8074024b2c tempest-VolumeImageDependencyTests-25375886 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_c1e8e8dc-7887-4cc1-aef8-37968c6baf5c_73q3q5xjdevstack@QuobyteHD" returned: 1 in 3.478s {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 15:25:56 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [None req-101e267a-7223-4d35-af33-9e8074024b2c tempest-VolumeImageDependencyTests-25375886 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_c1e8e8dc-7887-4cc1-aef8-37968c6baf5c_73q3q5xjdevstack@QuobyteHD' failed. Not Retrying. {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:423}} Sep 16 15:25:56 devstack cinder-volume[83259]: DEBUG cinder.coordination [None req-473e8d8e-957d-4a4c-9da7-7f1c9545451d tempest-SnapshotDependencyTests-1639469217 None] Lock "cinder-a8b16fa4-35da-41a8-b8f4-55013aa8fe09-delete_snapshot" acquired by "delete_snapshot" :: waited 0.682s {{(pid=83259) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 16 15:25:56 devstack cinder-volume[83259]: WARNING cinder.volume.volume_utils [None req-473e8d8e-957d-4a4c-9da7-7f1c9545451d tempest-SnapshotDependencyTests-1639469217 None] Volume driver (QuobyteDriver 1.2) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 16 15:25:56 devstack cinder-volume[83259]: DEBUG cinder.coordination [None req-473e8d8e-957d-4a4c-9da7-7f1c9545451d tempest-SnapshotDependencyTests-1639469217 None] Acquiring lock "cinder-quobyte-fb056960-1e79-47e9-8b58-6accef1fb32a" by "delete_snapshot" {{(pid=83259) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 16 15:25:56 devstack cinder-volume[83259]: DEBUG cinder.image.image_utils [None req-101e267a-7223-4d35-af33-9e8074024b2c tempest-VolumeImageDependencyTests-25375886 None] Temporary image c1e8e8dc-7887-4cc1-aef8-37968c6baf5c is fetched for user b7026066d1834b8fb54dfd214995c7ed. {{(pid=83259) fetch /opt/stack/cinder/cinder/image/image_utils.py:1399}} Sep 16 15:25:56 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [None req-6beb2171-4deb-4b68-bbfc-8f2712cce132 tempest-CreateVolumesFromSnapshotTest-853054668 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c/volume-eed9218a-6d1f-4192-9b58-07168a7c9d92" returned: 0 in 0.635s {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 15:25:56 devstack cinder-volume[83259]: DEBUG cinder.volume.drivers.quobyte [None req-6beb2171-4deb-4b68-bbfc-8f2712cce132 tempest-CreateVolumesFromSnapshotTest-853054668 None] <== create_volume: return (1610ms) {'provider_location': '10.10.41.181/cinder-vol-61f585ac-f8e2-4d19-a890-7ebc2726cc72'} {{(pid=83259) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Sep 16 15:25:56 devstack cinder-volume[83259]: DEBUG oslo_concurrency.lockutils [None req-6beb2171-4deb-4b68-bbfc-8f2712cce132 tempest-CreateVolumesFromSnapshotTest-853054668 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.627s {{(pid=83259) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 16 15:25:56 devstack cinder-volume[83259]: DEBUG oslo_concurrency.lockutils [None req-a4ae20ba-1fd5-4612-8f34-4bd76b3e3f5d tempest-CreateVolumesFromSnapshotTest-853054668 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.676s {{(pid=83259) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 16 15:25:56 devstack cinder-volume[83259]: DEBUG cinder.volume.drivers.quobyte [None req-a4ae20ba-1fd5-4612-8f34-4bd76b3e3f5d tempest-CreateVolumesFromSnapshotTest-853054668 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-16T13:25:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1639756360',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#Quobyte',id=9e87b1ab-d992-435d-83d1-a32eac37f0c8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d3e07dd8ed944a4e832e4091183e70ca',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-16T13:25:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-16T13:25:44Z,use_quota=True,user_id='bd19339b7db74ce6a52197e7902747d2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(485ead50-3df8-4d76-8d34-a4db136c980a),volume_type_id=485ead50-3df8-4d76-8d34-a4db136c980a)}" {{(pid=83259) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Sep 16 15:25:56 devstack cinder-volume[83259]: DEBUG cinder.volume.drivers.remotefs [None req-a4ae20ba-1fd5-4612-8f34-4bd76b3e3f5d tempest-CreateVolumesFromSnapshotTest-853054668 None] Creating volume 9e87b1ab-d992-435d-83d1-a32eac37f0c8 {{(pid=83259) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}} Sep 16 15:25:56 devstack cinder-volume[83259]: DEBUG oslo_concurrency.lockutils [None req-a4ae20ba-1fd5-4612-8f34-4bd76b3e3f5d tempest-CreateVolumesFromSnapshotTest-853054668 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83259) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 16 15:25:56 devstack cinder-volume[83259]: DEBUG oslo_concurrency.lockutils [None req-a4ae20ba-1fd5-4612-8f34-4bd76b3e3f5d tempest-CreateVolumesFromSnapshotTest-853054668 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=83259) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 16 15:25:56 devstack cinder-volume[83259]: DEBUG cinder.volume.drivers.quobyte [None req-a4ae20ba-1fd5-4612-8f34-4bd76b3e3f5d tempest-CreateVolumesFromSnapshotTest-853054668 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-61f585ac-f8e2-4d19-a890-7ebc2726cc72': None} {{(pid=83259) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:639}} Sep 16 15:25:56 devstack cinder-volume[83259]: DEBUG cinder.volume.drivers.quobyte [None req-a4ae20ba-1fd5-4612-8f34-4bd76b3e3f5d tempest-CreateVolumesFromSnapshotTest-853054668 None] Available shares ['10.10.41.181/cinder-vol-61f585ac-f8e2-4d19-a890-7ebc2726cc72'] {{(pid=83259) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:669}} Sep 16 15:25:56 devstack cinder-volume[83259]: DEBUG oslo_concurrency.lockutils [None req-a4ae20ba-1fd5-4612-8f34-4bd76b3e3f5d tempest-CreateVolumesFromSnapshotTest-853054668 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=83259) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 16 15:25:56 devstack cinder-volume[83259]: DEBUG cinder.volume.drivers.quobyte [None req-a4ae20ba-1fd5-4612-8f34-4bd76b3e3f5d tempest-CreateVolumesFromSnapshotTest-853054668 None] Selected 10.10.41.181/cinder-vol-61f585ac-f8e2-4d19-a890-7ebc2726cc72 as target Quobyte volume. {{(pid=83259) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:690}} Sep 16 15:25:56 devstack cinder-volume[83259]: INFO cinder.volume.drivers.remotefs [None req-a4ae20ba-1fd5-4612-8f34-4bd76b3e3f5d tempest-CreateVolumesFromSnapshotTest-853054668 None] casted to 10.10.41.181/cinder-vol-61f585ac-f8e2-4d19-a890-7ebc2726cc72 Sep 16 15:25:56 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [None req-a4ae20ba-1fd5-4612-8f34-4bd76b3e3f5d tempest-CreateVolumesFromSnapshotTest-853054668 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c/volume-9e87b1ab-d992-435d-83d1-a32eac37f0c8 1073741824 {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 15:25:56 devstack quobyte-client[83286]: System call of process 100403 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 16 15:25:56 devstack quobyte-client[83286]: The server volume:87712ffe-8a69-446d-9ed6-4430c7ee9792@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=87712ffe-8a69-446d-9ed6-4430c7ee9792, inode=166, name=volume-9e87b1ab-d992-435d-83d1-a32eac37f0c8, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.206), requestorAccessMask=0 Sep 16 15:25:56 devstack cinder-volume[83259]: INFO cinder.volume.manager [None req-f3e908d7-5536-48f5-a771-c2bb406fcf85 tempest-CreateVolumesFromSnapshotTest-853054668 None] Created volume successfully. Sep 16 15:25:56 devstack cinder-volume[83259]: DEBUG cinder.coordination [None req-473e8d8e-957d-4a4c-9da7-7f1c9545451d tempest-SnapshotDependencyTests-1639469217 None] Lock "cinder-quobyte-fb056960-1e79-47e9-8b58-6accef1fb32a" acquired by "delete_snapshot" :: waited 0.624s {{(pid=83259) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 16 15:25:56 devstack cinder-volume[83259]: DEBUG cinder.coordination [None req-473e8d8e-957d-4a4c-9da7-7f1c9545451d tempest-SnapshotDependencyTests-1639469217 None] Acquiring lock "cinder-quobyte-a8b16fa4-35da-41a8-b8f4-55013aa8fe09" by "_delete_snapshot" {{(pid=83259) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 16 15:25:56 devstack cinder-volume[83259]: DEBUG cinder.volume.manager [None req-6beb2171-4deb-4b68-bbfc-8f2712cce132 tempest-CreateVolumesFromSnapshotTest-853054668 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1e2e28c5-893a-439e-a155-372617f55dc5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-eed9218a-6d1f-4192-9b58-07168a7c9d92', 'volume_size': 1}' {{(pid=83259) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 15:25:56 devstack cinder-volume[83259]: DEBUG cinder.volume.manager [None req-6beb2171-4deb-4b68-bbfc-8f2712cce132 tempest-CreateVolumesFromSnapshotTest-853054668 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dc6321a8-66cb-4336-a61d-21383b108eb7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83259) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 15:25:56 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [None req-a4ae20ba-1fd5-4612-8f34-4bd76b3e3f5d tempest-CreateVolumesFromSnapshotTest-853054668 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c/volume-9e87b1ab-d992-435d-83d1-a32eac37f0c8 1073741824" returned: 0 in 0.646s {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 15:25:56 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [None req-a4ae20ba-1fd5-4612-8f34-4bd76b3e3f5d tempest-CreateVolumesFromSnapshotTest-853054668 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c/volume-9e87b1ab-d992-435d-83d1-a32eac37f0c8 {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 15:25:57 devstack cinder-volume[83259]: DEBUG cinder.coordination [None req-473e8d8e-957d-4a4c-9da7-7f1c9545451d tempest-SnapshotDependencyTests-1639469217 None] Lock "cinder-quobyte-a8b16fa4-35da-41a8-b8f4-55013aa8fe09" acquired by "_delete_snapshot" :: waited 0.374s {{(pid=83259) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 16 15:25:57 devstack cinder-volume[83259]: DEBUG cinder.volume.drivers.remotefs [None req-473e8d8e-957d-4a4c-9da7-7f1c9545451d tempest-SnapshotDependencyTests-1639469217 None] Deleting offline snapshot a8b16fa4-35da-41a8-b8f4-55013aa8fe09 of volume fb056960-1e79-47e9-8b58-6accef1fb32a {{(pid=83259) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1278}} Sep 16 15:25:57 devstack cinder-volume[83259]: DEBUG cinder.volume.drivers.remotefs [None req-473e8d8e-957d-4a4c-9da7-7f1c9545451d tempest-SnapshotDependencyTests-1639469217 None] snapshot_file for this snap is: volume-fb056960-1e79-47e9-8b58-6accef1fb32a.a8b16fa4-35da-41a8-b8f4-55013aa8fe09 {{(pid=83259) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1307}} Sep 16 15:25:57 devstack cinder-volume[83259]: DEBUG oslo.privsep.daemon [-] privsep: reply[e3cb3098-5c8f-4bcd-a921-2b2c3ed23594]: (4, 'qcow2') {{(pid=84312) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 16 15:25:57 devstack cinder-volume[83259]: INFO cinder.volume.flows.manager.create_volume [None req-6beb2171-4deb-4b68-bbfc-8f2712cce132 tempest-CreateVolumesFromSnapshotTest-853054668 None] Volume volume-eed9218a-6d1f-4192-9b58-07168a7c9d92 (eed9218a-6d1f-4192-9b58-07168a7c9d92): created successfully Sep 16 15:25:57 devstack cinder-volume[83259]: DEBUG cinder.volume.manager [None req-6beb2171-4deb-4b68-bbfc-8f2712cce132 tempest-CreateVolumesFromSnapshotTest-853054668 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dc6321a8-66cb-4336-a61d-21383b108eb7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83259) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 15:25:57 devstack cinder-volume[83259]: DEBUG cinder.volume.manager [None req-6beb2171-4deb-4b68-bbfc-8f2712cce132 tempest-CreateVolumesFromSnapshotTest-853054668 None] Flow 'volume_create_manager' (71ba8d4b-c3cc-4d96-9df9-03772aa0883a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83259) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 16 15:25:57 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [None req-473e8d8e-957d-4a4c-9da7-7f1c9545451d tempest-SnapshotDependencyTests-1639469217 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c/volume-fb056960-1e79-47e9-8b58-6accef1fb32a.a8b16fa4-35da-41a8-b8f4-55013aa8fe09 {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 15:25:57 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [None req-a4ae20ba-1fd5-4612-8f34-4bd76b3e3f5d tempest-CreateVolumesFromSnapshotTest-853054668 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c/volume-9e87b1ab-d992-435d-83d1-a32eac37f0c8" returned: 0 in 0.768s {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 15:25:57 devstack cinder-volume[83259]: DEBUG cinder.volume.drivers.quobyte [None req-a4ae20ba-1fd5-4612-8f34-4bd76b3e3f5d tempest-CreateVolumesFromSnapshotTest-853054668 None] <== create_volume: return (1475ms) {'provider_location': '10.10.41.181/cinder-vol-61f585ac-f8e2-4d19-a890-7ebc2726cc72'} {{(pid=83259) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Sep 16 15:25:57 devstack cinder-volume[83259]: DEBUG oslo_concurrency.lockutils [None req-a4ae20ba-1fd5-4612-8f34-4bd76b3e3f5d tempest-CreateVolumesFromSnapshotTest-853054668 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.496s {{(pid=83259) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 16 15:25:57 devstack cinder-volume[83259]: INFO cinder.volume.manager [None req-6beb2171-4deb-4b68-bbfc-8f2712cce132 tempest-CreateVolumesFromSnapshotTest-853054668 None] Created volume successfully. Sep 16 15:25:57 devstack cinder-volume[83259]: DEBUG oslo.privsep.daemon [-] privsep: reply[38e72060-1c2c-4714-8efa-582bcc607a93]: (4, 'raw') {{(pid=84312) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 16 15:25:57 devstack cinder-volume[83259]: DEBUG oslo_concurrency.lockutils [None req-02ced4b9-c63f-4c78-99b2-cb621f72bdee tempest-CreateVolumesFromSnapshotTest-853054668 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 6.896s {{(pid=83259) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 16 15:25:57 devstack cinder-volume[83259]: DEBUG cinder.volume.drivers.quobyte [None req-02ced4b9-c63f-4c78-99b2-cb621f72bdee tempest-CreateVolumesFromSnapshotTest-853054668 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-16T13:25:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1856268917',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#Quobyte',id=970d7e92-63f1-47e9-ab30-9f4995f321fc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d3e07dd8ed944a4e832e4091183e70ca',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-16T13:25:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-16T13:25:46Z,use_quota=True,user_id='bd19339b7db74ce6a52197e7902747d2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(485ead50-3df8-4d76-8d34-a4db136c980a),volume_type_id=485ead50-3df8-4d76-8d34-a4db136c980a)}" {{(pid=83259) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Sep 16 15:25:57 devstack cinder-volume[83259]: DEBUG cinder.volume.drivers.remotefs [None req-02ced4b9-c63f-4c78-99b2-cb621f72bdee tempest-CreateVolumesFromSnapshotTest-853054668 None] Creating volume 970d7e92-63f1-47e9-ab30-9f4995f321fc {{(pid=83259) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}} Sep 16 15:25:57 devstack cinder-volume[83259]: DEBUG oslo_concurrency.lockutils [None req-02ced4b9-c63f-4c78-99b2-cb621f72bdee tempest-CreateVolumesFromSnapshotTest-853054668 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83259) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 16 15:25:57 devstack cinder-volume[83259]: DEBUG oslo_concurrency.lockutils [None req-02ced4b9-c63f-4c78-99b2-cb621f72bdee tempest-CreateVolumesFromSnapshotTest-853054668 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=83259) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 16 15:25:57 devstack cinder-volume[83259]: DEBUG cinder.volume.drivers.quobyte [None req-02ced4b9-c63f-4c78-99b2-cb621f72bdee tempest-CreateVolumesFromSnapshotTest-853054668 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-61f585ac-f8e2-4d19-a890-7ebc2726cc72': None} {{(pid=83259) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:639}} Sep 16 15:25:57 devstack cinder-volume[83259]: DEBUG cinder.volume.drivers.quobyte [None req-02ced4b9-c63f-4c78-99b2-cb621f72bdee tempest-CreateVolumesFromSnapshotTest-853054668 None] Available shares ['10.10.41.181/cinder-vol-61f585ac-f8e2-4d19-a890-7ebc2726cc72'] {{(pid=83259) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:669}} Sep 16 15:25:57 devstack cinder-volume[83259]: DEBUG oslo_concurrency.lockutils [None req-02ced4b9-c63f-4c78-99b2-cb621f72bdee tempest-CreateVolumesFromSnapshotTest-853054668 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.025s {{(pid=83259) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 16 15:25:57 devstack cinder-volume[83259]: DEBUG cinder.volume.drivers.quobyte [None req-02ced4b9-c63f-4c78-99b2-cb621f72bdee tempest-CreateVolumesFromSnapshotTest-853054668 None] Selected 10.10.41.181/cinder-vol-61f585ac-f8e2-4d19-a890-7ebc2726cc72 as target Quobyte volume. {{(pid=83259) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:690}} Sep 16 15:25:57 devstack cinder-volume[83259]: INFO cinder.volume.drivers.remotefs [None req-02ced4b9-c63f-4c78-99b2-cb621f72bdee tempest-CreateVolumesFromSnapshotTest-853054668 None] casted to 10.10.41.181/cinder-vol-61f585ac-f8e2-4d19-a890-7ebc2726cc72 Sep 16 15:25:57 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [None req-02ced4b9-c63f-4c78-99b2-cb621f72bdee tempest-CreateVolumesFromSnapshotTest-853054668 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c/volume-970d7e92-63f1-47e9-ab30-9f4995f321fc 1073741824 {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 15:25:58 devstack quobyte-client[83286]: The server volume:87712ffe-8a69-446d-9ed6-4430c7ee9792@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=87712ffe-8a69-446d-9ed6-4430c7ee9792, inode=167, name=volume-970d7e92-63f1-47e9-ab30-9f4995f321fc, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.206), requestorAccessMask=0 Sep 16 15:25:58 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [None req-101e267a-7223-4d35-af33-9e8074024b2c tempest-VolumeImageDependencyTests-25375886 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_c1e8e8dc-7887-4cc1-aef8-37968c6baf5c_73q3q5xjdevstack@QuobyteHD {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 15:25:58 devstack cinder-volume[83259]: DEBUG cinder.volume.manager [None req-a4ae20ba-1fd5-4612-8f34-4bd76b3e3f5d tempest-CreateVolumesFromSnapshotTest-853054668 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e10d9d32-e866-4c51-a3f0-308ce7ae8cec) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9e87b1ab-d992-435d-83d1-a32eac37f0c8', 'volume_size': 1}' {{(pid=83259) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 15:25:58 devstack cinder-volume[83259]: DEBUG cinder.volume.manager [None req-a4ae20ba-1fd5-4612-8f34-4bd76b3e3f5d tempest-CreateVolumesFromSnapshotTest-853054668 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (930a7938-a334-4629-bfe8-2cd3648c500a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83259) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 15:25:58 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [None req-02ced4b9-c63f-4c78-99b2-cb621f72bdee tempest-CreateVolumesFromSnapshotTest-853054668 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c/volume-970d7e92-63f1-47e9-ab30-9f4995f321fc 1073741824" returned: 0 in 0.683s {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 15:25:58 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [None req-473e8d8e-957d-4a4c-9da7-7f1c9545451d tempest-SnapshotDependencyTests-1639469217 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c/volume-fb056960-1e79-47e9-8b58-6accef1fb32a.a8b16fa4-35da-41a8-b8f4-55013aa8fe09" returned: 0 in 1.210s {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 15:25:58 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [None req-02ced4b9-c63f-4c78-99b2-cb621f72bdee tempest-CreateVolumesFromSnapshotTest-853054668 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c/volume-970d7e92-63f1-47e9-ab30-9f4995f321fc {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 15:25:58 devstack cinder-volume[83259]: DEBUG cinder.volume.drivers.remotefs [None req-473e8d8e-957d-4a4c-9da7-7f1c9545451d tempest-SnapshotDependencyTests-1639469217 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-fb056960-1e79-47e9-8b58-6accef1fb32a(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83259) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:886}} Sep 16 15:25:58 devstack sudo[100413]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_c1e8e8dc-7887-4cc1-aef8-37968c6baf5c_73q3q5xjdevstack@QuobyteHD Sep 16 15:25:58 devstack sudo[100413]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 15:25:58 devstack cinder-volume[83259]: DEBUG oslo.privsep.daemon [-] privsep: reply[6bdd3ca6-0a8c-494d-ab57-46aef8323346]: (4, 'qcow2') {{(pid=84312) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 16 15:25:58 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [None req-473e8d8e-957d-4a4c-9da7-7f1c9545451d tempest-SnapshotDependencyTests-1639469217 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c/volume-fb056960-1e79-47e9-8b58-6accef1fb32a {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 15:25:59 devstack cinder-volume[83259]: INFO cinder.volume.flows.manager.create_volume [None req-a4ae20ba-1fd5-4612-8f34-4bd76b3e3f5d tempest-CreateVolumesFromSnapshotTest-853054668 None] Volume volume-9e87b1ab-d992-435d-83d1-a32eac37f0c8 (9e87b1ab-d992-435d-83d1-a32eac37f0c8): created successfully Sep 16 15:25:59 devstack cinder-volume[83259]: DEBUG cinder.volume.manager [None req-a4ae20ba-1fd5-4612-8f34-4bd76b3e3f5d tempest-CreateVolumesFromSnapshotTest-853054668 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (930a7938-a334-4629-bfe8-2cd3648c500a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83259) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 15:25:59 devstack cinder-volume[83259]: DEBUG cinder.volume.manager [None req-a4ae20ba-1fd5-4612-8f34-4bd76b3e3f5d tempest-CreateVolumesFromSnapshotTest-853054668 None] Flow 'volume_create_manager' (f646301e-9960-4e1e-aef7-ee82781fb4e8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83259) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 16 15:25:59 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [None req-02ced4b9-c63f-4c78-99b2-cb621f72bdee tempest-CreateVolumesFromSnapshotTest-853054668 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c/volume-970d7e92-63f1-47e9-ab30-9f4995f321fc" returned: 0 in 0.799s {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 15:25:59 devstack cinder-volume[83259]: DEBUG cinder.volume.drivers.quobyte [None req-02ced4b9-c63f-4c78-99b2-cb621f72bdee tempest-CreateVolumesFromSnapshotTest-853054668 None] <== create_volume: return (1550ms) {'provider_location': '10.10.41.181/cinder-vol-61f585ac-f8e2-4d19-a890-7ebc2726cc72'} {{(pid=83259) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Sep 16 15:25:59 devstack cinder-volume[83259]: DEBUG oslo_concurrency.lockutils [None req-02ced4b9-c63f-4c78-99b2-cb621f72bdee tempest-CreateVolumesFromSnapshotTest-853054668 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.584s {{(pid=83259) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 16 15:25:59 devstack cinder-volume[83259]: INFO cinder.volume.manager [None req-a4ae20ba-1fd5-4612-8f34-4bd76b3e3f5d tempest-CreateVolumesFromSnapshotTest-853054668 None] Created volume successfully. Sep 16 15:25:59 devstack cinder-volume[83259]: DEBUG oslo_concurrency.lockutils [None req-32a298a4-808d-41de-b40b-b0f83fb3d0eb tempest-CreateVolumesFromSnapshotTest-853054668 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 8.380s {{(pid=83259) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 16 15:25:59 devstack cinder-volume[83259]: DEBUG cinder.volume.drivers.quobyte [None req-32a298a4-808d-41de-b40b-b0f83fb3d0eb tempest-CreateVolumesFromSnapshotTest-853054668 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-16T13:25:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-2071963270',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#Quobyte',id=bc2f1ac8-5141-46e9-91f4-291033fdea05,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d3e07dd8ed944a4e832e4091183e70ca',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-16T13:25:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-16T13:25:44Z,use_quota=True,user_id='bd19339b7db74ce6a52197e7902747d2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(485ead50-3df8-4d76-8d34-a4db136c980a),volume_type_id=485ead50-3df8-4d76-8d34-a4db136c980a)}" {{(pid=83259) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Sep 16 15:25:59 devstack cinder-volume[83259]: DEBUG cinder.volume.drivers.remotefs [None req-32a298a4-808d-41de-b40b-b0f83fb3d0eb tempest-CreateVolumesFromSnapshotTest-853054668 None] Creating volume bc2f1ac8-5141-46e9-91f4-291033fdea05 {{(pid=83259) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}} Sep 16 15:25:59 devstack cinder-volume[83259]: DEBUG oslo_concurrency.lockutils [None req-32a298a4-808d-41de-b40b-b0f83fb3d0eb tempest-CreateVolumesFromSnapshotTest-853054668 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83259) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 16 15:25:59 devstack cinder-volume[83259]: DEBUG oslo_concurrency.lockutils [None req-32a298a4-808d-41de-b40b-b0f83fb3d0eb tempest-CreateVolumesFromSnapshotTest-853054668 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=83259) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 16 15:25:59 devstack cinder-volume[83259]: DEBUG cinder.volume.drivers.quobyte [None req-32a298a4-808d-41de-b40b-b0f83fb3d0eb tempest-CreateVolumesFromSnapshotTest-853054668 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-61f585ac-f8e2-4d19-a890-7ebc2726cc72': None} {{(pid=83259) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:639}} Sep 16 15:25:59 devstack cinder-volume[83259]: DEBUG cinder.volume.drivers.quobyte [None req-32a298a4-808d-41de-b40b-b0f83fb3d0eb tempest-CreateVolumesFromSnapshotTest-853054668 None] Available shares ['10.10.41.181/cinder-vol-61f585ac-f8e2-4d19-a890-7ebc2726cc72'] {{(pid=83259) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:669}} Sep 16 15:25:59 devstack cinder-volume[83259]: DEBUG oslo_concurrency.lockutils [None req-32a298a4-808d-41de-b40b-b0f83fb3d0eb tempest-CreateVolumesFromSnapshotTest-853054668 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=83259) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 16 15:25:59 devstack cinder-volume[83259]: DEBUG cinder.volume.drivers.quobyte [None req-32a298a4-808d-41de-b40b-b0f83fb3d0eb tempest-CreateVolumesFromSnapshotTest-853054668 None] Selected 10.10.41.181/cinder-vol-61f585ac-f8e2-4d19-a890-7ebc2726cc72 as target Quobyte volume. {{(pid=83259) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:690}} Sep 16 15:25:59 devstack cinder-volume[83259]: INFO cinder.volume.drivers.remotefs [None req-32a298a4-808d-41de-b40b-b0f83fb3d0eb tempest-CreateVolumesFromSnapshotTest-853054668 None] casted to 10.10.41.181/cinder-vol-61f585ac-f8e2-4d19-a890-7ebc2726cc72 Sep 16 15:25:59 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [None req-32a298a4-808d-41de-b40b-b0f83fb3d0eb tempest-CreateVolumesFromSnapshotTest-853054668 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c/volume-bc2f1ac8-5141-46e9-91f4-291033fdea05 1073741824 {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 15:25:59 devstack quobyte-client[83286]: The server volume:87712ffe-8a69-446d-9ed6-4430c7ee9792@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=87712ffe-8a69-446d-9ed6-4430c7ee9792, inode=168, name=volume-bc2f1ac8-5141-46e9-91f4-291033fdea05, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.206), requestorAccessMask=0 Sep 16 15:25:59 devstack cinder-volume[83259]: DEBUG cinder.volume.manager [None req-02ced4b9-c63f-4c78-99b2-cb621f72bdee tempest-CreateVolumesFromSnapshotTest-853054668 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2cba7913-2677-42a0-aa4a-765aaea80ce0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-970d7e92-63f1-47e9-ab30-9f4995f321fc', 'volume_size': 1}' {{(pid=83259) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 15:25:59 devstack cinder-volume[83259]: DEBUG cinder.volume.manager [None req-02ced4b9-c63f-4c78-99b2-cb621f72bdee tempest-CreateVolumesFromSnapshotTest-853054668 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (291c93f7-fcbb-4a6b-8af7-d45ec62a12fa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83259) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 15:26:00 devstack cinder-volume[83259]: INFO cinder.volume.flows.manager.create_volume [None req-02ced4b9-c63f-4c78-99b2-cb621f72bdee tempest-CreateVolumesFromSnapshotTest-853054668 None] Volume volume-970d7e92-63f1-47e9-ab30-9f4995f321fc (970d7e92-63f1-47e9-ab30-9f4995f321fc): created successfully Sep 16 15:26:00 devstack cinder-volume[83259]: DEBUG cinder.volume.manager [None req-02ced4b9-c63f-4c78-99b2-cb621f72bdee tempest-CreateVolumesFromSnapshotTest-853054668 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (291c93f7-fcbb-4a6b-8af7-d45ec62a12fa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83259) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 15:26:00 devstack cinder-volume[83259]: DEBUG cinder.volume.manager [None req-02ced4b9-c63f-4c78-99b2-cb621f72bdee tempest-CreateVolumesFromSnapshotTest-853054668 None] Flow 'volume_create_manager' (4c56a514-3e94-47c8-82f0-790e253d632e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83259) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 16 15:26:00 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [None req-473e8d8e-957d-4a4c-9da7-7f1c9545451d tempest-SnapshotDependencyTests-1639469217 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c/volume-fb056960-1e79-47e9-8b58-6accef1fb32a" returned: 0 in 1.351s {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 15:26:00 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [None req-473e8d8e-957d-4a4c-9da7-7f1c9545451d tempest-SnapshotDependencyTests-1639469217 None] Running cmd (subprocess): qemu-img commit -d /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c/volume-fb056960-1e79-47e9-8b58-6accef1fb32a.a8b16fa4-35da-41a8-b8f4-55013aa8fe09 {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 15:26:00 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [None req-32a298a4-808d-41de-b40b-b0f83fb3d0eb tempest-CreateVolumesFromSnapshotTest-853054668 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c/volume-bc2f1ac8-5141-46e9-91f4-291033fdea05 1073741824" returned: 0 in 0.875s {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 15:26:00 devstack cinder-volume[83259]: INFO cinder.volume.manager [None req-02ced4b9-c63f-4c78-99b2-cb621f72bdee tempest-CreateVolumesFromSnapshotTest-853054668 None] Created volume successfully. Sep 16 15:26:00 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [None req-32a298a4-808d-41de-b40b-b0f83fb3d0eb tempest-CreateVolumesFromSnapshotTest-853054668 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c/volume-bc2f1ac8-5141-46e9-91f4-291033fdea05 {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 15:26:01 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [None req-473e8d8e-957d-4a4c-9da7-7f1c9545451d tempest-SnapshotDependencyTests-1639469217 None] CMD "qemu-img commit -d /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c/volume-fb056960-1e79-47e9-8b58-6accef1fb32a.a8b16fa4-35da-41a8-b8f4-55013aa8fe09" returned: 0 in 0.710s {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 15:26:01 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [None req-32a298a4-808d-41de-b40b-b0f83fb3d0eb tempest-CreateVolumesFromSnapshotTest-853054668 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c/volume-bc2f1ac8-5141-46e9-91f4-291033fdea05" returned: 0 in 0.364s {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 15:26:01 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [None req-473e8d8e-957d-4a4c-9da7-7f1c9545451d tempest-SnapshotDependencyTests-1639469217 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c/volume-fb056960-1e79-47e9-8b58-6accef1fb32a.a8b16fa4-35da-41a8-b8f4-55013aa8fe09 {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 15:26:01 devstack cinder-volume[83259]: DEBUG cinder.volume.drivers.quobyte [None req-32a298a4-808d-41de-b40b-b0f83fb3d0eb tempest-CreateVolumesFromSnapshotTest-853054668 None] <== create_volume: return (1701ms) {'provider_location': '10.10.41.181/cinder-vol-61f585ac-f8e2-4d19-a890-7ebc2726cc72'} {{(pid=83259) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Sep 16 15:26:01 devstack cinder-volume[83259]: DEBUG oslo_concurrency.lockutils [None req-32a298a4-808d-41de-b40b-b0f83fb3d0eb tempest-CreateVolumesFromSnapshotTest-853054668 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.807s {{(pid=83259) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 16 15:26:01 devstack sudo[100413]: pam_unix(sudo:session): session closed for user root Sep 16 15:26:01 devstack cinder-volume[83259]: DEBUG cinder.volume.manager [None req-32a298a4-808d-41de-b40b-b0f83fb3d0eb tempest-CreateVolumesFromSnapshotTest-853054668 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0315b8c9-2870-40d7-bcda-ac3d266bf3ec) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-bc2f1ac8-5141-46e9-91f4-291033fdea05', 'volume_size': 1}' {{(pid=83259) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 15:26:01 devstack cinder-volume[83259]: DEBUG cinder.volume.manager [None req-32a298a4-808d-41de-b40b-b0f83fb3d0eb tempest-CreateVolumesFromSnapshotTest-853054668 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (533cd1d8-b500-473a-a268-552f6ec79594) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83259) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 15:26:01 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [None req-101e267a-7223-4d35-af33-9e8074024b2c tempest-VolumeImageDependencyTests-25375886 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_c1e8e8dc-7887-4cc1-aef8-37968c6baf5c_73q3q5xjdevstack@QuobyteHD" returned: 0 in 3.616s {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 15:26:01 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [None req-473e8d8e-957d-4a4c-9da7-7f1c9545451d tempest-SnapshotDependencyTests-1639469217 None] CMD "rm -f /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c/volume-fb056960-1e79-47e9-8b58-6accef1fb32a.a8b16fa4-35da-41a8-b8f4-55013aa8fe09" returned: 0 in 0.634s {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 15:26:01 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [None req-101e267a-7223-4d35-af33-9e8074024b2c tempest-VolumeImageDependencyTests-25375886 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_c1e8e8dc-7887-4cc1-aef8-37968c6baf5c_73q3q5xjdevstack@QuobyteHD {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 15:26:01 devstack cinder-volume[83259]: DEBUG cinder.coordination [None req-473e8d8e-957d-4a4c-9da7-7f1c9545451d tempest-SnapshotDependencyTests-1639469217 None] Lock "cinder-quobyte-a8b16fa4-35da-41a8-b8f4-55013aa8fe09" released by "_delete_snapshot" :: held 4.770s {{(pid=83259) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 16 15:26:02 devstack cinder-volume[83259]: INFO cinder.volume.flows.manager.create_volume [None req-32a298a4-808d-41de-b40b-b0f83fb3d0eb tempest-CreateVolumesFromSnapshotTest-853054668 None] Volume volume-bc2f1ac8-5141-46e9-91f4-291033fdea05 (bc2f1ac8-5141-46e9-91f4-291033fdea05): created successfully Sep 16 15:26:02 devstack cinder-volume[83259]: DEBUG cinder.volume.manager [None req-32a298a4-808d-41de-b40b-b0f83fb3d0eb tempest-CreateVolumesFromSnapshotTest-853054668 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (533cd1d8-b500-473a-a268-552f6ec79594) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83259) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 15:26:02 devstack cinder-volume[83259]: DEBUG cinder.volume.manager [None req-32a298a4-808d-41de-b40b-b0f83fb3d0eb tempest-CreateVolumesFromSnapshotTest-853054668 None] Flow 'volume_create_manager' (406c1135-8e3b-4af2-9c63-7d4365e6ed28) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83259) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 16 15:26:02 devstack cinder-volume[83259]: DEBUG cinder.coordination [None req-473e8d8e-957d-4a4c-9da7-7f1c9545451d tempest-SnapshotDependencyTests-1639469217 None] Lock "cinder-quobyte-fb056960-1e79-47e9-8b58-6accef1fb32a" released by "delete_snapshot" :: held 5.340s {{(pid=83259) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 16 15:26:02 devstack sudo[100429]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_c1e8e8dc-7887-4cc1-aef8-37968c6baf5c_73q3q5xjdevstack@QuobyteHD Sep 16 15:26:02 devstack sudo[100429]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 15:26:02 devstack cinder-volume[83259]: INFO cinder.volume.manager [None req-32a298a4-808d-41de-b40b-b0f83fb3d0eb tempest-CreateVolumesFromSnapshotTest-853054668 None] Created volume successfully. Sep 16 15:26:02 devstack cinder-volume[83259]: DEBUG cinder.quota [None req-473e8d8e-957d-4a4c-9da7-7f1c9545451d tempest-SnapshotDependencyTests-1639469217 None] Created reservations ['cc06906f-6d8c-42c8-b85b-4a5ed36ae26c', '82c713d8-4006-45f2-8ebd-08b5d1ea1903', 'ef4dcb26-a934-4831-9599-175b94a6736e', '49a260fd-807c-48cb-a8c4-4846d2eaa32d'] {{(pid=83259) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 16 15:26:02 devstack cinder-volume[83259]: INFO cinder.volume.manager [None req-473e8d8e-957d-4a4c-9da7-7f1c9545451d tempest-SnapshotDependencyTests-1639469217 None] Delete snapshot completed successfully. Sep 16 15:26:02 devstack cinder-volume[83259]: DEBUG cinder.coordination [None req-473e8d8e-957d-4a4c-9da7-7f1c9545451d tempest-SnapshotDependencyTests-1639469217 None] Lock "cinder-a8b16fa4-35da-41a8-b8f4-55013aa8fe09-delete_snapshot" released by "delete_snapshot" :: held 6.437s {{(pid=83259) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 16 15:26:02 devstack cinder-volume[83259]: DEBUG cinder.coordination [None req-f0eaf19e-a4a6-484f-be6a-cd65a88b0d7e tempest-CreateVolumesFromSnapshotTest-853054668 None] Acquiring lock "cinder-970d7e92-63f1-47e9-ab30-9f4995f321fc-delete_volume" by "delete_volume" {{(pid=83259) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 16 15:26:02 devstack cinder-volume[83259]: DEBUG cinder.coordination [None req-29af2cd5-6bff-47f6-8311-9a7d1bd5d0ce tempest-SnapshotDependencyTests-1639469217 None] Acquiring lock "cinder-fb056960-1e79-47e9-8b58-6accef1fb32a-delete_volume" by "delete_volume" {{(pid=83259) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 16 15:26:02 devstack cinder-volume[83259]: DEBUG cinder.coordination [None req-f0eaf19e-a4a6-484f-be6a-cd65a88b0d7e tempest-CreateVolumesFromSnapshotTest-853054668 None] Lock "cinder-970d7e92-63f1-47e9-ab30-9f4995f321fc-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=83259) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 16 15:26:02 devstack cinder-volume[83259]: DEBUG cinder.coordination [None req-29af2cd5-6bff-47f6-8311-9a7d1bd5d0ce tempest-SnapshotDependencyTests-1639469217 None] Lock "cinder-fb056960-1e79-47e9-8b58-6accef1fb32a-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=83259) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 16 15:26:02 devstack cinder-volume[83259]: WARNING cinder.volume.volume_utils [None req-f0eaf19e-a4a6-484f-be6a-cd65a88b0d7e tempest-CreateVolumesFromSnapshotTest-853054668 None] Volume driver (QuobyteDriver 1.2) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 16 15:26:02 devstack cinder-volume[83259]: DEBUG cinder.coordination [None req-f0eaf19e-a4a6-484f-be6a-cd65a88b0d7e tempest-CreateVolumesFromSnapshotTest-853054668 None] Acquiring lock "cinder-quobyte-970d7e92-63f1-47e9-ab30-9f4995f321fc" by "delete_volume" {{(pid=83259) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 16 15:26:02 devstack cinder-volume[83259]: WARNING cinder.volume.volume_utils [None req-29af2cd5-6bff-47f6-8311-9a7d1bd5d0ce tempest-SnapshotDependencyTests-1639469217 None] Volume driver (QuobyteDriver 1.2) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 16 15:26:02 devstack cinder-volume[83259]: DEBUG cinder.coordination [None req-29af2cd5-6bff-47f6-8311-9a7d1bd5d0ce tempest-SnapshotDependencyTests-1639469217 None] Acquiring lock "cinder-quobyte-fb056960-1e79-47e9-8b58-6accef1fb32a" by "delete_volume" {{(pid=83259) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 16 15:26:02 devstack cinder-volume[83259]: DEBUG cinder.coordination [None req-f0eaf19e-a4a6-484f-be6a-cd65a88b0d7e tempest-CreateVolumesFromSnapshotTest-853054668 None] Lock "cinder-quobyte-970d7e92-63f1-47e9-ab30-9f4995f321fc" acquired by "delete_volume" :: waited 0.045s {{(pid=83259) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 16 15:26:02 devstack cinder-volume[83259]: DEBUG oslo.privsep.daemon [-] privsep: reply[1da60a92-7ebd-4aeb-98c3-79d9b4b7c12c]: (4, 'qcow2') {{(pid=84312) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 16 15:26:02 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [None req-f0eaf19e-a4a6-484f-be6a-cd65a88b0d7e tempest-CreateVolumesFromSnapshotTest-853054668 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c/volume-970d7e92-63f1-47e9-ab30-9f4995f321fc {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 15:26:03 devstack cinder-volume[83259]: DEBUG cinder.coordination [None req-29af2cd5-6bff-47f6-8311-9a7d1bd5d0ce tempest-SnapshotDependencyTests-1639469217 None] Lock "cinder-quobyte-fb056960-1e79-47e9-8b58-6accef1fb32a" acquired by "delete_volume" :: waited 0.191s {{(pid=83259) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 16 15:26:03 devstack cinder-volume[83259]: DEBUG oslo.privsep.daemon [-] privsep: reply[fddbbeac-e35e-433d-a513-be103338fdc0]: (4, 'qcow2') {{(pid=84312) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 16 15:26:03 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [None req-29af2cd5-6bff-47f6-8311-9a7d1bd5d0ce tempest-SnapshotDependencyTests-1639469217 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c/volume-fb056960-1e79-47e9-8b58-6accef1fb32a {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 15:26:03 devstack quobyte-client[83286]: System call of process 100431 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 16 15:26:03 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [None req-f0eaf19e-a4a6-484f-be6a-cd65a88b0d7e tempest-CreateVolumesFromSnapshotTest-853054668 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c/volume-970d7e92-63f1-47e9-ab30-9f4995f321fc" returned: 0 in 0.747s {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 15:26:03 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [None req-f0eaf19e-a4a6-484f-be6a-cd65a88b0d7e tempest-CreateVolumesFromSnapshotTest-853054668 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c/volume-970d7e92-63f1-47e9-ab30-9f4995f321fc {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 15:26:04 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [None req-f0eaf19e-a4a6-484f-be6a-cd65a88b0d7e tempest-CreateVolumesFromSnapshotTest-853054668 None] CMD "rm -f /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c/volume-970d7e92-63f1-47e9-ab30-9f4995f321fc" returned: 0 in 0.234s {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 15:26:04 devstack cinder-volume[83259]: DEBUG cinder.coordination [None req-f0eaf19e-a4a6-484f-be6a-cd65a88b0d7e tempest-CreateVolumesFromSnapshotTest-853054668 None] Lock "cinder-quobyte-970d7e92-63f1-47e9-ab30-9f4995f321fc" released by "delete_volume" :: held 1.326s {{(pid=83259) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 16 15:26:04 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [None req-29af2cd5-6bff-47f6-8311-9a7d1bd5d0ce tempest-SnapshotDependencyTests-1639469217 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c/volume-fb056960-1e79-47e9-8b58-6accef1fb32a" returned: 0 in 1.264s {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 15:26:04 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [None req-29af2cd5-6bff-47f6-8311-9a7d1bd5d0ce tempest-SnapshotDependencyTests-1639469217 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c/volume-fb056960-1e79-47e9-8b58-6accef1fb32a {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 15:26:04 devstack sudo[100429]: pam_unix(sudo:session): session closed for user root Sep 16 15:26:04 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [None req-101e267a-7223-4d35-af33-9e8074024b2c tempest-VolumeImageDependencyTests-25375886 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_c1e8e8dc-7887-4cc1-aef8-37968c6baf5c_73q3q5xjdevstack@QuobyteHD" returned: 1 in 3.292s {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 15:26:04 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [None req-101e267a-7223-4d35-af33-9e8074024b2c tempest-VolumeImageDependencyTests-25375886 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_c1e8e8dc-7887-4cc1-aef8-37968c6baf5c_73q3q5xjdevstack@QuobyteHD' failed. Not Retrying. {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:423}} Sep 16 15:26:04 devstack cinder-volume[83259]: DEBUG oslo_concurrency.lockutils [None req-101e267a-7223-4d35-af33-9e8074024b2c tempest-VolumeImageDependencyTests-25375886 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83259) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 16 15:26:05 devstack cinder-volume[83259]: DEBUG oslo_concurrency.lockutils [None req-101e267a-7223-4d35-af33-9e8074024b2c tempest-VolumeImageDependencyTests-25375886 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.005s {{(pid=83259) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 16 15:26:05 devstack cinder-volume[83259]: DEBUG cinder.volume.drivers.quobyte [None req-101e267a-7223-4d35-af33-9e8074024b2c tempest-VolumeImageDependencyTests-25375886 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-16T13:25:40Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#Quobyte',id=e1442a37-0aca-4f7a-9ffd-c3dcb64c0b07,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='683678bd901a42ec9487acb038532b52',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-16T13:25:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-16T13:25:41Z,use_quota=True,user_id='b7026066d1834b8fb54dfd214995c7ed',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(485ead50-3df8-4d76-8d34-a4db136c980a),volume_type_id=485ead50-3df8-4d76-8d34-a4db136c980a)}" {{(pid=83259) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Sep 16 15:26:05 devstack cinder-volume[83259]: DEBUG cinder.volume.drivers.remotefs [None req-101e267a-7223-4d35-af33-9e8074024b2c tempest-VolumeImageDependencyTests-25375886 None] Creating volume e1442a37-0aca-4f7a-9ffd-c3dcb64c0b07 {{(pid=83259) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}} Sep 16 15:26:05 devstack cinder-volume[83259]: DEBUG oslo_concurrency.lockutils [None req-101e267a-7223-4d35-af33-9e8074024b2c tempest-VolumeImageDependencyTests-25375886 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83259) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 16 15:26:05 devstack cinder-volume[83259]: DEBUG oslo_concurrency.lockutils [None req-101e267a-7223-4d35-af33-9e8074024b2c tempest-VolumeImageDependencyTests-25375886 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83259) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 16 15:26:05 devstack cinder-volume[83259]: DEBUG cinder.volume.drivers.quobyte [None req-101e267a-7223-4d35-af33-9e8074024b2c tempest-VolumeImageDependencyTests-25375886 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-61f585ac-f8e2-4d19-a890-7ebc2726cc72': None} {{(pid=83259) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:639}} Sep 16 15:26:05 devstack cinder-volume[83259]: DEBUG cinder.volume.drivers.quobyte [None req-101e267a-7223-4d35-af33-9e8074024b2c tempest-VolumeImageDependencyTests-25375886 None] Available shares ['10.10.41.181/cinder-vol-61f585ac-f8e2-4d19-a890-7ebc2726cc72'] {{(pid=83259) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:669}} Sep 16 15:26:05 devstack cinder-volume[83259]: DEBUG oslo_concurrency.lockutils [None req-101e267a-7223-4d35-af33-9e8074024b2c tempest-VolumeImageDependencyTests-25375886 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=83259) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 16 15:26:05 devstack cinder-volume[83259]: DEBUG cinder.volume.drivers.quobyte [None req-101e267a-7223-4d35-af33-9e8074024b2c tempest-VolumeImageDependencyTests-25375886 None] Selected 10.10.41.181/cinder-vol-61f585ac-f8e2-4d19-a890-7ebc2726cc72 as target Quobyte volume. {{(pid=83259) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:690}} Sep 16 15:26:05 devstack cinder-volume[83259]: INFO cinder.volume.drivers.remotefs [None req-101e267a-7223-4d35-af33-9e8074024b2c tempest-VolumeImageDependencyTests-25375886 None] casted to 10.10.41.181/cinder-vol-61f585ac-f8e2-4d19-a890-7ebc2726cc72 Sep 16 15:26:05 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [None req-101e267a-7223-4d35-af33-9e8074024b2c tempest-VolumeImageDependencyTests-25375886 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c/volume-e1442a37-0aca-4f7a-9ffd-c3dcb64c0b07 1073741824 {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 15:26:05 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [None req-29af2cd5-6bff-47f6-8311-9a7d1bd5d0ce tempest-SnapshotDependencyTests-1639469217 None] CMD "rm -f /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c/volume-fb056960-1e79-47e9-8b58-6accef1fb32a" returned: 0 in 0.593s {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 15:26:05 devstack quobyte-client[83286]: System call of process 100443 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 16 15:26:05 devstack quobyte-client[83286]: The server volume:87712ffe-8a69-446d-9ed6-4430c7ee9792@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=87712ffe-8a69-446d-9ed6-4430c7ee9792, inode=169, name=volume-e1442a37-0aca-4f7a-9ffd-c3dcb64c0b07, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.206), requestorAccessMask=0 Sep 16 15:26:05 devstack cinder-volume[83259]: DEBUG cinder.coordination [None req-29af2cd5-6bff-47f6-8311-9a7d1bd5d0ce tempest-SnapshotDependencyTests-1639469217 None] Lock "cinder-quobyte-fb056960-1e79-47e9-8b58-6accef1fb32a" released by "delete_volume" :: held 2.687s {{(pid=83259) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 16 15:26:05 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [None req-101e267a-7223-4d35-af33-9e8074024b2c tempest-VolumeImageDependencyTests-25375886 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c/volume-e1442a37-0aca-4f7a-9ffd-c3dcb64c0b07 1073741824" returned: 0 in 0.807s {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 15:26:05 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [None req-101e267a-7223-4d35-af33-9e8074024b2c tempest-VolumeImageDependencyTests-25375886 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c/volume-e1442a37-0aca-4f7a-9ffd-c3dcb64c0b07 {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 15:26:06 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [None req-101e267a-7223-4d35-af33-9e8074024b2c tempest-VolumeImageDependencyTests-25375886 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c/volume-e1442a37-0aca-4f7a-9ffd-c3dcb64c0b07" returned: 0 in 0.319s {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 15:26:06 devstack cinder-volume[83259]: DEBUG cinder.volume.drivers.quobyte [None req-101e267a-7223-4d35-af33-9e8074024b2c tempest-VolumeImageDependencyTests-25375886 None] <== create_volume: return (1174ms) {'provider_location': '10.10.41.181/cinder-vol-61f585ac-f8e2-4d19-a890-7ebc2726cc72'} {{(pid=83259) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Sep 16 15:26:06 devstack cinder-volume[83259]: DEBUG oslo_concurrency.lockutils [None req-101e267a-7223-4d35-af33-9e8074024b2c tempest-VolumeImageDependencyTests-25375886 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.201s {{(pid=83259) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 16 15:26:06 devstack cinder-volume[83259]: DEBUG cinder.quota [None req-f0eaf19e-a4a6-484f-be6a-cd65a88b0d7e tempest-CreateVolumesFromSnapshotTest-853054668 None] Created reservations ['4a8b8f66-96cb-4a1c-a94d-541a721471b2', '2d312b77-35f6-4203-a26c-60777e259104', '5b57cba8-eb10-4692-a3cc-e4a8c9076c9d', 'f3309743-32f6-46c2-a420-36fe8ece01d8'] {{(pid=83259) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 16 15:26:06 devstack cinder-volume[83259]: DEBUG cinder.quota [None req-29af2cd5-6bff-47f6-8311-9a7d1bd5d0ce tempest-SnapshotDependencyTests-1639469217 None] Created reservations ['e7ec894b-23a9-4ad8-9fcd-b26e32c6ee94', '0cb4c67d-137e-443a-9c6a-eccc176821f2', 'a4e9d654-a210-429d-a528-32e0b23d0359', 'dfe493b9-5398-422f-bd28-ba3f52e68a5e'] {{(pid=83259) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 16 15:26:06 devstack cinder-volume[83259]: DEBUG cinder.volume.volume_utils [None req-101e267a-7223-4d35-af33-9e8074024b2c tempest-VolumeImageDependencyTests-25375886 None] Attempting download of c1e8e8dc-7887-4cc1-aef8-37968c6baf5c ((None, [{'url': 'file:///opt/stack/data/glance/images/c1e8e8dc-7887-4cc1-aef8-37968c6baf5c', 'metadata': {}}])) to volume e1442a37-0aca-4f7a-9ffd-c3dcb64c0b07. {{(pid=83259) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1189}} Sep 16 15:26:06 devstack cinder-volume[83259]: DEBUG oslo_concurrency.lockutils [None req-f0eaf19e-a4a6-484f-be6a-cd65a88b0d7e tempest-CreateVolumesFromSnapshotTest-853054668 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83259) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 16 15:26:06 devstack cinder-volume[83259]: DEBUG oslo_concurrency.lockutils [None req-f0eaf19e-a4a6-484f-be6a-cd65a88b0d7e tempest-CreateVolumesFromSnapshotTest-853054668 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=83259) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 16 15:26:06 devstack cinder-volume[83259]: DEBUG cinder.volume.drivers.quobyte [None req-f0eaf19e-a4a6-484f-be6a-cd65a88b0d7e tempest-CreateVolumesFromSnapshotTest-853054668 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-61f585ac-f8e2-4d19-a890-7ebc2726cc72': None} {{(pid=83259) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:639}} Sep 16 15:26:06 devstack cinder-volume[83259]: DEBUG cinder.volume.drivers.quobyte [None req-f0eaf19e-a4a6-484f-be6a-cd65a88b0d7e tempest-CreateVolumesFromSnapshotTest-853054668 None] Available shares ['10.10.41.181/cinder-vol-61f585ac-f8e2-4d19-a890-7ebc2726cc72'] {{(pid=83259) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:669}} Sep 16 15:26:06 devstack cinder-volume[83259]: DEBUG oslo_concurrency.lockutils [None req-f0eaf19e-a4a6-484f-be6a-cd65a88b0d7e tempest-CreateVolumesFromSnapshotTest-853054668 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=83259) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 16 15:26:06 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [None req-f0eaf19e-a4a6-484f-be6a-cd65a88b0d7e tempest-CreateVolumesFromSnapshotTest-853054668 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 15:26:06 devstack cinder-volume[83259]: DEBUG oslo.privsep.daemon [-] privsep: reply[03130634-1ba0-4f92-979c-0bbfdd090cb8]: (4, 'raw') {{(pid=84312) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 16 15:26:06 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [None req-101e267a-7223-4d35-af33-9e8074024b2c tempest-VolumeImageDependencyTests-25375886 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_c1e8e8dc-7887-4cc1-aef8-37968c6baf5c_8zei5ysn {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 15:26:07 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [None req-f0eaf19e-a4a6-484f-be6a-cd65a88b0d7e tempest-CreateVolumesFromSnapshotTest-853054668 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c" returned: 0 in 0.462s {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 15:26:07 devstack cinder-volume[83259]: DEBUG cinder.manager [None req-f0eaf19e-a4a6-484f-be6a-cd65a88b0d7e tempest-CreateVolumesFromSnapshotTest-853054668 None] Notifying Schedulers of capabilities ... {{(pid=83259) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 16 15:26:07 devstack cinder-volume[83259]: INFO cinder.volume.manager [None req-f0eaf19e-a4a6-484f-be6a-cd65a88b0d7e tempest-CreateVolumesFromSnapshotTest-853054668 None] Deleted volume successfully. Sep 16 15:26:07 devstack sudo[100449]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_c1e8e8dc-7887-4cc1-aef8-37968c6baf5c_8zei5ysn Sep 16 15:26:07 devstack sudo[100449]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 15:26:07 devstack cinder-volume[83259]: DEBUG cinder.coordination [None req-398ceb4d-597d-4368-a865-2ee63dff53f1 tempest-SnapshotDependencyTests-1639469217 None] Acquiring lock "cinder-5bfa9b0a-2bac-43b9-b551-4be6e2e870e6-delete_volume" by "delete_volume" {{(pid=83259) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 16 15:26:07 devstack cinder-volume[83259]: DEBUG cinder.coordination [None req-8bbe9592-411e-4891-b025-5aa12e4f21b8 tempest-CreateVolumesFromSnapshotTest-853054668 None] Acquiring lock "cinder-bc2f1ac8-5141-46e9-91f4-291033fdea05-delete_volume" by "delete_volume" {{(pid=83259) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 16 15:26:07 devstack cinder-volume[83259]: DEBUG oslo_concurrency.lockutils [None req-29af2cd5-6bff-47f6-8311-9a7d1bd5d0ce tempest-SnapshotDependencyTests-1639469217 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83259) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 16 15:26:07 devstack cinder-volume[83259]: DEBUG oslo_concurrency.lockutils [None req-29af2cd5-6bff-47f6-8311-9a7d1bd5d0ce tempest-SnapshotDependencyTests-1639469217 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=83259) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 16 15:26:07 devstack cinder-volume[83259]: DEBUG cinder.volume.drivers.quobyte [None req-29af2cd5-6bff-47f6-8311-9a7d1bd5d0ce tempest-SnapshotDependencyTests-1639469217 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-61f585ac-f8e2-4d19-a890-7ebc2726cc72': None} {{(pid=83259) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:639}} Sep 16 15:26:07 devstack cinder-volume[83259]: DEBUG cinder.volume.drivers.quobyte [None req-29af2cd5-6bff-47f6-8311-9a7d1bd5d0ce tempest-SnapshotDependencyTests-1639469217 None] Available shares ['10.10.41.181/cinder-vol-61f585ac-f8e2-4d19-a890-7ebc2726cc72'] {{(pid=83259) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:669}} Sep 16 15:26:07 devstack cinder-volume[83259]: DEBUG oslo_concurrency.lockutils [None req-29af2cd5-6bff-47f6-8311-9a7d1bd5d0ce tempest-SnapshotDependencyTests-1639469217 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=83259) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 16 15:26:07 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [None req-29af2cd5-6bff-47f6-8311-9a7d1bd5d0ce tempest-SnapshotDependencyTests-1639469217 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 15:26:07 devstack cinder-volume[83259]: DEBUG cinder.coordination [None req-f0eaf19e-a4a6-484f-be6a-cd65a88b0d7e tempest-CreateVolumesFromSnapshotTest-853054668 None] Lock "cinder-970d7e92-63f1-47e9-ab30-9f4995f321fc-delete_volume" released by "delete_volume" :: held 4.901s {{(pid=83259) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 16 15:26:07 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [None req-29af2cd5-6bff-47f6-8311-9a7d1bd5d0ce tempest-SnapshotDependencyTests-1639469217 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c" returned: 0 in 0.331s {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 15:26:07 devstack cinder-volume[83259]: DEBUG cinder.manager [None req-29af2cd5-6bff-47f6-8311-9a7d1bd5d0ce tempest-SnapshotDependencyTests-1639469217 None] Notifying Schedulers of capabilities ... {{(pid=83259) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 16 15:26:07 devstack cinder-volume[83259]: DEBUG cinder.coordination [None req-398ceb4d-597d-4368-a865-2ee63dff53f1 tempest-SnapshotDependencyTests-1639469217 None] Lock "cinder-5bfa9b0a-2bac-43b9-b551-4be6e2e870e6-delete_volume" acquired by "delete_volume" :: waited 0.445s {{(pid=83259) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 16 15:26:08 devstack cinder-volume[83259]: DEBUG cinder.coordination [None req-8bbe9592-411e-4891-b025-5aa12e4f21b8 tempest-CreateVolumesFromSnapshotTest-853054668 None] Lock "cinder-bc2f1ac8-5141-46e9-91f4-291033fdea05-delete_volume" acquired by "delete_volume" :: waited 0.536s {{(pid=83259) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 16 15:26:08 devstack cinder-volume[83259]: INFO cinder.volume.manager [None req-29af2cd5-6bff-47f6-8311-9a7d1bd5d0ce tempest-SnapshotDependencyTests-1639469217 None] Deleted volume successfully. Sep 16 15:26:08 devstack cinder-volume[83259]: DEBUG cinder.coordination [None req-29af2cd5-6bff-47f6-8311-9a7d1bd5d0ce tempest-SnapshotDependencyTests-1639469217 None] Lock "cinder-fb056960-1e79-47e9-8b58-6accef1fb32a-delete_volume" released by "delete_volume" :: held 5.386s {{(pid=83259) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 16 15:26:08 devstack cinder-volume[83259]: WARNING cinder.volume.volume_utils [None req-398ceb4d-597d-4368-a865-2ee63dff53f1 tempest-SnapshotDependencyTests-1639469217 None] Volume driver (QuobyteDriver 1.2) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 16 15:26:08 devstack cinder-volume[83259]: DEBUG cinder.coordination [None req-398ceb4d-597d-4368-a865-2ee63dff53f1 tempest-SnapshotDependencyTests-1639469217 None] Acquiring lock "cinder-quobyte-5bfa9b0a-2bac-43b9-b551-4be6e2e870e6" by "delete_volume" {{(pid=83259) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 16 15:26:08 devstack cinder-volume[83259]: WARNING cinder.volume.volume_utils [None req-8bbe9592-411e-4891-b025-5aa12e4f21b8 tempest-CreateVolumesFromSnapshotTest-853054668 None] Volume driver (QuobyteDriver 1.2) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 16 15:26:08 devstack cinder-volume[83259]: DEBUG cinder.coordination [None req-8bbe9592-411e-4891-b025-5aa12e4f21b8 tempest-CreateVolumesFromSnapshotTest-853054668 None] Acquiring lock "cinder-quobyte-bc2f1ac8-5141-46e9-91f4-291033fdea05" by "delete_volume" {{(pid=83259) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 16 15:26:08 devstack cinder-volume[83259]: DEBUG cinder.coordination [None req-398ceb4d-597d-4368-a865-2ee63dff53f1 tempest-SnapshotDependencyTests-1639469217 None] Lock "cinder-quobyte-5bfa9b0a-2bac-43b9-b551-4be6e2e870e6" acquired by "delete_volume" :: waited 0.039s {{(pid=83259) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 16 15:26:08 devstack cinder-volume[83259]: DEBUG oslo.privsep.daemon [-] privsep: reply[4b580bfb-8857-4e75-b6bd-d77e7b9e81c8]: (4, 'qcow2') {{(pid=84312) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 16 15:26:08 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [None req-398ceb4d-597d-4368-a865-2ee63dff53f1 tempest-SnapshotDependencyTests-1639469217 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c/volume-5bfa9b0a-2bac-43b9-b551-4be6e2e870e6 {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 15:26:08 devstack cinder-volume[83259]: DEBUG cinder.coordination [None req-8bbe9592-411e-4891-b025-5aa12e4f21b8 tempest-CreateVolumesFromSnapshotTest-853054668 None] Lock "cinder-quobyte-bc2f1ac8-5141-46e9-91f4-291033fdea05" acquired by "delete_volume" :: waited 0.195s {{(pid=83259) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 16 15:26:08 devstack cinder-volume[83259]: DEBUG oslo.privsep.daemon [-] privsep: reply[8d43bdf3-5d86-4329-9543-90370624d553]: (4, 'qcow2') {{(pid=84312) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 16 15:26:08 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [None req-8bbe9592-411e-4891-b025-5aa12e4f21b8 tempest-CreateVolumesFromSnapshotTest-853054668 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c/volume-bc2f1ac8-5141-46e9-91f4-291033fdea05 {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 15:26:09 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [None req-398ceb4d-597d-4368-a865-2ee63dff53f1 tempest-SnapshotDependencyTests-1639469217 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c/volume-5bfa9b0a-2bac-43b9-b551-4be6e2e870e6" returned: 0 in 0.760s {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 15:26:09 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [None req-398ceb4d-597d-4368-a865-2ee63dff53f1 tempest-SnapshotDependencyTests-1639469217 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c/volume-5bfa9b0a-2bac-43b9-b551-4be6e2e870e6 {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 15:26:09 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [None req-398ceb4d-597d-4368-a865-2ee63dff53f1 tempest-SnapshotDependencyTests-1639469217 None] CMD "rm -f /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c/volume-5bfa9b0a-2bac-43b9-b551-4be6e2e870e6" returned: 0 in 0.172s {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 15:26:09 devstack cinder-volume[83259]: DEBUG cinder.coordination [None req-398ceb4d-597d-4368-a865-2ee63dff53f1 tempest-SnapshotDependencyTests-1639469217 None] Lock "cinder-quobyte-5bfa9b0a-2bac-43b9-b551-4be6e2e870e6" released by "delete_volume" :: held 1.259s {{(pid=83259) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 16 15:26:09 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [None req-8bbe9592-411e-4891-b025-5aa12e4f21b8 tempest-CreateVolumesFromSnapshotTest-853054668 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c/volume-bc2f1ac8-5141-46e9-91f4-291033fdea05" returned: 0 in 1.246s {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 15:26:09 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [None req-8bbe9592-411e-4891-b025-5aa12e4f21b8 tempest-CreateVolumesFromSnapshotTest-853054668 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c/volume-bc2f1ac8-5141-46e9-91f4-291033fdea05 {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 15:26:10 devstack sudo[100449]: pam_unix(sudo:session): session closed for user root Sep 16 15:26:10 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [None req-101e267a-7223-4d35-af33-9e8074024b2c tempest-VolumeImageDependencyTests-25375886 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_c1e8e8dc-7887-4cc1-aef8-37968c6baf5c_8zei5ysn" returned: 0 in 3.470s {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 15:26:10 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [None req-101e267a-7223-4d35-af33-9e8074024b2c tempest-VolumeImageDependencyTests-25375886 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_c1e8e8dc-7887-4cc1-aef8-37968c6baf5c_8zei5ysn {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 15:26:10 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [None req-8bbe9592-411e-4891-b025-5aa12e4f21b8 tempest-CreateVolumesFromSnapshotTest-853054668 None] CMD "rm -f /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c/volume-bc2f1ac8-5141-46e9-91f4-291033fdea05" returned: 0 in 0.555s {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 15:26:10 devstack cinder-volume[83259]: DEBUG cinder.coordination [None req-8bbe9592-411e-4891-b025-5aa12e4f21b8 tempest-CreateVolumesFromSnapshotTest-853054668 None] Lock "cinder-quobyte-bc2f1ac8-5141-46e9-91f4-291033fdea05" released by "delete_volume" :: held 2.154s {{(pid=83259) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 16 15:26:10 devstack sudo[100462]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_c1e8e8dc-7887-4cc1-aef8-37968c6baf5c_8zei5ysn Sep 16 15:26:10 devstack cinder-volume[83259]: DEBUG cinder.quota [None req-398ceb4d-597d-4368-a865-2ee63dff53f1 tempest-SnapshotDependencyTests-1639469217 None] Created reservations ['edbd0fae-3bbd-4624-86a6-5ca2d55a4a38', '8b9911a2-81db-406f-8f10-baaa82e7fd0f', '53da7ed3-ecc1-4425-aadc-f4c3968fe8b0', '91ddd647-d36a-4dad-a385-46d2e2388761'] {{(pid=83259) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 16 15:26:10 devstack sudo[100462]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 15:26:10 devstack cinder-volume[83259]: DEBUG cinder.quota [None req-8bbe9592-411e-4891-b025-5aa12e4f21b8 tempest-CreateVolumesFromSnapshotTest-853054668 None] Created reservations ['35a03ca2-05a7-489a-834d-0e25452b8584', '6ee99823-b87b-48cf-b1ce-bace80d3b24a', '416d4cf0-49c1-4d98-b6c7-22940dd234cd', 'dc9223f5-5df3-4d21-8115-b8222205b381'] {{(pid=83259) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 16 15:26:11 devstack cinder-volume[83259]: DEBUG oslo_concurrency.lockutils [None req-398ceb4d-597d-4368-a865-2ee63dff53f1 tempest-SnapshotDependencyTests-1639469217 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83259) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 16 15:26:11 devstack cinder-volume[83259]: DEBUG oslo_concurrency.lockutils [None req-398ceb4d-597d-4368-a865-2ee63dff53f1 tempest-SnapshotDependencyTests-1639469217 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.005s {{(pid=83259) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 16 15:26:11 devstack cinder-volume[83259]: DEBUG cinder.volume.drivers.quobyte [None req-398ceb4d-597d-4368-a865-2ee63dff53f1 tempest-SnapshotDependencyTests-1639469217 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-61f585ac-f8e2-4d19-a890-7ebc2726cc72': None} {{(pid=83259) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:639}} Sep 16 15:26:11 devstack cinder-volume[83259]: DEBUG cinder.volume.drivers.quobyte [None req-398ceb4d-597d-4368-a865-2ee63dff53f1 tempest-SnapshotDependencyTests-1639469217 None] Available shares ['10.10.41.181/cinder-vol-61f585ac-f8e2-4d19-a890-7ebc2726cc72'] {{(pid=83259) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:669}} Sep 16 15:26:11 devstack cinder-volume[83259]: DEBUG oslo_concurrency.lockutils [None req-398ceb4d-597d-4368-a865-2ee63dff53f1 tempest-SnapshotDependencyTests-1639469217 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=83259) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 16 15:26:11 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [None req-398ceb4d-597d-4368-a865-2ee63dff53f1 tempest-SnapshotDependencyTests-1639469217 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 15:26:11 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [None req-398ceb4d-597d-4368-a865-2ee63dff53f1 tempest-SnapshotDependencyTests-1639469217 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c" returned: 0 in 0.325s {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 15:26:11 devstack cinder-volume[83259]: DEBUG cinder.manager [None req-398ceb4d-597d-4368-a865-2ee63dff53f1 tempest-SnapshotDependencyTests-1639469217 None] Notifying Schedulers of capabilities ... {{(pid=83259) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 16 15:26:11 devstack cinder-volume[83259]: INFO cinder.volume.manager [None req-398ceb4d-597d-4368-a865-2ee63dff53f1 tempest-SnapshotDependencyTests-1639469217 None] Deleted volume successfully. Sep 16 15:26:11 devstack cinder-volume[83259]: DEBUG cinder.coordination [None req-398ceb4d-597d-4368-a865-2ee63dff53f1 tempest-SnapshotDependencyTests-1639469217 None] Lock "cinder-5bfa9b0a-2bac-43b9-b551-4be6e2e870e6-delete_volume" released by "delete_volume" :: held 3.767s {{(pid=83259) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 16 15:26:11 devstack cinder-volume[83259]: DEBUG oslo_concurrency.lockutils [None req-8bbe9592-411e-4891-b025-5aa12e4f21b8 tempest-CreateVolumesFromSnapshotTest-853054668 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83259) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 16 15:26:11 devstack cinder-volume[83259]: DEBUG oslo_concurrency.lockutils [None req-8bbe9592-411e-4891-b025-5aa12e4f21b8 tempest-CreateVolumesFromSnapshotTest-853054668 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=83259) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 16 15:26:11 devstack cinder-volume[83259]: DEBUG cinder.volume.drivers.quobyte [None req-8bbe9592-411e-4891-b025-5aa12e4f21b8 tempest-CreateVolumesFromSnapshotTest-853054668 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-61f585ac-f8e2-4d19-a890-7ebc2726cc72': None} {{(pid=83259) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:639}} Sep 16 15:26:11 devstack cinder-volume[83259]: DEBUG cinder.volume.drivers.quobyte [None req-8bbe9592-411e-4891-b025-5aa12e4f21b8 tempest-CreateVolumesFromSnapshotTest-853054668 None] Available shares ['10.10.41.181/cinder-vol-61f585ac-f8e2-4d19-a890-7ebc2726cc72'] {{(pid=83259) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:669}} Sep 16 15:26:11 devstack cinder-volume[83259]: DEBUG oslo_concurrency.lockutils [None req-8bbe9592-411e-4891-b025-5aa12e4f21b8 tempest-CreateVolumesFromSnapshotTest-853054668 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=83259) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 16 15:26:11 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [None req-8bbe9592-411e-4891-b025-5aa12e4f21b8 tempest-CreateVolumesFromSnapshotTest-853054668 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 15:26:11 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [None req-8bbe9592-411e-4891-b025-5aa12e4f21b8 tempest-CreateVolumesFromSnapshotTest-853054668 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c" returned: 0 in 0.119s {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 15:26:11 devstack cinder-volume[83259]: DEBUG cinder.manager [None req-8bbe9592-411e-4891-b025-5aa12e4f21b8 tempest-CreateVolumesFromSnapshotTest-853054668 None] Notifying Schedulers of capabilities ... {{(pid=83259) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 16 15:26:12 devstack cinder-volume[83259]: INFO cinder.volume.manager [None req-8bbe9592-411e-4891-b025-5aa12e4f21b8 tempest-CreateVolumesFromSnapshotTest-853054668 None] Deleted volume successfully. Sep 16 15:26:12 devstack cinder-volume[83259]: DEBUG cinder.coordination [None req-c0eab8b0-9f40-464e-9b75-36741514e77b tempest-CreateVolumesFromSnapshotTest-853054668 None] Acquiring lock "cinder-9e87b1ab-d992-435d-83d1-a32eac37f0c8-delete_volume" by "delete_volume" {{(pid=83259) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 16 15:26:12 devstack cinder-volume[83259]: DEBUG cinder.coordination [None req-8bbe9592-411e-4891-b025-5aa12e4f21b8 tempest-CreateVolumesFromSnapshotTest-853054668 None] Lock "cinder-bc2f1ac8-5141-46e9-91f4-291033fdea05-delete_volume" released by "delete_volume" :: held 4.326s {{(pid=83259) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 16 15:26:12 devstack cinder-volume[83259]: DEBUG cinder.coordination [None req-c0eab8b0-9f40-464e-9b75-36741514e77b tempest-CreateVolumesFromSnapshotTest-853054668 None] Lock "cinder-9e87b1ab-d992-435d-83d1-a32eac37f0c8-delete_volume" acquired by "delete_volume" :: waited 0.073s {{(pid=83259) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 16 15:26:12 devstack cinder-volume[83259]: WARNING cinder.volume.volume_utils [None req-c0eab8b0-9f40-464e-9b75-36741514e77b tempest-CreateVolumesFromSnapshotTest-853054668 None] Volume driver (QuobyteDriver 1.2) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 16 15:26:12 devstack cinder-volume[83259]: DEBUG cinder.coordination [None req-c0eab8b0-9f40-464e-9b75-36741514e77b tempest-CreateVolumesFromSnapshotTest-853054668 None] Acquiring lock "cinder-quobyte-9e87b1ab-d992-435d-83d1-a32eac37f0c8" by "delete_volume" {{(pid=83259) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 16 15:26:12 devstack cinder-volume[83259]: DEBUG cinder.coordination [None req-c0eab8b0-9f40-464e-9b75-36741514e77b tempest-CreateVolumesFromSnapshotTest-853054668 None] Lock "cinder-quobyte-9e87b1ab-d992-435d-83d1-a32eac37f0c8" acquired by "delete_volume" :: waited 0.018s {{(pid=83259) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 16 15:26:12 devstack cinder-volume[83259]: DEBUG oslo.privsep.daemon [-] privsep: reply[c55e7193-8a4e-4c04-affa-c4efce6fe4c1]: (4, 'qcow2') {{(pid=84312) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 16 15:26:12 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [None req-c0eab8b0-9f40-464e-9b75-36741514e77b tempest-CreateVolumesFromSnapshotTest-853054668 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c/volume-9e87b1ab-d992-435d-83d1-a32eac37f0c8 {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 15:26:13 devstack sudo[100462]: pam_unix(sudo:session): session closed for user root Sep 16 15:26:13 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [None req-c0eab8b0-9f40-464e-9b75-36741514e77b tempest-CreateVolumesFromSnapshotTest-853054668 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c/volume-9e87b1ab-d992-435d-83d1-a32eac37f0c8" returned: 0 in 0.788s {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 15:26:13 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [None req-c0eab8b0-9f40-464e-9b75-36741514e77b tempest-CreateVolumesFromSnapshotTest-853054668 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c/volume-9e87b1ab-d992-435d-83d1-a32eac37f0c8 {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 15:26:13 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [None req-101e267a-7223-4d35-af33-9e8074024b2c tempest-VolumeImageDependencyTests-25375886 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_c1e8e8dc-7887-4cc1-aef8-37968c6baf5c_8zei5ysn" returned: 1 in 3.453s {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 15:26:13 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [None req-101e267a-7223-4d35-af33-9e8074024b2c tempest-VolumeImageDependencyTests-25375886 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_c1e8e8dc-7887-4cc1-aef8-37968c6baf5c_8zei5ysn' failed. Not Retrying. {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:423}} Sep 16 15:26:13 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [None req-c0eab8b0-9f40-464e-9b75-36741514e77b tempest-CreateVolumesFromSnapshotTest-853054668 None] CMD "rm -f /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c/volume-9e87b1ab-d992-435d-83d1-a32eac37f0c8" returned: 0 in 0.219s {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 15:26:13 devstack cinder-volume[83259]: DEBUG oslo.privsep.daemon [-] privsep: reply[01ac19cc-266d-44b5-a27b-d84267d23ccb]: (4, 'raw') {{(pid=84312) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 16 15:26:13 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [None req-101e267a-7223-4d35-af33-9e8074024b2c tempest-VolumeImageDependencyTests-25375886 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_c1e8e8dc-7887-4cc1-aef8-37968c6baf5c_73q3q5xjdevstack@QuobyteHD {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 15:26:14 devstack cinder-volume[83259]: DEBUG cinder.coordination [None req-c0eab8b0-9f40-464e-9b75-36741514e77b tempest-CreateVolumesFromSnapshotTest-853054668 None] Lock "cinder-quobyte-9e87b1ab-d992-435d-83d1-a32eac37f0c8" released by "delete_volume" :: held 1.384s {{(pid=83259) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 16 15:26:14 devstack cinder-volume[83259]: DEBUG cinder.quota [None req-c0eab8b0-9f40-464e-9b75-36741514e77b tempest-CreateVolumesFromSnapshotTest-853054668 None] Created reservations ['5ba66c75-3f4b-4f10-9fb8-20350cab0762', '9a878c0b-ee6e-48d4-8526-35bfcc9f27eb', '187c9b4a-d7f4-4910-a449-990daa2f2271', 'f824b6bd-cb9a-46e3-b2b6-a9cd65926a5a'] {{(pid=83259) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 16 15:26:14 devstack sudo[100473]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_c1e8e8dc-7887-4cc1-aef8-37968c6baf5c_73q3q5xjdevstack@QuobyteHD Sep 16 15:26:14 devstack sudo[100473]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 15:26:14 devstack cinder-volume[83259]: DEBUG oslo_concurrency.lockutils [None req-c0eab8b0-9f40-464e-9b75-36741514e77b tempest-CreateVolumesFromSnapshotTest-853054668 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83259) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 16 15:26:14 devstack cinder-volume[83259]: DEBUG oslo_concurrency.lockutils [None req-c0eab8b0-9f40-464e-9b75-36741514e77b tempest-CreateVolumesFromSnapshotTest-853054668 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.015s {{(pid=83259) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 16 15:26:14 devstack cinder-volume[83259]: DEBUG cinder.volume.drivers.quobyte [None req-c0eab8b0-9f40-464e-9b75-36741514e77b tempest-CreateVolumesFromSnapshotTest-853054668 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-61f585ac-f8e2-4d19-a890-7ebc2726cc72': None} {{(pid=83259) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:639}} Sep 16 15:26:14 devstack cinder-volume[83259]: DEBUG cinder.volume.drivers.quobyte [None req-c0eab8b0-9f40-464e-9b75-36741514e77b tempest-CreateVolumesFromSnapshotTest-853054668 None] Available shares ['10.10.41.181/cinder-vol-61f585ac-f8e2-4d19-a890-7ebc2726cc72'] {{(pid=83259) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:669}} Sep 16 15:26:14 devstack cinder-volume[83259]: DEBUG oslo_concurrency.lockutils [None req-c0eab8b0-9f40-464e-9b75-36741514e77b tempest-CreateVolumesFromSnapshotTest-853054668 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.056s {{(pid=83259) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 16 15:26:14 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [None req-c0eab8b0-9f40-464e-9b75-36741514e77b tempest-CreateVolumesFromSnapshotTest-853054668 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 15:26:15 devstack cinder-volume[83259]: DEBUG cinder.coordination [None req-6e42825f-1296-4018-9d87-3c78a1cfb382 tempest-CreateVolumesFromSnapshotTest-853054668 None] Acquiring lock "cinder-eed9218a-6d1f-4192-9b58-07168a7c9d92-delete_volume" by "delete_volume" {{(pid=83259) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 16 15:26:15 devstack cinder-volume[83259]: DEBUG cinder.coordination [None req-6e42825f-1296-4018-9d87-3c78a1cfb382 tempest-CreateVolumesFromSnapshotTest-853054668 None] Lock "cinder-eed9218a-6d1f-4192-9b58-07168a7c9d92-delete_volume" acquired by "delete_volume" :: waited 0.204s {{(pid=83259) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 16 15:26:15 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [None req-c0eab8b0-9f40-464e-9b75-36741514e77b tempest-CreateVolumesFromSnapshotTest-853054668 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c" returned: 0 in 0.966s {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 15:26:15 devstack cinder-volume[83259]: DEBUG cinder.manager [None req-c0eab8b0-9f40-464e-9b75-36741514e77b tempest-CreateVolumesFromSnapshotTest-853054668 None] Notifying Schedulers of capabilities ... {{(pid=83259) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 16 15:26:15 devstack cinder-volume[83259]: INFO cinder.volume.manager [None req-c0eab8b0-9f40-464e-9b75-36741514e77b tempest-CreateVolumesFromSnapshotTest-853054668 None] Deleted volume successfully. Sep 16 15:26:16 devstack cinder-volume[83259]: WARNING cinder.volume.volume_utils [None req-6e42825f-1296-4018-9d87-3c78a1cfb382 tempest-CreateVolumesFromSnapshotTest-853054668 None] Volume driver (QuobyteDriver 1.2) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 16 15:26:16 devstack cinder-volume[83259]: DEBUG cinder.coordination [None req-6e42825f-1296-4018-9d87-3c78a1cfb382 tempest-CreateVolumesFromSnapshotTest-853054668 None] Acquiring lock "cinder-quobyte-eed9218a-6d1f-4192-9b58-07168a7c9d92" by "delete_volume" {{(pid=83259) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 16 15:26:16 devstack cinder-volume[83259]: DEBUG cinder.coordination [None req-c0eab8b0-9f40-464e-9b75-36741514e77b tempest-CreateVolumesFromSnapshotTest-853054668 None] Lock "cinder-9e87b1ab-d992-435d-83d1-a32eac37f0c8-delete_volume" released by "delete_volume" :: held 3.618s {{(pid=83259) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 16 15:26:16 devstack cinder-volume[83259]: DEBUG cinder.coordination [None req-6e42825f-1296-4018-9d87-3c78a1cfb382 tempest-CreateVolumesFromSnapshotTest-853054668 None] Lock "cinder-quobyte-eed9218a-6d1f-4192-9b58-07168a7c9d92" acquired by "delete_volume" :: waited 0.025s {{(pid=83259) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 16 15:26:16 devstack cinder-volume[83259]: DEBUG oslo.privsep.daemon [-] privsep: reply[52beae7e-e6b0-4751-b945-d73b1d9bb8c9]: (4, 'qcow2') {{(pid=84312) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 16 15:26:16 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [None req-6e42825f-1296-4018-9d87-3c78a1cfb382 tempest-CreateVolumesFromSnapshotTest-853054668 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c/volume-eed9218a-6d1f-4192-9b58-07168a7c9d92 {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 15:26:16 devstack quobyte-client[83286]: System call of process 100478 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 16 15:26:16 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [None req-6e42825f-1296-4018-9d87-3c78a1cfb382 tempest-CreateVolumesFromSnapshotTest-853054668 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c/volume-eed9218a-6d1f-4192-9b58-07168a7c9d92" returned: 0 in 0.628s {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 15:26:16 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [None req-6e42825f-1296-4018-9d87-3c78a1cfb382 tempest-CreateVolumesFromSnapshotTest-853054668 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c/volume-eed9218a-6d1f-4192-9b58-07168a7c9d92 {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 15:26:17 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [None req-6e42825f-1296-4018-9d87-3c78a1cfb382 tempest-CreateVolumesFromSnapshotTest-853054668 None] CMD "rm -f /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c/volume-eed9218a-6d1f-4192-9b58-07168a7c9d92" returned: 0 in 0.281s {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 15:26:17 devstack cinder-volume[83259]: DEBUG cinder.coordination [None req-6e42825f-1296-4018-9d87-3c78a1cfb382 tempest-CreateVolumesFromSnapshotTest-853054668 None] Lock "cinder-quobyte-eed9218a-6d1f-4192-9b58-07168a7c9d92" released by "delete_volume" :: held 1.164s {{(pid=83259) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 16 15:26:17 devstack sudo[100473]: pam_unix(sudo:session): session closed for user root Sep 16 15:26:17 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [None req-101e267a-7223-4d35-af33-9e8074024b2c tempest-VolumeImageDependencyTests-25375886 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_c1e8e8dc-7887-4cc1-aef8-37968c6baf5c_73q3q5xjdevstack@QuobyteHD" returned: 0 in 3.765s {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 15:26:17 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [None req-101e267a-7223-4d35-af33-9e8074024b2c tempest-VolumeImageDependencyTests-25375886 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_c1e8e8dc-7887-4cc1-aef8-37968c6baf5c_73q3q5xjdevstack@QuobyteHD {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 15:26:18 devstack cinder-volume[83259]: DEBUG cinder.quota [None req-6e42825f-1296-4018-9d87-3c78a1cfb382 tempest-CreateVolumesFromSnapshotTest-853054668 None] Created reservations ['15132224-d035-4b79-bba0-8b5d8a10654e', 'c427bc62-e9ed-464a-96b2-1e49123ea696', '83087804-1220-4f4b-b0e7-f3dc1dc30ca7', '26340c06-ac63-4cd6-89e7-31f4c8dcd113'] {{(pid=83259) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 16 15:26:18 devstack cinder-volume[83259]: DEBUG oslo_concurrency.lockutils [None req-6e42825f-1296-4018-9d87-3c78a1cfb382 tempest-CreateVolumesFromSnapshotTest-853054668 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83259) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 16 15:26:18 devstack cinder-volume[83259]: DEBUG oslo_concurrency.lockutils [None req-6e42825f-1296-4018-9d87-3c78a1cfb382 tempest-CreateVolumesFromSnapshotTest-853054668 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.008s {{(pid=83259) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 16 15:26:18 devstack cinder-volume[83259]: DEBUG cinder.volume.drivers.quobyte [None req-6e42825f-1296-4018-9d87-3c78a1cfb382 tempest-CreateVolumesFromSnapshotTest-853054668 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-61f585ac-f8e2-4d19-a890-7ebc2726cc72': None} {{(pid=83259) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:639}} Sep 16 15:26:18 devstack cinder-volume[83259]: DEBUG cinder.volume.drivers.quobyte [None req-6e42825f-1296-4018-9d87-3c78a1cfb382 tempest-CreateVolumesFromSnapshotTest-853054668 None] Available shares ['10.10.41.181/cinder-vol-61f585ac-f8e2-4d19-a890-7ebc2726cc72'] {{(pid=83259) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:669}} Sep 16 15:26:18 devstack cinder-volume[83259]: DEBUG oslo_concurrency.lockutils [None req-6e42825f-1296-4018-9d87-3c78a1cfb382 tempest-CreateVolumesFromSnapshotTest-853054668 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.058s {{(pid=83259) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 16 15:26:18 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [None req-6e42825f-1296-4018-9d87-3c78a1cfb382 tempest-CreateVolumesFromSnapshotTest-853054668 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 15:26:18 devstack sudo[100484]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_c1e8e8dc-7887-4cc1-aef8-37968c6baf5c_73q3q5xjdevstack@QuobyteHD Sep 16 15:26:18 devstack sudo[100484]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 15:26:18 devstack cinder-volume[83259]: DEBUG cinder.coordination [None req-55aa3e10-6cbf-42e9-8055-88191c5886e3 tempest-CreateVolumesFromSnapshotTest-853054668 None] Acquiring lock "cinder-5a69e104-0230-463d-a98e-3cede0895bb4-delete_volume" by "delete_volume" {{(pid=83259) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 16 15:26:19 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [None req-6e42825f-1296-4018-9d87-3c78a1cfb382 tempest-CreateVolumesFromSnapshotTest-853054668 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c" returned: 0 in 0.645s {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 15:26:19 devstack cinder-volume[83259]: DEBUG cinder.manager [None req-6e42825f-1296-4018-9d87-3c78a1cfb382 tempest-CreateVolumesFromSnapshotTest-853054668 None] Notifying Schedulers of capabilities ... {{(pid=83259) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 16 15:26:19 devstack cinder-volume[83259]: DEBUG cinder.coordination [None req-55aa3e10-6cbf-42e9-8055-88191c5886e3 tempest-CreateVolumesFromSnapshotTest-853054668 None] Lock "cinder-5a69e104-0230-463d-a98e-3cede0895bb4-delete_volume" acquired by "delete_volume" :: waited 0.265s {{(pid=83259) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 16 15:26:19 devstack cinder-volume[83259]: INFO cinder.volume.manager [None req-6e42825f-1296-4018-9d87-3c78a1cfb382 tempest-CreateVolumesFromSnapshotTest-853054668 None] Deleted volume successfully. Sep 16 15:26:19 devstack cinder-volume[83259]: DEBUG cinder.coordination [None req-6e42825f-1296-4018-9d87-3c78a1cfb382 tempest-CreateVolumesFromSnapshotTest-853054668 None] Lock "cinder-eed9218a-6d1f-4192-9b58-07168a7c9d92-delete_volume" released by "delete_volume" :: held 3.943s {{(pid=83259) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 16 15:26:19 devstack cinder-volume[83259]: WARNING cinder.volume.volume_utils [None req-55aa3e10-6cbf-42e9-8055-88191c5886e3 tempest-CreateVolumesFromSnapshotTest-853054668 None] Volume driver (QuobyteDriver 1.2) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 16 15:26:19 devstack cinder-volume[83259]: DEBUG cinder.coordination [None req-55aa3e10-6cbf-42e9-8055-88191c5886e3 tempest-CreateVolumesFromSnapshotTest-853054668 None] Acquiring lock "cinder-quobyte-5a69e104-0230-463d-a98e-3cede0895bb4" by "delete_volume" {{(pid=83259) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 16 15:26:19 devstack cinder-volume[83259]: DEBUG cinder.coordination [None req-55aa3e10-6cbf-42e9-8055-88191c5886e3 tempest-CreateVolumesFromSnapshotTest-853054668 None] Lock "cinder-quobyte-5a69e104-0230-463d-a98e-3cede0895bb4" acquired by "delete_volume" :: waited 0.012s {{(pid=83259) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 16 15:26:19 devstack cinder-volume[83259]: DEBUG oslo.privsep.daemon [-] privsep: reply[1a456b63-2d6c-4f30-bf3a-d3444a432e48]: (4, 'qcow2') {{(pid=84312) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 16 15:26:19 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [None req-55aa3e10-6cbf-42e9-8055-88191c5886e3 tempest-CreateVolumesFromSnapshotTest-853054668 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c/volume-5a69e104-0230-463d-a98e-3cede0895bb4 {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 15:26:20 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [None req-55aa3e10-6cbf-42e9-8055-88191c5886e3 tempest-CreateVolumesFromSnapshotTest-853054668 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c/volume-5a69e104-0230-463d-a98e-3cede0895bb4" returned: 0 in 0.684s {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 15:26:20 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [None req-55aa3e10-6cbf-42e9-8055-88191c5886e3 tempest-CreateVolumesFromSnapshotTest-853054668 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c/volume-5a69e104-0230-463d-a98e-3cede0895bb4 {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 15:26:20 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [None req-55aa3e10-6cbf-42e9-8055-88191c5886e3 tempest-CreateVolumesFromSnapshotTest-853054668 None] CMD "rm -f /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c/volume-5a69e104-0230-463d-a98e-3cede0895bb4" returned: 0 in 0.357s {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 15:26:20 devstack cinder-volume[83259]: DEBUG cinder.coordination [None req-55aa3e10-6cbf-42e9-8055-88191c5886e3 tempest-CreateVolumesFromSnapshotTest-853054668 None] Lock "cinder-quobyte-5a69e104-0230-463d-a98e-3cede0895bb4" released by "delete_volume" :: held 1.356s {{(pid=83259) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 16 15:26:21 devstack cinder-volume[83259]: DEBUG cinder.quota [None req-55aa3e10-6cbf-42e9-8055-88191c5886e3 tempest-CreateVolumesFromSnapshotTest-853054668 None] Created reservations ['70aafbd4-77e7-4d50-9e27-15bfc7337637', 'e099ef2a-dc9b-4024-ad36-51560c913a2a', '92d7e087-aa04-4941-a07a-94a9b943fd3d', '415e4ba5-a7ee-4227-aed3-98665944bacc'] {{(pid=83259) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 16 15:26:21 devstack cinder-volume[83259]: DEBUG oslo_concurrency.lockutils [None req-55aa3e10-6cbf-42e9-8055-88191c5886e3 tempest-CreateVolumesFromSnapshotTest-853054668 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83259) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 16 15:26:21 devstack cinder-volume[83259]: DEBUG oslo_concurrency.lockutils [None req-55aa3e10-6cbf-42e9-8055-88191c5886e3 tempest-CreateVolumesFromSnapshotTest-853054668 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=83259) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 16 15:26:21 devstack cinder-volume[83259]: DEBUG cinder.volume.drivers.quobyte [None req-55aa3e10-6cbf-42e9-8055-88191c5886e3 tempest-CreateVolumesFromSnapshotTest-853054668 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-61f585ac-f8e2-4d19-a890-7ebc2726cc72': None} {{(pid=83259) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:639}} Sep 16 15:26:21 devstack cinder-volume[83259]: DEBUG cinder.volume.drivers.quobyte [None req-55aa3e10-6cbf-42e9-8055-88191c5886e3 tempest-CreateVolumesFromSnapshotTest-853054668 None] Available shares ['10.10.41.181/cinder-vol-61f585ac-f8e2-4d19-a890-7ebc2726cc72'] {{(pid=83259) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:669}} Sep 16 15:26:21 devstack cinder-volume[83259]: DEBUG oslo_concurrency.lockutils [None req-55aa3e10-6cbf-42e9-8055-88191c5886e3 tempest-CreateVolumesFromSnapshotTest-853054668 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=83259) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 16 15:26:21 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [None req-55aa3e10-6cbf-42e9-8055-88191c5886e3 tempest-CreateVolumesFromSnapshotTest-853054668 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 15:26:21 devstack sudo[100484]: pam_unix(sudo:session): session closed for user root Sep 16 15:26:22 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [None req-101e267a-7223-4d35-af33-9e8074024b2c tempest-VolumeImageDependencyTests-25375886 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_c1e8e8dc-7887-4cc1-aef8-37968c6baf5c_73q3q5xjdevstack@QuobyteHD" returned: 1 in 4.289s {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 15:26:22 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [None req-101e267a-7223-4d35-af33-9e8074024b2c tempest-VolumeImageDependencyTests-25375886 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_c1e8e8dc-7887-4cc1-aef8-37968c6baf5c_73q3q5xjdevstack@QuobyteHD' failed. Not Retrying. {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:423}} Sep 16 15:26:22 devstack cinder-volume[83259]: DEBUG cinder.image.image_utils [None req-101e267a-7223-4d35-af33-9e8074024b2c tempest-VolumeImageDependencyTests-25375886 None] c1e8e8dc-7887-4cc1-aef8-37968c6baf5c was raw, converting to qcow2 {{(pid=83259) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1088}} Sep 16 15:26:22 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [None req-101e267a-7223-4d35-af33-9e8074024b2c tempest-VolumeImageDependencyTests-25375886 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_c1e8e8dc-7887-4cc1-aef8-37968c6baf5c_73q3q5xjdevstack@QuobyteHD /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c/volume-e1442a37-0aca-4f7a-9ffd-c3dcb64c0b07 {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 15:26:22 devstack sudo[100496]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_c1e8e8dc-7887-4cc1-aef8-37968c6baf5c_73q3q5xjdevstack@QuobyteHD /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c/volume-e1442a37-0aca-4f7a-9ffd-c3dcb64c0b07 Sep 16 15:26:22 devstack sudo[100496]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 15:26:22 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [None req-55aa3e10-6cbf-42e9-8055-88191c5886e3 tempest-CreateVolumesFromSnapshotTest-853054668 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c" returned: 0 in 0.481s {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 15:26:22 devstack cinder-volume[83259]: DEBUG cinder.manager [None req-55aa3e10-6cbf-42e9-8055-88191c5886e3 tempest-CreateVolumesFromSnapshotTest-853054668 None] Notifying Schedulers of capabilities ... {{(pid=83259) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 16 15:26:22 devstack cinder-volume[83259]: INFO cinder.volume.manager [None req-55aa3e10-6cbf-42e9-8055-88191c5886e3 tempest-CreateVolumesFromSnapshotTest-853054668 None] Deleted volume successfully. Sep 16 15:26:22 devstack cinder-volume[83259]: DEBUG cinder.coordination [None req-9ef9d995-a494-4a67-b3a6-f5502b4fbb36 tempest-CreateVolumesFromSnapshotTest-853054668 None] Acquiring lock "cinder-5fdcf1c8-bc59-42af-9700-d1581956b154-delete_snapshot" by "delete_snapshot" {{(pid=83259) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 16 15:26:22 devstack cinder-volume[83259]: DEBUG cinder.coordination [None req-9ef9d995-a494-4a67-b3a6-f5502b4fbb36 tempest-CreateVolumesFromSnapshotTest-853054668 None] Lock "cinder-5fdcf1c8-bc59-42af-9700-d1581956b154-delete_snapshot" acquired by "delete_snapshot" :: waited 0.122s {{(pid=83259) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 16 15:26:22 devstack cinder-volume[83259]: WARNING cinder.volume.volume_utils [None req-9ef9d995-a494-4a67-b3a6-f5502b4fbb36 tempest-CreateVolumesFromSnapshotTest-853054668 None] Volume driver (QuobyteDriver 1.2) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 16 15:26:22 devstack cinder-volume[83259]: DEBUG cinder.coordination [None req-9ef9d995-a494-4a67-b3a6-f5502b4fbb36 tempest-CreateVolumesFromSnapshotTest-853054668 None] Acquiring lock "cinder-quobyte-b5d13a99-d0aa-49b6-aea0-a30656b55662" by "delete_snapshot" {{(pid=83259) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 16 15:26:22 devstack cinder-volume[83259]: DEBUG cinder.coordination [None req-55aa3e10-6cbf-42e9-8055-88191c5886e3 tempest-CreateVolumesFromSnapshotTest-853054668 None] Lock "cinder-5a69e104-0230-463d-a98e-3cede0895bb4-delete_volume" released by "delete_volume" :: held 3.704s {{(pid=83259) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 16 15:26:22 devstack cinder-volume[83259]: DEBUG cinder.coordination [None req-9ef9d995-a494-4a67-b3a6-f5502b4fbb36 tempest-CreateVolumesFromSnapshotTest-853054668 None] Lock "cinder-quobyte-b5d13a99-d0aa-49b6-aea0-a30656b55662" acquired by "delete_snapshot" :: waited 0.029s {{(pid=83259) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 16 15:26:22 devstack cinder-volume[83259]: DEBUG cinder.coordination [None req-9ef9d995-a494-4a67-b3a6-f5502b4fbb36 tempest-CreateVolumesFromSnapshotTest-853054668 None] Acquiring lock "cinder-quobyte-5fdcf1c8-bc59-42af-9700-d1581956b154" by "_delete_snapshot" {{(pid=83259) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 16 15:26:22 devstack cinder-volume[83259]: DEBUG cinder.coordination [None req-9ef9d995-a494-4a67-b3a6-f5502b4fbb36 tempest-CreateVolumesFromSnapshotTest-853054668 None] Lock "cinder-quobyte-5fdcf1c8-bc59-42af-9700-d1581956b154" acquired by "_delete_snapshot" :: waited 0.015s {{(pid=83259) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 16 15:26:22 devstack cinder-volume[83259]: DEBUG cinder.volume.drivers.remotefs [None req-9ef9d995-a494-4a67-b3a6-f5502b4fbb36 tempest-CreateVolumesFromSnapshotTest-853054668 None] Deleting offline snapshot 5fdcf1c8-bc59-42af-9700-d1581956b154 of volume b5d13a99-d0aa-49b6-aea0-a30656b55662 {{(pid=83259) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1278}} Sep 16 15:26:22 devstack cinder-volume[83259]: DEBUG cinder.volume.drivers.remotefs [None req-9ef9d995-a494-4a67-b3a6-f5502b4fbb36 tempest-CreateVolumesFromSnapshotTest-853054668 None] snapshot_file for this snap is: volume-b5d13a99-d0aa-49b6-aea0-a30656b55662.5fdcf1c8-bc59-42af-9700-d1581956b154 {{(pid=83259) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1307}} Sep 16 15:26:23 devstack cinder-volume[83259]: DEBUG oslo.privsep.daemon [-] privsep: reply[ab02b3a3-c343-4f09-9c89-8d61aee28f30]: (4, 'qcow2') {{(pid=84312) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 16 15:26:23 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [None req-9ef9d995-a494-4a67-b3a6-f5502b4fbb36 tempest-CreateVolumesFromSnapshotTest-853054668 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c/volume-b5d13a99-d0aa-49b6-aea0-a30656b55662.5fdcf1c8-bc59-42af-9700-d1581956b154 {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 15:26:23 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [None req-9ef9d995-a494-4a67-b3a6-f5502b4fbb36 tempest-CreateVolumesFromSnapshotTest-853054668 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c/volume-b5d13a99-d0aa-49b6-aea0-a30656b55662.5fdcf1c8-bc59-42af-9700-d1581956b154" returned: 0 in 0.617s {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 15:26:23 devstack cinder-volume[83259]: DEBUG cinder.volume.drivers.remotefs [None req-9ef9d995-a494-4a67-b3a6-f5502b4fbb36 tempest-CreateVolumesFromSnapshotTest-853054668 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-b5d13a99-d0aa-49b6-aea0-a30656b55662(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83259) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:886}} Sep 16 15:26:23 devstack cinder-volume[83259]: DEBUG oslo.privsep.daemon [-] privsep: reply[efdd0638-25aa-44c6-a29e-29208ce70c06]: (4, 'qcow2') {{(pid=84312) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 16 15:26:23 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [None req-9ef9d995-a494-4a67-b3a6-f5502b4fbb36 tempest-CreateVolumesFromSnapshotTest-853054668 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c/volume-b5d13a99-d0aa-49b6-aea0-a30656b55662 {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 15:26:24 devstack quobyte-client[83286]: System call of process 100501 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 16 15:26:24 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [None req-9ef9d995-a494-4a67-b3a6-f5502b4fbb36 tempest-CreateVolumesFromSnapshotTest-853054668 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c/volume-b5d13a99-d0aa-49b6-aea0-a30656b55662" returned: 0 in 0.974s {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 15:26:24 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [None req-9ef9d995-a494-4a67-b3a6-f5502b4fbb36 tempest-CreateVolumesFromSnapshotTest-853054668 None] Running cmd (subprocess): qemu-img commit -d /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c/volume-b5d13a99-d0aa-49b6-aea0-a30656b55662.5fdcf1c8-bc59-42af-9700-d1581956b154 {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 15:26:25 devstack quobyte-client[83286]: System call of process 100508 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 16 15:26:25 devstack quobyte-client[83286]: System call of process 100508 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 16 15:26:25 devstack sudo[100496]: pam_unix(sudo:session): session closed for user root Sep 16 15:26:25 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [None req-9ef9d995-a494-4a67-b3a6-f5502b4fbb36 tempest-CreateVolumesFromSnapshotTest-853054668 None] CMD "qemu-img commit -d /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c/volume-b5d13a99-d0aa-49b6-aea0-a30656b55662.5fdcf1c8-bc59-42af-9700-d1581956b154" returned: 0 in 0.591s {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 15:26:25 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [None req-9ef9d995-a494-4a67-b3a6-f5502b4fbb36 tempest-CreateVolumesFromSnapshotTest-853054668 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c/volume-b5d13a99-d0aa-49b6-aea0-a30656b55662.5fdcf1c8-bc59-42af-9700-d1581956b154 {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 15:26:25 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [None req-101e267a-7223-4d35-af33-9e8074024b2c tempest-VolumeImageDependencyTests-25375886 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_c1e8e8dc-7887-4cc1-aef8-37968c6baf5c_73q3q5xjdevstack@QuobyteHD /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c/volume-e1442a37-0aca-4f7a-9ffd-c3dcb64c0b07" returned: 0 in 3.464s {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 15:26:25 devstack cinder-volume[83259]: DEBUG cinder.image.image_utils [None req-101e267a-7223-4d35-af33-9e8074024b2c tempest-VolumeImageDependencyTests-25375886 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_c1e8e8dc-7887-4cc1-aef8-37968c6baf5c_73q3q5xjdevstack@QuobyteHD, size 0.00 MB, duration 3.52 sec, destination /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c/volume-e1442a37-0aca-4f7a-9ffd-c3dcb64c0b07 {{(pid=83259) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:501}} Sep 16 15:26:25 devstack cinder-volume[83259]: INFO cinder.image.image_utils [None req-101e267a-7223-4d35-af33-9e8074024b2c tempest-VolumeImageDependencyTests-25375886 None] Converted 0.00 MB image at 0.00 MB/s Sep 16 15:26:25 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [None req-9ef9d995-a494-4a67-b3a6-f5502b4fbb36 tempest-CreateVolumesFromSnapshotTest-853054668 None] CMD "rm -f /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c/volume-b5d13a99-d0aa-49b6-aea0-a30656b55662.5fdcf1c8-bc59-42af-9700-d1581956b154" returned: 0 in 0.166s {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 15:26:25 devstack cinder-volume[83259]: DEBUG oslo.privsep.daemon [-] privsep: reply[5337458d-504c-4932-b45c-0aa6a3591c84]: (4, 'qcow2') {{(pid=84312) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 16 15:26:25 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [None req-101e267a-7223-4d35-af33-9e8074024b2c tempest-VolumeImageDependencyTests-25375886 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c/volume-e1442a37-0aca-4f7a-9ffd-c3dcb64c0b07 {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 15:26:25 devstack cinder-volume[83259]: DEBUG cinder.coordination [None req-9ef9d995-a494-4a67-b3a6-f5502b4fbb36 tempest-CreateVolumesFromSnapshotTest-853054668 None] Lock "cinder-quobyte-5fdcf1c8-bc59-42af-9700-d1581956b154" released by "_delete_snapshot" :: held 2.938s {{(pid=83259) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 16 15:26:25 devstack cinder-volume[83259]: DEBUG cinder.coordination [None req-9ef9d995-a494-4a67-b3a6-f5502b4fbb36 tempest-CreateVolumesFromSnapshotTest-853054668 None] Lock "cinder-quobyte-b5d13a99-d0aa-49b6-aea0-a30656b55662" released by "delete_snapshot" :: held 3.022s {{(pid=83259) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 16 15:26:26 devstack cinder-volume[83259]: DEBUG cinder.quota [None req-9ef9d995-a494-4a67-b3a6-f5502b4fbb36 tempest-CreateVolumesFromSnapshotTest-853054668 None] Created reservations ['832f3574-c3cd-4d8f-8717-cb8e59ddbe59', '1083734d-a406-4d53-a576-a46c4e0c4a46', 'fee296f4-8bc7-4bf5-a516-f0faa88ef040', '810a4e08-3ae0-4c4c-a9f1-d2eaea19a45f'] {{(pid=83259) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 16 15:26:26 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [None req-101e267a-7223-4d35-af33-9e8074024b2c tempest-VolumeImageDependencyTests-25375886 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c/volume-e1442a37-0aca-4f7a-9ffd-c3dcb64c0b07" returned: 0 in 0.684s {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 15:26:26 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [None req-101e267a-7223-4d35-af33-9e8074024b2c tempest-VolumeImageDependencyTests-25375886 None] Running cmd (subprocess): qemu-img resize /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c/volume-e1442a37-0aca-4f7a-9ffd-c3dcb64c0b07 1G {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 15:26:26 devstack quobyte-client[83286]: System call of process 100516 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 16 15:26:26 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [None req-101e267a-7223-4d35-af33-9e8074024b2c tempest-VolumeImageDependencyTests-25375886 None] CMD "qemu-img resize /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c/volume-e1442a37-0aca-4f7a-9ffd-c3dcb64c0b07 1G" returned: 0 in 0.385s {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 15:26:26 devstack cinder-volume[83259]: DEBUG cinder.volume.volume_utils [None req-101e267a-7223-4d35-af33-9e8074024b2c tempest-VolumeImageDependencyTests-25375886 None] Downloaded image c1e8e8dc-7887-4cc1-aef8-37968c6baf5c ((None, [{'url': 'file:///opt/stack/data/glance/images/c1e8e8dc-7887-4cc1-aef8-37968c6baf5c', 'metadata': {}}])) to volume e1442a37-0aca-4f7a-9ffd-c3dcb64c0b07 successfully. {{(pid=83259) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1234}} Sep 16 15:26:26 devstack cinder-volume[83259]: DEBUG cinder.image.image_utils [None req-101e267a-7223-4d35-af33-9e8074024b2c tempest-VolumeImageDependencyTests-25375886 None] Temporary image c1e8e8dc-7887-4cc1-aef8-37968c6baf5c for user b7026066d1834b8fb54dfd214995c7ed is deleted. {{(pid=83259) fetch /opt/stack/cinder/cinder/image/image_utils.py:1403}} Sep 16 15:26:26 devstack cinder-volume[83259]: DEBUG cinder.volume.volume_utils [None req-101e267a-7223-4d35-af33-9e8074024b2c tempest-VolumeImageDependencyTests-25375886 None] Marking volume e1442a37-0aca-4f7a-9ffd-c3dcb64c0b07 as bootable. {{(pid=83259) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1138}} Sep 16 15:26:26 devstack cinder-volume[83259]: DEBUG cinder.volume.flows.manager.create_volume [None req-101e267a-7223-4d35-af33-9e8074024b2c tempest-VolumeImageDependencyTests-25375886 None] Copying metadata from image c1e8e8dc-7887-4cc1-aef8-37968c6baf5c to e1442a37-0aca-4f7a-9ffd-c3dcb64c0b07. {{(pid=83259) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Sep 16 15:26:26 devstack cinder-volume[83259]: DEBUG cinder.volume.flows.manager.create_volume [None req-101e267a-7223-4d35-af33-9e8074024b2c tempest-VolumeImageDependencyTests-25375886 None] Creating volume glance metadata for volume e1442a37-0aca-4f7a-9ffd-c3dcb64c0b07 backed by image c1e8e8dc-7887-4cc1-aef8-37968c6baf5c with: {'image_id': 'c1e8e8dc-7887-4cc1-aef8-37968c6baf5c', 'image_name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'checksum': '01ff9feff5a03c11d9d05bae6b76fce5', 'container_format': 'bare', 'disk_format': 'raw', 'min_disk': 1, 'min_ram': 0, 'size': 1024}. {{(pid=83259) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Sep 16 15:26:27 devstack cinder-volume[83259]: INFO cinder.volume.manager [None req-9ef9d995-a494-4a67-b3a6-f5502b4fbb36 tempest-CreateVolumesFromSnapshotTest-853054668 None] Delete snapshot completed successfully. Sep 16 15:26:27 devstack cinder-volume[83259]: DEBUG cinder.coordination [None req-9ef9d995-a494-4a67-b3a6-f5502b4fbb36 tempest-CreateVolumesFromSnapshotTest-853054668 None] Lock "cinder-5fdcf1c8-bc59-42af-9700-d1581956b154-delete_snapshot" released by "delete_snapshot" :: held 4.280s {{(pid=83259) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 16 15:26:27 devstack cinder-volume[83259]: DEBUG cinder.volume.manager [None req-101e267a-7223-4d35-af33-9e8074024b2c tempest-VolumeImageDependencyTests-25375886 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (10b1f3a0-0c75-4695-b5aa-978dcef0ce88) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e1442a37-0aca-4f7a-9ffd-c3dcb64c0b07', 'volume_size': 1, 'image_id': 'c1e8e8dc-7887-4cc1-aef8-37968c6baf5c', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/c1e8e8dc-7887-4cc1-aef8-37968c6baf5c', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '01ff9feff5a03c11d9d05bae6b76fce5', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '683678bd901a42ec9487acb038532b52', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '6576905ee751186781601563d4fc2c79003824357eb5598624623ff727fbd08a8ec7eb82545c5895e0b7c91890265d56617455b6194dddfe3ad340a1324ae721', 'id': 'c1e8e8dc-7887-4cc1-aef8-37968c6baf5c', 'created_at': datetime.datetime(2025, 9, 16, 13, 25, 37, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2025, 9, 16, 13, 25, 39, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/c1e8e8dc-7887-4cc1-aef8-37968c6baf5c/file', 'properties': {}}, 'image_service': }' {{(pid=83259) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 15:26:27 devstack cinder-volume[83259]: DEBUG cinder.volume.manager [None req-101e267a-7223-4d35-af33-9e8074024b2c tempest-VolumeImageDependencyTests-25375886 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (430c61ac-dbc7-4787-852d-8c878bda5eb2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83259) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 15:26:27 devstack cinder-volume[83259]: INFO cinder.volume.flows.manager.create_volume [None req-101e267a-7223-4d35-af33-9e8074024b2c tempest-VolumeImageDependencyTests-25375886 None] Volume volume-e1442a37-0aca-4f7a-9ffd-c3dcb64c0b07 (e1442a37-0aca-4f7a-9ffd-c3dcb64c0b07): created successfully Sep 16 15:26:27 devstack cinder-volume[83259]: DEBUG cinder.volume.manager [None req-101e267a-7223-4d35-af33-9e8074024b2c tempest-VolumeImageDependencyTests-25375886 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (430c61ac-dbc7-4787-852d-8c878bda5eb2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83259) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 15:26:27 devstack cinder-volume[83259]: DEBUG cinder.volume.manager [None req-101e267a-7223-4d35-af33-9e8074024b2c tempest-VolumeImageDependencyTests-25375886 None] Flow 'volume_create_manager' (9949af42-1cf6-40e4-9522-90610496996a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83259) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 16 15:26:27 devstack cinder-volume[83259]: INFO cinder.volume.manager [None req-101e267a-7223-4d35-af33-9e8074024b2c tempest-VolumeImageDependencyTests-25375886 None] Created volume successfully. Sep 16 15:26:28 devstack cinder-volume[83259]: DEBUG cinder.coordination [None req-72bbf119-e78b-4085-8d87-62cd7fa74fae tempest-CreateVolumesFromSnapshotTest-853054668 None] Acquiring lock "cinder-b5d13a99-d0aa-49b6-aea0-a30656b55662-delete_volume" by "delete_volume" {{(pid=83259) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 16 15:26:28 devstack cinder-volume[83259]: DEBUG cinder.coordination [None req-72bbf119-e78b-4085-8d87-62cd7fa74fae tempest-CreateVolumesFromSnapshotTest-853054668 None] Lock "cinder-b5d13a99-d0aa-49b6-aea0-a30656b55662-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=83259) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 16 15:26:28 devstack cinder-volume[83259]: DEBUG cinder.coordination [None req-27fba2de-fe38-4dbf-8de5-497048ccd943 tempest-VolumeImageDependencyTests-25375886 None] Acquiring lock "cinder-e1442a37-0aca-4f7a-9ffd-c3dcb64c0b07-delete_volume" by "delete_volume" {{(pid=83259) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 16 15:26:28 devstack cinder-volume[83259]: DEBUG cinder.coordination [None req-27fba2de-fe38-4dbf-8de5-497048ccd943 tempest-VolumeImageDependencyTests-25375886 None] Lock "cinder-e1442a37-0aca-4f7a-9ffd-c3dcb64c0b07-delete_volume" acquired by "delete_volume" :: waited 0.035s {{(pid=83259) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 16 15:26:28 devstack cinder-volume[83259]: WARNING cinder.volume.volume_utils [None req-72bbf119-e78b-4085-8d87-62cd7fa74fae tempest-CreateVolumesFromSnapshotTest-853054668 None] Volume driver (QuobyteDriver 1.2) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 16 15:26:28 devstack cinder-volume[83259]: DEBUG cinder.coordination [None req-72bbf119-e78b-4085-8d87-62cd7fa74fae tempest-CreateVolumesFromSnapshotTest-853054668 None] Acquiring lock "cinder-quobyte-b5d13a99-d0aa-49b6-aea0-a30656b55662" by "delete_volume" {{(pid=83259) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 16 15:26:28 devstack cinder-volume[83259]: WARNING cinder.volume.volume_utils [None req-27fba2de-fe38-4dbf-8de5-497048ccd943 tempest-VolumeImageDependencyTests-25375886 None] Volume driver (QuobyteDriver 1.2) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 16 15:26:28 devstack cinder-volume[83259]: DEBUG cinder.coordination [None req-27fba2de-fe38-4dbf-8de5-497048ccd943 tempest-VolumeImageDependencyTests-25375886 None] Acquiring lock "cinder-quobyte-e1442a37-0aca-4f7a-9ffd-c3dcb64c0b07" by "delete_volume" {{(pid=83259) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 16 15:26:28 devstack cinder-volume[83259]: DEBUG cinder.coordination [None req-27fba2de-fe38-4dbf-8de5-497048ccd943 tempest-VolumeImageDependencyTests-25375886 None] Lock "cinder-quobyte-e1442a37-0aca-4f7a-9ffd-c3dcb64c0b07" acquired by "delete_volume" :: waited 0.016s {{(pid=83259) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 16 15:26:28 devstack cinder-volume[83259]: DEBUG cinder.coordination [None req-72bbf119-e78b-4085-8d87-62cd7fa74fae tempest-CreateVolumesFromSnapshotTest-853054668 None] Lock "cinder-quobyte-b5d13a99-d0aa-49b6-aea0-a30656b55662" acquired by "delete_volume" :: waited 0.050s {{(pid=83259) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 16 15:26:28 devstack cinder-volume[83259]: DEBUG oslo.privsep.daemon [-] privsep: reply[0f1ac69d-b272-4f01-b34e-34e6f623bede]: (4, 'qcow2') {{(pid=84312) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 16 15:26:28 devstack cinder-volume[83259]: DEBUG oslo.privsep.daemon [-] privsep: reply[67e2a6b0-34ac-4661-b8d9-71fc7bc2a3fb]: (4, 'qcow2') {{(pid=84312) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 16 15:26:28 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [None req-27fba2de-fe38-4dbf-8de5-497048ccd943 tempest-VolumeImageDependencyTests-25375886 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c/volume-e1442a37-0aca-4f7a-9ffd-c3dcb64c0b07 {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 15:26:28 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [None req-72bbf119-e78b-4085-8d87-62cd7fa74fae tempest-CreateVolumesFromSnapshotTest-853054668 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c/volume-b5d13a99-d0aa-49b6-aea0-a30656b55662 {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 15:26:28 devstack quobyte-client[83286]: System call of process 100519 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 16 15:26:28 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [None req-27fba2de-fe38-4dbf-8de5-497048ccd943 tempest-VolumeImageDependencyTests-25375886 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c/volume-e1442a37-0aca-4f7a-9ffd-c3dcb64c0b07" returned: 0 in 0.499s {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 15:26:28 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [None req-27fba2de-fe38-4dbf-8de5-497048ccd943 tempest-VolumeImageDependencyTests-25375886 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c/volume-e1442a37-0aca-4f7a-9ffd-c3dcb64c0b07 {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 15:26:29 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [None req-72bbf119-e78b-4085-8d87-62cd7fa74fae tempest-CreateVolumesFromSnapshotTest-853054668 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c/volume-b5d13a99-d0aa-49b6-aea0-a30656b55662" returned: 0 in 0.595s {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 15:26:29 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [None req-72bbf119-e78b-4085-8d87-62cd7fa74fae tempest-CreateVolumesFromSnapshotTest-853054668 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c/volume-b5d13a99-d0aa-49b6-aea0-a30656b55662 {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 15:26:29 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [None req-27fba2de-fe38-4dbf-8de5-497048ccd943 tempest-VolumeImageDependencyTests-25375886 None] CMD "rm -f /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c/volume-e1442a37-0aca-4f7a-9ffd-c3dcb64c0b07" returned: 0 in 0.260s {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 15:26:29 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [None req-72bbf119-e78b-4085-8d87-62cd7fa74fae tempest-CreateVolumesFromSnapshotTest-853054668 None] CMD "rm -f /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c/volume-b5d13a99-d0aa-49b6-aea0-a30656b55662" returned: 0 in 0.232s {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 15:26:29 devstack cinder-volume[83259]: DEBUG cinder.coordination [None req-27fba2de-fe38-4dbf-8de5-497048ccd943 tempest-VolumeImageDependencyTests-25375886 None] Lock "cinder-quobyte-e1442a37-0aca-4f7a-9ffd-c3dcb64c0b07" released by "delete_volume" :: held 1.066s {{(pid=83259) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 16 15:26:29 devstack cinder-volume[83259]: DEBUG cinder.coordination [None req-72bbf119-e78b-4085-8d87-62cd7fa74fae tempest-CreateVolumesFromSnapshotTest-853054668 None] Lock "cinder-quobyte-b5d13a99-d0aa-49b6-aea0-a30656b55662" released by "delete_volume" :: held 1.244s {{(pid=83259) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 16 15:26:29 devstack cinder-volume[83259]: DEBUG cinder.quota [None req-72bbf119-e78b-4085-8d87-62cd7fa74fae tempest-CreateVolumesFromSnapshotTest-853054668 None] Created reservations ['9c534694-96b5-4cd1-8871-b51f942e1fd8', '78d88fbc-6efd-44eb-84b8-e012a210e56f', '89be221a-f2a7-4494-869f-cd202892e41a', '52e90dd8-5b1d-4312-8948-3c07e70a07be'] {{(pid=83259) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 16 15:26:29 devstack cinder-volume[83259]: DEBUG cinder.quota [None req-27fba2de-fe38-4dbf-8de5-497048ccd943 tempest-VolumeImageDependencyTests-25375886 None] Created reservations ['a1be7acc-82bf-4c78-a71c-74e6774bd331', '3fb713a3-243b-4ed0-8767-1638b777edc7', 'f1bf32c9-b6a0-438f-8588-5d11be9694b3', '07687049-58da-417d-950a-65f2f00d2a13'] {{(pid=83259) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 16 15:26:30 devstack cinder-volume[83259]: DEBUG oslo_concurrency.lockutils [None req-27fba2de-fe38-4dbf-8de5-497048ccd943 tempest-VolumeImageDependencyTests-25375886 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83259) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 16 15:26:30 devstack cinder-volume[83259]: DEBUG oslo_concurrency.lockutils [None req-27fba2de-fe38-4dbf-8de5-497048ccd943 tempest-VolumeImageDependencyTests-25375886 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=83259) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 16 15:26:30 devstack cinder-volume[83259]: DEBUG cinder.volume.drivers.quobyte [None req-27fba2de-fe38-4dbf-8de5-497048ccd943 tempest-VolumeImageDependencyTests-25375886 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-61f585ac-f8e2-4d19-a890-7ebc2726cc72': None} {{(pid=83259) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:639}} Sep 16 15:26:30 devstack cinder-volume[83259]: DEBUG cinder.volume.drivers.quobyte [None req-27fba2de-fe38-4dbf-8de5-497048ccd943 tempest-VolumeImageDependencyTests-25375886 None] Available shares ['10.10.41.181/cinder-vol-61f585ac-f8e2-4d19-a890-7ebc2726cc72'] {{(pid=83259) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:669}} Sep 16 15:26:30 devstack cinder-volume[83259]: DEBUG oslo_concurrency.lockutils [None req-27fba2de-fe38-4dbf-8de5-497048ccd943 tempest-VolumeImageDependencyTests-25375886 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=83259) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 16 15:26:30 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [None req-27fba2de-fe38-4dbf-8de5-497048ccd943 tempest-VolumeImageDependencyTests-25375886 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 15:26:30 devstack cinder-volume[83259]: DEBUG oslo_concurrency.lockutils [None req-72bbf119-e78b-4085-8d87-62cd7fa74fae tempest-CreateVolumesFromSnapshotTest-853054668 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83259) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 16 15:26:30 devstack cinder-volume[83259]: DEBUG oslo_concurrency.lockutils [None req-72bbf119-e78b-4085-8d87-62cd7fa74fae tempest-CreateVolumesFromSnapshotTest-853054668 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.035s {{(pid=83259) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 16 15:26:30 devstack cinder-volume[83259]: DEBUG cinder.volume.drivers.quobyte [None req-72bbf119-e78b-4085-8d87-62cd7fa74fae tempest-CreateVolumesFromSnapshotTest-853054668 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-61f585ac-f8e2-4d19-a890-7ebc2726cc72': None} {{(pid=83259) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:639}} Sep 16 15:26:30 devstack cinder-volume[83259]: DEBUG cinder.volume.drivers.quobyte [None req-72bbf119-e78b-4085-8d87-62cd7fa74fae tempest-CreateVolumesFromSnapshotTest-853054668 None] Available shares ['10.10.41.181/cinder-vol-61f585ac-f8e2-4d19-a890-7ebc2726cc72'] {{(pid=83259) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:669}} Sep 16 15:26:30 devstack cinder-volume[83259]: DEBUG oslo_concurrency.lockutils [None req-72bbf119-e78b-4085-8d87-62cd7fa74fae tempest-CreateVolumesFromSnapshotTest-853054668 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.022s {{(pid=83259) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 16 15:26:30 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [None req-72bbf119-e78b-4085-8d87-62cd7fa74fae tempest-CreateVolumesFromSnapshotTest-853054668 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 15:26:30 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [None req-27fba2de-fe38-4dbf-8de5-497048ccd943 tempest-VolumeImageDependencyTests-25375886 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c" returned: 0 in 0.315s {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 15:26:30 devstack cinder-volume[83259]: DEBUG cinder.manager [None req-27fba2de-fe38-4dbf-8de5-497048ccd943 tempest-VolumeImageDependencyTests-25375886 None] Notifying Schedulers of capabilities ... {{(pid=83259) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 16 15:26:30 devstack cinder-volume[83259]: INFO cinder.volume.manager [None req-27fba2de-fe38-4dbf-8de5-497048ccd943 tempest-VolumeImageDependencyTests-25375886 None] Deleted volume successfully. Sep 16 15:26:30 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [None req-72bbf119-e78b-4085-8d87-62cd7fa74fae tempest-CreateVolumesFromSnapshotTest-853054668 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c" returned: 0 in 0.481s {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 15:26:30 devstack cinder-volume[83259]: DEBUG cinder.manager [None req-72bbf119-e78b-4085-8d87-62cd7fa74fae tempest-CreateVolumesFromSnapshotTest-853054668 None] Notifying Schedulers of capabilities ... {{(pid=83259) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 16 15:26:30 devstack cinder-volume[83259]: INFO cinder.volume.manager [None req-72bbf119-e78b-4085-8d87-62cd7fa74fae tempest-CreateVolumesFromSnapshotTest-853054668 None] Deleted volume successfully. Sep 16 15:26:30 devstack cinder-volume[83259]: DEBUG cinder.coordination [None req-27fba2de-fe38-4dbf-8de5-497048ccd943 tempest-VolumeImageDependencyTests-25375886 None] Lock "cinder-e1442a37-0aca-4f7a-9ffd-c3dcb64c0b07-delete_volume" released by "delete_volume" :: held 2.750s {{(pid=83259) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 16 15:26:30 devstack cinder-volume[83259]: DEBUG cinder.coordination [None req-72bbf119-e78b-4085-8d87-62cd7fa74fae tempest-CreateVolumesFromSnapshotTest-853054668 None] Lock "cinder-b5d13a99-d0aa-49b6-aea0-a30656b55662-delete_volume" released by "delete_volume" :: held 2.893s {{(pid=83259) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 16 15:26:35 devstack cinder-volume[83259]: WARNING cinder.volume.volume_utils [None req-24ceff67-4c23-45d2-9577-131120a3b827 tempest-CinderUnicodeTest-2029788039 None] Volume driver (QuobyteDriver 1.2) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 16 15:26:35 devstack cinder-volume[83259]: DEBUG cinder.volume.flows.manager.create_volume [None req-24ceff67-4c23-45d2-9577-131120a3b827 tempest-CinderUnicodeTest-2029788039 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#Quobyte'], 'hosts': ['devstack@QuobyteHD#Quobyte']} {{(pid=83259) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1387}} Sep 16 15:26:35 devstack cinder-volume[83259]: DEBUG cinder.volume.manager [None req-24ceff67-4c23-45d2-9577-131120a3b827 tempest-CinderUnicodeTest-2029788039 None] Flow 'volume_create_manager' (18a11b4d-3a40-4f14-baa0-e953591e014e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83259) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 16 15:26:35 devstack cinder-volume[83259]: DEBUG cinder.volume.manager [None req-24ceff67-4c23-45d2-9577-131120a3b827 tempest-CinderUnicodeTest-2029788039 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (287f7bc0-c372-40f1-9cb3-5e9387481905) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83259) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 15:26:35 devstack cinder-volume[83259]: DEBUG cinder.volume.manager [None req-24ceff67-4c23-45d2-9577-131120a3b827 tempest-CinderUnicodeTest-2029788039 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (287f7bc0-c372-40f1-9cb3-5e9387481905) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-16T13:26:35Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#Quobyte',id=009118ef-280e-4d19-89ef-d447df9a7b30,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7d535679e8f54024941d9bd68e2ec9fa',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-16T13:26:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-16T13:26:35Z,use_quota=True,user_id='935d8dc35782460da11e38358b7b4214',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(485ead50-3df8-4d76-8d34-a4db136c980a),volume_type_id=485ead50-3df8-4d76-8d34-a4db136c980a)' {{(pid=83259) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 15:26:35 devstack cinder-volume[83259]: DEBUG cinder.volume.manager [None req-24ceff67-4c23-45d2-9577-131120a3b827 tempest-CinderUnicodeTest-2029788039 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (847c2a6e-030d-4023-99f0-3ee1c9255f73) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83259) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 15:26:35 devstack cinder-volume[83259]: DEBUG cinder.volume.manager [None req-24ceff67-4c23-45d2-9577-131120a3b827 tempest-CinderUnicodeTest-2029788039 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (847c2a6e-030d-4023-99f0-3ee1c9255f73) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83259) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 15:26:35 devstack cinder-volume[83259]: DEBUG cinder.volume.manager [None req-24ceff67-4c23-45d2-9577-131120a3b827 tempest-CinderUnicodeTest-2029788039 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c29b775e-04ab-4a4b-b492-6949b73b62ac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83259) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 15:26:35 devstack cinder-volume[83259]: DEBUG cinder.volume.manager [None req-24ceff67-4c23-45d2-9577-131120a3b827 tempest-CinderUnicodeTest-2029788039 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c29b775e-04ab-4a4b-b492-6949b73b62ac) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '009118ef-280e-4d19-89ef-d447df9a7b30', 'volume_name': 'volume-009118ef-280e-4d19-89ef-d447df9a7b30', 'volume_size': 1}' {{(pid=83259) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 15:26:35 devstack cinder-volume[83259]: DEBUG cinder.volume.manager [None req-24ceff67-4c23-45d2-9577-131120a3b827 tempest-CinderUnicodeTest-2029788039 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3c61b4f8-b680-4037-b890-3bee43f0121f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83259) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 15:26:35 devstack cinder-volume[83259]: DEBUG cinder.volume.manager [None req-24ceff67-4c23-45d2-9577-131120a3b827 tempest-CinderUnicodeTest-2029788039 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3c61b4f8-b680-4037-b890-3bee43f0121f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83259) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 15:26:35 devstack cinder-volume[83259]: DEBUG cinder.volume.manager [None req-24ceff67-4c23-45d2-9577-131120a3b827 tempest-CinderUnicodeTest-2029788039 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e610e165-e6a1-4444-9f5b-7188a9af6635) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83259) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 15:26:35 devstack cinder-volume[83259]: INFO cinder.volume.flows.manager.create_volume [None req-24ceff67-4c23-45d2-9577-131120a3b827 tempest-CinderUnicodeTest-2029788039 None] Volume 009118ef-280e-4d19-89ef-d447df9a7b30: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-009118ef-280e-4d19-89ef-d447df9a7b30', 'volume_size': 1} Sep 16 15:26:35 devstack cinder-volume[83259]: DEBUG oslo_concurrency.lockutils [None req-24ceff67-4c23-45d2-9577-131120a3b827 tempest-CinderUnicodeTest-2029788039 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83259) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 16 15:26:35 devstack cinder-volume[83259]: DEBUG oslo_concurrency.lockutils [None req-24ceff67-4c23-45d2-9577-131120a3b827 tempest-CinderUnicodeTest-2029788039 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=83259) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 16 15:26:35 devstack cinder-volume[83259]: DEBUG cinder.volume.drivers.quobyte [None req-24ceff67-4c23-45d2-9577-131120a3b827 tempest-CinderUnicodeTest-2029788039 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-16T13:26:35Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#Quobyte',id=009118ef-280e-4d19-89ef-d447df9a7b30,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7d535679e8f54024941d9bd68e2ec9fa',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-16T13:26:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-16T13:26:35Z,use_quota=True,user_id='935d8dc35782460da11e38358b7b4214',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(485ead50-3df8-4d76-8d34-a4db136c980a),volume_type_id=485ead50-3df8-4d76-8d34-a4db136c980a)}" {{(pid=83259) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Sep 16 15:26:35 devstack cinder-volume[83259]: DEBUG cinder.volume.drivers.remotefs [None req-24ceff67-4c23-45d2-9577-131120a3b827 tempest-CinderUnicodeTest-2029788039 None] Creating volume 009118ef-280e-4d19-89ef-d447df9a7b30 {{(pid=83259) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}} Sep 16 15:26:35 devstack cinder-volume[83259]: DEBUG oslo_concurrency.lockutils [None req-24ceff67-4c23-45d2-9577-131120a3b827 tempest-CinderUnicodeTest-2029788039 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83259) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 16 15:26:35 devstack cinder-volume[83259]: DEBUG oslo_concurrency.lockutils [None req-24ceff67-4c23-45d2-9577-131120a3b827 tempest-CinderUnicodeTest-2029788039 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83259) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 16 15:26:35 devstack cinder-volume[83259]: DEBUG cinder.volume.drivers.quobyte [None req-24ceff67-4c23-45d2-9577-131120a3b827 tempest-CinderUnicodeTest-2029788039 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-61f585ac-f8e2-4d19-a890-7ebc2726cc72': None} {{(pid=83259) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:639}} Sep 16 15:26:35 devstack cinder-volume[83259]: DEBUG cinder.volume.drivers.quobyte [None req-24ceff67-4c23-45d2-9577-131120a3b827 tempest-CinderUnicodeTest-2029788039 None] Available shares ['10.10.41.181/cinder-vol-61f585ac-f8e2-4d19-a890-7ebc2726cc72'] {{(pid=83259) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:669}} Sep 16 15:26:35 devstack cinder-volume[83259]: DEBUG oslo_concurrency.lockutils [None req-24ceff67-4c23-45d2-9577-131120a3b827 tempest-CinderUnicodeTest-2029788039 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=83259) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 16 15:26:35 devstack cinder-volume[83259]: DEBUG cinder.volume.drivers.quobyte [None req-24ceff67-4c23-45d2-9577-131120a3b827 tempest-CinderUnicodeTest-2029788039 None] Selected 10.10.41.181/cinder-vol-61f585ac-f8e2-4d19-a890-7ebc2726cc72 as target Quobyte volume. {{(pid=83259) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:690}} Sep 16 15:26:35 devstack cinder-volume[83259]: INFO cinder.volume.drivers.remotefs [None req-24ceff67-4c23-45d2-9577-131120a3b827 tempest-CinderUnicodeTest-2029788039 None] casted to 10.10.41.181/cinder-vol-61f585ac-f8e2-4d19-a890-7ebc2726cc72 Sep 16 15:26:35 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [None req-24ceff67-4c23-45d2-9577-131120a3b827 tempest-CinderUnicodeTest-2029788039 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c/volume-009118ef-280e-4d19-89ef-d447df9a7b30 1073741824 {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 15:26:35 devstack quobyte-client[83286]: The server volume:87712ffe-8a69-446d-9ed6-4430c7ee9792@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=87712ffe-8a69-446d-9ed6-4430c7ee9792, inode=170, name=volume-009118ef-280e-4d19-89ef-d447df9a7b30, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.206), requestorAccessMask=0 Sep 16 15:26:35 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [None req-24ceff67-4c23-45d2-9577-131120a3b827 tempest-CinderUnicodeTest-2029788039 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c/volume-009118ef-280e-4d19-89ef-d447df9a7b30 1073741824" returned: 0 in 0.333s {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 15:26:35 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [None req-24ceff67-4c23-45d2-9577-131120a3b827 tempest-CinderUnicodeTest-2029788039 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c/volume-009118ef-280e-4d19-89ef-d447df9a7b30 {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 15:26:35 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [None req-24ceff67-4c23-45d2-9577-131120a3b827 tempest-CinderUnicodeTest-2029788039 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c/volume-009118ef-280e-4d19-89ef-d447df9a7b30" returned: 0 in 0.098s {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 15:26:35 devstack cinder-volume[83259]: DEBUG cinder.volume.drivers.quobyte [None req-24ceff67-4c23-45d2-9577-131120a3b827 tempest-CinderUnicodeTest-2029788039 None] <== create_volume: return (505ms) {'provider_location': '10.10.41.181/cinder-vol-61f585ac-f8e2-4d19-a890-7ebc2726cc72'} {{(pid=83259) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Sep 16 15:26:35 devstack cinder-volume[83259]: DEBUG oslo_concurrency.lockutils [None req-24ceff67-4c23-45d2-9577-131120a3b827 tempest-CinderUnicodeTest-2029788039 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.519s {{(pid=83259) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 16 15:26:36 devstack cinder-volume[83259]: DEBUG cinder.volume.manager [None req-24ceff67-4c23-45d2-9577-131120a3b827 tempest-CinderUnicodeTest-2029788039 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e610e165-e6a1-4444-9f5b-7188a9af6635) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-009118ef-280e-4d19-89ef-d447df9a7b30', 'volume_size': 1}' {{(pid=83259) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 15:26:36 devstack cinder-volume[83259]: DEBUG cinder.volume.manager [None req-24ceff67-4c23-45d2-9577-131120a3b827 tempest-CinderUnicodeTest-2029788039 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f8421db3-e485-44b7-8e6a-ec99976ade07) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83259) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 15:26:36 devstack cinder-volume[83259]: INFO cinder.volume.flows.manager.create_volume [None req-24ceff67-4c23-45d2-9577-131120a3b827 tempest-CinderUnicodeTest-2029788039 None] Volume volume-009118ef-280e-4d19-89ef-d447df9a7b30 (009118ef-280e-4d19-89ef-d447df9a7b30): created successfully Sep 16 15:26:36 devstack cinder-volume[83259]: DEBUG cinder.volume.manager [None req-24ceff67-4c23-45d2-9577-131120a3b827 tempest-CinderUnicodeTest-2029788039 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f8421db3-e485-44b7-8e6a-ec99976ade07) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83259) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 15:26:36 devstack cinder-volume[83259]: DEBUG cinder.volume.manager [None req-24ceff67-4c23-45d2-9577-131120a3b827 tempest-CinderUnicodeTest-2029788039 None] Flow 'volume_create_manager' (18a11b4d-3a40-4f14-baa0-e953591e014e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83259) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 16 15:26:36 devstack cinder-volume[83259]: INFO cinder.volume.manager [None req-24ceff67-4c23-45d2-9577-131120a3b827 tempest-CinderUnicodeTest-2029788039 None] Created volume successfully. Sep 16 15:26:37 devstack cinder-volume[83259]: WARNING cinder.volume.volume_utils [None req-be6c2621-a23a-4746-83ed-d209e4aa85d4 tempest-CinderUnicodeTest-2029788039 None] Volume driver (QuobyteDriver 1.2) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 16 15:26:37 devstack cinder-volume[83259]: DEBUG cinder.volume.flows.manager.create_volume [None req-be6c2621-a23a-4746-83ed-d209e4aa85d4 tempest-CinderUnicodeTest-2029788039 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#Quobyte'], 'hosts': ['devstack@QuobyteHD#Quobyte']} {{(pid=83259) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1387}} Sep 16 15:26:37 devstack cinder-volume[83259]: DEBUG cinder.volume.manager [None req-be6c2621-a23a-4746-83ed-d209e4aa85d4 tempest-CinderUnicodeTest-2029788039 None] Flow 'volume_create_manager' (10328df7-b2de-405a-9b35-89a285e45fe6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83259) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 16 15:26:37 devstack cinder-volume[83259]: DEBUG cinder.volume.manager [None req-be6c2621-a23a-4746-83ed-d209e4aa85d4 tempest-CinderUnicodeTest-2029788039 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2a1975c7-2164-497b-bbf4-1af41fa67d3a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83259) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 15:26:37 devstack cinder-volume[83259]: DEBUG cinder.volume.manager [None req-be6c2621-a23a-4746-83ed-d209e4aa85d4 tempest-CinderUnicodeTest-2029788039 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2a1975c7-2164-497b-bbf4-1af41fa67d3a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-16T13:26:37Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-1910572486',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#Quobyte',id=68cc05fd-6c44-443e-9982-10c13854b166,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7d535679e8f54024941d9bd68e2ec9fa',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-16T13:26:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-16T13:26:38Z,use_quota=True,user_id='935d8dc35782460da11e38358b7b4214',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(485ead50-3df8-4d76-8d34-a4db136c980a),volume_type_id=485ead50-3df8-4d76-8d34-a4db136c980a)' {{(pid=83259) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 15:26:37 devstack cinder-volume[83259]: DEBUG cinder.volume.manager [None req-be6c2621-a23a-4746-83ed-d209e4aa85d4 tempest-CinderUnicodeTest-2029788039 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0402a0b3-9ffd-4045-9e2b-6d390c69645c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83259) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 15:26:37 devstack cinder-volume[83259]: DEBUG cinder.volume.manager [None req-be6c2621-a23a-4746-83ed-d209e4aa85d4 tempest-CinderUnicodeTest-2029788039 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0402a0b3-9ffd-4045-9e2b-6d390c69645c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83259) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 15:26:37 devstack cinder-volume[83259]: DEBUG cinder.volume.manager [None req-be6c2621-a23a-4746-83ed-d209e4aa85d4 tempest-CinderUnicodeTest-2029788039 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (abbaf725-f56c-4db7-8c17-9dd01bf8171b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83259) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 15:26:37 devstack cinder-volume[83259]: DEBUG cinder.volume.manager [None req-be6c2621-a23a-4746-83ed-d209e4aa85d4 tempest-CinderUnicodeTest-2029788039 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (abbaf725-f56c-4db7-8c17-9dd01bf8171b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '68cc05fd-6c44-443e-9982-10c13854b166', 'volume_name': 'volume-68cc05fd-6c44-443e-9982-10c13854b166', 'volume_size': 1}' {{(pid=83259) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 15:26:37 devstack cinder-volume[83259]: DEBUG cinder.volume.manager [None req-be6c2621-a23a-4746-83ed-d209e4aa85d4 tempest-CinderUnicodeTest-2029788039 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dc588341-b740-405a-afbf-08c92f75f2e1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83259) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 15:26:37 devstack cinder-volume[83259]: DEBUG cinder.volume.manager [None req-be6c2621-a23a-4746-83ed-d209e4aa85d4 tempest-CinderUnicodeTest-2029788039 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dc588341-b740-405a-afbf-08c92f75f2e1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83259) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 15:26:37 devstack cinder-volume[83259]: DEBUG cinder.volume.manager [None req-be6c2621-a23a-4746-83ed-d209e4aa85d4 tempest-CinderUnicodeTest-2029788039 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (347ee888-1708-4dbd-90d8-43b5a029f194) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83259) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 15:26:37 devstack cinder-volume[83259]: INFO cinder.volume.flows.manager.create_volume [None req-be6c2621-a23a-4746-83ed-d209e4aa85d4 tempest-CinderUnicodeTest-2029788039 None] Volume 68cc05fd-6c44-443e-9982-10c13854b166: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-68cc05fd-6c44-443e-9982-10c13854b166', 'volume_size': 1} Sep 16 15:26:37 devstack cinder-volume[83259]: DEBUG oslo_concurrency.lockutils [None req-be6c2621-a23a-4746-83ed-d209e4aa85d4 tempest-CinderUnicodeTest-2029788039 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83259) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 16 15:26:37 devstack cinder-volume[83259]: DEBUG oslo_concurrency.lockutils [None req-be6c2621-a23a-4746-83ed-d209e4aa85d4 tempest-CinderUnicodeTest-2029788039 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.003s {{(pid=83259) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 16 15:26:37 devstack cinder-volume[83259]: DEBUG cinder.volume.drivers.quobyte [None req-be6c2621-a23a-4746-83ed-d209e4aa85d4 tempest-CinderUnicodeTest-2029788039 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-16T13:26:37Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-1910572486',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#Quobyte',id=68cc05fd-6c44-443e-9982-10c13854b166,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7d535679e8f54024941d9bd68e2ec9fa',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-16T13:26:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-16T13:26:38Z,use_quota=True,user_id='935d8dc35782460da11e38358b7b4214',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(485ead50-3df8-4d76-8d34-a4db136c980a),volume_type_id=485ead50-3df8-4d76-8d34-a4db136c980a)}" {{(pid=83259) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Sep 16 15:26:37 devstack cinder-volume[83259]: DEBUG cinder.volume.drivers.remotefs [None req-be6c2621-a23a-4746-83ed-d209e4aa85d4 tempest-CinderUnicodeTest-2029788039 None] Creating volume 68cc05fd-6c44-443e-9982-10c13854b166 {{(pid=83259) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}} Sep 16 15:26:37 devstack cinder-volume[83259]: DEBUG oslo_concurrency.lockutils [None req-be6c2621-a23a-4746-83ed-d209e4aa85d4 tempest-CinderUnicodeTest-2029788039 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83259) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 16 15:26:37 devstack cinder-volume[83259]: DEBUG oslo_concurrency.lockutils [None req-be6c2621-a23a-4746-83ed-d209e4aa85d4 tempest-CinderUnicodeTest-2029788039 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83259) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 16 15:26:37 devstack cinder-volume[83259]: DEBUG cinder.volume.drivers.quobyte [None req-be6c2621-a23a-4746-83ed-d209e4aa85d4 tempest-CinderUnicodeTest-2029788039 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-61f585ac-f8e2-4d19-a890-7ebc2726cc72': None} {{(pid=83259) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:639}} Sep 16 15:26:37 devstack cinder-volume[83259]: DEBUG cinder.volume.drivers.quobyte [None req-be6c2621-a23a-4746-83ed-d209e4aa85d4 tempest-CinderUnicodeTest-2029788039 None] Available shares ['10.10.41.181/cinder-vol-61f585ac-f8e2-4d19-a890-7ebc2726cc72'] {{(pid=83259) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:669}} Sep 16 15:26:37 devstack cinder-volume[83259]: DEBUG oslo_concurrency.lockutils [None req-be6c2621-a23a-4746-83ed-d209e4aa85d4 tempest-CinderUnicodeTest-2029788039 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=83259) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 16 15:26:37 devstack cinder-volume[83259]: DEBUG cinder.volume.drivers.quobyte [None req-be6c2621-a23a-4746-83ed-d209e4aa85d4 tempest-CinderUnicodeTest-2029788039 None] Selected 10.10.41.181/cinder-vol-61f585ac-f8e2-4d19-a890-7ebc2726cc72 as target Quobyte volume. {{(pid=83259) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:690}} Sep 16 15:26:37 devstack cinder-volume[83259]: INFO cinder.volume.drivers.remotefs [None req-be6c2621-a23a-4746-83ed-d209e4aa85d4 tempest-CinderUnicodeTest-2029788039 None] casted to 10.10.41.181/cinder-vol-61f585ac-f8e2-4d19-a890-7ebc2726cc72 Sep 16 15:26:37 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [None req-be6c2621-a23a-4746-83ed-d209e4aa85d4 tempest-CinderUnicodeTest-2029788039 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c/volume-68cc05fd-6c44-443e-9982-10c13854b166 1073741824 {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 15:26:38 devstack quobyte-client[83286]: System call of process 100537 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 16 15:26:38 devstack quobyte-client[83286]: The server volume:87712ffe-8a69-446d-9ed6-4430c7ee9792@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=87712ffe-8a69-446d-9ed6-4430c7ee9792, inode=171, name=volume-68cc05fd-6c44-443e-9982-10c13854b166, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.206), requestorAccessMask=0 Sep 16 15:26:38 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [None req-be6c2621-a23a-4746-83ed-d209e4aa85d4 tempest-CinderUnicodeTest-2029788039 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c/volume-68cc05fd-6c44-443e-9982-10c13854b166 1073741824" returned: 0 in 0.322s {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 15:26:38 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [None req-be6c2621-a23a-4746-83ed-d209e4aa85d4 tempest-CinderUnicodeTest-2029788039 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c/volume-68cc05fd-6c44-443e-9982-10c13854b166 {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 15:26:38 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [None req-be6c2621-a23a-4746-83ed-d209e4aa85d4 tempest-CinderUnicodeTest-2029788039 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c/volume-68cc05fd-6c44-443e-9982-10c13854b166" returned: 0 in 0.097s {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 15:26:38 devstack cinder-volume[83259]: DEBUG cinder.volume.drivers.quobyte [None req-be6c2621-a23a-4746-83ed-d209e4aa85d4 tempest-CinderUnicodeTest-2029788039 None] <== create_volume: return (485ms) {'provider_location': '10.10.41.181/cinder-vol-61f585ac-f8e2-4d19-a890-7ebc2726cc72'} {{(pid=83259) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Sep 16 15:26:38 devstack cinder-volume[83259]: DEBUG oslo_concurrency.lockutils [None req-be6c2621-a23a-4746-83ed-d209e4aa85d4 tempest-CinderUnicodeTest-2029788039 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.500s {{(pid=83259) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 16 15:26:38 devstack cinder-volume[83259]: DEBUG cinder.volume.manager [None req-be6c2621-a23a-4746-83ed-d209e4aa85d4 tempest-CinderUnicodeTest-2029788039 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (347ee888-1708-4dbd-90d8-43b5a029f194) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-68cc05fd-6c44-443e-9982-10c13854b166', 'volume_size': 1}' {{(pid=83259) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 15:26:38 devstack cinder-volume[83259]: DEBUG cinder.volume.manager [None req-be6c2621-a23a-4746-83ed-d209e4aa85d4 tempest-CinderUnicodeTest-2029788039 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8362138b-600d-40f8-a994-21279486426a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83259) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 15:26:38 devstack cinder-volume[83259]: INFO cinder.volume.flows.manager.create_volume [None req-be6c2621-a23a-4746-83ed-d209e4aa85d4 tempest-CinderUnicodeTest-2029788039 None] Volume volume-68cc05fd-6c44-443e-9982-10c13854b166 (68cc05fd-6c44-443e-9982-10c13854b166): created successfully Sep 16 15:26:38 devstack cinder-volume[83259]: DEBUG cinder.volume.manager [None req-be6c2621-a23a-4746-83ed-d209e4aa85d4 tempest-CinderUnicodeTest-2029788039 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8362138b-600d-40f8-a994-21279486426a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83259) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 15:26:38 devstack cinder-volume[83259]: DEBUG cinder.volume.manager [None req-be6c2621-a23a-4746-83ed-d209e4aa85d4 tempest-CinderUnicodeTest-2029788039 None] Flow 'volume_create_manager' (10328df7-b2de-405a-9b35-89a285e45fe6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83259) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 16 15:26:38 devstack cinder-volume[83259]: INFO cinder.volume.manager [None req-be6c2621-a23a-4746-83ed-d209e4aa85d4 tempest-CinderUnicodeTest-2029788039 None] Created volume successfully. Sep 16 15:26:40 devstack cinder-volume[83259]: WARNING cinder.volume.volume_utils [None req-aed0d66d-7e80-481f-9581-ac7fa36d9c6d tempest-CinderUnicodeTest-2029788039 None] Volume driver (QuobyteDriver 1.2) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 16 15:26:40 devstack cinder-volume[83259]: DEBUG oslo_concurrency.lockutils [None req-aed0d66d-7e80-481f-9581-ac7fa36d9c6d tempest-CinderUnicodeTest-2029788039 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=83259) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 16 15:26:40 devstack cinder-volume[83259]: DEBUG oslo_concurrency.lockutils [None req-aed0d66d-7e80-481f-9581-ac7fa36d9c6d tempest-CinderUnicodeTest-2029788039 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.004s {{(pid=83259) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 16 15:26:40 devstack cinder-volume[83259]: DEBUG cinder.volume.drivers.remotefs [None req-aed0d66d-7e80-481f-9581-ac7fa36d9c6d tempest-CinderUnicodeTest-2029788039 None] Creating offline snapshot ad8a5db2-c740-4d5e-b9c5-8f263cbd2f94 of volume 68cc05fd-6c44-443e-9982-10c13854b166 {{(pid=83259) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1694}} Sep 16 15:26:40 devstack cinder-volume[83259]: DEBUG oslo.privsep.daemon [-] privsep: reply[bd78ca52-65c9-4a6c-a0f3-0958786a417e]: (4, 'qcow2') {{(pid=84312) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 16 15:26:40 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [None req-aed0d66d-7e80-481f-9581-ac7fa36d9c6d tempest-CinderUnicodeTest-2029788039 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c/volume-68cc05fd-6c44-443e-9982-10c13854b166 {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 15:26:40 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [None req-aed0d66d-7e80-481f-9581-ac7fa36d9c6d tempest-CinderUnicodeTest-2029788039 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c/volume-68cc05fd-6c44-443e-9982-10c13854b166" returned: 0 in 0.475s {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 15:26:40 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [None req-aed0d66d-7e80-481f-9581-ac7fa36d9c6d tempest-CinderUnicodeTest-2029788039 None] Running cmd (subprocess): qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c/volume-68cc05fd-6c44-443e-9982-10c13854b166,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c/volume-68cc05fd-6c44-443e-9982-10c13854b166.ad8a5db2-c740-4d5e-b9c5-8f263cbd2f94 1G {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 15:26:41 devstack quobyte-client[83286]: The server volume:87712ffe-8a69-446d-9ed6-4430c7ee9792@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=87712ffe-8a69-446d-9ed6-4430c7ee9792, inode=172, name=volume-68cc05fd-6c44-443e-9982-10c13854b166.ad8a5db2-c740-4d5e-b9c5-8f263cbd2f94, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.206), requestorAccessMask=0 Sep 16 15:26:41 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [None req-aed0d66d-7e80-481f-9581-ac7fa36d9c6d tempest-CinderUnicodeTest-2029788039 None] CMD "qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c/volume-68cc05fd-6c44-443e-9982-10c13854b166,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c/volume-68cc05fd-6c44-443e-9982-10c13854b166.ad8a5db2-c740-4d5e-b9c5-8f263cbd2f94 1G" returned: 0 in 0.233s {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 15:26:41 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [None req-aed0d66d-7e80-481f-9581-ac7fa36d9c6d tempest-CinderUnicodeTest-2029788039 None] Running cmd (subprocess): qemu-img rebase -u -b volume-68cc05fd-6c44-443e-9982-10c13854b166 -F qcow2 /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c/volume-68cc05fd-6c44-443e-9982-10c13854b166.ad8a5db2-c740-4d5e-b9c5-8f263cbd2f94 {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 15:26:41 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [None req-aed0d66d-7e80-481f-9581-ac7fa36d9c6d tempest-CinderUnicodeTest-2029788039 None] CMD "qemu-img rebase -u -b volume-68cc05fd-6c44-443e-9982-10c13854b166 -F qcow2 /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c/volume-68cc05fd-6c44-443e-9982-10c13854b166.ad8a5db2-c740-4d5e-b9c5-8f263cbd2f94" returned: 0 in 0.136s {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 15:26:41 devstack cinder-volume[83259]: DEBUG cinder.volume.drivers.remotefs [None req-aed0d66d-7e80-481f-9581-ac7fa36d9c6d tempest-CinderUnicodeTest-2029788039 None] File path /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c/volume-68cc05fd-6c44-443e-9982-10c13854b166.ad8a5db2-c740-4d5e-b9c5-8f263cbd2f94 is being set with permissions: 660 {{(pid=83259) _set_rw_permissions /opt/stack/cinder/cinder/volume/drivers/remotefs.py:492}} Sep 16 15:26:41 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [None req-aed0d66d-7e80-481f-9581-ac7fa36d9c6d tempest-CinderUnicodeTest-2029788039 None] Running cmd (subprocess): chmod 660 /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c/volume-68cc05fd-6c44-443e-9982-10c13854b166.ad8a5db2-c740-4d5e-b9c5-8f263cbd2f94 {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 15:26:41 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [None req-aed0d66d-7e80-481f-9581-ac7fa36d9c6d tempest-CinderUnicodeTest-2029788039 None] CMD "chmod 660 /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c/volume-68cc05fd-6c44-443e-9982-10c13854b166.ad8a5db2-c740-4d5e-b9c5-8f263cbd2f94" returned: 0 in 0.085s {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 15:26:41 devstack cinder-volume[83259]: DEBUG cinder.volume.drivers.remotefs [None req-aed0d66d-7e80-481f-9581-ac7fa36d9c6d tempest-CinderUnicodeTest-2029788039 None] Setting permissions: /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c/volume-68cc05fd-6c44-443e-9982-10c13854b166 -> 1000:1000 {{(pid=83259) _do_create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1584}} Sep 16 15:26:41 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [None req-aed0d66d-7e80-481f-9581-ac7fa36d9c6d tempest-CinderUnicodeTest-2029788039 None] Running cmd (subprocess): chown --reference=/opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c/volume-68cc05fd-6c44-443e-9982-10c13854b166 /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c/volume-68cc05fd-6c44-443e-9982-10c13854b166.ad8a5db2-c740-4d5e-b9c5-8f263cbd2f94 {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 15:26:41 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [None req-aed0d66d-7e80-481f-9581-ac7fa36d9c6d tempest-CinderUnicodeTest-2029788039 None] CMD "chown --reference=/opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c/volume-68cc05fd-6c44-443e-9982-10c13854b166 /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c/volume-68cc05fd-6c44-443e-9982-10c13854b166.ad8a5db2-c740-4d5e-b9c5-8f263cbd2f94" returned: 0 in 0.105s {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 15:26:41 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [None req-aed0d66d-7e80-481f-9581-ac7fa36d9c6d tempest-CinderUnicodeTest-2029788039 None] Running cmd (subprocess): truncate -s0 /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c/volume-68cc05fd-6c44-443e-9982-10c13854b166.info {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 15:26:41 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [None req-aed0d66d-7e80-481f-9581-ac7fa36d9c6d tempest-CinderUnicodeTest-2029788039 None] CMD "truncate -s0 /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c/volume-68cc05fd-6c44-443e-9982-10c13854b166.info" returned: 0 in 0.090s {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 15:26:41 devstack cinder-volume[83259]: DEBUG cinder.volume.drivers.remotefs [None req-aed0d66d-7e80-481f-9581-ac7fa36d9c6d tempest-CinderUnicodeTest-2029788039 None] File path /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c/volume-68cc05fd-6c44-443e-9982-10c13854b166.info is being set with permissions: 660 {{(pid=83259) _set_rw_permissions /opt/stack/cinder/cinder/volume/drivers/remotefs.py:492}} Sep 16 15:26:41 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [None req-aed0d66d-7e80-481f-9581-ac7fa36d9c6d tempest-CinderUnicodeTest-2029788039 None] Running cmd (subprocess): chmod 660 /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c/volume-68cc05fd-6c44-443e-9982-10c13854b166.info {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 15:26:41 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [None req-aed0d66d-7e80-481f-9581-ac7fa36d9c6d tempest-CinderUnicodeTest-2029788039 None] CMD "chmod 660 /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c/volume-68cc05fd-6c44-443e-9982-10c13854b166.info" returned: 0 in 0.083s {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 15:26:41 devstack cinder-volume[83259]: DEBUG oslo_concurrency.lockutils [None req-aed0d66d-7e80-481f-9581-ac7fa36d9c6d tempest-CinderUnicodeTest-2029788039 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.587s {{(pid=83259) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 16 15:26:42 devstack cinder-volume[83259]: INFO cinder.volume.manager [None req-aed0d66d-7e80-481f-9581-ac7fa36d9c6d tempest-CinderUnicodeTest-2029788039 None] Create snapshot completed successfully Sep 16 15:26:42 devstack cinder-volume[83259]: DEBUG cinder.coordination [None req-f4757d99-bdbb-45de-bf40-54beae53cc71 tempest-CinderUnicodeTest-2029788039 None] Acquiring lock "cinder-ad8a5db2-c740-4d5e-b9c5-8f263cbd2f94-delete_snapshot" by "delete_snapshot" {{(pid=83259) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 16 15:26:42 devstack cinder-volume[83259]: DEBUG cinder.coordination [None req-f4757d99-bdbb-45de-bf40-54beae53cc71 tempest-CinderUnicodeTest-2029788039 None] Lock "cinder-ad8a5db2-c740-4d5e-b9c5-8f263cbd2f94-delete_snapshot" acquired by "delete_snapshot" :: waited 0.054s {{(pid=83259) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 16 15:26:42 devstack cinder-volume[83259]: WARNING cinder.volume.volume_utils [None req-f4757d99-bdbb-45de-bf40-54beae53cc71 tempest-CinderUnicodeTest-2029788039 None] Volume driver (QuobyteDriver 1.2) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 16 15:26:42 devstack cinder-volume[83259]: DEBUG cinder.coordination [None req-f4757d99-bdbb-45de-bf40-54beae53cc71 tempest-CinderUnicodeTest-2029788039 None] Acquiring lock "cinder-quobyte-68cc05fd-6c44-443e-9982-10c13854b166" by "delete_snapshot" {{(pid=83259) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 16 15:26:42 devstack cinder-volume[83259]: DEBUG cinder.coordination [None req-f4757d99-bdbb-45de-bf40-54beae53cc71 tempest-CinderUnicodeTest-2029788039 None] Lock "cinder-quobyte-68cc05fd-6c44-443e-9982-10c13854b166" acquired by "delete_snapshot" :: waited 0.010s {{(pid=83259) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 16 15:26:42 devstack cinder-volume[83259]: DEBUG cinder.coordination [None req-f4757d99-bdbb-45de-bf40-54beae53cc71 tempest-CinderUnicodeTest-2029788039 None] Acquiring lock "cinder-quobyte-ad8a5db2-c740-4d5e-b9c5-8f263cbd2f94" by "_delete_snapshot" {{(pid=83259) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 16 15:26:42 devstack cinder-volume[83259]: DEBUG cinder.coordination [None req-f4757d99-bdbb-45de-bf40-54beae53cc71 tempest-CinderUnicodeTest-2029788039 None] Lock "cinder-quobyte-ad8a5db2-c740-4d5e-b9c5-8f263cbd2f94" acquired by "_delete_snapshot" :: waited 0.011s {{(pid=83259) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 16 15:26:42 devstack cinder-volume[83259]: DEBUG cinder.volume.drivers.remotefs [None req-f4757d99-bdbb-45de-bf40-54beae53cc71 tempest-CinderUnicodeTest-2029788039 None] Deleting offline snapshot ad8a5db2-c740-4d5e-b9c5-8f263cbd2f94 of volume 68cc05fd-6c44-443e-9982-10c13854b166 {{(pid=83259) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1278}} Sep 16 15:26:42 devstack cinder-volume[83259]: DEBUG cinder.volume.drivers.remotefs [None req-f4757d99-bdbb-45de-bf40-54beae53cc71 tempest-CinderUnicodeTest-2029788039 None] snapshot_file for this snap is: volume-68cc05fd-6c44-443e-9982-10c13854b166.ad8a5db2-c740-4d5e-b9c5-8f263cbd2f94 {{(pid=83259) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1307}} Sep 16 15:26:42 devstack cinder-volume[83259]: DEBUG oslo.privsep.daemon [-] privsep: reply[ffe7ba42-2e88-484d-8b8e-34f23eb44ecf]: (4, 'qcow2') {{(pid=84312) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 16 15:26:42 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [None req-f4757d99-bdbb-45de-bf40-54beae53cc71 tempest-CinderUnicodeTest-2029788039 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c/volume-68cc05fd-6c44-443e-9982-10c13854b166.ad8a5db2-c740-4d5e-b9c5-8f263cbd2f94 {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 15:26:42 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [None req-f4757d99-bdbb-45de-bf40-54beae53cc71 tempest-CinderUnicodeTest-2029788039 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c/volume-68cc05fd-6c44-443e-9982-10c13854b166.ad8a5db2-c740-4d5e-b9c5-8f263cbd2f94" returned: 0 in 0.400s {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 15:26:42 devstack cinder-volume[83259]: DEBUG cinder.volume.drivers.remotefs [None req-f4757d99-bdbb-45de-bf40-54beae53cc71 tempest-CinderUnicodeTest-2029788039 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-68cc05fd-6c44-443e-9982-10c13854b166(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83259) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:886}} Sep 16 15:26:42 devstack cinder-volume[83259]: DEBUG oslo.privsep.daemon [-] privsep: reply[ea634f84-d0b1-44fc-a814-7cc99ed11c88]: (4, 'qcow2') {{(pid=84312) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 16 15:26:42 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [None req-f4757d99-bdbb-45de-bf40-54beae53cc71 tempest-CinderUnicodeTest-2029788039 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c/volume-68cc05fd-6c44-443e-9982-10c13854b166 {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 15:26:43 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [None req-f4757d99-bdbb-45de-bf40-54beae53cc71 tempest-CinderUnicodeTest-2029788039 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c/volume-68cc05fd-6c44-443e-9982-10c13854b166" returned: 0 in 0.379s {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 15:26:43 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [None req-f4757d99-bdbb-45de-bf40-54beae53cc71 tempest-CinderUnicodeTest-2029788039 None] Running cmd (subprocess): qemu-img commit -d /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c/volume-68cc05fd-6c44-443e-9982-10c13854b166.ad8a5db2-c740-4d5e-b9c5-8f263cbd2f94 {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 15:26:43 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [None req-f4757d99-bdbb-45de-bf40-54beae53cc71 tempest-CinderUnicodeTest-2029788039 None] CMD "qemu-img commit -d /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c/volume-68cc05fd-6c44-443e-9982-10c13854b166.ad8a5db2-c740-4d5e-b9c5-8f263cbd2f94" returned: 0 in 0.191s {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 15:26:43 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [None req-f4757d99-bdbb-45de-bf40-54beae53cc71 tempest-CinderUnicodeTest-2029788039 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c/volume-68cc05fd-6c44-443e-9982-10c13854b166.ad8a5db2-c740-4d5e-b9c5-8f263cbd2f94 {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 15:26:43 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [None req-f4757d99-bdbb-45de-bf40-54beae53cc71 tempest-CinderUnicodeTest-2029788039 None] CMD "rm -f /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c/volume-68cc05fd-6c44-443e-9982-10c13854b166.ad8a5db2-c740-4d5e-b9c5-8f263cbd2f94" returned: 0 in 0.099s {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 15:26:43 devstack cinder-volume[83259]: DEBUG cinder.coordination [None req-f4757d99-bdbb-45de-bf40-54beae53cc71 tempest-CinderUnicodeTest-2029788039 None] Lock "cinder-quobyte-ad8a5db2-c740-4d5e-b9c5-8f263cbd2f94" released by "_delete_snapshot" :: held 1.393s {{(pid=83259) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 16 15:26:43 devstack cinder-volume[83259]: DEBUG cinder.coordination [None req-f4757d99-bdbb-45de-bf40-54beae53cc71 tempest-CinderUnicodeTest-2029788039 None] Lock "cinder-quobyte-68cc05fd-6c44-443e-9982-10c13854b166" released by "delete_snapshot" :: held 1.416s {{(pid=83259) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 16 15:26:44 devstack cinder-volume[83259]: DEBUG cinder.quota [None req-f4757d99-bdbb-45de-bf40-54beae53cc71 tempest-CinderUnicodeTest-2029788039 None] Created reservations ['64618364-0986-4da2-bde7-c6afe61bfd54', 'bc6bc618-d6cd-4a35-a1e7-d507dc7551eb', 'b0353680-50f3-4ab5-a1f5-542f9e80b4e8', '23e740e3-7c46-4f7d-b2bc-29de4e30a4b7'] {{(pid=83259) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 16 15:26:44 devstack cinder-volume[83259]: INFO cinder.volume.manager [None req-f4757d99-bdbb-45de-bf40-54beae53cc71 tempest-CinderUnicodeTest-2029788039 None] Delete snapshot completed successfully. Sep 16 15:26:44 devstack cinder-volume[83259]: DEBUG cinder.coordination [None req-f4757d99-bdbb-45de-bf40-54beae53cc71 tempest-CinderUnicodeTest-2029788039 None] Lock "cinder-ad8a5db2-c740-4d5e-b9c5-8f263cbd2f94-delete_snapshot" released by "delete_snapshot" :: held 1.832s {{(pid=83259) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 16 15:26:44 devstack cinder-volume[83259]: DEBUG cinder.coordination [None req-681b3176-64d5-48cd-bfe8-221f989456a6 tempest-CinderUnicodeTest-2029788039 None] Acquiring lock "cinder-68cc05fd-6c44-443e-9982-10c13854b166-delete_volume" by "delete_volume" {{(pid=83259) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 16 15:26:44 devstack cinder-volume[83259]: DEBUG cinder.coordination [None req-681b3176-64d5-48cd-bfe8-221f989456a6 tempest-CinderUnicodeTest-2029788039 None] Lock "cinder-68cc05fd-6c44-443e-9982-10c13854b166-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=83259) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 16 15:26:44 devstack cinder-volume[83259]: WARNING cinder.volume.volume_utils [None req-681b3176-64d5-48cd-bfe8-221f989456a6 tempest-CinderUnicodeTest-2029788039 None] Volume driver (QuobyteDriver 1.2) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 16 15:26:44 devstack cinder-volume[83259]: DEBUG cinder.coordination [None req-681b3176-64d5-48cd-bfe8-221f989456a6 tempest-CinderUnicodeTest-2029788039 None] Acquiring lock "cinder-quobyte-68cc05fd-6c44-443e-9982-10c13854b166" by "delete_volume" {{(pid=83259) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 16 15:26:44 devstack cinder-volume[83259]: DEBUG cinder.coordination [None req-681b3176-64d5-48cd-bfe8-221f989456a6 tempest-CinderUnicodeTest-2029788039 None] Lock "cinder-quobyte-68cc05fd-6c44-443e-9982-10c13854b166" acquired by "delete_volume" :: waited 0.017s {{(pid=83259) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 16 15:26:44 devstack cinder-volume[83259]: DEBUG oslo.privsep.daemon [-] privsep: reply[5eb15dac-9781-4a0f-985a-6c3405e648b4]: (4, 'qcow2') {{(pid=84312) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 16 15:26:44 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [None req-681b3176-64d5-48cd-bfe8-221f989456a6 tempest-CinderUnicodeTest-2029788039 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c/volume-68cc05fd-6c44-443e-9982-10c13854b166 {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 15:26:45 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [None req-681b3176-64d5-48cd-bfe8-221f989456a6 tempest-CinderUnicodeTest-2029788039 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c/volume-68cc05fd-6c44-443e-9982-10c13854b166" returned: 0 in 0.450s {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 15:26:45 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [None req-681b3176-64d5-48cd-bfe8-221f989456a6 tempest-CinderUnicodeTest-2029788039 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c/volume-68cc05fd-6c44-443e-9982-10c13854b166 {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 15:26:45 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [None req-681b3176-64d5-48cd-bfe8-221f989456a6 tempest-CinderUnicodeTest-2029788039 None] CMD "rm -f /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c/volume-68cc05fd-6c44-443e-9982-10c13854b166" returned: 0 in 0.124s {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 15:26:45 devstack cinder-volume[83259]: DEBUG cinder.coordination [None req-681b3176-64d5-48cd-bfe8-221f989456a6 tempest-CinderUnicodeTest-2029788039 None] Lock "cinder-quobyte-68cc05fd-6c44-443e-9982-10c13854b166" released by "delete_volume" :: held 0.759s {{(pid=83259) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 16 15:26:45 devstack cinder-volume[83259]: DEBUG cinder.quota [None req-681b3176-64d5-48cd-bfe8-221f989456a6 tempest-CinderUnicodeTest-2029788039 None] Created reservations ['82171eb2-c7cf-494a-9968-a7694f8ae6c3', '6d5baca2-4c1b-4f67-8af1-a57b0c8514f9', '932563e2-55c2-40e0-86eb-458756223752', '22d8010f-e06e-4d29-a629-84dcf942f02e'] {{(pid=83259) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 16 15:26:46 devstack cinder-volume[83259]: DEBUG oslo_concurrency.lockutils [None req-681b3176-64d5-48cd-bfe8-221f989456a6 tempest-CinderUnicodeTest-2029788039 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83259) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 16 15:26:46 devstack cinder-volume[83259]: DEBUG oslo_concurrency.lockutils [None req-681b3176-64d5-48cd-bfe8-221f989456a6 tempest-CinderUnicodeTest-2029788039 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=83259) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 16 15:26:46 devstack cinder-volume[83259]: DEBUG cinder.volume.drivers.quobyte [None req-681b3176-64d5-48cd-bfe8-221f989456a6 tempest-CinderUnicodeTest-2029788039 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-61f585ac-f8e2-4d19-a890-7ebc2726cc72': None} {{(pid=83259) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:639}} Sep 16 15:26:46 devstack cinder-volume[83259]: DEBUG cinder.volume.drivers.quobyte [None req-681b3176-64d5-48cd-bfe8-221f989456a6 tempest-CinderUnicodeTest-2029788039 None] Available shares ['10.10.41.181/cinder-vol-61f585ac-f8e2-4d19-a890-7ebc2726cc72'] {{(pid=83259) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:669}} Sep 16 15:26:46 devstack cinder-volume[83259]: DEBUG oslo_concurrency.lockutils [None req-681b3176-64d5-48cd-bfe8-221f989456a6 tempest-CinderUnicodeTest-2029788039 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=83259) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 16 15:26:46 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [None req-681b3176-64d5-48cd-bfe8-221f989456a6 tempest-CinderUnicodeTest-2029788039 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 15:26:46 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [None req-681b3176-64d5-48cd-bfe8-221f989456a6 tempest-CinderUnicodeTest-2029788039 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c" returned: 0 in 0.101s {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 15:26:46 devstack cinder-volume[83259]: DEBUG cinder.manager [None req-681b3176-64d5-48cd-bfe8-221f989456a6 tempest-CinderUnicodeTest-2029788039 None] Notifying Schedulers of capabilities ... {{(pid=83259) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 16 15:26:46 devstack cinder-volume[83259]: INFO cinder.volume.manager [None req-681b3176-64d5-48cd-bfe8-221f989456a6 tempest-CinderUnicodeTest-2029788039 None] Deleted volume successfully. Sep 16 15:26:46 devstack cinder-volume[83259]: DEBUG cinder.coordination [None req-681b3176-64d5-48cd-bfe8-221f989456a6 tempest-CinderUnicodeTest-2029788039 None] Lock "cinder-68cc05fd-6c44-443e-9982-10c13854b166-delete_volume" released by "delete_volume" :: held 1.848s {{(pid=83259) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 16 15:26:46 devstack cinder-volume[83259]: DEBUG cinder.coordination [None req-79ae8f1c-a557-4678-96d6-38b19299d4d0 tempest-CinderUnicodeTest-2029788039 None] Acquiring lock "cinder-009118ef-280e-4d19-89ef-d447df9a7b30-delete_volume" by "delete_volume" {{(pid=83259) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 16 15:26:46 devstack cinder-volume[83259]: DEBUG cinder.coordination [None req-79ae8f1c-a557-4678-96d6-38b19299d4d0 tempest-CinderUnicodeTest-2029788039 None] Lock "cinder-009118ef-280e-4d19-89ef-d447df9a7b30-delete_volume" acquired by "delete_volume" :: waited 0.039s {{(pid=83259) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 16 15:26:47 devstack cinder-volume[83259]: WARNING cinder.volume.volume_utils [None req-79ae8f1c-a557-4678-96d6-38b19299d4d0 tempest-CinderUnicodeTest-2029788039 None] Volume driver (QuobyteDriver 1.2) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 16 15:26:47 devstack cinder-volume[83259]: DEBUG cinder.coordination [None req-79ae8f1c-a557-4678-96d6-38b19299d4d0 tempest-CinderUnicodeTest-2029788039 None] Acquiring lock "cinder-quobyte-009118ef-280e-4d19-89ef-d447df9a7b30" by "delete_volume" {{(pid=83259) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 16 15:26:47 devstack cinder-volume[83259]: DEBUG cinder.coordination [None req-79ae8f1c-a557-4678-96d6-38b19299d4d0 tempest-CinderUnicodeTest-2029788039 None] Lock "cinder-quobyte-009118ef-280e-4d19-89ef-d447df9a7b30" acquired by "delete_volume" :: waited 0.012s {{(pid=83259) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 16 15:26:47 devstack cinder-volume[83259]: DEBUG oslo.privsep.daemon [-] privsep: reply[492c4492-c7a3-4b93-add2-99cd1703f49a]: (4, 'qcow2') {{(pid=84312) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 16 15:26:47 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [None req-79ae8f1c-a557-4678-96d6-38b19299d4d0 tempest-CinderUnicodeTest-2029788039 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c/volume-009118ef-280e-4d19-89ef-d447df9a7b30 {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 15:26:47 devstack cinder-volume[83259]: DEBUG oslo_service.periodic_task [None req-050ec8a1-6ffd-499d-95ad-d548a84437e2 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=83259) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} Sep 16 15:26:47 devstack cinder-volume[83259]: DEBUG oslo_concurrency.lockutils [None req-050ec8a1-6ffd-499d-95ad-d548a84437e2 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83259) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 16 15:26:47 devstack cinder-volume[83259]: DEBUG oslo_concurrency.lockutils [None req-050ec8a1-6ffd-499d-95ad-d548a84437e2 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.011s {{(pid=83259) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 16 15:26:47 devstack cinder-volume[83259]: DEBUG cinder.volume.drivers.quobyte [None req-050ec8a1-6ffd-499d-95ad-d548a84437e2 None None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-61f585ac-f8e2-4d19-a890-7ebc2726cc72': None} {{(pid=83259) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:639}} Sep 16 15:26:47 devstack cinder-volume[83259]: DEBUG cinder.volume.drivers.quobyte [None req-050ec8a1-6ffd-499d-95ad-d548a84437e2 None None] Available shares ['10.10.41.181/cinder-vol-61f585ac-f8e2-4d19-a890-7ebc2726cc72'] {{(pid=83259) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:669}} Sep 16 15:26:47 devstack cinder-volume[83259]: DEBUG oslo_concurrency.lockutils [None req-050ec8a1-6ffd-499d-95ad-d548a84437e2 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.027s {{(pid=83259) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 16 15:26:47 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [None req-050ec8a1-6ffd-499d-95ad-d548a84437e2 None None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 15:26:47 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [None req-050ec8a1-6ffd-499d-95ad-d548a84437e2 None None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c" returned: 0 in 0.159s {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 15:26:47 devstack cinder-volume[83259]: DEBUG cinder.manager [None req-050ec8a1-6ffd-499d-95ad-d548a84437e2 None None] Notifying Schedulers of capabilities ... {{(pid=83259) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 16 15:26:47 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [None req-79ae8f1c-a557-4678-96d6-38b19299d4d0 tempest-CinderUnicodeTest-2029788039 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c/volume-009118ef-280e-4d19-89ef-d447df9a7b30" returned: 0 in 0.653s {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 15:26:47 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [None req-79ae8f1c-a557-4678-96d6-38b19299d4d0 tempest-CinderUnicodeTest-2029788039 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c/volume-009118ef-280e-4d19-89ef-d447df9a7b30 {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 15:26:47 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [None req-79ae8f1c-a557-4678-96d6-38b19299d4d0 tempest-CinderUnicodeTest-2029788039 None] CMD "rm -f /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c/volume-009118ef-280e-4d19-89ef-d447df9a7b30" returned: 0 in 0.096s {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 15:26:48 devstack cinder-volume[83259]: DEBUG cinder.coordination [None req-79ae8f1c-a557-4678-96d6-38b19299d4d0 tempest-CinderUnicodeTest-2029788039 None] Lock "cinder-quobyte-009118ef-280e-4d19-89ef-d447df9a7b30" released by "delete_volume" :: held 0.924s {{(pid=83259) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 16 15:26:48 devstack cinder-volume[83259]: DEBUG cinder.quota [None req-79ae8f1c-a557-4678-96d6-38b19299d4d0 tempest-CinderUnicodeTest-2029788039 None] Created reservations ['f77e4b28-7934-422c-9129-c040e0846b46', 'ab295fec-a1bd-43dd-8834-6ef6430a0257', '718f73d8-3bb8-4fde-8fab-c9792653ca0d', 'd4793601-e477-4c3a-a737-dc752e58fa24'] {{(pid=83259) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 16 15:26:48 devstack cinder-volume[83259]: DEBUG oslo_concurrency.lockutils [None req-79ae8f1c-a557-4678-96d6-38b19299d4d0 tempest-CinderUnicodeTest-2029788039 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83259) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 16 15:26:48 devstack cinder-volume[83259]: DEBUG oslo_concurrency.lockutils [None req-79ae8f1c-a557-4678-96d6-38b19299d4d0 tempest-CinderUnicodeTest-2029788039 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=83259) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 16 15:26:48 devstack cinder-volume[83259]: DEBUG cinder.volume.drivers.quobyte [None req-79ae8f1c-a557-4678-96d6-38b19299d4d0 tempest-CinderUnicodeTest-2029788039 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-61f585ac-f8e2-4d19-a890-7ebc2726cc72': None} {{(pid=83259) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:639}} Sep 16 15:26:48 devstack cinder-volume[83259]: DEBUG cinder.volume.drivers.quobyte [None req-79ae8f1c-a557-4678-96d6-38b19299d4d0 tempest-CinderUnicodeTest-2029788039 None] Available shares ['10.10.41.181/cinder-vol-61f585ac-f8e2-4d19-a890-7ebc2726cc72'] {{(pid=83259) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:669}} Sep 16 15:26:48 devstack cinder-volume[83259]: DEBUG oslo_concurrency.lockutils [None req-79ae8f1c-a557-4678-96d6-38b19299d4d0 tempest-CinderUnicodeTest-2029788039 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=83259) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 16 15:26:48 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [None req-79ae8f1c-a557-4678-96d6-38b19299d4d0 tempest-CinderUnicodeTest-2029788039 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 15:26:48 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [None req-79ae8f1c-a557-4678-96d6-38b19299d4d0 tempest-CinderUnicodeTest-2029788039 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/f4578906894827eec99eb502b7b8f11c" returned: 0 in 0.110s {{(pid=83259) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 15:26:48 devstack cinder-volume[83259]: DEBUG cinder.manager [None req-79ae8f1c-a557-4678-96d6-38b19299d4d0 tempest-CinderUnicodeTest-2029788039 None] Notifying Schedulers of capabilities ... {{(pid=83259) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 16 15:26:48 devstack cinder-volume[83259]: INFO cinder.volume.manager [None req-79ae8f1c-a557-4678-96d6-38b19299d4d0 tempest-CinderUnicodeTest-2029788039 None] Deleted volume successfully. Sep 16 15:26:48 devstack cinder-volume[83259]: DEBUG cinder.coordination [None req-79ae8f1c-a557-4678-96d6-38b19299d4d0 tempest-CinderUnicodeTest-2029788039 None] Lock "cinder-009118ef-280e-4d19-89ef-d447df9a7b30-delete_volume" released by "delete_volume" :: held 2.028s {{(pid=83259) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 16 15:26:58 devstack cinder-volume[83259]: DEBUG dbcounter [-] [83259] Writing DB stats cinder:UPDATE=123,cinder:DELETE=10,cinder:SELECT=73,cinder:INSERT=26 {{(pid=83259) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Sep 16 15:26:58 devstack cinder-volume[83259]: DEBUG dbcounter [-] [83259] Writing DB stats cinder:UPDATE=120,cinder:DELETE=11,cinder:SELECT=83,cinder:INSERT=39 {{(pid=83259) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}